WayToClawEarn
Medium impactHN 热帖

Running local models on Apple Silicon is 3 times more expensive than OpenRouter calls

An in-depth analysis found that running a local large language model (such as Gemma 4 31B) on an M5 MacBook Pro costs up to $1.5-$4.8 per million tokens after amortizing the hardware cost, while using the same quality model through OpenRouter only costs 1/3 of the price. Although the electricity cost of local inference is low (about $0.02/ hours), the real hidden cost is hardware accelerated depreciation.

WayToClawEarn EditorialPublished May 17, 2026Updated Aug 8, 2026

Editorial review of public sources · AI-assisted drafting. How we work · Original source

Core conclusion

On May 17, 2026, developer Will Angel published a hotly discussed article "Apple Silicon costs more than OpenRouter", which proved through detailed data comparison: the actual amortized cost of running a local large language model on the M5 MacBook Pro is actually 2-3 times more expensive than calling the cloud model through OpenRouter.

Key Points

  • Event Time: 2026-05-17
  • Core findings: Apple Silicon local inference costs about $1.5-$4.8 per million tokens, and OpenRouter’s similar model only costs $0.5-$1.5
  • Affected objects: All individual developers, independent entrepreneurs, and content automation teams who run AI models locally
  • The biggest revelation: Hardware accelerated depreciation is an invisible killer, but electricity costs are the lowest

Background: A big discussion about the cost of "local vs. cloud

The data released by Will Angel on his personal blog attracted widespread attention from the Hacker News community (48+ points that day). He is using the latest M5 Max MacBook Pro (64GB memory, official website price $4,299), running the Gemma 4 31B model - a model with performance close to the Anthropic Claude Sonnet level.

He made detailed calculations from three dimensions: power cost, hardware depreciation, and inference speed:

Electricity Cost: 50-100W power consumption, calculated as $0.18/kWh, only $0.009-$0.018 (about 1 cent) per hour Hardware depreciation: $4,299 equipment is amortized based on 3-10 years of life, $0.05-$0.16/ hours Inference speed: Gemma 4 31B is about 10-40 tokens/s on M5 Max

vs

Key impact analysis

DimensionsLocal inference (Apple Silicon)Cloud inference (OpenRouter)Inspiration for us
Cost per million tokens$1.5-$4.8$0.5-$1.5Cloud is 2-3 times cheaper
Inference speed10-40 tokens/s20-80 tokens/s2 times faster in the cloud
Initial investment$4,299 (hardware + 0 software)$0 (pay as you go)Zero threshold for cloud
Privacy ControlCompletely localData passes through a third partyLocal wins (specific scenarios)
RuntimeBattery/Thermal LimitationsUnlimited 24/7Cloud suitable for continuous tasks
ScalabilityLimited by stand-alone hardwareElastic scalingThe cloud is suitable for batch processing

Adaptation suggestions: When should I use which one?

This is not a "black and white" issue. Choose according to your actual scenario:

Select local inference (Apple Silicon) scenario

  • Privacy Sensitive: Processing of customer data, business secrets, and personal privacy content
  • Latency sensitive: requires millisecond response (local inference is slow but network latency is lower)
  • Offline/Mobile Scenario: No stable network connection
  • Development and Debugging: Frequent parameter adjustment and experimental testing (pay-as-you-go payment will accumulate)

Select cloud inference (OpenRouter, etc.) scenario

  • Mass Production: Large-scale content generation, data processing
  • High throughput requirements: A large number of requests need to be processed simultaneously
  • Zero upfront investment: Idea verification stage, don’t want to bet on $4,000+ hardware
  • Multi-model comparison: OpenRouter supports dozens of models to switch on demand

Mixed strategy (recommended)

  • Local model for daily development/debugging
  • Use OpenRouter for production-level batch tasks
  • When using n8n + AI Agent to build automated workflows, set up intelligent routing: simple tasks go locally, and complex tasks go to the cloud.

Related

Further reading

This topic has sparked a lot of discussion, and I recommend the following content to get more perspective:

Tool entry

The tools and services covered in this article include: OpenRouter, Apple Silicon, Claude, n8n, DeepSeek, Gemini. The above platforms have detailed guides on WayToClawEarn.

Internal link guidance

View source →

Disclaimer: this site shares educational insights only, for inspiration and reference. No outcome guarantee; external execution and decisions are your own responsibility.