Hacker News

Favorites Setup
Comment by bb123 | original | Benchmarking Pocket-Scale Inference
[−]bb123 · 2026-08-30 Sun 12:06 UTC · link
I'm not sure about that. I can run Qwen 3.8 27B at acceptable speed on an M1 MacBook Pro from 5 years ago. Thats Opus 4.6 Quality, on 5 year old consumer hardware. I think the trend is the opposite - smaller models that can run on hardware people already have are getting better and better.
[−]sidpatil · 2026-08-30 Sun 16:09 UTC · link
How much RAM does your system have?