Mac mini and local Claude! 68 t/s
Oh, I'm sorry—is your $4,000 custom-built PC still struggling to hit double-digit speeds while sounding like a jet engine taking off from a tarmac? That’s cute. Meanwhile, this tiny silver coaster on my desk is churning out 68 tokens per second while staying so quiet I sometimes forget it's turned on. While you’re busy debugging your CUDA drivers for the fifth time this week and praying your cloud provider doesn't deprecate your favorite model, my M4 Mini has already finished the task and is silently judging your life choices. "Pro" hardware doesn't have to come in a case the size of a mini-fridge anymore.