How fast is Gemma 4 12B on the M5 Max Mac with 128 GB?

About 38 tokens per second, much faster than reading. The first word arrives after 6.4 seconds.

38tokens per second

Much faster than reading

First word in 6.4 s · a 300-word answer in about 17 s

What 38 tokens per second looks like

Measured on 2 Macs

M5 Max · 128 GB

Gemma 4 12B on other Macs

  1. M5 Max Mac with 128 GBFirst word 6.4 s · 2 Macs38tok/s
  2. M5 Pro Mac with 24 GBFirst word 7.6 s · 6 Macs31tok/s
  3. M5 Pro Mac with 48 GBFirst word 13.2 s · 2 Macs26tok/s
  4. M4 Pro Mac with 24 GBFirst word 46.6 s · 2 Macs25tok/s
  5. M2 Pro Mac with 32 GBFirst word 3.4 s · 2 Macs18tok/s
  6. M5 Mac with 24 GBFirst word 10.2 s · 2 Macs15tok/s

Other models on the M5 Max Mac with 128 GB

  1. Ternary Bonsai 2 27B2 Macs40tok/s
  2. Qwen3.8 27B Max QualityFirst word 10.5 s · 3 Macs11tok/s

Run Gemma 4 12B on your Mac

Loci is free, needs no account, and keeps every conversation on your device.

Download for Mac

How these speeds are measured

  • Every number comes from real chats in Loci, timed on the device that wrote the answer, with Loci's default settings.
  • Tokens per second is how fast an answer is written once it starts. On phones, four characters of text count as one token for every model; on a Mac, Loci counts the model's own tokens. Reading pace is about 5.
  • First word is how long an answer takes to start after you send a message. Longer conversations take longer.
  • Each device counts once. The large number is the median; the typical range covers the middle half of devices.
  • Results use the last 30 days when enough devices have been measured. Otherwise, labeled 90-day samples include older measurements under the same sample and app-version requirements.
  • Each phone speed comes from at least 10 phones of that model. Different phone models and Android chip variants are measured separately. Open a result to see its sample size.
  • On phones, answers written in Low Power Mode or Battery Saver, in the background, or with web search or other tools are left out.

Methods, fixed editions and citations · Check model requirements for your device