About 19 tokens per second, much faster than reading. The first word arrives after 3.4 seconds.
19tokens per second
Much faster than reading
First word in 3.4 s · a 300-word answer in about 25 s
What 19 tokens per second looks like
Sure. Start with the task you have been putting off, while your focus is fresh. Give it one uninterrupted hour, then take a short walk. Answer messages in one batch after lunch, and keep the last half hour to plan tomorrow, so the morning starts without decisions.Sure. Start with the task you have been putting off, while your focus is fresh. Give it one uninterrupted hour, then take a short walk. Answer messages in one batch after lunch, and keep the last half hour to plan tomorrow, so the morning starts without decisions.
Typical range 13–21 tokens per second · 93 iPhones
Slows to 9.7 tokens per second when the iPhone is hot.
The same for the iPhone 14, iPhone 13 Pro, iPhone 13 Pro Max, iPhone 14 Plus and iPhone SE (3rd gen), with the same A15 Bionic chip.
Every number comes from real chats in Loci, timed on the device that wrote the answer, with Loci's default settings.
Tokens per second is how fast an answer is written once it starts. Four characters of text count as one token, for every model and device. Reading pace is about 5.
First word is how long an answer takes to start after you send a message. Longer conversations take longer.
Each device counts once. The large number is the median; the typical range covers the middle half of devices.
Answers written in Low Power Mode or Battery Saver, in the background, or with web search or other tools are left out.