Sulat.com / Writing on AIFriday, November 20, 2026
Artificial Intelligence/19 November 2026

Cerebras says it serves Kimi K3.1 Pro, 2.8 trillion parameters, at up to 2,000 tokens per second

Cerebras CTO Sean Lie says the company now serves Moonshot AI's 2.8-trillion-parameter Kimi K3.1 Pro at up to 2,000 tokens per second. Access is through Cerebras's enterprise Dedicated catalog.

A large glossy orange 3D Cerebras logo stands in a dark data-centre aisle between server racks with streaks of light racing past.

At a glance

  • Cerebras CTO Sean Lie says Cerebras serves Moonshot AI's 2.8-trillion-parameter Kimi K3.1 Pro at up to 2,000 tokens per second, against 450 for the first model it served, Llama 70B, just over two years ago.
  • Cerebras's 12 November results call it a day-zero launch partner for Kimi K3.1 and say the model runs at up to 2,000 tokens per second, the fastest in the industry. Both figures are Cerebras's own.
  • Cerebras's October blog says a Kimi K3-sized model needs 59 wafers of 44 GB each, with the weights fixed on the chips and only activations moving between them, at roughly 2 microseconds a hop.
  • Kimi K3.1 Pro joined Cerebras's enterprise Dedicated catalog on 9 November; the shared pay-per-token catalog lists two models that are far smaller.

Cerebras says it now serves Moonshot AI’s Kimi K3.1 Pro, a 2.8-trillion-parameter model, at up to 2,000 tokens per second. Cerebras chief technology officer Sean Lie posted the figure on X. A token is the small chunk of text a model reads or writes, and a parameter is one of the learned numbers that make up the model.

Lie set the number against where Cerebras started. “The first model we ever served at @cerebras was Llama 70B at 450 tokens/sec,” he wrote, and that was just over two years ago. He says Kimi K3.1 Pro has 40x the parameters and that “our inference speeds are only going up”.

Before and after cards: Llama 70B at 450 tokens per second, now Kimi K3.1 Pro at up to 2,000, 40x the parameters, per Cerebras CTO.
Lie’s figures: 450 tokens per second then, up to 2,000 now, on a model 40 times larger.

What Cerebras has said about it

Cerebras made the same claim in its third-quarter results on 12 November. The release calls Cerebras a “day-zero launch partner” for Kimi K3.1 and says Kimi K3.1 on Cerebras “is the fastest in the industry, running up to 2,000 tokens per second”. Both figures are Cerebras’s own. For the earlier Kimi K2.6, Cerebras’s May blog post cites a measurement from Artificial Analysis, an independent benchmarking firm, of 981 output tokens per second.

Moonshot put Kimi K3.1 Pro on its own API on 23 October and said the weights would follow by 4 November. It’s post-trained from Kimi K3. Featherless’s write-up describes a mixture-of-experts model, which sends each token through only a few of its parts: 104 billion of the 2.8 trillion parameters are active per token, and the context window is 1,048,576 tokens. Moonshot lists it at US$2 per million input tokens and US$10 per million output tokens, and a Highspeed version at twice that price.

On speed, DeepInfra’s summary of Artificial Analysis data has Moonshot’s own API at 31 tokens per second and Highspeed at 69.4. DigitalOcean leads at list price with 200.8, ahead of Baseten at 183.0.

How a model this size fits

A Cerebras chip is a whole silicon wafer with 44 GB of on-chip memory, so a trillion-parameter model has to be spread across many of them. Cerebras’s 22 October post works through the earlier Kimi K3, about 3 trillion parameters stored at 4-bit precision. Cerebras puts that at roughly 16 GB for each of 93 layers. A wafer holds two of the 69 linear-attention layers or one of the 24 dense layers, for 59 wafers in total. Featherless’s summary of K3.1 Pro says the size and layer count carry over from K3.

The weights stay on the wafers. Only the activations, the intermediate results of each layer, pass from one wafer to the next, at roughly 2 microseconds a hop, the post says. Cerebras says that layout runs multi-trillion-parameter models at “1000-2000+ tokens per second”.

Wafers chained in a line, each holding two layers; 44 GB per wafer, 16 GB per layer, 59 wafers for Kimi K3 in Cerebras’s example.
Cerebras’s own example puts Kimi K3 on 59 wafers, with only activations moving between them.

Who can use it

Cerebras’s change log shows Kimi K3.1 Pro joined its Dedicated model catalog on 9 November, with reasoning levels of low, medium, high and max, and max the default, plus image input. Dedicated Inference reserves capacity for one organisation and, per Cerebras’s docs, is available to enterprise customers, who contact Cerebras to set it up.

The shared catalog, where developers pay per token, lists two models, a 120-billion-parameter model and Qwen 3.8 27B. Both are a small fraction of K3.1 Pro’s size.

Two cards: Cerebras’s shared catalog lists two smaller models; Kimi K3.1 Pro is in the dedicated catalog for enterprise customers.
Kimi K3.1 Pro sits in Cerebras’s enterprise Dedicated catalog, not the shared one.

Cerebras says its CS-4 system will soon be in full production and that its next system, the CS-5, is targeted for early summer 2027 in the northern hemisphere, designed for up to 10,000 tokens per second per user. Both claims are in the same 12 November release.


Discover more from Sulat AI & Tech News

Subscribe to get the latest posts sent to your email.