Skip to content
followmy.ai
Blog

I Stayed Up for the Kimi K3 Drop So You Didn't Have To

Moonshot AI dropped Kimi K3, a 2.8T-parameter open-weight model you can't run at home, and here's why it still changes what's coming next.

By Tom Nguyen 5 min read

The short version

Moonshot AI released the full open weights of Kimi K3 at 00:00 UTC on July 27, a 2.8-trillion-parameter mixture-of-experts model with a 1M-token context window. At roughly 1.4TB in MXFP4, Kimi K3 is the largest open-weight model ever published, and you will need 64 or more accelerators to run it at home, which means almost nobody will. Open weights you can’t run on your own hardware still matter, because they set a public ceiling that every closed lab now has to answer to.

What actually dropped on July 27?

Moonshot AI, the Beijing lab behind the Kimi chatbot, published the complete open weights of Kimi K3 at midnight UTC on July 27, which landed in the evening of July 26 for anyone on US time. Kimi K3 is a 2.8-trillion-parameter mixture-of-experts model with a one-million-token context window, and in its MXFP4 quantized form the download weighs in around 1.4 terabytes. That size makes Kimi K3 the largest open-weight release in the history of the field, edging past every prior open MoE by a wide margin.

I sat up for it. The r/LocalLLaMA community had been running a countdown for days, the kind of shared anticipation you usually only see for a game launch, and I wanted to watch the files actually appear rather than read about them the next morning. When the weights went live, the mood in the thread flipped from hype to arithmetic almost instantly, because the second question after “is it out” is always “can I run it,” and for Kimi K3 the honest answer for most people is no.

Can you actually run Kimi K3 yourself?

No, not on anything resembling a normal setup. Self-hosting Kimi K3 realistically takes 64 or more accelerators, which puts it out of reach of hobbyists, most startups, and frankly a lot of well-funded labs. A 1.4TB model in MXFP4 does not fit on a single machine, a single 8-GPU box, or even a small cluster you’d assemble in a garage. This is data-center hardware, and running it means either owning a rack of high-end accelerators or renting time from an inference provider who already did.

That gap between “open” and “runnable” is the whole story here, and it’s worth being clear-eyed about it. When people say Kimi K3 is open, they mean the weights are public and licensed for use, not that you personally can spin it up tonight. The practical path for almost everyone is a hosted endpoint from an inference provider, where you pay per token and someone else eats the hardware cost. That’s not a knock on the release. It’s just what “open” means at 2.8 trillion parameters.

Why does an open model you can’t run still matter?

Because it resets the public ceiling, and everyone builds off that ceiling whether they run the model or not. When a closed lab like OpenAI or Anthropic ships a model, the community can only measure it from the outside through benchmarks and vibes. When Moonshot AI ships Kimi K3 with open weights, researchers can inspect the architecture, fine-tune on top of it, distill smaller models from it, and probe exactly how a 2.8T MoE with 1M context behaves. That knowledge doesn’t stay locked behind one company’s API.

Here’s the specific implication I keep coming back to: the smaller, runnable models you and I will actually use next year get better because Kimi K3 exists. Distillation and architecture lessons flow downhill. A frontier open model is a public reference implementation, and every 30B model that gets trained after this can borrow ideas that were previously trade secrets. I can’t run Kimi K3, but I will almost certainly use something that learned from it.

There’s also a geopolitics beat worth naming plainly. A Chinese lab just published the largest open-weight model in history, for free, while the leading US labs keep their frontier weights closed. That’s a strategic choice, and it reshapes who gets credited as the open-source leader in AI. Whatever you think of the motives, the effect is that the open ecosystem’s high-water mark now flies a Chinese flag, and that changes the conversation in a way benchmarks alone don’t capture.

How good is Kimi K3 really?

The early framing, including the write-up I read from GMICloud arguing Kimi K3 is here to topple GPT and Claude, leans hard into the horse-race angle, and I’d take the toppling talk with a grain of salt for now. A 2.8T MoE with a 1M context window is genuinely enormous, and on paper it should compete at the frontier. But “largest” is not the same as “best,” and MoE models activate only a fraction of their parameters per token, so the raw 2.8T number oversells how much compute actually fires on any given request.

The honest assessment on day one is that Kimi K3 looks like a serious frontier-class model, and the real verdict comes from independent evals over the next few weeks, not from launch-day threads. The million-token context is the feature I’m most curious about in practice, because long-context claims tend to degrade in the messy middle where retrieval actually matters. I want to see how Kimi K3 holds up on a full codebase or a stack of legal documents before I call it a GPT killer.

What should you do about it?

For most people, the move is simple: don’t try to self-host, and wait for a hosted endpoint on a reputable inference provider before you build anything on Kimi K3. If you’re a researcher or a lab with real hardware, the weights are the interesting part, and the fine-tuning and distillation experiments start now. If you’re a builder shipping products, treat Kimi K3 as one more option in a growing menu of strong models, and let the pricing and latency of the hosted versions decide whether it earns a slot in your stack.

And if you just want to keep a pulse on where open AI is heading, Kimi K3 is the marker to remember for July 2025. It’s the moment the largest open-weight model came from a Chinese lab, at a size no individual can run, in a release that still ripples down to the tools regular people use. That combination is the actual news, more than any single benchmark score.

FAQ

When did Kimi K3 release? Moonshot AI published the full open weights of Kimi K3 at 00:00 UTC on July 27, 2025, which was the evening of July 26 in US time zones.

How big is Kimi K3? Kimi K3 is a 2.8-trillion-parameter mixture-of-experts model with a 1M-token context window, and its MXFP4 quantized weights total roughly 1.4TB, making it the largest open-weight model ever released.

Can I run Kimi K3 on my own computer? No. Self-hosting Kimi K3 realistically requires 64 or more accelerators, so nearly everyone will access it through a hosted inference provider rather than local hardware.

Is Kimi K3 better than GPT or Claude? Too early to say. Kimi K3 is frontier-class on paper, but independent evaluations over the coming weeks, especially on long-context tasks, will decide how it actually compares.

Why does an open model most people can’t run matter? Because open weights let researchers inspect, fine-tune, and distill Kimi K3, and those lessons flow down into the smaller, runnable models that regular users will actually rely on.

Found this useful? Read more from the blog →