Mixture of Experts

Summary: DeepSeek V4 Pro in 30 Seconds DeepSeek V4 Pro 0813 went generally available on August 13, 2026. No press release, no blog post, just one line in a changelog. 1.7 trillion parameters, mixture-of-experts architecture, 1M token context, 384K token output ceiling. The weights are on Hugging Face under the MIT license. You can download them, modify them and ship them in a commercial product. Official scores are bold: 87.9 on Terminal Bench 2.1, 62.7 on DeepSWE. Independent testing is more restrained: 53 on the Artificial Analysis Intelligence Index. Pricing is $0.435 in and $0.87 out per million tokens. From August 16 the off-peak rate is half of that. The catch: its smaller sibling V4 Flash scores 52 on the same index at one third of the price. You are paying triple for one point. Model launches have settled into a ritual: a teaser video, a wall of benchmark charts, an excited founder post. DeepSeek skipped all of it. DeepSeek V4 Pro 0813 went generally available on August 13, 2026 with no announcement at all. One line landed in the API changelog and the weights appeared on Hugging Face. ...

Summary: Qwen3.8-Max in 30 Seconds Qwen3.8-Max is Alibaba’s new flagship model, made generally available on August 2, 2026. 2.4 trillion parameters, 95 billion active (MoE architecture). It reads text, images and video, and returns text. Context window is in the 1 million token class. On one task it ran 125 hours (about 5 days) with no human input, rebuilding an experiment from a machine learning paper from scratch, confirming its six findings, then inventing a method that beats the paper. It beats Claude Opus 4.8 on most coding and agent tests, trades blows with Claude Fable 5 and GPT-5.6 Sol, and falls behind on some. API pricing is $2 input / $6 output per million tokens. Repeated input costs $0.25. This is the first time Alibaba has open-weighted a Max-class model. The weights landed on Hugging Face on August 12, 2026, though under Alibaba’s own Qwen3.8-Max license rather than Apache 2.0. Two days later, on August 14, Qwen3.8-27B followed: a dense 27B model under Apache 2.0 that fits on a single GPU. Ask an AI to “rebuild the experiment in this paper, then improve on it” and it normally stalls after a few turns, waiting for you to step in and steer. ...

TL;DR: Kimi K3 in 30 Seconds Kimi K3 is the new AI model Chinese company Moonshot AI announced on July 16, 2026; at 2.8 trillion parameters, it is the largest open source model released so far. In a single 48-hour run it designed a working chip, finished an astrophysics study in 2 hours instead of 2 weeks, and cut a teaser video from 56 raw clips. It reads 1 million tokens at once: roughly like reading the entire Lord of the Rings trilogy in one sitting and remembering all of it. On coding it plays in the same league as the strongest Claude and ChatGPT models, and beats them on some tests. It falls behind on hard knowledge questions. You can try it in the Kimi app and on kimi.com. The model files go public on July 27, 2026. Ask an AI to design a chip for you and what happens? It probably writes you a nice article about how chips are designed. ...

A powerful move has arrived on the price and efficiency front of the AI race! On July 8, 2026, xAI, Elon Musk’s AI company now operating under the SpaceX umbrella, announced Grok 4.5, its first major model release since going public. The model is also the fruit of a collaboration with the Cursor team, and its pitch is clear: not the highest benchmark score, but the most efficient way to get work done. ...

Hello everyone! 😁 Today we’re diving into a very exciting topic. Google DeepMind just dropped a massive bomb in the open source AI world: Gemma 4 models are officially released! 🚀 You know how people keep saying “open source models are nice but they can’t even compete with closed source ones”… With Gemma 4, you might want to rethink that claim. This model family delivers the most impressive intelligence-per-parameter we’ve ever seen. ...