Mixture of Experts

TL;DR: Kimi K3 in 30 Seconds Kimi K3 is the new AI model Chinese company Moonshot AI announced on July 16, 2026; at 2.8 trillion parameters, it is the largest open source model released so far. In a single 48-hour run it designed a working chip, finished an astrophysics study in 2 hours instead of 2 weeks, and cut a teaser video from 56 raw clips. It reads 1 million tokens at once: roughly like reading the entire Lord of the Rings trilogy in one sitting and remembering all of it. On coding it plays in the same league as the strongest Claude and ChatGPT models, and beats them on some tests. It falls behind on hard knowledge questions. You can try it in the Kimi app and on kimi.com. The model files go public on July 27, 2026. Ask an AI to design a chip for you and what happens? It probably writes you a nice article about how chips are designed. ...

A powerful move has arrived on the price and efficiency front of the AI race! On July 8, 2026, xAI, Elon Musk’s AI company now operating under the SpaceX umbrella, announced Grok 4.5, its first major model release since going public. The model is also the fruit of a collaboration with the Cursor team, and its pitch is clear: not the highest benchmark score, but the most efficient way to get work done. ...

Hello everyone! 😁 Today we’re diving into a very exciting topic. Google DeepMind just dropped a massive bomb in the open source AI world: Gemma 4 models are officially released! 🚀 You know how people keep saying “open source models are nice but they can’t even compete with closed source ones”… With Gemma 4, you might want to rethink that claim. This model family delivers the most impressive intelligence-per-parameter we’ve ever seen. ...

I’m back with a groundbreaking development that is shaking up the tech world! Yes, as you guessed from the title, we are talking about Kimi K2.5. Developed by the Chinese company Moonshot AI, this model is currently taking the world by storm with its 1.04 Trillion parameters and technical specifications. 🚀 In this post, we will take a close look at the technical details, features, and popularity of Kimi K2.5, which is challenging giants like GPT-4.1 and Claude. 👇🏻 ...

Meta Launch Llama 4 (Meta AI Blog) Important Note: Meta has announced a new chapter in the history of artificial intelligence today. The Llama 4 series is surpassing its competitors with its multimodal AI capabilities and revolutionary mixture-of-experts architecture. In initial tests, it manages to outperform leading models like GPT-4o and Gemini 2.0! Llama 4: A Revolution in Multimodal AI 🚀 Meta has officially announced Llama 4 models, which will open a new chapter in the world of artificial intelligence. Llama 4 is a natively multimodal large language model family: it processes text and images in a single model and stands out especially with its mixture-of-experts (MoE) architecture. Continuing Meta’s open-weight model approach, Llama 4 represents an important step in the AI ecosystem with both its performance and accessibility. ...