π§ Moonshot AI open-sources Kimi K3: 2.8 trillion parameters, free to download
Moonshot AI just dropped the weights for Kimi K3, a 2.8-trillion-parameter model with a 1 million token context window -- the largest open-weight AI model ever released. It only requires about 50B active params per token thanks to sparse expert routing, so it runs leaner than the headline number sounds. The catch: you need about 1.4 TB of disk space. Is open-sourcing frontier-scale models good for the industry?
