Skip to content
AI IntelligenceSep 20, 2026AI Intelligence
Article

StepFun launches Step 5 Preview MoE model with weights open on October

StepFun has launched its Step 5 Preview model, featuring a 600-billion parameter sparse Mixture of Experts architecture with 27 billion active parameters. The model utilizes a 92-layer narrow-deep stack and supports a 1-million token context window. StepFun plans to open-source the weights on October 15.

Frontier EditorialSource: Pandaily
01

Source Brief

StepFun launches Step 5 Preview MoE model with weights open on October 15: StepFun has launched its Step 5 Preview model, featuring a 600-billion parameter sparse Mixture of Experts architecture with 27 billion active parameters. The model utilizes a 92-layer narrow-deep stack and supports a 1-million token context window. StepFun plans to open-source the weights on October 15.