Stepfun

Technology

• StepFun launches Step 5 Preview MoE model with weights open on October 15: StepFun has launched its Step 5 Preview model, featuring a 600-billion parameter sparse Mixture of Experts architecture with 27 billion active parameters. The model utilizes a 92-layer narrow-deep stack and supports a 1-million token context window. StepFun plans to open-source the weights on October 15.

  AI Models • Pandaily

  Permalink