1m Context Window

Moonshot unveils Kimi K3.1 Pro, 3T-class open-weight model with 1M-token context: Moonshot unveiled Kimi K3.1 Pro, a 3T-class open-weight model with a 1M-token context window, and K3.1 Pro Highspeed. The company says full weights will be released by Nov. 4.

AI Models • Techmeme

StepFun releases open weights for Step 5 Preview, a 600B model with 27B active parameters: StepFun released open weights for its Step 5 Preview model, with 600B total and 27B active parameters and a 1M context window. It published a technical blog describing the model's 92-layer design, sparse grouped-query attention, and long-horizon agent training.

StepFun • Pandaily