Open Weight
Topic archive • 2 matches
2026-10-15
Technology
StepFun releases open weights for Step 5 Preview, a 600B model with 27B active parameters: StepFun released open weights for its Step 5 Preview model, with 600B total and 27B active parameters and a 1M context window. It published a technical blog describing the model's 92-layer design, sparse grouped-query attention, and long-horizon agent training.
StepFun • Pandaily
PermalinkStudy finds LLM reasoning uses 3.7× more inference energy on average: A study measured inference energy for 86 open-weight LLM checkpoints across seven benchmarks and six hardware platforms. Most configurations used a median 2.6–4.8× more energy than another configuration scoring at least as well, with gaps up to 27×; reasoning raised energy about 3.7× on average.
AI Research • arXiv
Permalink