Infrastructure

DeepSeek open-sources DeepInfer, the inference framework behind V4.1-Flash: Deepseek is open-sourcing DeepInfer, the inference framework behind its V4.1-Flash model. The vLLM-based system cuts compute costs and energy use when running AI models. The release adds pricing pressure on Western providers including OpenAI and Anthropic.

AI Infrastructure • The Decoder

Mistral launches Voxtral 3, a voice-agent stack supporting 50+ languages: Mistral AI launched Voxtral 3, a voice-agent model family combining speech-to-text, text-to-speech and an SDK. It supports over 50 languages and lets agents use external tools during live conversations. It can run on own infrastructure or EU-hosted APIs.

Voice AI • The Decoder

Google releases developer tool to run PyTorch apps off Nvidia GPUs: Google released a developer tool that lets PyTorch users move their apps off Nvidia GPUs. It joins Amazon in targeting Nvidia's stronghold with AI app developers.

AI Infrastructure • TechCrunch AI

Meta details Prometheus supercluster with about 1M GPUs at full scale, used to train Muse models: Meta detailed Prometheus, a gigawatt-scale supercluster in Ohio that will have about one million GPUs at full scale. It was used to train the company's Muse foundational models.

AI Infrastructure • Techmeme

Ant Group open-sources Ling-3.1-flash, a 560B-parameter AI model: Ant Group released the weights of Ling-3.1-flash, allowing developers to deploy the AI model on their own infrastructure. The model has about 560 billion total parameters, activates about 25 billion per token, and supports a context window of up to one million tokens.

AI Models • TechNode