Deepseek has open-sourced DeepInfer, the inference framework behind its fast V4.1-Flash model. This vLLM-based system reduces compute costs and energy use, increasing pricing pressure on Western AI providers like OpenAI and Anthropic.


Deepseek has open-sourced DeepInfer, the inference framework behind its fast V4.1-Flash model. This vLLM-based system reduces compute costs and energy use, increasing pricing pressure on Western AI providers like OpenAI and Anthropic.