AI News
DeepSeek Open-Sources DeepInfer, Its Production Inference Engine — Blackwell and Ascend 950 Only, No KV Cache Layer
On October 20, 2026, DeepSeek published DeepInfer, the inference framework behind its own services, on GitHub under Apache 2.0. It supports one model, DeepSeek-V4.1-Flash, on two hardware targets: NVIDIA SM100 (Blackwell) GPUs and Huawei Ascend 950 NPUs. DeepSeek also disclosed operating figures, including 155 trillion tokens per day on a single cluster and $38 of revenue per GPU-hour, all self-reported. The release leaves out the KV cache system, prefill/decode disaggregation, and replica load balancing. This is an analysis of public materials covering what the release changes for self-hosters, API users, and U.S. organizations.
Oct 21, 2026·6min