DeepInfer
DeepInfer is an open-source inference framework developed by DeepSeek for running its models across accelerator clusters. DeepSeek announced its public release on October 20, 2026.
Explore Chinese AI through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Chinese AI.
Showing 1-6 of 6 articles
DeepInfer is an open-source inference framework developed by DeepSeek for running its models across accelerator clusters. DeepSeek announced its public release on October 20, 2026.
DeepSelect is an open-source library of top-k selection kernels published by the Chinese AI company DeepSeek.
Group Relative Policy Optimization (GRPO) is a reinforcement learning algorithm for fine-tuning large language models that eliminates the separate critic (value) network used by PPO
The model-as-a-service (MaaS) market in China is the commercial market for access to large language models and other generative models through public-cloud APIs, where enterprises and developers pay per token…
NOSA (Native and Offloadable Sparse Attention) is a trainable sparse attention mechanism designed so that most of a language model's KV cache can live in CPU memory during decoding without the CPU-to-GPU…
Xiaomi XRING O100 is a dedicated AI accelerator designed by Xiaomi for local large-model inference on consumer devices.