AI Inference

Explore AI Inference through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: Machine Learning

Articles that also belong to these categories. Counts cover all of AI Inference.

Showing 1-15 of 15 articles

Jev (AI model)

Jev is an AI model released in waitlisted early access on 15 September 2026, and opened to all developers on 20 September, by TypeSafe AI, a San Francisco startup founded in 2024 by former OpenAI researcher…

AI ModelsMachine Learning

MXFP4

MXFP4 (Microscaling FP4) is a 4-bit block-scaled number format for quantization in machine learning, defined in the Open Compute Project (OCP) Microscaling Formats (MX) Specification v1.0 of September 2023.

AI HardwareMachine Learning

On-device AI

On-device AI is the practice of running machine learning models on the phone, laptop, watch, or embedded board a person is actually using, instead of sending the input to a remote data center.

AI HardwareMachine Learning

Prompt Caching

Prompt caching is a large language model (LLM) inference optimization that stores the computed key-value (KV) state of a repeated prompt prefix so it can be reused across API calls, cutting both cost and…

Developer ToolsLarge Language Models

Pruning

Pruning is a family of techniques used in machine learning and artificial intelligence to remove parts of a model or search space that are estimated to be unnecessary for accuracy or optimality.

Machine LearningTraining & Optimization

Zhijian Liu

Zhijian Liu is a computer scientist who works on efficient machine learning. He is an assistant professor at the University of California, San Diego, where he directs Z Lab, and a co-founder of Inco AI

Machine LearningPeople