AI Inference

Explore AI Inference through related topics and the articles other pages reference most.

Explore articles

Browse subtopics (52)

Articles that also belong to these categories. Counts cover all of AI Inference.

Showing 121-131 of 131 articles

Unconventional AI

Unconventional AI (legally Unconventional, Inc.) is an American AI hardware startup, headquartered in Mountain View, California, that is trying to build computers for artificial intelligence that compute with…

AI CompaniesAI Compute

YaRN

YaRN (Yet another RoPE extensioN method) is a compute-efficient method for extending the context window of large language models that use Rotary Position Embeddings (RoPE).

Deep LearningModel Architecture

Zettascale Computing

Zettascale Computing (Zettascale Computing Corp., or "zscc" for short, in the company's own usage) is a San Francisco startup that designs reconfigurable AI chips it calls XPUs.

AI CompaniesAI Hardware

Zhijian Liu

Zhijian Liu is a computer scientist who works on efficient machine learning. He is an assistant professor at the University of California, San Diego, where he directs Z Lab, and a co-founder of Inco AI

Machine LearningPeople

d-Matrix

d-Matrix is a privately held American semiconductor company headquartered in Santa Clara, California that builds accelerators, I/O cards and software for AI inference in data centers.

AI CompaniesAI Compute

d-Matrix Corsair

Corsair is the first commercial AI accelerator product from d-Matrix, a Silicon Valley AI inference hardware startup based in Santa Clara, California.

AI ComputeAI Hardware

d-Matrix Raptor

Raptor is the second-generation AI inference accelerator from d-Matrix, a Santa Clara semiconductor startup, and the first commercial chip built on the company's 3D stacked digital in-memory compute technology

AI ComputeAI Hardware

d3-turbo

d3-turbo is a multimodal decision model in the Decision 3.0 family from the vLLM Semantic Router team. It produces structured decisions and probabilities rather than free-form generated text.

AI ModelsMultimodal AI

doubleAI

doubleAI (legal name AA-I Technologies Ltd., also written AAI) is an Israeli artificial intelligence company founded in August 2023 by Amnon Shashua, Shai Shalev-Shwartz, Gal Beniamini, Yoav Levine, Or Sharir…

AI CompaniesAI Research