Essential AI

Essential AI (legal name Essential AI Labs, Inc.) is a San Francisco based artificial intelligence research company founded in 2023 by Ashish Vaswani and Niki Parmar, two co-authors of the 2017 paper "Attention Is All You Need" that introduced the transformer architecture.^[1][2] The company emerged from stealth in December 2023 with $56.5 million in Series A funding led by March Capital, alongside backers including Google, Nvidia, AMD, Thrive Capital, Franklin Venture Partners, and KB Investment, bringing total disclosed funding to roughly $65 million.^[1][3] Essential AI initially framed its mission around an "enterprise brain" that would automate knowledge work. In early 2025 Vaswani told the board he would drop that business model and turn the company into an open research lab, and its public output shifted to openly released artifacts: the Essential-Web v1.0 web data corpus (June 2025), the Rnj-1 family of open weight language models (December 2025), and the long-context Rnj-1.5 (2026).^{[4][6][22][23]} Under Vaswani as chief executive officer, the company ran a research stack that combined Google TPU v5p and AMD Instinct MI300X compute, the Muon optimizer, and a custom data taxonomy pipeline.^[4][6] In June 2026 Nvidia hired Vaswani and several other members of the team, a move Axios described as an acqui-hire of "the team behind Essential AI".^[20][21] A source told Ground Level AI that Vaswani would work on Nvidia's Nemotron open models.^[20] No terms were disclosed, and the reports described a hiring of the team rather than a purchase of the company.^[20][21]

Company overview

Sources: ^{[1][2][3][4][5][6][7]}

What is Essential AI?

Essential AI is a foundation model research lab whose distinguishing feature is its founders: Ashish Vaswani and Niki Parmar were both authors of "Attention Is All You Need", the 2017 paper that introduced the transformer, the architecture underlying essentially every modern large language model.^[1][2][8] The company raised approximately $65 million across a seed round and a $56.5 million December 2023 Series A whose investors span a hyperscaler (Google), two accelerator vendors (Nvidia and AMD), and conventional venture capital.^[1][3] After about two years working toward enterprise products that it never publicly launched, Essential AI repositioned in early 2025 as an open research lab, most notably releasing the Essential-Web v1.0 dataset of about 24 trillion tokens and the 8.3 billion parameter Rnj-1 code and STEM language models.^{[4][6][17][22]} At its launch, Vaswani framed the company's purpose broadly: "We believe that breakthroughs in AI will unlock the most profound tools for thought, advancing humanity's collective knowledge and capability."^[19] In June 2026 Vaswani and several Essential AI researchers moved to Nvidia.^[20][21]

Who founded Essential AI?

Essential AI was founded by two researchers whose careers had run in parallel from Google Brain through the founding cohort of Adept AI Labs. Ashish Vaswani is the first-listed author of "Attention Is All You Need", the 2017 paper that introduced the transformer architecture and that has become one of the most cited works in modern machine learning; Parmar is the third-listed author.^[2][8][12] Vaswani holds a PhD in computer science from the University of Southern California and worked at Google Brain between roughly 2016 and 2021, where he carried out the work that led to the paper.^[2][22] Niki Parmar, a co-author of the same paper, holds a bachelor's degree from the Pune Institute of Computer Technology and a master's degree in computer science from the University of Southern California.^[9]

In 2021 Vaswani and Parmar left Google and co-founded Adept AI with former Google director David Luan; the company launched publicly in April 2022 with $65 million in funding, with Luan as chief executive, Parmar as chief technology officer, and Vaswani as chief scientist.^[10][12][26] Adept set out to train models that could carry out tasks in existing software from natural language instructions; its first product, ACT-1, ran as an overlay on top of applications such as Google Chrome and Salesforce.^[10][27] Vaswani and Parmar left less than a year after Adept's launch. On January 13, 2023, The Information reported that the two had departed, which they confirmed, and that their LinkedIn profiles indicated they were working on a new startup.^[26] Bloomberg later reported, citing a person familiar with the matter, that Vaswani left after clashes between co-founders; Vaswani told Bloomberg the primary reason was his realization that founding his own company would give him more freedom.^[22] Adept raised a further $350 million in March 2023, bringing its total to $415 million.^[27] In June 2024 Amazon hired Luan and Adept co-founders Augustus Odena, Maxwell Nye, Erich Elsen, and Kelsey Szot into its AGI team and took a non-exclusive license to some of Adept's technology; Adept said it would focus entirely on solutions that enable agentic AI and continued operating with its remaining staff.^[11]

Essential AI's first publicly reported funding was an $8 million seed round, reported by Reuters on May 4, 2023, citing four sources.^[12] Thrive Capital led the round; Conviction and angel investor Elad Gil also participated, according to one source.^[12] At that point the company remained in stealth, had not launched a product, and was described by Reuters' sources as aiming to "build software for enterprises to use large language models".^[12]

How much funding has Essential AI raised?

Essential AI announced its $56.5 million Series A on December 12, 2023, formally exiting stealth.^[1][3] The round was led by March Capital and included AMD, Franklin Venture Partners, Google, KB Investment, Nvidia, and existing seed investor Thrive Capital.^[1][3] The announcement put the company's total funding to date at "nearly $65 million".^[1] It also disclosed an expanded seed amount of $8.3 million (compared with the $8 million figure reported earlier in 2023) and listed seed investors including Brad Gerstner, Amjad Masad, Conviction, Elad Gil, Francis D'Souza, David H. Petraeus, Gustavo Sapoznik, Jamie Montgomery, and Mei Zuo.^[1][3] The release identified Montgomery, co-founder and managing partner of March Capital, as a board member of Essential AI.^[1] The company did not disclose the valuation at which it raised the capital.^[3] A Form D notice filed with the U.S. Securities and Exchange Commission on November 6, 2023, shortly before the announcement, reported an equity offering of about $51.5 million, of which about $36.5 million had been sold to eight investors, with the first sale dated October 30, 2023; the filing listed Vaswani and Parmar as executive officers and directors and Montgomery as a director.^[25]

The investor base combined hyperscaler interests (Google), GPU and accelerator vendors (Nvidia, AMD), and conventional venture capital. In January 2024 Essential AI and Google Cloud announced a multi-year partnership that made Google Cloud the startup's preferred cloud provider, under which Essential AI would train its models on Cloud TPU v5p and use Google analytics tools such as BigQuery and Looker.^[24] AMD's investment preceded Essential AI's later disclosure that it ran substantial training and inference workloads on AMD Instinct MI300X accelerators (see Technical infrastructure below).^[4][6]

No round after the Series A was disclosed. In September 2025 Bloomberg reported that, as Essential AI changed focus, Vaswani was asking investors for at least $150 million.^[22] No close of such a round was reported, and in June 2026 a source close to the startup told Ground Level AI that Vaswani had been struggling to raise money.^[20] Some figures that circulated online were not supported by any company announcement: Value Add VC, which had reported that Essential AI raised a $175 million Series B in August 2025 and was raising about $1.5 billion at an $8.6 billion valuation, withdrew those claims in an October 6, 2026 correction, saying it could not find a source for them.^[34]

Funding round summary

No valuation was disclosed for either round, and no later funding round was reported before the team's June 2026 move to Nvidia.^[3][34]

What is Essential AI's mission and how has it evolved?

At launch, Essential AI articulated a mission centered on enterprise productivity. The Series A press release, titled "Essential AI Raises $56.5M Series A to Build the Enterprise Brain", described the company as developing "full-stack AI products that quickly learn to increase productivity by automating time-consuming and monotonous workflows".^[1] In his public launch announcement, co-founder and chief executive Ashish Vaswani framed the ambition in broader terms: "We believe that breakthroughs in AI will unlock the most profound tools for thought, advancing humanity's collective knowledge and capability."^[19] The press release said the company's mission was "to deepen the partnership between humans and computers".^[1] Coverage in December 2023 by VentureBeat and SiliconANGLE, drawing on the company's website, described products that the company said would make data analysts 10 times faster, speed up the work of financial analysts, and help business users "become independent data driven decision makers themselves".^[14][3]

The change in direction came in early 2025. According to Bloomberg, at a board meeting in January 2025 Vaswani said he planned to abandon the company's business model and rededicate it to frontier research, and he got the support he needed; March Capital's Jamie Montgomery told Bloomberg, "We've got to let Ashish be Ashish."^[22] The company's own account, in its December 2025 Rnj-1 announcement, says that in February 2025 Essential "decided to go back to the basics" because research and product "were both competing for a small team's focus".^[6] Although the company never publicly launched an enterprise product, its blog and research outputs from 2025 onward emphasised open infrastructure and capabilities in code and STEM. By December 2025, shortly after the Rnj-1 release, the company's website described its mission as building "an open platform to accelerate the science and engineering of deep learning".^[5] Its "Essential memo" lists near-term bets on long context capabilities, modeling the behaviors of computer programs, time-varying and space-varying modalities, and low-level performance optimization on newer accelerator families, with targets such as long-context code automation with whole-repo refactoring and kernel optimizations on next-generation accelerators.^[31]

In a June 2025 interview with The Economic Times, Vaswani said the team was building "an open science or open-source frontier model that everybody can control", which would include opening up its weights and, to a certain extent, its training data; he added that "in the short term, we would like to be the DeepSeek in the West".^[30] Bloomberg reported that the business plan was to build open-source models and then sell tools, such as datasets and products to help with data selection, that would let customers take full advantage of the technology, a model it compared with Red Hat; Montgomery said Essential had tried to develop a plan for monetizing its technology but decided it was premature.^[22] Bloomberg's coverage of the Rnj-1 launch presented the model as a boost to US open-source efforts at a time when Chinese firms such as DeepSeek and Alibaba were dominating open models.^[13]

What has Essential AI built? (Research output)

Essential AI published a small, technically dense set of research artifacts that together describe the company's training stack. The principal public outputs, each carrying the Essential AI institutional affiliation, are described below.

Practical Efficiency of Muon for Pretraining (May 2025)

In May 2025 Essential AI published "Practical Efficiency of Muon for Pretraining" on arXiv (2505.02222).^[15] The paper, with 23 listed authors at Essential AI and Vaswani as the last-listed author, presents the company's empirical case for adopting the Muon optimizer in place of AdamW for large language model pretraining.^[15] The headline claim is that "Muon, the simplest instantiation of a second-order optimizer, explicitly expands the Pareto frontier over AdamW on the compute-time tradeoff."^[15] Specifically, the authors report that Muon retains data efficiency at large batch sizes well beyond the critical batch size at which AdamW degrades, while remaining computationally cheap enough to be practical at the scale of foundation model training.^[15]

A secondary contribution of the paper is what the authors describe as the first empirical demonstration of maximal update parametrization (muP) being used to calibrate hyperparameters for an LLM trained with Muon.^[15] The authors introduce a "telescoping" algorithm for handling error in muP transfer and run experiments with models up to four billion parameters and batch sizes up to 16 million tokens.^[15] In a June 2025 blog post titled "Muon Doesn't Clearly Grok faster", Essential AI tested claims that Muon accelerates grokking on a modular division task; it found that Muon did grok faster than AdamW under certain conditions but that the advantage disappeared across a wider range of hyperparameters and model sizes.^[32] The company also published blog posts on Muon, muP and the compute-time tradeoff, and on layer sharding for large-scale training with Muon.^[33]

Essential-Web v1.0 (June 2025)

Essential AI's largest release is Essential-Web v1.0, a 24 trillion token web corpus published on arXiv (2506.14111) on June 17, 2025 and released on Hugging Face under the Open Data Commons Attribution licence.^[4][16] The dataset contains 23.6 billion documents drawn from 101 Common Crawl snapshots between CC-MAIN-2013-20 and CC-MAIN-2024-38.^[16] Each document carries a 12 field metadata schema that the paper refers to as EAI-Taxonomy, organised into five groups:

1. Free Decimal Correspondence (FDC): a public-domain analogue of the Dewey Decimal System with a three level hierarchy describing subject matter, with codes such as 51 for mathematics and 512 for algebra.^[4][16]
2. Bloom's Taxonomy fields: two categories (knowledge domain and cognitive process) covering educational dimensions.^[4][16]
3. Document type (V1 and V2): separate web format classifications using 17 and 25 category schemas.^[4][16]
4. Content quality fields: reasoning depth, technical correctness, and education level, each on multi level ordinal scales.^[4][16]
5. Extraction quality fields: extraction artifacts and missing content indicators describing data quality issues.^[4][16]

The labels are produced by EAI-Distill-0.5b, a 0.5 billion parameter classifier fine-tuned from Qwen2.5-0.5B-Instruct on labels from Qwen2.5-32B-Instruct (selected as the teacher after a comparison that included DeepSeek-V3 and Qwen2.5-72B-Instruct).^[4][16] The student model stays within about three percent of the teacher on annotator agreement (an overall mean Cohen's kappa of 0.71 versus 0.74 on a random evaluation set) while running about 50 times faster, and labelling the full corpus took approximately 90,000 AMD MI300X GPU hours, with the job running on 512 GPUs for about a week.^[4]

The processing pipeline applies snapshot-level and global exact deduplication (with xxhash document identifiers), snapshot-level MinHash locality sensitive hashing deduplication with a Jaccard threshold of 0.7 (14 bands of 9 rows each), language filtering, and quality filters drawn from the RedPajama V2 pipeline and the DCLM baseline fastText classifier.^[4][16] Of 248.4 billion raw documents, 23.6 billion remained; at the step level, global exact deduplication removed 45.6% of the documents reaching that stage and language filtering removed 50.8%.^[4]

The paper's headline empirical result is that simple SQL style filters over the EAI-Taxonomy metadata produce competitive domain specific subsets without requiring a dedicated classifier. Compared against the strongest published web-based baselines, the taxonomy filtered subsets come within 8.0% of the state of the art on mathematics and exceed it by 14.3% on web code, 24.5% on STEM, and 8.6% on medical evaluation suites (relative figures).^[4] Specific reported numbers include 28.7% on HumanEval+ for the taxonomy filtered code mixture (versus 28.0% for DCLM baseline) and 47.0% on MMLU computer science (versus 32.0% for DCLM baseline).^[4] Essential AI announced in June 2025 that the dataset had reached "#1 on Hugging Face".^[33]

Rnj-1 (December 2025)

On December 5, 2025 Essential AI released Rnj-1, the company's first publicly available pair of open weight language models, with an announcement post by Vaswani and accompanying model cards.^[6][17] Bloomberg covered the release on December 8, describing it as the startup's first model.^[13]

Rnj-1 (an homage to the mathematician Srinivasa Ramanujan, pronounced "range-1") consists of two checkpoints, a base model and an instruction tuned model.^[6][13][17] Both contain approximately 8.3 billion parameters and follow an architecture similar to Gemma 3 except that Rnj-1 uses only global attention, with 32 transformer layers, a model dimension of 4096, an MLP dimension of 16384, 32 attention heads, 8 key value heads, a head dimension of 128, GeGLU activations, tied embeddings, and a vocabulary of 128,000 tokens.^[17] The pretraining context is 8,192 tokens, extended to 32,768 by mid training; the instruct model can be extrapolated to 128,000 through YaRN RoPE scaling.^[17]

Training consisted of three phases:

The Muon optimizer is used throughout all phases of training,^[17] at a larger scale (about 8 billion parameters) than the models of up to four billion parameters in the company's earlier Muon paper;^[15] the announcement says both of the company's flagship runs "have benefited from the superior token efficiency of Muon".^[6] The announcement says the company's accelerator fleet, described as a 1.2 exaflop fleet, was split across two clouds and combined Google TPU v5p chips with AMD Instinct MI300X GPUs.^[6] The model is released under the Apache 2.0 licence as EssentialAI/rnj-1 and EssentialAI/rnj-1-instruct, with quantised GGUF builds also distributed; the model card lists serverless access through Together AI and local or self-hosted use through llama.cpp, vLLM, and SGLang.^[17]

Essential AI positions Rnj-1 as a code and STEM focused model rather than a generalist chatbot. According to the model card, both models show strong results on HumanEval+, MBPP+, BigCodeBench, and LiveCodeBench v6 and compete with the strongest open weight models of similar size, "sometimes outperforming even larger models such as GPT OSS 20B"; the instruct variant reaches 86.21% on HumanEval fill in the middle (HE-FIM-Python, average), against 82.49% for the base model.^[17] On SWE-bench Verified (in a bash only harness) Rnj-1 instruct scores 20.8%, which the card says is higher than Gemini 2.0 Flash and Qwen2.5-Coder 32B Instruct under the same agentic framework, and Essential AI describes the model as "an order of magnitude stronger than comparably sized models on SWE-bench".^[6][17] Mathematics results include 92.6% on GSM8K and 43.3% on AIME 2025, and the card cites GPQA Diamond (38.9%) and SuperGPQA as evidence of scientific reasoning.^[17] The company says the instruct model surpasses comparable models on the Berkeley Function Calling Leaderboard for function calling.^[6][17] The model card explicitly notes regressions under 128K extrapolation, identity confusion between providers, and weakness on factual questions.^[17] Bloomberg reported the company's claim of "frontier matching" coding, math and agentic reasoning capabilities from only 8 billion parameters, and noted that the model was designed to run on consumer-grade GPUs.^[13]

Rnj-1.5 (2026)

Essential AI followed Rnj-1 with rnj-1.5-instruct, a long-context version of the instruct model released on Hugging Face under the Apache 2.0 licence; the weights were uploaded on April 22, 2026 and the model card was added on May 26, 2026.^[23][35] According to the card, the model extends the context window from 32k to 160k tokens and scores 77% on the RULER benchmark at a 128k context window.^[23] Its main architectural change is to interleave block-local self-attention layers, whose compute and storage cost per position is fixed, with global attention layers; after ablations the team settled on a 32-layer pattern of 21 local and 11 global layers that concentrates the global layers in the middle of the network.^[23] The card cites earlier local self-attention work by Parmar (the Image Transformer, 2018) and Vaswani (2021) among its references for this design.^[23]

The card also describes "lookback" needle-in-a-haystack evaluations built from GitHub repositories, about 75 billion tokens of science text converted from PDF documents with olmOCR 2, repository-level code data for mid-training, and a synthetic pipeline that mined about 200,000 software engineering tasks from 3,500 GitHub repositories, from which three teacher models generated about 600,000 agent trajectories.^[23] On SWE-bench Verified, Essential AI reports a 40% resolve rate with the SWE-agent harness and 25% with mini-swe-agent.^[23] Support for the model's block-local attention was added to vLLM in version 0.20.0.^[23]

Other research

Essential AI has also published an arXiv paper titled "Rethinking Reflection in Pre-Training" (2504.04022) examining how reasoning behaviour emerges during pretraining as opposed to post training.^[18] The authors introduce deliberate errors into chains of thought and test whether a model can still reach the right answer; they report that this self-correcting ability appears early in pretraining and improves steadily, with an OLMo-2 7B model pretrained on 4 trillion tokens showing self-correction on the six self-reflection tasks the authors designed.^[18] The paper shares authorship overlap with the Muon and Essential-Web papers, including Andrew Hojel, Michael Pust, Mohit Parmar, and Vaswani.^[18] Bloomberg reported that, to Vaswani, a major takeaway from the work was that the field's focus on post-training had obscured a strategy that could yield significant long-term improvements.^[22] Essential AI's Hugging Face organization hosts adversarial versions of benchmarks such as GSM8K, CRUXEval, TriviaQA, and BBH, along with sets of "reflection" model outputs, uploaded in April 2025.^[36]

What hardware and tools did Essential AI use? (Technical infrastructure)

Public Essential AI papers and posts describe an infrastructure stack that mixed multiple accelerator architectures. Under the January 2024 Google Cloud partnership, Essential AI said it would train its models on Cloud TPU v5p.^[24] Essential-Web v1.0 was annotated using approximately 90,000 AMD MI300X GPU hours, with the inference job running on 512 AMD Instinct MI300X GPUs for about a week.^[4] The Rnj-1 announcement says the company's accelerator infrastructure was "distributed across two clouds and vastly different platforms", TPU v5p chips and AMD MI300X GPUs, and that over 2025 the team built a unified JAX training framework with TPU and GPU support that could schedule workloads on either platform; it reported model FLOPs utilization for the flagship runs of about 50% of the maximum achievable on MI300X GPUs.^[6] The same post says Rnj-1 is robust to quantization from BF16 to FP8 to NVFP4, with throughput measured on NVIDIA B200 GPUs.^[6] These disclosures are consistent with the structure of the Series A, which combined investments from Google (a major TPU operator) and AMD.^[1]

Training and inference tooling described in public artifacts includes the Muon optimizer (used in place of AdamW across pretraining and post training), the muP parametrisation for hyperparameter transfer, a WSD learning rate schedule, and inference support through vLLM, SGLang, llama.cpp, and the standard Hugging Face Transformers library.^[15][17]

Who worked at Essential AI? (Team)

Public information about the Essential AI team is concentrated in arXiv paper author lists, the company website, and press coverage. Ashish Vaswani served as chief executive officer and is an author on all of the company's principal papers.^{[4][15][18][23]} Niki Parmar was the co-founder named alongside Vaswani in funding announcements and the original 2023 press materials, and the November 2023 Form D listed both as executive officers and directors.^[1][25] Bloomberg reported in September 2025 that Essential AI had 25 employees working from a loft in San Francisco's South of Market neighborhood; Vaswani told Bloomberg that Essential had already lost some employees, at a time when companies such as Meta were offering some researchers compensation packages in the hundreds of millions of dollars.^[22]

Did Niki Parmar leave Essential AI?

Yes. Parmar joined Anthropic in December 2024, according to her own post on X in February 2025, in which she said she had contributed to the development of Claude 3.7 Sonnet.^[28] Sharon Goldman, reporting earlier that month, said Parmar had started at Anthropic in January 2025.^[29] Her departure left Ashish Vaswani as the sole remaining founder leading the company through its 2025 open release period.^[6][28]

The author lists on the Muon and Essential-Web papers identify a recurring research engineering team, including Andrew Hojel, Michael Pust, Mohit Parmar, Tim Romanski, Yash Vanjani, Ritvik Kapila, Anthony M. Polloreno, Karl Stratos, Philip Monk, Adarsh Chaluvaraju, Andrew Ma, Anil Thomas, Ashish Tanwer, Darsh J. Shah, Khoi Nguyen, Kurt Smith, Michael Callahan, Platon Mazarakis, Peter Rushton, Saurabh Srivastava, Somanshu Singla, Alok Tripathy, and Ishaan Shah.^[15][4] The Rnj-1.5 model card lists 16 contributors, including Vaswani, Alok Tripathy, Saurabh Srivastava, Aleksa Gordić, and Ameya Velingker.^[23] At the Series A, Vaswani said he and Parmar planned to build "a world-class, multi-disciplinary team of engineers, researchers, designers, and sales and product experts".^[1] The company's memo says its staff came from universities including Stanford, MIT, and UC Berkeley and from labs and companies including Google Brain, DeepMind, Meta, Microsoft, Amazon, and Apple.^[31]

What happened to Essential AI in 2026?

On June 20, 2026, Sharon Goldman reported in her newsletter Ground Level AI that Nvidia had hired Vaswani and several others from the Essential AI team, citing a source close to the startup who said Vaswani would work on Nvidia's Nemotron open-source models.^[20] The same source said Vaswani had been struggling to raise money and that "taking Ashish/Essential away from AMD was also a motivator"; AMD had been an early strategic investor in Essential AI, and the startup had long relied on AMD GPUs.^[20] Several Essential AI researchers, including Alok Tripathy and Saurabh Srivastava, had changed their LinkedIn profiles to show work at Nvidia, while a second source close to the deal said he was not sure "if the deal is finally done".^[20] Ground Level AI presented the move as one of a series of Nvidia talent acquisitions as the chipmaker expanded its AI research and software ambitions.^[20]

On June 23, 2026, Axios reported that "Nvidia also acqui-hired the team behind Essential AI, including AI researcher Ashish Vaswani".^[21] Axios contrasted the deal with genuine lab-to-lab departures that month, such as Noam Shazeer leaving Google DeepMind for OpenAI, and called Essential AI "more along the lines of the expected consolidation of startups".^[21] Financial terms were not reported.^[21][34] As of late October 2026, Essential AI's website still presented Rnj-1 as its latest model release and did not mention the deal.^[5]

The arrangement resembled earlier deals in which large technology companies hired the core team of an AI startup rather than buying the company outright. Amazon hired Adept chief executive David Luan and other Adept co-founders and licensed its technology in June 2024, a deal GeekWire compared with Microsoft's hiring of Inflection AI co-founders Mustafa Suleyman and Karén Simonyan along with other employees, and Google paid more than $2 billion to acqui-hire Shazeer and part of his Character.AI team.^[11][21]

Timeline

How does Essential AI compare with other foundation model startups?

Essential AI is one of a cluster of foundation model startups founded between 2019 and 2023 by researchers from Google, Google Brain, or DeepMind, several of which share investors, technical lineage, or strategic positioning. The table below compares it with Adept AI, Inflection AI, and Cohere.

Essential AI is distinguished within this group by its founders' technical lineage as transformer co-authors, its relatively modest disclosed funding (about $65 million, against $415 million for Adept by March 2023), and its 2025 shift from a closed enterprise framing to open weight releases.^[1][6][27]

Why is Essential AI significant?

Essential AI's significance derives less from its initial commercial product (which was never launched) than from the public artifacts the company released from 2025 onward. Three points stand out in its public record:

• Founders' provenance: Vaswani and Parmar are the first- and third-listed authors of "Attention Is All You Need", and Reuters noted when reporting the seed round that they were joining other authors of the paper, such as Noam Shazeer of Character.AI and Aidan Gomez of Cohere, in founding venture-backed startups.^[12]
• Data infrastructure: Essential-Web v1.0 is a 24 trillion token, openly licensed web corpus, and its taxonomy and SQL style filtering approach are positioned by its authors as an alternative to the domain-specific classifiers and pipelines behind datasets such as FineWeb and DCLM.^[4][16]
• Open weight code models: Rnj-1's reported SWE-bench Verified and code benchmark numbers at 8.3 billion parameters provide a data point for the broader question of how far smaller models can be pushed with focused data curation and modern optimizers such as Muon.^[6][13][17]

Bloomberg's September 2025 profile placed Essential AI's shift within a wider search by researchers for alternatives to the large corporate labs, citing research-focused startups such as Thinking Machines Lab and Safe Superintelligence, and quoted AMD chief strategy officer Mathew Hein as calling the company's research focus "a bit unusual" for a startup while seeing demand for more open alternatives in AI.^[22] Axios later grouped the June 2026 Nvidia deal with the expected consolidation of AI startups.^[21]

The principal methodological contribution of the Essential-Web release, the use of an explicit taxonomy with metadata fields that can be queried directly using SQL style filters, contrasts with two earlier approaches described in the paper: heuristic filtering and deduplication, as in RedPajama, and model-based quality filtering through classifiers, as in DCLM and FineWeb.^[4] By exposing the underlying classifier signals as document level metadata, Essential AI aimed to lower the cost of constructing domain specific subsets and make ablation studies easier to design.^[4][16]

Public communications

Essential AI's external communications were concentrated in three channels: the company blog at essential.ai, paper releases on arXiv, and dataset and model releases on Hugging Face under the EssentialAI organisation. The company also operated accounts on the X social network (@essential_ai) and LinkedIn, and maintained a public Discord community for users of the Rnj-1 model family.^[5][17] Mainstream coverage clustered around a few moments: the December 2023 Series A, the September 2025 Bloomberg profile, the December 2025 Rnj-1 release, and the June 2026 reports of the Nvidia deal.^{[1][13][20][21][22]}

The company's blog posts typically take a technical rather than promotional register. The "Muon Doesn't Clearly Grok faster" post, for example, is a narrow empirical study of whether Muon speeds up grokking on a small algorithmic task.^[32] The Rnj-1 announcement is organised around capabilities, the history of the project, research and infrastructure work, and future plans; its closing section names conditional computation, longer contexts, lower precision training, and reinforcement learning among the directions the team expected to pursue.^[6]

What are the limitations and criticisms of Essential AI?

A number of caveats apply to Essential AI's public record. The company never publicly launched the enterprise products discussed at its Series A in December 2023. Bloomberg described Vaswani's January 2025 decision as telling his backers that he would take the money they had given him for one purpose and do something entirely different, although the investors supported the change.^[22] Bloomberg also wrote that it was too early to tell whether Essential's pretraining research would translate into significant practical changes or commercial success, and that the company was likely to operate under substantial pressure.^[22] The company did not report closing the larger round it sought in 2025, and in June 2026 a source told Ground Level AI that Vaswani had been struggling to raise money before the team moved to Nvidia.^[20][22]

The Essential-Web paper's benchmark gains are domain specific and rely on relatively small training token budgets (each comparison anneals a base model on 80 billion tokens of the candidate data) where ranking effects can be sensitive to the choice of evaluation suite.^[4] Mathematics was the one domain where EAI-Taxonomy filtered data trailed the best published baseline: on GSM8K, FineMath 3+ scored 26.4% against 22.4% for the best taxonomy subset, although on the MATH and MMLU-Math benchmarks the taxonomy subset performed within standard error of FineMath 3+.^[4] The Rnj-1 model card states that the model is "not optimized for factual recovery", that it has a strong inclination to write code even for non-code tasks, and that some quality regressions occur under 128K extrapolation, particularly on science and performance evaluations (MMLU-STEM falls from 81.8 to 69.4).^[17] Identity confusion with other model providers is also documented in the model card.^[17]

The company did not publish revenue, customer, or commercial deployment figures, and the most detailed publicly available descriptions of staffing and infrastructure are drawn from paper author lists and blog posts rather than formal disclosure.^{[4][6][16][17]}

Comparison

See Adept AI, Inflection AI, Cohere, and Mistral AI for adjacent foundation model startups. See Muon and AdamW for the optimizers discussed in Essential AI's pretraining research. See Common Crawl, RedPajama, DCLM, and FineWeb for related web scale pretraining datasets. See Gemma 3 for the open architecture template most closely followed by Rnj-1, and Nemotron for the Nvidia model family that Vaswani was reported to be working on after joining Nvidia in 2026.

Continue reading

• NvidiaNvidia Corporation is an American technology company that designs graphics processing units (GPUs) and is the world's dominant supplier of hardware for artificial intelligenceMentioned 25 times above
• MMuon (optimizer)Muon (short for MomentUm Orthogonalized by Newton-Schulz) is a neural-network optimizer that updates the two-dimensional weight matrices of hidden layers by taking the momentum-based SGD update and…Mentioned 24 times above
• Hugging FaceHugging Face is an artificial intelligence company and collaboration platform for machine learning.Mentioned 7 times above
• AAdamWAdamW is a variant of the Adam optimizer that decouples weight decay from the gradient-based update rule, applying the decay directly to the weights instead of folding it into the loss as an L2 penalty.Mentioned 6 times above
• DCLM (DataComp for Language Models)DCLM, short for DataComp for Language Models (also styled DataComp-LM), is an open benchmark, dataset, and software framework, released in June 2024Mentioned 6 times above
• TTPU v5pTPU v5p (Cloud TPU v5p) is Google's fifth-generation, performance-tier Tensor Processing Unit, a custom AI accelerator that delivers 459 bfloat16 TFLOPS per chip and scales to pods of 8,960 chips (about 4.1…Mentioned 6 times above

More from See also

• List of neolabs
• Neolab
• Nemotron
• Attention Is All You Need
• Transformers
• Adept AI
• Google Brain
• muP (Maximal Update Parametrization)
• Common Crawl
• RedPajama
• FineWeb
• SWE-bench Verified
• HumanEval
• BigCodeBench
• LiveCodeBench
• MBPP
• GSM8K
• GPQA Diamond
• AIME 2025
• Berkeley Function Calling Leaderboard
• Gemma 3
• YaRN
• Rotary Position Embedding
• AMD Instinct MI300X
• vLLM
• Large Language Model
• Foundation Models
• Agentic AI
• Cohere
• Inflection AI
• Character.AI
• Mistral AI
• Supervised fine-tuning
• Pre-training

Topics:AI CompaniesAI Research

References

1. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22Essential AI / Business Wire, "Essential AI Raises $56.5M Series A to Build the Enterprise Brain", Business Wire, 2023-12-12. businesswire.com/...-to-Build-the-Enterprise-Brain. Accessed 2026-10-27.
2. ^1 ^2 ^3 ^4 ^5Wikipedia contributors, "Ashish Vaswani", Wikipedia, 2025. en.wikipedia.org/...Ashish_Vaswani. Accessed 2026-05-20.
3. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12Maria Deutscher, "Nvidia, AMD back $56.5M round for Essential AI Labs, led by Transformer architecture co-inventors", SiliconANGLE, 2023-12-12. siliconangle.com/...rmer-architecture-co-inventors. Accessed 2026-10-27.
4. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22 ^23 ^24 ^25 ^26 ^27Essential AI (Andrew Hojel, Michael Pust, Tim Romanski, Yash Vanjani, Ritvik Kapila, Mohit Parmar, et al.), "Essential-Web v1.0: 24T tokens of organized web data", arXiv:2506.14111, 2025-06-17. arxiv.org/...2506.14111. Accessed 2026-10-27.
5. ^1 ^2 ^3 ^4Essential AI, "Research and blog", essential.ai, 2025-2026. essential.ai. Accessed 2026-10-27. Archived copy of 11 December 2025: web.archive.org/...essential.ai.
6. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22Ashish Vaswani / Essential AI, "Announcing Rnj-1: Building Instruments of Intelligence", essential.ai, 2025-12-05. essential.ai/...rnj-1. Accessed 2026-10-27.
7. ^AI Expert Network, "Essential AI: Building the Enterprise Brain", aiexpert.network, 2023-12-20. aiexpert.network/...-building-the-enterprise-brain. Accessed 2026-10-27.
8. ^1 ^2Ashish Vaswani et al., "Attention Is All You Need", arXiv:1706.03762, 2017-06-12. arxiv.org/...1706.03762. Accessed 2026-05-20.
9. ^Gennaro Cuofano, "Niki Parmar", FourWeekMBA, 2024-03-19. fourweekmba.com/niki-parmar. Accessed 2026-10-27.
10. ^1 ^2 ^3 ^4Katyanna Quach, "Ex-Googlers to build 'general intelligence' at Adept AI", The Register, 2022-04-27. theregister.com/...adept_ai_google. Accessed 2026-10-27.
11. ^1 ^2 ^3 ^4Taylor Soper, "Amazon hires founders from well-funded enterprise AI startup Adept to boost tech giant's 'AGI' team", GeekWire, 2024-06-28. geekwire.com/...dept-to-boost-tech-giants-agi-team. Accessed 2026-10-27.
12. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10Anna Tong and Krystal Hu, "Top ex-Google AI researchers raise funding from Thrive Capital, sources say", Reuters via Yahoo Finance, 2023-05-04. finance.yahoo.com/...ogle-ai-researchers-120100948. Accessed 2026-10-27.
13. ^1 ^2 ^3 ^4 ^5 ^6Saritha Rai, "Transformer Paper Authors at AI Startup Debut Open Source Model", Bloomberg, 2025-12-08. bloomberg.com/...i-startup-debut-open-source-model. Accessed 2026-10-27.
14. ^Shubham Sharma, "Essential AI emerges from stealth with backing from Google, Nvidia and AMD", VentureBeat, 2023-12-12. venturebeat.com/...king-from-google-nvidia-and-amd. Accessed 2026-10-27.
15. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11Essential AI (Ishaan Shah, Anthony M. Polloreno, Karl Stratos, Philip Monk, Adarsh Chaluvaraju, Andrew Hojel, et al.), "Practical Efficiency of Muon for Pretraining", arXiv:2505.02222, 2025-05-04. arxiv.org/...2505.02222. Accessed 2026-10-27.
16. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13Essential AI, "EssentialAI/essential-web-v1.0 dataset card", Hugging Face, 2025-06-17. huggingface.co/...essential-web-v1.0. Accessed 2026-10-27.
17. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22Essential AI, "EssentialAI/rnj-1-instruct model card", Hugging Face, 2025-12-08. huggingface.co/...rnj-1-instruct. Accessed 2026-10-27.
18. ^1 ^2 ^3 ^4 ^5Essential AI, "Rethinking Reflection in Pre-Training", arXiv:2504.04022, 2025-04-05. arxiv.org/...2504.04022. Accessed 2026-10-27.
19. ^1 ^2Ashish Vaswani (@ashVaswani), "I'm thrilled to announce our company, @essential_ai ...", X (Twitter), 2023-12-12. x.com/...1734680441888886937. Accessed 2026-10-27.
20. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15Sharon Goldman, "Nvidia quietly acquihires Essential AI team, including Transformer coauthor Ashish Vaswani", Ground Level AI, 2026-06-20. groundlevel-ai.com/...quietly-acquihires-essential. Accessed 2026-10-27.
21. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12Ina Fried, "AI lab musical chairs hits Google the hardest", Axios, 2026-06-23. axios.com/...ai-lab-agi-google-deepmind-departures. Accessed 2026-10-27.
22. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18Julia Love, "What If We're Doing AI All Wrong?", Bloomberg Businessweek, 2025-09-03. bloomberg.com/...ficial-intelligence-from-big-tech. Accessed 2026-10-27.
23. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11Essential AI, "EssentialAI/rnj-1.5-instruct model card", Hugging Face, 2026-05-26. huggingface.co/...rnj-1.5-instruct. Accessed 2026-10-27.
24. ^1 ^2 ^3 ^4Essential AI and Google Cloud, "Essential AI Chooses Google Cloud to Power Enterprise Decision Making with Generative AI", Google Cloud Press Corner (PR Newswire), 2024-01-29. googlecloudpresscorner.com/...g-with-Generative-AI. Accessed 2026-10-27.
25. ^1 ^2 ^3 ^4U.S. Securities and Exchange Commission, "Form D: Essential AI Labs, Inc." (CIK 0001999940), filed 2023-11-06. sec.gov/...primary_doc.xml. Accessed 2026-10-27.
26. ^1 ^2 ^3 ^4Jon Victor and Amir Efrati, "Two Co-Founders of Adept, an OpenAI Rival, Suddenly Left to Start Another Company", The Information, 2023-01-13. theinformation.com/...eft-to-start-another-company. Accessed 2026-10-27.
27. ^1 ^2 ^3 ^4 ^5Kyle Wiggers, "Adept, a startup training AI to use existing software and APIs, raises $350M", TechCrunch, 2023-03-15. techcrunch.com/...ng-software-and-apis-raises-350m. Accessed 2026-10-27.
28. ^1 ^2 ^3Niki Parmar (@nikiparmar09), "Today is as good a day as any to share that I joined Anthropic last Dec ...", X (Twitter), 2025-02-24. x.com/...1894168474886574404. Accessed 2026-10-27.
29. ^Sharon Goldman (@sharongoldman), "NEW: Anthropic has quietly made 2 big hires ...", X (Twitter), 2025-02-13. x.com/...1890148968094745050. Accessed 2026-10-27.
30. ^Swathi Moorthy, "We would like to be DeepSeek in the West, says Essential AI cofounder", The Economic Times, 2025-06-17. economictimes.indiatimes.com/...121891250.cms. Accessed 2026-10-27.
31. ^1 ^2Essential AI, "About Us (Essential Memo)", essential.ai. essential.ai/about. Accessed 2026-10-27.
32. ^1 ^2Essential AI, "Muon Doesn't Clearly Grok faster", essential.ai, 2025-06-20. essential.ai/...grokking. Accessed 2026-10-27.
33. ^1 ^2Essential AI, "Research", essential.ai, 2025. essential.ai/research. Accessed 2026-10-27.
34. ^1 ^2 ^3Trace Cohen, "Essential AI Valuation 2026: The $65M-Funded Frontier Model Startup Explained", Value Add VC, 2026-06-14 (correction dated 2026-10-06). valueaddvc.com/...startup-raising-at-86b-explained. Accessed 2026-10-27.
35. ^1 ^2Hugging Face, "EssentialAI/rnj-1.5-instruct commit history", Hugging Face, 2026. huggingface.co/...main. Accessed 2026-10-27.
36. ^Essential AI, "EssentialAI organization page (models and datasets)", Hugging Face. huggingface.co/EssentialAI. Accessed 2026-10-27.

Show all 36 references