Category

Natural Language Processing

226 articlesRSS

Showing 121-180 of 226 articles

Meta Prompting

Meta prompting (also spelled meta-prompting) is an advanced prompt engineering technique where large language models (LLMs) are used to generate, refine,...

Artificial IntelligenceMachine Learning

Mike Lewis

Mike Lewis is a British natural language processing researcher based in Seattle who serves as a research scientist at Meta AI (Facebook AI Research, FAIR) and...

Meta AIPeople

Multimodal Model

A multimodal model is an artificial intelligence system that processes, relates, and generates information across two or more types of data, or modalities,...

Computer VisionDeep Learning

N-gram

An n-gram is a contiguous sequence of n items extracted from a given sample of text or speech, where the items can be characters, syllables, words, or other...

Machine Learning

NLU

Natural Language Understanding (NLU) is the subfield of artificial intelligence and natural language processing that turns unstructured human language into...

Artificial Intelligence

Named entity recognition

Named entity recognition (NER) is the natural language processing task of locating spans of text that name real-world things, such as people, organizations,...

Machine Learning

Natural Language Understanding

Natural language understanding (NLU) is the branch of artificial intelligence and computational linguistics that enables machines to read human language and...

Machine Learning

Natural language inference (NLI)

Natural language inference (NLI), also known as recognising textual entailment (RTE), is the natural language processing task of deciding whether a hypothesis...

AI BenchmarksReasoning Models

Natural language processing

Natural language processing (NLP) is the branch of artificial intelligence that enables computers to read, understand, generate, and respond to human language...

Artificial IntelligenceMachine Learning

Nemotron-CC

Nemotron-CC is a large-scale, open English-language pretraining dataset for large language models released by NVIDIA in December 2024. The corpus contains...

Data & DatasetsNVIDIA

No Language Left Behind (NLLB)

No Language Left Behind (NLLB) is a machine translation research project and model family from Meta AI, announced in July 2022. Its flagship system, NLLB-200,...

Meta AIOpen Source AI

OCR Models

OCR Models are artificial intelligence (AI) systems that convert images of typed, handwritten, or printed text into machine-readable digital text through...

Artificial IntelligenceComputer Vision

OPUS-MT

OPUS-MT is a large collection of open, freely licensed neural machine translation models and tools produced by the Language Technology Research Group at the...

Large Language Models

PIQA

PIQA (Physical Interaction Question Answering) is a benchmark dataset of roughly 21,000 binary multiple-choice questions that evaluates the physical...

AI Benchmarks

PaLM

PaLM (Pathways Language Model) is a family of large language models developed by Google Research. The original PaLM, announced on April 4, 2022, was a...

Google DeepMindLarge Language Models

Perplexity

Perplexity has two distinct meanings in the field of artificial intelligence. In natural language processing and information theory, perplexity (often...

Machine LearningMathematics

Pleias

Pleias (stylized PleIAs) is a Paris based artificial intelligence laboratory and small company that designs, pretrains, and releases large language models...

AI CompaniesOpen Source AI

Positional encoding

Positional encoding is a technique used to inject information about token order into transformer models. Because transformers process all tokens in a sequence...

Deep LearningTransformer Models

Post-training

Post-training is the stage of large language model (LLM) development that comes after pre-training and turns a raw, general-purpose base model into an aligned,...

Artificial IntelligenceDeep Learning

Pre-Trained Model

A pre-trained model is a machine learning model that has already been trained on a large, general-purpose dataset and can then be reused, either as a fixed...

Deep LearningMachine Learning

Pre-training

Pre-training is the first and most compute-intensive stage of building a modern AI model: a neural network is trained on a massive, mostly unlabeled dataset...

Artificial IntelligenceComputer Vision

Prompt Engineering

Prompt engineering is the practice of designing, structuring, and refining the text inputs (prompts) given to a generative AI model so that it produces a...

Large Language ModelsMachine Learning

PubMedQA

PubMedQA is a biomedical question answering dataset and benchmark that evaluates whether machine learning models can answer yes/no/maybe research questions...

AI BenchmarksHealthcare AI

Question Answering Models

See also: Natural Language Processing Models and Tasks Question answering (QA) models are natural language processing systems that take a natural-language...

AI Models

Question answering

Question answering (QA) is a subfield of natural language processing and information retrieval in which a computer system automatically produces a direct...

Information RetrievalMachine Learning

QuillBot

QuillBot is an artificial intelligence-powered writing platform, founded in 2017, whose AI paraphrasing tool is its flagship product alongside a grammar...

AI CompaniesAI Tools & Products

Qwen

Qwen is a family of open-source and proprietary large language models (LLMs) and multimodal models developed by Alibaba Cloud, the cloud computing division of...

Chinese AILarge Language Models

ROUGE

ROUGE (Recall-Oriented Understudy for Gisting Evaluation) is a set of automatic metrics that score the quality of a machine-generated text summary by counting...

Machine LearningModel Evaluation

RedPajama

RedPajama is a family of large-scale, openly licensed datasets for training large language models (LLMs), created by Together AI with academic and open-source...

Data & DatasetsMachine Learning

Reinforcement Learning from Human Feedback (RLHF)

Reinforcement Learning from Human Feedback (RLHF) is a machine learning technique that trains artificial intelligence systems to behave according to human...

AI AlignmentDeep Learning

Reporting Bias

Reporting bias is a type of data bias in machine learning that occurs when the frequency of events, properties, or outcomes captured in a dataset does not...

AI EthicsData & Datasets

Reranker

A reranker (also called a cross-encoder reranker or rerank model) is a neural model used in retrieval augmented generation and information retrieval pipelines...

Information Retrieval

Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) is a technique in natural language processing that augments a generative model with an information-retrieval component, so...

Large Language ModelsMachine Learning

RoBERTa

RoBERTa (Robustly Optimized BERT Pretraining Approach) is an open-source natural language processing model released in July 2019 by researchers at Facebook AI...

Deep LearningMachine Learning

SEDD (Score Entropy Discrete Diffusion)

Score Entropy Discrete Diffusion (SEDD) is a discrete diffusion model for language and other discrete data introduced by Aaron Lou, Chenlin Meng, and Stefano...

Diffusion Models

SPLADE

SPLADE (Sparse Lexical and Expansion model) is a learned sparse retrieval model that encodes a query or document as a weighted, vocabulary-sized sparse vector...

Information Retrieval

SQuAD

SQuAD (the Stanford Question Answering Dataset) is a large-scale reading comprehension benchmark from Stanford University in which a model must answer a...

AI Benchmarks

SciBERT

SciBERT is a BERT-based language model pretrained from scratch on a large corpus of scientific papers, built by the Allen Institute for AI (AI2). It was...

AI ModelsLarge Language Models

SeamlessM4T

SeamlessM4T (short for Massively Multilingual and Multimodal Machine Translation) is a machine translation model released by Meta AI on August 22, 2023. It was...

Meta AISpeech & Audio AI

Semantic Scholar

Semantic Scholar is a free, AI-powered academic search engine and open research-data platform built by the Allen Institute for AI (AI2, also styled Ai2), the...

AI Tools & ProductsInformation Retrieval

Semantic chunking

Semantic chunking is a family of document-segmentation strategies for retrieval augmented generation pipelines that places chunk boundaries based on similarity...

Information Retrieval

Semantic search

Semantic search is an information retrieval approach that finds results based on the meaning and intent behind a query rather than relying solely on exact...

Machine Learning

Sentence Similarity Models

Sentence similarity models are machine learning systems that map natural language sentences to fixed-length numerical vectors (sentence embeddings) so that...

AI Models

Sentence-BERT (SBERT)

Sentence-BERT (SBERT) is a modification of the pretrained BERT transformer network that produces semantically meaningful, fixed-size sentence embeddings...

AI Models

Sentence-transformers/all-MiniLM-L6-v2 model

Sentence-transformers/all-MiniLM-L6-v2 model Hugging Face sentence-transformers/all-MiniLM-L6-v2 Name all-MiniLM-L6-v2 User / Organization...

AI ModelsOpen Source AI

Sentence-transformers/all-mpnet-base-v2 model

Hugging Face sentence-transformers/all-mpnet-base-v2 Name all-mpnet-base-v2 User / Organization sentence-transformers Type Natural Language Processing Task...

AI ModelsOpen Source AI

SentencePiece

SentencePiece is an open-source, language-agnostic subword tokenization library and detokenizer developed at Google and introduced by Taku Kudo and John...

Machine LearningOpen Source AI

Sentiment Analysis

Sentiment analysis, also called opinion mining or emotion AI, is the use of natural language processing to automatically determine the sentiment, emotion, or...

Machine Learning

Sequence Model

A sequence model is a class of machine learning models that processes, generates, or predicts ordered data where the position and surrounding context of each...

Deep LearningMachine Learning

Sequence-to-Sequence Task

See also: Machine learning terms, Natural language processing, Recurrent neural network A sequence-to-sequence (seq2seq) task is any machine learning problem...

Deep LearningMachine Learning

Similarity Measure

A similarity measure (also called a similarity function or similarity metric) is a real-valued function that quantifies the degree of resemblance between two...

Information RetrievalMachine Learning

SimpleBench

SimpleBench is a text-only benchmark for large language models created by Philip, the host of the AI Explained YouTube channel, with collaborator Hemang. It...

AI BenchmarksArtificial Intelligence

SimpleQA

SimpleQA is a factuality benchmark released by OpenAI on October 30, 2024 that measures whether large language models can answer short, fact-seeking questions...

AI BenchmarksAI Safety

Speech recognition

Speech recognition, also known as automatic speech recognition (ASR), is the technology that converts spoken language into written text. It sits at the...

Deep LearningMachine Learning

Structured output

Structured output is a set of techniques and API features that constrain a large language model (LLM) to emit responses that exactly conform to a predefined...

Artificial IntelligenceDeveloper Tools

Summarization Models

Summarization models are natural language processing systems that condense a source document, set of documents, or dialogue into a shorter version that...

AI Models

SuperGLUE

SuperGLUE is a public benchmark for evaluating general-purpose English language understanding in machine learning systems, consisting of eight challenging...

AI BenchmarksData & Datasets

Supervised fine-tuning

Supervised fine-tuning (SFT) is the process of further training a pre-trained large language model (LLM) on a smaller, labeled dataset of input-output pairs so...

Artificial IntelligenceDeep Learning

TF-IDF (Term Frequency-Inverse Document Frequency)

TF-IDF (term frequency-inverse document frequency) is a numerical statistic that measures how important a word is to a single document within a larger...

AlgorithmsInformation Retrieval

Table Question Answering Models

Table question answering models (TableQA models) are machine learning systems that answer natural language questions over structured tabular data such as...

AI Models