Natural Language Processing Models

From AI Wiki
Revision as of 19:44, 2 February 2023 by Alpha5 (talk | contribs)
See also: Natural Language Processing and Models
ModelHF NameCreatorTaskLibraryDatasetLanguagePaperRelated toLicense
Albert-base-v2 modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
Wikipedia
Bookcorpus
English1909.11942Apache-2.0
Allenai/longformer-base-4096 modelPyTorch
TensorFlow
Transformers
Rust
English2004.05150Apache-2.0
Allenai/scibert scivocab uncased modelPyTorch
JAX
Transformers
English
Bert-base-cased modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Wikipedia
Bookcorpus
English1810.04805Apache-2.0
Bert-base-chinese modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Chinese1810.04805
Bert-base-multilingual-cased modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Wikipedia104 languages1810.04805Apache-2.0
Bert-base-uncased modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
Core ML
Wikipedia
Bookcorpus
English1810.04805Apache-2.0
Bigcode/santacoder modelText GenerationPyTorch
Transformers
Bigcode/the-stackCode1911.02150
2207.14255
2301.03988
Bigcode-openrail-m
Bigscience/bloom-560m modelText GenerationPyTorch
JAX
Safetensors
Transformers
48 languages1909.08053
2110.02861
2108.12409
Bigscience-bloom-rail-1.0
Camembert-base modelFill-MaskPyTorch
TensorFlow
Safetensors
Transformers
OscarFrench1911.03894Mit
Cardiffnlp/twitter-roberta-base-sentiment modelText ClassificationPyTorch
TensorFlow
JAX
Transformers
Tweet evalEnglish2010.12421
Cardiffnlp/twitter-roberta-base-sentiment-latest modelText ClassificationPyTorch
TensorFlow
Transformers
Tweet evalEnglish2202.03829
Deepset/roberta-base-squad2 modelQuestion AnsweringPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
Squad v2EnglishCc-by-4.0
Deepset/sentence bert modelPyTorch
JAX
Transformers
Apache-2.0
Distilbert-base-multilingual-cased modelFill-MaskPyTorch
TensorFlow
Safetensors
Transformers
ONNX
Wikipedia104 languages1910.09700
1910.01108
Apache-2.0
Distilbert-base-uncased modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
Wikipedia
Bookcorpus
English1910.01108Apache-2.0
Distilbert-base-uncased-finetuned-sst-2-english modelText ClassificationPyTorch
TensorFlow
Safetensors
Transformers
Rust
Sst2
Glue
English1910.01108Apache-2.0
Distilgpt2 modelText GenerationPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
TF Lite
Core ML
OpenwebtextEnglish1910.09700
1910.01108
2201.08542
2203.12574
1503.02531
Apache-2.0
Distilroberta-base modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
OpenwebtextEnglish1910.09700
1910.01108
Apache-2.0
Dslim/bert-base-NER modelToken ClassificationPyTorch
TensorFlow
JAX
Safetensors
Transformers
Conll2003English1810.04805Mit
Facebook/bart-large-cnn modelText2Text Generation
Summarization
PyTorch
TensorFlow
JAX
Transformers
Rust
Cnn dailymailEnglish1910.13461Mit
Facebook/bart-large-mnli modelText Classification
Zero-Shot Classification
PyTorch
JAX
Safetensors
Transformers
Rust
Multi nli1910.13461
1909.00161
Mit
Google/bert uncased L-2 H-128 A-2 modelPyTorch
JAX
Transformers
1908.08962Apache-2.0
Google/electra-base-discriminator modelPyTorch
TensorFlow
JAX
Transformers
Rust
EnglishApache-2.0
Gpt2 modelText GenerationPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
TF Lite
EnglishMit
Gpt2-large modelText GenerationPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
English1910.09700Mit
Helsinki-NLP/opus-mt-en-es modelText2Text Generation
Translation
PyTorch
TensorFlow
JAX
Transformers
English
Spanish
Apache-2.0
Lengyue233/content-vec-best modelPyTorch
Transformers
Mit
Microsoft/deberta-base modelFill-MaskPyTorch
TensorFlow
Transformers
Rust
English2006.03654Mit
Microsoft/layoutlm-base-uncased modelPyTorch
TensorFlow
Transformers
1912.13318
Microsoft/layoutlmv3-base modelPyTorch
TensorFlow
Transformers
ONNX
English2204.08387Cc-by-nc-sa-4.0
Prajjwal1/bert-tiny modelPyTorch
Transformers
English1908.08962
2110.01518
Mit
Roberta-base modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
Wikipedia
Bookcorpus
English1907.11692
1806.02847
Mit
Roberta-large modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
ONNX
Wikipedia
Bookcorpus
English1907.11692
1806.02847
Mit
SZTAKI-HLT/hubert-base-cc modelPyTorch
TensorFlow
JAX
Transformers
Wikipedia
Common crawl
HungarianApache-2.0
Sentence-transformers/all-MiniLM-L6-v2 modelSentence Similarity
Feature Extraction
PyTorch
TensorFlow
Rust
Sentence Transformers
S2orc
Flax-sentence-embeddings/stackexchange xml
Ms marco
Gooaq
Yahoo answers topics
Code search net
Search qa
Eli5
Snli
Multi nli
Wikihow
Natural questions
Trivia qa
Embedding-data/sentence-compression
Embedding-data/flickr30k-captions
Embedding-data/altlex
Embedding-data/simple-wiki
Embedding-data/QQP
Embedding-data/SPECTER
Embedding-data/PAQ pairs
Embedding-data/WikiAnswers
English1904.06472
2102.07033
2104.08727
1704.05179
1810.09305
Apache-2.0
Sentence-transformers/all-mpnet-base-v2 modelSentence Similarity
Feature Extraction
PyTorch
Sentence Transformers
S2orc
Flax-sentence-embeddings/stackexchange xml
Gooaq
Yahoo answers topics
Code search net
Search qa
Eli5
Snli
Multi nli
Wikihow
Natural questions
Trivia qa
Embedding-data/sentence-compression
Embedding-data/flickr30k-captions
Embedding-data/altlex
Embedding-data/simple-wiki
Embedding-data/QQP
Embedding-data/SPECTER
Embedding-data/PAQ pairs
Embedding-data/WikiAnswers
MS Marco
English1904.06472
2102.07033
2104.08727
1704.05179
1810.09305
Apache-2.0
T5-base modelText2Text Generation
Translation
Summarization
PyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
C44 languages1805.12471
1708.00055
1704.05426
1606.05250
1808.09121
1810.12885
1905.10044
1910.09700
Apache-2.0
T5-small modelText2Text Generation
Translation
Summarization
PyTorch
TensorFlow
JAX
Safetensors
Transformers
Rust
C45 languages1805.12471
1708.00055
1704.05426
1606.05250
1808.09121
1810.12885
1905.10044
1910.09700
Apache-2.0
Xlm-roberta-base modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
ONNX
94 languages1911.02116Mit
Xlm-roberta-large modelFill-MaskPyTorch
TensorFlow
JAX
Safetensors
Transformers
ONNX
94 languages1911.02116Mit