Multimodal Models

See also: Multimodal and Models

Model	Name	User/Org	Task	Library	Dataset	Language	Paper	Related to	License
Cambridgeltl/SapBERT-from-PubMedBERT-fulltext model	SapBERT-from-PubMedBERT-fulltext	http://cambridgeltl	Feature Extraction	PyTorch TensorFlow JAX Safetensors Transformers		English	2010.11784	BERT Embedding Biomedical Lexical semantics Bionlp Biology Science Entity linking	Apache-2.0
Facebook/bart-large model	bart-large	http://facebook	Feature Extraction	PyTorch TensorFlow JAX Transformers Rust		English	1910.13461	Bart	Apache-2.0
Facebook/dino-vitb16 model	dino-vitb16	http://facebook	Feature Extraction	PyTorch TensorFlow Transformers	Imagenet-1k		2104.14294	Vision Vit Dino	Apache-2.0
Facebook/dino-vits8 model	dino-vits8	http://facebook	Feature Extraction	PyTorch Transformers	Imagenet-1k		2104.14294	Vision Vit Dino	Apache-2.0
Nlpconnect/vit-gpt2-image-captioning model	vit-gpt2-image-captioning	http://nlpconnect	Image-to-Text	PyTorch Transformers				Vision-encoder-decoder Image-captioning	Apache-2.0
Runwayml/stable-diffusion-v1-5 model	stable-diffusion-v1-5	http://runwayml	Text-to-Image	Diffusers			1910.09700 2103.00020 2207.12598 2112.10752 2205.11487	Stable-diffusion Stable-diffusion-diffusers	Creativeml-openrail-m
Sentence-transformers/all-MiniLM-L6-v2 model	all-MiniLM-L6-v2	http://sentence-transformers	Sentence Similarity Feature Extraction	PyTorch TensorFlow Rust Sentence Transformers	S2orc Flax-sentence-embeddings/stackexchange xml Ms marco Gooaq Yahoo answers topics Code search net Search qa Eli5 Snli Multi nli Wikihow Natural questions Trivia qa Embedding-data/sentence-compression Embedding-data/flickr30k-captions Embedding-data/altlex Embedding-data/simple-wiki Embedding-data/QQP Embedding-data/SPECTER Embedding-data/PAQ pairs Embedding-data/WikiAnswers	English	1904.06472 2102.07033 2104.08727 1704.05179 1810.09305	BERT	Apache-2.0
Sentence-transformers/all-mpnet-base-v2 model	all-mpnet-base-v2	http://sentence-transformers	Sentence Similarity Feature Extraction	PyTorch Sentence Transformers	S2orc Flax-sentence-embeddings/stackexchange xml Gooaq Yahoo answers topics Code search net Search qa Eli5 Snli Multi nli Wikihow Natural questions Trivia qa Embedding-data/sentence-compression Embedding-data/flickr30k-captions Embedding-data/altlex Embedding-data/simple-wiki Embedding-data/QQP Embedding-data/SPECTER Embedding-data/PAQ pairs Embedding-data/WikiAnswers MS Marco	English	1904.06472 2102.07033 2104.08727 1704.05179 1810.09305	Mpnet	Apache-2.0