DistilBERT
DistilBERT is a compressed version of BERT released by Hugging Face in August 2019 (with an accompanying paper in October 2019) that is 40% smaller and 60% faster than BERT-base while retaining 97% of its…
Explore Transformer Models through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Transformer Models.
Showing 1-3 of 3 articles
DistilBERT is a compressed version of BERT released by Hugging Face in August 2019 (with an accompanying paper in October 2019) that is 40% smaller and 60% faster than BERT-base while retaining 97% of its…
Hy4 Preview is an open-weight large language model released by the Tencent Hy Team on August 28, 2026.
Qwen3.8-Flash-Next is an experimental open-weight multimodal large language model released by Alibaba Group's Qwen team on August 26, 2026.