Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2204.02311

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 41.2M • • 3.38k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 15.6M • 4.19k

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Paper • 2006.03654 • Published Jun 5, 2020 • 3
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21

Running

3.31k

AnyCoder

🏆

3.31k

Generate code snippets with AI for web and app frameworks
Running

Agents

Featured

274

Qwen2.5 Coder Artifacts

🐢

274

Generate and preview code from your app description
Paused

Agents

Featured

921

QwQ-32B-Preview

🔍

921

QwQ-32B-Preview
Running on CPU Upgrade

14.1k

Open LLM Leaderboard

🏆

14.1k

Track, rank and evaluate open LLMs and chatbots

Fundamentals NLP

Distributed Representations of Sentences and Documents

Paper • 1405.4053 • Published May 16, 2014
Sequence to Sequence Learning with Neural Networks

Paper • 1409.3215 • Published Sep 10, 2014 • 5
PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3
Recent Trends in Deep Learning Based Natural Language Processing

Paper • 1708.02709 • Published Aug 9, 2017

#MustRead Papers

Signature papers in AI/ML with focus on generative AI or large language models that bring unique perspectives and/or are highly cited by peers

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Paper • 2201.11903 • Published Jan 28, 2022 • 16
Orca 2: Teaching Small Language Models How to Reason

Paper • 2311.11045 • Published Nov 18, 2023 • 77

A collection of arXiv papers from Chip Huyen's AI Engineering organized by chapter and ordered by when each appears in the book.

Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning

Paper • 2211.04325 • Published Oct 26, 2022 • 1
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
On the Opportunities and Risks of Foundation Models

Paper • 2108.07258 • Published Aug 16, 2021 • 2
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Paper • 2204.07705 • Published Apr 16, 2022 • 2

PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3
meta-llama/Llama-2-13b

Text Generation • Updated Apr 17, 2024 • 13 • 353
deepseek-ai/DeepSeek-V3-0324

Text Generation • 685B • Updated Mar 27, 2025 • 1.4M • • 3.18k
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 810k • • 3.08k

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Paper • 1910.01108 • Published Oct 2, 2019 • 24
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Paper • 1910.01108 • Published Oct 2, 2019 • 24

PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 41.2M • • 3.38k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 15.6M • 4.19k

A collection of arXiv papers from Chip Huyen's AI Engineering organized by chapter and ordered by when each appears in the book.

Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning

Paper • 2211.04325 • Published Oct 26, 2022 • 1
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
On the Opportunities and Risks of Foundation Models

Paper • 2108.07258 • Published Aug 16, 2021 • 2
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Paper • 2204.07705 • Published Apr 16, 2022 • 2

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Paper • 2006.03654 • Published Jun 5, 2020 • 3
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21

PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3
meta-llama/Llama-2-13b

Text Generation • Updated Apr 17, 2024 • 13 • 353
deepseek-ai/DeepSeek-V3-0324

Text Generation • 685B • Updated Mar 27, 2025 • 1.4M • • 3.18k
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 810k • • 3.08k

Running

3.31k

AnyCoder

🏆

3.31k

Generate code snippets with AI for web and app frameworks
Running

Agents

Featured

274

Qwen2.5 Coder Artifacts

🐢

274

Generate and preview code from your app description
Paused

Agents

Featured

921

QwQ-32B-Preview

🔍

921

QwQ-32B-Preview
Running on CPU Upgrade

14.1k

Open LLM Leaderboard

🏆

14.1k

Track, rank and evaluate open LLMs and chatbots

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Paper • 1910.01108 • Published Oct 2, 2019 • 24
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21

Fundamentals NLP

Distributed Representations of Sentences and Documents

Paper • 1405.4053 • Published May 16, 2014
Sequence to Sequence Learning with Neural Networks

Paper • 1409.3215 • Published Sep 10, 2014 • 5
PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3
Recent Trends in Deep Learning Based Natural Language Processing

Paper • 1708.02709 • Published Aug 9, 2017

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 33
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Paper • 1910.01108 • Published Oct 2, 2019 • 24

#MustRead Papers

Signature papers in AI/ML with focus on generative AI or large language models that bring unique perspectives and/or are highly cited by peers

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 144
Language Models are Few-Shot Learners

Paper • 2005.14165 • Published May 28, 2020 • 21
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Paper • 2201.11903 • Published Jan 28, 2022 • 16
Orca 2: Teaching Small Language Models How to Reason

Paper • 2311.11045 • Published Nov 18, 2023 • 77

PaLM: Scaling Language Modeling with Pathways

Paper • 2204.02311 • Published Apr 5, 2022 • 3

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs