To-Do List
- See also: Machine learning terms
AI Anxiety - fear and apprehension about uncertainties that AI could cause such as job loss or destruction of human civilization
Alignment / Alignment problem / Control problem - steer AGI towards the goals of humans. Prevent AGI from destroying the world - https://www.reddit.com/r/ControlProblem/wiki/faq
AlphaGenome - https://deepmind.google/discover/blog/alphagenome-ai-for-better-understanding-the-genome/
AlphaGo - https://www.deepmind.com/research/highlighted-research/alphago - Go playing AI from DeepMind
Anthropic AI - AI research company from former OpenAI employees. 300 million from Google
Artificial general intelligence
Attention Is All You Need (https://arxiv.org/abs/1706.03762) - influential paper that introduced Transformer
Claude - Chatbot from Anthropic
CLIP (Contrastive Language–Image Pre-training) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many Text-to-Image Models like Stable Diffusion
Chain of Thought Prompting (CoT) - https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html
CodeGen - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474
Common Crawl - open repository of web crawl data
Context window - Claude from Anthropic claims to have the context window of 100k tokens (https://www.anthropic.com/index/100k-context-windows)
D-ID - https://www.d-id.com/- AI animation
Diff Models - https://carper.ai/diff-models-a-new-way-to-edit-code/
Diffusion LLMs - Gemini Diffusion
DeepMind - AI company owned by Google
DeepMind Sparrow - chatbot / text generator
Edge AI - https://ai.google.dev/edge
EleutherAI - https://www.eleuther.ai/, https://github.com/EleutherAI, https://huggingface.co/EleutherAI
hallucinations - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web
Mixture of Experts (MoE) -
MusicML - text to music, Google, https://blog.google/technology/ai/musiclm-google-ai-test-kitchen/
Jailbreaking - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043
Jasper - Content (Text) generation
LAION - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research
Long-Horizon Reinforcement Learning
Platonic Representation Hypothesis (PRH) - models are converging to a shared representation space, and this is becoming more true as we make models bigger and smarter. - https://blog.jxmo.io/p/there-is-only-one-model
Prime Voice AI by Eleven Labs (https://beta.elevenlabs.io/) - realistic voices
privacy - relating to AI and training of models
replicate - use open-source models with a Cloud API, https://replicate.com/
RLHF - Reinforcement Learning from Human Feedback - https://huggingface.co/blog/rlhf
The Pile - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027
Transformer - https://news.ycombinator.com/item?id=34566275
ViT - Vision Transformer - https://arxiv.org/abs/2010.11929
World Models - https://www.worldmodelworkshop.org/
YaRN - Yet another RoPE extensioN method