To-Do List: Difference between revisions
No edit summary |
No edit summary |
||
(10 intermediate revisions by 3 users not shown) | |||
Line 2: | Line 2: | ||
'''[[Acronyms]]''' | '''[[Acronyms]]''' | ||
'''[[AI Anxiety]]''' - fear and apprehension about uncertainties that AI could cause such as job loss or destruction of human civilization | |||
'''[[AI Summary Generators]]''' | '''[[AI Summary Generators]]''' | ||
Line 20: | Line 22: | ||
'''[[Attention Is All You Need]]''' (https://arxiv.org/abs/1706.03762) - influential paper that introduced [[Transformer]] | '''[[Attention Is All You Need]]''' (https://arxiv.org/abs/1706.03762) - influential paper that introduced [[Transformer]] | ||
'''[[BERT]]''' | '''[[BERT]]''' | ||
Line 28: | Line 28: | ||
'''[[CLIP]]''' ([[Contrastive Language–Image Pre-training]]) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many [[Text-to-Image Models]] like [[Stable Diffusion]] | '''[[CLIP]]''' ([[Contrastive Language–Image Pre-training]]) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many [[Text-to-Image Models]] like [[Stable Diffusion]] | ||
'''[[Chain of Thought Prompting]]''' - https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html | |||
'''[[CodeGen]]''' - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474 | '''[[CodeGen]]''' - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474 | ||
Line 34: | Line 36: | ||
'''[[Companies]]''' | '''[[Companies]]''' | ||
'''[[Context window]]''' - [[Claude]] from [[Anthropic]] claims to have the context window of 100k [[tokens]] (https://www.anthropic.com/index/100k-context-windows) | |||
'''[[Controversies]]''' | '''[[Controversies]]''' | ||
Line 44: | Line 48: | ||
'''[[Diff Models]]''' - https://carper.ai/diff-models-a-new-way-to-edit-code/ | '''[[Diff Models]]''' - https://carper.ai/diff-models-a-new-way-to-edit-code/ | ||
'''[[DeepMind]]''' - AI company owned by Google | '''[[DeepMind]]''' - AI company owned by Google | ||
Line 59: | Line 61: | ||
'''[[Few shot]]''' | '''[[Few shot]]''' | ||
'''[[Foundation | '''[[Foundation models]]''' | ||
'''[[hallucinations]]''' - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web | '''[[hallucinations]]''' - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web | ||
'''[[inference]]''' | '''[[inference]]''' | ||
'''[[MusicML]]''' - text to music, [[Google]], https://blog.google/technology/ai/musiclm-google-ai-test-kitchen/ | |||
'''[[Jailbreaking]]''' - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043 | '''[[Jailbreaking]]''' - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043 | ||
Line 70: | Line 74: | ||
'''[[LAION]]''' - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research | '''[[LAION]]''' - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research | ||
'''[[Language model]]''' | '''[[Language model]]''' | ||
Line 78: | Line 80: | ||
'''[[Machine learning terms]] | '''[[Machine learning terms]] | ||
'''[[One shot]]''' | '''[[One shot]]''' | ||
Line 90: | Line 90: | ||
'''[[privacy]]''' - relating to AI and training of models | '''[[privacy]]''' - relating to AI and training of models | ||
'''[[Prompt extraction]]''' | '''[[Prompt extraction]]''' | ||
Line 102: | Line 100: | ||
'''[[RLHF]]''' - [[Reinforcement Learning from Human Feedback]] - https://huggingface.co/blog/rlhf | '''[[RLHF]]''' - [[Reinforcement Learning from Human Feedback]] - https://huggingface.co/blog/rlhf | ||
'''[[Text-to-3D]]''' | '''[[Text-to-3D]]''' | ||
Line 113: | Line 109: | ||
'''[[Text-to-video]]''' | '''[[Text-to-video]]''' | ||
'''[[ | '''[[The Pile]]''' - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027 | ||
'''[[ | '''[[Transformer]]''' - https://news.ycombinator.com/item?id=34566275 | ||
'''[[ | '''[[ViT]]''' - [[Vision Transformer]] - https://arxiv.org/abs/2010.11929 |
Latest revision as of 09:53, 14 May 2023
- See also: Machine learning terms
AI Anxiety - fear and apprehension about uncertainties that AI could cause such as job loss or destruction of human civilization
Alignment / Alignment problem / Control problem - steer AGI towards the goals of humans. Prevent AGI from destroying the world - https://www.reddit.com/r/ControlProblem/wiki/faq
AlphaGo - https://www.deepmind.com/research/highlighted-research/alphago - Go playing AI from DeepMind
Anthropic AI - AI research company from former OpenAI employees. 300 million from Google
Artificial general intelligence
Attention Is All You Need (https://arxiv.org/abs/1706.03762) - influential paper that introduced Transformer
Claude - Chatbot from Anthropic
CLIP (Contrastive Language–Image Pre-training) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many Text-to-Image Models like Stable Diffusion
Chain of Thought Prompting - https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html
CodeGen - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474
Common Crawl - open repository of web crawl data
Context window - Claude from Anthropic claims to have the context window of 100k tokens (https://www.anthropic.com/index/100k-context-windows)
D-ID - https://www.d-id.com/- AI animation
Diff Models - https://carper.ai/diff-models-a-new-way-to-edit-code/
DeepMind - AI company owned by Google
DeepMind Sparrow - chatbot / text generator
EleutherAI - https://www.eleuther.ai/, https://github.com/EleutherAI, https://huggingface.co/EleutherAI
hallucinations - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web
MusicML - text to music, Google, https://blog.google/technology/ai/musiclm-google-ai-test-kitchen/
Jailbreaking - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043
Jasper - Content (Text) generation
LAION - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research
Prime Voice AI by Eleven Labs (https://beta.elevenlabs.io/) - realistic voices
privacy - relating to AI and training of models
replicate - use open-source models with a Cloud API, https://replicate.com/
RLHF - Reinforcement Learning from Human Feedback - https://huggingface.co/blog/rlhf
The Pile - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027