To-Do List: Difference between revisions

From AI Wiki
No edit summary
No edit summary
 
(14 intermediate revisions by 3 users not shown)
Line 2: Line 2:


'''[[Acronyms]]'''
'''[[Acronyms]]'''
'''[[AI Anxiety]]''' - fear and apprehension about uncertainties that AI could cause such as job loss or destruction of human civilization


'''[[AI Summary Generators]]'''
'''[[AI Summary Generators]]'''
Line 20: Line 22:


'''[[Attention Is All You Need]]''' (https://arxiv.org/abs/1706.03762) - influential paper that introduced [[Transformer]]
'''[[Attention Is All You Need]]''' (https://arxiv.org/abs/1706.03762) - influential paper that introduced [[Transformer]]
'''[[Bard]]''' - powered by [[LaMDA]], [[ChatGPT]] competitor from [[Google]]


'''[[BERT]]'''
'''[[BERT]]'''
Line 28: Line 28:


'''[[CLIP]]''' ([[Contrastive Language–Image Pre-training]]) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many [[Text-to-Image Models]] like [[Stable Diffusion]]
'''[[CLIP]]''' ([[Contrastive Language–Image Pre-training]]) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many [[Text-to-Image Models]] like [[Stable Diffusion]]
'''[[Chain of Thought Prompting]]''' - https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html


'''[[CodeGen]]''' - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474
'''[[CodeGen]]''' - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474
'''[[Common Crawl]]''' - open repository of web crawl data


'''[[Companies]]'''
'''[[Companies]]'''
'''[[Context window]]''' - [[Claude]] from [[Anthropic]] claims to have the context window of 100k [[tokens]] (https://www.anthropic.com/index/100k-context-windows)


'''[[Controversies]]'''
'''[[Controversies]]'''
Line 42: Line 48:


'''[[Diff Models]]''' - https://carper.ai/diff-models-a-new-way-to-edit-code/
'''[[Diff Models]]''' - https://carper.ai/diff-models-a-new-way-to-edit-code/
'''[[Diffusion model]]'''


'''[[DeepMind]]''' - AI company owned by Google
'''[[DeepMind]]''' - AI company owned by Google
Line 57: Line 61:
'''[[Few shot]]'''
'''[[Few shot]]'''


'''[[Foundation Models]]'''
'''[[Foundation models]]'''


'''[[hallucinations]]''' = nonsensical answers to factual questions from large language models
'''[[hallucinations]]''' - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web


'''[[inference]]'''
'''[[inference]]'''
'''[[MusicML]]''' - text to music, [[Google]], https://blog.google/technology/ai/musiclm-google-ai-test-kitchen/


'''[[Jailbreaking]]''' - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043
'''[[Jailbreaking]]''' - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043
Line 68: Line 74:


'''[[LAION]]''' - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research
'''[[LAION]]''' - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research
'''[[LaMDA]]'''


'''[[Language model]]'''
'''[[Language model]]'''
Line 86: Line 90:


'''[[privacy]]''' - relating to AI and training of models
'''[[privacy]]''' - relating to AI and training of models
'''[[Prompt engineering]]'''


'''[[Prompt extraction]]'''
'''[[Prompt extraction]]'''
Line 98: Line 100:


'''[[RLHF]]''' - [[Reinforcement Learning from Human Feedback]] - https://huggingface.co/blog/rlhf
'''[[RLHF]]''' - [[Reinforcement Learning from Human Feedback]] - https://huggingface.co/blog/rlhf
'''[[Transformer]]''' - https://news.ycombinator.com/item?id=34566275


'''[[Text-to-3D]]'''
'''[[Text-to-3D]]'''
Line 109: Line 109:
'''[[Text-to-video]]'''
'''[[Text-to-video]]'''


'''[[ViT]]''' - [[Vision Transformer]] - https://arxiv.org/abs/2010.11929
'''[[The Pile]]''' - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027


'''[[The Pile]]''' - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027
'''[[Transformer]]''' - https://news.ycombinator.com/item?id=34566275


'''[[Unstable Diffusion]]'''
'''[[ViT]]''' - [[Vision Transformer]] - https://arxiv.org/abs/2010.11929

Latest revision as of 09:53, 14 May 2023

See also: Machine learning terms


Acronyms

AI Anxiety - fear and apprehension about uncertainties that AI could cause such as job loss or destruction of human civilization

AI Summary Generators

Alignment / Alignment problem / Control problem - steer AGI towards the goals of humans. Prevent AGI from destroying the world - https://www.reddit.com/r/ControlProblem/wiki/faq

AlphaGo - https://www.deepmind.com/research/highlighted-research/alphago - Go playing AI from DeepMind

AlphaZero

Anthropic AI - AI research company from former OpenAI employees. 300 million from Google

Applications

Art

Artificial general intelligence

Attention Is All You Need (https://arxiv.org/abs/1706.03762) - influential paper that introduced Transformer

BERT

Claude - Chatbot from Anthropic

CLIP (Contrastive Language–Image Pre-training) - https://arxiv.org/abs/2103.00020, https://openai.com/blog/clip/ - encode images and text into representations that can be compared in the same space. basis for many Text-to-Image Models like Stable Diffusion

Chain of Thought Prompting - https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html

CodeGen - https://github.com/salesforce/CodeGen, https://arxiv.org/abs/2203.13474

Common Crawl - open repository of web crawl data

Companies

Context window - Claude from Anthropic claims to have the context window of 100k tokens (https://www.anthropic.com/index/100k-context-windows)

Controversies

CUDA

Dev tools

D-ID - https://www.d-id.com/- AI animation

Diff Models - https://carper.ai/diff-models-a-new-way-to-edit-code/

DeepMind - AI company owned by Google

DeepMind Sparrow - chatbot / text generator

DreamStudio - Stability AI

Ethics

EleutherAI - https://www.eleuther.ai/, https://github.com/EleutherAI, https://huggingface.co/EleutherAI

Few shot

Foundation models

hallucinations - nonsensical answers to factual questions from large language models - https://en.wikipedia.org/wiki/Hallucination_(artificial_intelligence), https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web

inference

MusicML - text to music, Google, https://blog.google/technology/ai/musiclm-google-ai-test-kitchen/

Jailbreaking - jailbreaking AI models: https://news.ycombinator.com/item?id=34676043

Jasper - Content (Text) generation

LAION - https://laion.ai/ - non-profit organization, provides datasets, tools and models to liberate machine learning research

Language model

Large language models (LLMs)

Machine learning terms

One shot

Organizations

Papers

Prime Voice AI by Eleven Labs (https://beta.elevenlabs.io/) - realistic voices

privacy - relating to AI and training of models

Prompt extraction

Prompt injection

PyTorch

replicate - use open-source models with a Cloud API, https://replicate.com/

RLHF - Reinforcement Learning from Human Feedback - https://huggingface.co/blog/rlhf

Text-to-3D

Text-to-audio

Text-to-image

Text-to-video

The Pile - https://pile.eleuther.ai/, https://arxiv.org/abs/2101.00027

Transformer - https://news.ycombinator.com/item?id=34566275

ViT - Vision Transformer - https://arxiv.org/abs/2010.11929