Zero shot, one shot and few shot learning

From AI Wiki
Revision as of 14:07, 6 March 2023 by Daikon Radish (talk | contribs)

Zero shot learning is when you have no examples in the prompt. One shot learning is when you have 1 example in the prompt. Few shot learning is when you have a few examples in the prompt. all of these techniques allow the machine learning model to learn with limited or no labeled data.

Zero Shot Learning

Zero-shot learning is when a model is trained to recognize new objects or concepts that it has never seen before. The model is trained on a set of known objects or concepts, and during inference, it is presented with new objects or concepts with no examples. The model uses its knowledge of the known objects or concepts to classify new objects or concepts.

Example

For example, a model trained on images of dogs and cats may be presented with an image of a zebra during inference. Even though the model has never seen a zebra before, it may be able to classify it correctly based on its knowledge of other animals.

One Shot Learning

One-shot learning refers to a scenario where the machine learning model is trained on only one example of each class. The goal is to learn from this single example and generalize to new, unseen examples of the same class. In other words, the model must be able to recognize the class based on a single example and classify new, similar examples accurately.

Example

For example, imagine you want to build a system that can recognize different handwritten digits. In a typical machine learning setup, you would need to provide the model with a large number of examples of each digit, and the model would learn to recognize each digit by finding patterns in the training data. In one-shot learning, however, you might only provide the model with a single example of each digit, and the model would have to learn to recognize new instances of each digit based on that single example.

Few Shot Learning

Few-shot learning is similar to one-shot learning, but it refers to a scenario where the model is trained on a small number of examples, typically between 2 and 20 examples per class. The goal is still to learn from these few examples and generalize to new, unseen examples of the same class.

Example

For example, a model trained on images of different types of fruits can be tested on a new image of a fruit it has never seen before. Using few-shot learning, the model can recognize the new fruit from just a few images.