Inference

See also: Machine learning terms

Introduction

In machine learning, inference refers to the process of using a trained model to make predictions or decisions about new data. The trained model takes in input data and produces output predictions based on its patterns learned from training data. Inference is essential for making a machine learning model into a practical application as it enables the model to be utilized for its intended purposes such as classifying images, creating text, or making recommendations.

Inference can be performed in real-time, where predictions are made as new data becomes available, or batch mode, where predictions are made for a large set of data all at once. Speed and accuracy in inference are crucial factors when applying machine learning models since they directly impact their usability and usefulness in practical applications.

Explain Like I'm 5 (ELI5)

Machine learning models use inference, or making a guess based on what you have learned from examples. Imagine having pictures of animals and wanting to guess which kind is in a new picture that hasn't been seen before; using what you learned from looking at other images, you could use what was known before to make your guess. That's similar to what a machine learning model does - except instead of using your brain, it uses math instead!

Explain Like I'm 5 (ELI5)

Let's pretend you own a toy box with many toys inside, such as cars, dolls and stuffed animals. When you want to play with one of them, you reach inside and grab one out - much like how a machine learning model "infers" or makes an assumption.

The machine learning model has encountered many examples of different things, just as you have in your toy box. When asked to make a prediction about something new, it reaches into its own "mind" to find the ideal toy to play with. Drawing upon all this knowledge from past examples, it makes an educated guess as to what the new thing might be.

Much like you might guess that the new toy is a stuffed animal based on what you've seen before in your toy box, the machine learning model makes predictions based on information it's seen. Just as sometimes you might be wrong and pick out a car instead of a stuffed animal, so too can this model make mistakes and provide incorrect answers. But the more examples it sees and plays with toys more frequently, the better equipped it becomes at making accurate predictions!