Interface administrators, Administrators (Semantic MediaWiki), Curators (Semantic MediaWiki), Editors (Semantic MediaWiki), Suppressors, Administrators
7,785
edits
Batch size: Difference between revisions
no edit summary
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
==Introduction== | ==Introduction== | ||
[[Machine learning]] relies on a [[hyperparameter]] called [[batch size]] which indicates how many [[examples]] should be run before changing internal model parameters. This number can vary based on both machine memory capacity and the needs of each model and dataset. | [[Machine learning]] relies on a [[hyperparameter]] called [[batch size]] which indicates how many [[examples]] should be run before changing internal model parameters. It is the number of examples in a [[batch]]. This number can vary based on both machine memory capacity and the needs of each model and dataset. | ||
==Example== | |||
If the batch size is 50, then the model processes 50 examples per iteration. If the batch size is 200, then the model processes 200 examples per iteration. | |||
==Batch Size and Gradient Descent== | ==Batch Size and Gradient Descent== | ||