Hyperparameter optimization: Difference between revisions
From Rice Wiki
(Created page with "Category:Machine Learning Aspects of an ML model is controlled by hyperparameters. '''Hyperparameter optimization''' is an iterative process that attempts to find the best hyperparameters for a given model. = Grid search = '''Grid search''' (aka. grid search cross validation) computes all possible combinations of hyperparameters based on your input (possible values for each hyperparameter). The model is then trained and validated, and the best performance resul...") |
|||
| Line 8: | Line 8: | ||
= Other techniques = | = Other techniques = | ||
Other techniques include | Other techniques include | ||
* Random search | * Random search: faster but no guarantee | ||
* Bayesian optimizaiton | * Bayesian optimizaiton | ||
* Hyperband | * Hyperband | ||
Latest revision as of 21:06, 18 May 2024
Aspects of an ML model is controlled by hyperparameters. Hyperparameter optimization is an iterative process that attempts to find the best hyperparameters for a given model.
Grid search
Grid search (aka. grid search cross validation) computes all possible combinations of hyperparameters based on your input (possible values for each hyperparameter). The model is then trained and validated, and the best performance result is taken.
Other techniques
Other techniques include
- Random search: faster but no guarantee
- Bayesian optimizaiton
- Hyperband
