Learning rate

The learning rate is a hyperparameter in machine learning algorithms that controls the step size at each iteration while moving toward a minimum of a loss function. It plays a critical role in model training by influencing the speed and quality of convergence.

Read More →

Score-based generative model

A score-based generative model is a type of probabilistic model that generates data by estimating the gradient of the data distribution’s log-density, known as the score function. These models employ techniques from stochastic differential equations and denoising score matching to synthesize high-quality samples, especially in image generation.

Read More →

Continual learning

Continual learning is an area of machine learning focused on enabling models to learn continuously from data streams without forgetting previously acquired knowledge. It addresses challenges such as catastrophic forgetting and aims to create adaptive systems capable of lifelong learning.

Read More →