QLoRA (quantized LoRA)
QLoRA (quantized LoRA) is a machine learning technique that combines quantization and Low-Rank Adaptation to efficiently fine-tune large language models with reduced computational resources while maintaining performance.
quantization
Model compression
Model compression refers to a set of techniques aimed at reducing the size and computational requirements of machine learning models while maintaining their performance. It enables deployment of models on resource-constrained devices and improves inference efficiency.
Quantization (neural networks)
Quantization in neural networks is the process of reducing the precision of the numbers used to represent model parameters and activations, typically to improve computational efficiency and reduce memory usage. It enables deployment of neural networks on resource-constrained devices by approximating floating-point values with lower-bit representations, often with minimal impact on accuracy.