Loss function
A loss function is a mathematical function used in optimization and machine learning to measure the difference between predicted values and actual values. It guides algorithms in minimizing errors during model training.
Artificial Intelligence
RT-1 (robotics transformer)
RT-1 is an advanced robotics transformer designed for versatile applications in various fields, integrating robotics and AI technologies.
OPT (language model)
OPT (Open Pre-trained Transformer) is a large-scale language model developed to provide an open alternative to proprietary models. It is designed to facilitate research and transparency in natural language processing by offering publicly accessible weights and code.
VQ-VAE
VQ-VAE (Vector Quantized Variational Autoencoder) is a generative model architecture that combines discrete latent representations with variational autoencoders, enabling efficient learning and synthesis of complex data like images and audio.
Libratus
Libratus is an artificial intelligence program developed to play and excel at no-limit Texas hold ’em poker. It demonstrated significant advances in AI by defeating top human professional players in 2017, showcasing new techniques in game theory and decision-making under uncertainty.
Prompt tuning
Prompt tuning is a technique in natural language processing that adapts large language models to specific tasks by optimizing a small set of prompt parameters instead of fine-tuning the entire model. It offers a parameter-efficient alternative to traditional model fine-tuning, enabling task adaptation with reduced computational resources.
Alex Krizhevsky
Alex Krizhevsky is a notable figure in the field of artificial intelligence, particularly known for his contributions to deep learning and computer vision.
VQ-VAE-2
VQ-VAE-2 is a hierarchical vector quantized variational autoencoder designed to improve generative modeling of images by combining multi-scale latent representations. It extends its predecessor by introducing a two-level latent hierarchy, enabling high-quality image generation and efficient compression.
BLOOM (language model)
BLOOM is a large open-access multilingual language model developed to facilitate natural language processing tasks across numerous languages. It is notable for its collaborative development and emphasis on openness in artificial intelligence.
Transformers for reinforcement learning (Decision Transformer)
The Decision Transformer is a model that applies transformer architectures to reinforcement learning, merging sequence modeling with decision-making tasks.