Free Information Center
Cosformer is a variant of transformer architecture that employs cosine-based attention mechanisms to improve computational efficiency and scalability. It modifies the traditional self-attention by incorporating cosine similarity, aiming to reduce complexity while maintaining performance.
Empowerment in machine learning is an information-theoretic measure used to quantify the agent’s potential influence over its environment. It is applied primarily in reinforcement learning as an intrinsic motivation to encourage exploration and autonomous behavior.
Mamba-2 (state space with selective scan) is a computational framework or methodology designed to optimize state space analysis by incorporating selective scanning techniques. It aims to improve efficiency in exploring large or complex state spaces by focusing on relevant subsets.
XLNet is a generalized autoregressive pretraining method for natural language processing that integrates the advantages of Transformer-XL and permutation language modeling, improving performance on various NLP tasks.
Arthur Samuel was an American pioneer in computer science known for his work in artificial intelligence and machine learning. He is particularly noted for developing one of the earliest self-learning programs, which played a significant role in the advancement of machine learning techniques.
QLoRA (quantized LoRA) is a machine learning technique that combines quantization and Low-Rank Adaptation to efficiently fine-tune large language models with reduced computational resources while maintaining performance.
Hugging Face is an open-source company specializing in natural language processing and artificial intelligence tools. It is known for its development and maintenance of the Transformers library, which provides state-of-the-art machine learning models for a variety of applications.
Kinetics is a large-scale dataset designed for action recognition, consisting of thousands of video clips categorized into various human actions.
ImageNet is a large visual database designed for use in visual object recognition software research, playing a significant role in advancing machine learning.
Herbert A. Simon was an American polymath known for his contributions to economics, psychology, artificial intelligence, and cognitive science. He was awarded the Nobel Prize in Economics in 1978 for his research into decision-making processes within economic organizations.