Stochastic gradient descent
Stochastic gradient descent is an optimization algorithm used in machine learning and statistical modeling to minimize loss functions by iteratively updating parameters using random subsets of data.
Technology & Innovation
RetNet (retention network)
RetNet, or retention network, is a conceptual and technological framework designed to improve data retention and memory within machine learning models, particularly in neural networks. It emphasizes the organization and preservation of information over time to enhance long-term learning and recall.
AirSim (Microsoft autonomous simulation)
AirSim is an open-source simulator developed by Microsoft for autonomous vehicles, focusing on drone and car simulation in realistic environments.
InternVideo (video–language model)
InternVideo is an advanced video-language model designed to enhance video understanding and interaction through natural language processing.
StripedHyena (hybrid state space model)
StripedHyena is a hybrid state space model combining elements of classical state space approaches with modern machine learning techniques to improve time series analysis and prediction accuracy. It integrates probabilistic modeling and neural network components to capture complex dynamics in sequential data.
WaveNet
WaveNet is a deep generative model for raw audio waveforms developed by DeepMind, known for producing highly realistic speech and audio synthesis through neural network architectures.
James L. McClelland
James L. McClelland is a prominent figure in cognitive psychology and artificial intelligence, known for his contributions to connectionist models of cognitive processes.
Behavioral cloning from observation
Behavioral cloning from observation is a machine learning technique where an agent learns to perform tasks by mimicking observed behaviors, without requiring explicit action labels. It extends traditional behavioral cloning by leveraging observational data to replicate expert behavior.
Neural occupancy field
A neural occupancy field is a representation used in computer vision and graphics to encode 3D shapes or scenes by learning a continuous function that predicts the occupancy status of any point in space. This technique leverages neural networks to model detailed geometric information efficiently.
Arbitrary style transfer
Arbitrary style transfer is a technique in computer vision and neural networks that allows for the application of artistic styles to images.