Performer (kernel attention) – #399
Performer (kernel attention) – #399 is a machine learning model architecture designed to improve the efficiency of the attention mechanism in transformers. It uses kernel methods to approximate the traditional softmax attention, enabling linear time complexity for processing long sequences.