Routing Transformer

The Routing Transformer is a variant of the Transformer architecture designed to improve efficiency in handling long sequences by routing tokens dynamically to sparse attention patterns. It reduces computational complexity while maintaining performance in natural language processing tasks.

Read More →

Tencent AI Lab

Tencent AI Lab is a research division of Tencent focused on advancing artificial intelligence technologies. Established to explore AI applications across various domains, the lab conducts research in areas such as machine learning, natural language processing, and computer vision.

Read More →