MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map

Yuhong Chou, Man Yao, Kexin Wang, Yuqi Pan, Rui-Jie Zhu, Jibin Wu, Yiran Zhong, Yu Qiao, Bo Xu, Guoqi Li
September, 2024
PDF Cite
Type
Journal article
Publication
In The Thirty-eighth Annual Conference on Neural Information Processing Systems