PaTH Attention: Position Encoding via Accumulating Householder Transformations
- Songlin Yang
- Yikang Shen
- et al.
- 2025
- NeurIPS 2025
Publications
34 results for Rameswar Panda
Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
- Shawn Tan
- Songlin Yang
- et al.
- 2025
- ICLR 2025
Self-MoE: Towards Compositional Large Language Models with Self-Specialized Experts
- Junmo Kang
- Leonid Karlinsky
- et al.
- 2025
- ICLR 2025
Reducing Transformer Key-Value Cache Size with Cross-Layer Attention
- William Brandon
- Mayank Mishra
- et al.
- 2024
- NeurIPS 2024
Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks
- Ibrahim Abdelaziz
- Kinjal Basu
- et al.
- 2024
- EMNLP 2024
Data Engineering for Scaling Language Models to 128K Context
- Yao Fu
- Rameswar Panda
- et al.
- 2024
- ICML 2024
Scaling Granite Code Models to 128K Context
- Matthew Stallone
- Vaibhav Saxena
- et al.
- 2024
- arXiv
Granite code models: A family of open foundation models for code intelligence
- Mayank Mishra
- Matthew Stallone
- et al.
- 2024
- arXiv
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models
- Sivan Doveh
- Assaf Arbelle
- et al.
- 2023
- NeurIPS 2023
Energy Transformer
- Benjamin Hoover
- Yuchen Liang
- et al.
- 2023
- NeurIPS 2023