Tri Dao
Researcher · Princeton University; Together AI · United States
Wrote FlashAttention, the IO-aware exact attention kernel that made long contexts affordable on GPUs.
- Areas
- Attention, Systems
- Eras
- Scaling
- Top era
- Scaling
- Top score
- 9
- Confidence
- high
Key publications
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022, NeurIPS)
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces (2023)