FlashAttention
IO-aware exact attention algorithm that is 2-4x faster and uses less memory.
About
FlashAttention by Tri Dao is an IO-aware exact attention algorithm that reduces memory usage from O(N^2) to O(N) while being 2-4x faster than standard attention. Critical optimization for training and inference of large transformer models. BSD-3-Clause license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Frameworks & Libraries
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Expert (5/5)
- License
- BSD-3-Clause
- Minimum VRAM
- 8 GB
- Added
- Apr 3, 2026
Related Tools
JAX neural network library with PyTorch-like module system.
High-level deep learning API supporting JAX, TensorFlow, and PyTorch backends.
Neural network library for JAX by Google providing Linen module system.
Deep learning platform by Baidu with industrial-strength deployment tools.
Hugging Face library for state-of-the-art NLP models
End-to-end open-source ML platform by Google for training and deployment.