Is Flash Attention 2 mandatory?
bytedance/Lance
Since `flash_attn` is imported in qwen2_navit.py without checking `is_flash_attn_2_available()` like in other .py files, does it mean Flash Attention package need to be installed?
If Flash Attention is mandatory, you might want mentioned it in Readme file. But it would be nice if Flash Attention is being optional.
View on GitHub ↗
SaaS Metrics