8000 [CANN]: add the basic supports of Flash Attention kernel by shibizhao · Pull Request #13627 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

[CANN]: add the basic supports of Flash Attention kernel #13627

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 18 commits into from
May 26, 2025
Merged

[CANN]: add the basic supports of Flash Attention kernel #13627

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
72df31d
cann: add the basic FA support
shibizhao May 14, 2025
3a73182
cann: update the readme
shibizhao May 15, 2025
6a39d63
cann: update the FlashAttention with PSEShift
shibizhao May 18, 2025
8a902b9
cann: update the input parameters in FA
shibizhao May 18, 2025
f5e24a5
cann: update the alibi with max_bias
shibizhao May 18, 2025
c8c2908
cann: add the constrints of softcap
shibizhao May 19, 2025
47f2c64
cann: update the docs CANN.md
shibizhao May 19, 2025
fb62f01
cann: update the docs CANN.md
shibizhao May 19, 2025
b266beb
cann: fix typo of CANN.md
shibizhao May 21, 2025
8a112f0
cann: add some comments and update the CANN.md
shibizhao May 21, 2025
1779e00
cann: update the CANN.md
shibizhao May 21, 2025
092ccf6
cann: update the inner precise for fusedInferAttention
shibizhao May 21, 2025
c380305
cann: update the constraints of flash_attn_ext on ggml-cann.cpp
shibizhao May 22, 2025
89f884e
cann: resolve the conflict with laster master branch
shibizhao May 23, 2025
1a3bfec
Merge branch 'master' into flash-attn-cann
shibizhao May 23, 2025
3b084d5
cann: clean the whitespace
shibizhao May 23, 2025
d23697b
cann: clean the whitespace
shibizhao May 23, 2025
8a7829b
cann: add a new endline
shibizhao May 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
cann: add the constrints of softcap
  • Loading branch information
@shibizhao
shibizhao committed May 19, 2025
commit c8c2908bfc9cadc2abe0973521dedecd657dcf63
Loading
0