8000 Arm AArch64: optimized GEMV and GEMM kernels for q4_0_q8_0, and q8_0_q8_0 quantization by Dibakar · Pull Request #5780 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

Arm AArch64: optimized GEMV and GEMM kernels for q4_0_q8_0, and q8_0_q8_0 quantization #5780

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 28 commits into from
Jul 10, 2024
Merged

Arm AArch64: optimized GEMV and GEMM kernels for q4_0_q8_0, and q8_0_q8_0 quantization #5780

Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
002e36e
Arm AArch64: optimized GEMV and GEMM kernels for q4_0_q8_0, and q8_0_…
Dibakar Feb 28, 2024
340ef07
Arm AArch64: add optimized GEMV and GEMM asm kernels for q4_0_q8_0 qu…
Dibakar Apr 22, 2024
81215ff
Arm AArch64: add optimized GEMV and GEMM asm kernels for q4_0_q8_0 qu…
Dibakar Apr 23, 2024
6c8d826
Arm AArch64: add optimized GEMV and GEMM asm kernels for q4_0_q8_0 qu…
Dibakar Apr 25, 2024
43e1297
Arm AArch64: add optimized GEMV and GEMM asm kernels for q4_0_q8_0 qu…
Dibakar Apr 29, 2024
441ab64
Arm AArch64: add copyright claim only to ggml-aarch64.cpp and ggml-aa…
Dibakar Apr 29, 2024
8ee6779
Arm AArch64: minor code refactoring for rebase
Dibakar May 1, 2024
a657246
Arm AArch64: minor code refactoring for resolving a build issue with …
Dibakar May 16, 2024
746b57f
Arm AArch64: minor code refactoring to split the Q4_0_AARC64 type int…
Dibakar May 21, 2024
5d10c21
Arm AArch64: minor code change for resolving a build issue with serve…
Dibakar May 31, 2024
7ac03e5
retrigger checks
Dibakar May 31, 2024
e2c1c47
Arm AArch64: minor code changes for rebase
Dibakar Jun 5, 2024
79b6cdf
Arm AArch64: minor changes to skip the pr#7433 vec_dot code for arm c…
Dibakar Jun 14, 2024
3c1ad5f
Arm AArch64: remove stale LLAMA_QKK_64 from CMakeLists.txt and delete…
Dibakar Jun 14, 2024
a7055b7
Arm AArch64: add reference scalar gemm and gemv, and avoid dynamic me…
Dibakar Jun 18, 2024
cce236b
Arm AArch64: add multithreaded quantization support for the new types…
Dibakar Jun 19, 2024
7a70606
Arm AArch64: minor code refactoring
Dibakar Jun 19, 2024
ffbfabb
Arm AArch64: simplify logic for calling gemm and gemv functions in gg…
Dibakar Jun 23, 2024
cbbfd69
Arm AArch64: minimize changes in ggml_compute_forward_mul_mat
Dibakar Jun 26, 2024
3564644
Arm AArch64: minor code refactoring, and add reference scalar code to…
Dibakar Jul 3, 2024
110d143
Arm AArch64: minor code refactoring
Dibakar Jul 3, 2024
4ff0b22
Arm AArch64: minor code refactoring
Dibakar Jul 6, 2024
42724b4
Arm AArch64: minor code refactoring
Dibakar Jul 8, 2024
e5f4713
rebase on the latest master commit 3fd62a6 and adapt to the new direc…
Dibakar Jul 8, 2024
c2595d0
Arm AArch64: remove a redundant comment
Dibakar Jul 9, 2024
a7abb78
Arm AArch64: add pragma in ggml-aarch64.c to turn -Woverlength-string…
Dibakar Jul 9, 2024
0e84ef1
Arm AArch64: use __aarch64__ check to guard 64-bit neon kernels
Dibakar Jul 9, 2024
c653eb1
Arm AArch64: update docs/build.md README to include compile time flag…
Dibakar Jul 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
retrigger checks
  • Loading branch information
@Dibakar
Dibakar committed Jul 8, 2024
commit 7ac03e5fe8ac63d87df37a07e72584fc3dcba633

No changes to show.

This commit has no content.

0