8000 Compile bug: llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54:error '_mm256_set_m128i' was not declared in this scope · Issue #11385 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

Compile bug: llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54:error '_mm256_set_m128i' was not declared in this scope #11385

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
zhangyangniubi opened this issue Jan 24, 2025 · 5 comments
Open

Compile bug: llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54:error '_mm256_set_m128i' was not declared in this scope #11385

zhangyangniubi opened this issue Jan 24, 2025 · 5 comments
Labels
bug-unconfirmed

Comments

@zhangyangniubi
Copy link

Git commit

master

Operating systems

Linux

GGML backends

CPU

Problem description & steps to reproduce

linux system build project occur

First Bad Commit

No response

Compile command

cmake -B build
cmake --build bulid --config Release

Relevant log output

/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp: In function ‘void ggml_gemm_q4_0_8x8_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54: error: ‘_mm256_set_m128i’ was not declared in this scope
 #define GGML_F32Cx8x2_LOAD(x, y)     _mm512_cvtph_ps(_mm256_set_m128i(_mm_loadu_si128((const __m128i *)(y)), _mm_loadu_si128((const __m128i *)(x))))
                                                      ^
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:2610:50: note: in expansion of macro ‘GGML_F32Cx8x2_LOAD’
                     const __m512 col_scale_f32 = GGML_F32Cx8x2_LOAD(b_ptr_0[b].d, b_ptr_1[b].d);
                                                  ^~~~~~~~~~~~~~~~~~
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54: note: suggested alternative: ‘_mm256_set_epi8’
 #define GGML_F32Cx8x2_LOAD(x, y)     _mm512_cvtph_ps(_mm256_set_m128i(_mm_loadu_si128((const __m128i *)(y)), _mm_loadu_si128((const __m128i *)(x))))
                                                      ^
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:2610:50: note: in expansion of macro ‘GGML_F32Cx8x2_LOAD’
                     const __m512 col_scale_f32 = GGML_F32Cx8x2_LOAD(b_ptr_0[b].d, b_ptr_1[b].d);
                                                  ^~~~~~~~~~~~~~~~~~
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54: error: ‘_mm256_set_m128i’ was not declared in this scope
 #define GGML_F32Cx8x2_LOAD(x, y)     _mm512_cvtph_ps(_mm256_set_m128i(_mm_loadu_si128((const __m128i *)(y)), _mm_loadu_si128((const __m128i *)(x))))
                                                      ^
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:2804:50: note: in expansion of macro ‘GGML_F32Cx8x2_LOAD’
                     const __m512 col_scale_f32 = GGML_F32Cx8x2_LOAD(b_ptr_0[b].d, b_ptr_1[b].d);
                                                  ^~~~~~~~~~~~~~~~~~
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:80:54: note: suggested alternative: ‘_mm256_set_epi8’
 #define GGML_F32Cx8x2_LOAD(x, y)     _mm512_cvtph_ps(_mm256_set_m128i(_mm_loadu_si128((const __m128i *)(y)), _mm_loadu_si128((const __m128i *)(x))))
                                                      ^
/home/warehouse/llmfn/llama.cpp-master/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:2804:50: note: in expansion of macro ‘GGML_F32Cx8x2_LOAD’
                     const __m512 col_scale_f32 = GGML_F32Cx8x2_LOAD(b_ptr_0[b].d, b_ptr_1[b].d);
                                                  ^~~~~~~~~~~~~~~~~~
ggml/src/CMakeFiles/ggml-cpu.dir/build.make:88: recipe for target 'ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o' failed
make[2]: *** [ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o] Error 1
make[2]: *** Waiting for unfinished jobs....
[  9%] Built target xxhash
CMakeFiles/Makefile2:1085: recipe for target 'ggml/src/CMakeFiles/ggml-cpu.dir/all' failed
make[1]: *** [ggml/src/CMakeFiles/ggml-cpu.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2
@nvzflow
Copy link
nvzflow commented Jan 30, 2025 •
edited
Loading

see same problem , following same steps for CPU build, CUDA seems to work.

@ylxy123
Copy link
ylxy123 commented Feb 10, 2025

Just encountered the same problem, u need to update the local gcc/g++ to version 9.4 and it will compile without problems

@vudiy
Copy link
vudiy commented Mar 6, 2025

@zhangyangniubi pls . do you resolve this problem ?

@github-actions github-actions bot added the stale label Apr 6, 2025
@ZisGod
Copy link
ZisGod commented Apr 10, 2025

I encountered a similar issue, could you help me solve it?

@github-actions github-actions bot removed the stale label Apr 11, 2025
@github-actions github-actions bot added the stale label May 11, 2025
@vklb
Copy link
vklb commented May 20, 2025

I had the same problem, as @ylxy123 mentioned here upgrading the gcc to version above 9 (13 in my case) resolved the problem. I assume the project developed and tested with newer compilers

@github-actions github-actions bot removed the stale label May 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug-unconfirmed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@vudiy @nvzflow @ylxy123 @vklb @ZisGod @zhangyangniubi
0