Closed
Description
Prerequisites
Please answer the following questions for yourself before submitting an issue.
- I am running the latest code. Development is very rapid so there are no tagged versions as of now. (I tested on both the latest tagged version and on git+https://github.com/abetlen/llama-cpp-python)
- I carefully followed the README.md.
- I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the Discussions, and have a new bug or useful enhancement to share.
Expected Behavior
Able to install the package on a modern operating system.
Current Behavior
Build fails.
Environment and Context
Latest fedora docker image. arm64 architecture.
- Physical (or virtual) hardware you are using, e.g. for Linux:
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Vendor ID: Apple
Model name: -
Model: 0
Thread(s) per core: 1
Core(s) per cluster: 8
Socket(s): -
Cluster(s): 1
Stepping: 0x0
BogoMIPS: 48.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 asimddp sha512 asimdfhm dit uscat ilrcpc flagm sb paca p
acg dcpodp sve2 flagm2 frint svei8mm svebf16 bf16 afp
NUMA:
NUMA node(s): 1
NUMA node0 CPU(s): 0-7
Vulnerabilities:
Gather data sampling: Not affected
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Reg file data sampling: Not affected
Retbleed: Not affected
Spec rstack overflow: Not affected
Spec store bypass: Vulnerable
Spectre v1: Mitigation; __user pointer sanitization
Spectre v2: Not affected
Srbds: Not affected
Tsx async abort: Not affected
- Operating System, e.g. for Linux:
Linux 659a43242f7a 6.12.13-200.fc41.aarch64 #1 SMP PREEMPT_DYNAMIC Sat Feb 8 20:30:50 UTC 2025 aarch64 GNU/Linux
- SDK version, e.g. for Linux:
STEP 4/7: run python3 --version
Python 3.13.3
--> 3b63e5deea1f
STEP 5/7: run make --version
GNU Make 4.4.1
Built for aarch64-redhat-linux-gnu
Copyright (C) 1988-2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
--> 3339700ae84f
STEP 6/7: run g++ --version
g++ (GCC) 15.1.1 20250521 (Red Hat 15.1.1-2)
Copyright (C) 2025 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
Failure Information (for bugs)
Broken build.
Steps to Reproduce
Try and build this containerfile on a arm64 OS which can reproduce this issue:
from quay.io/fedora/fedora:42
run dnf group install development-tools -y
run dnf install uv g++ -y
run python3 --version
run make --version
run g++ --version
run uv pip install llama-cpp-python --system
Failure Logs
https://gist.github.com/paul-civitas/e65280b303eb4465c3938b60c769c0e7
Metadata
Metadata
Assignees
Labels
No labels