8000 docs: Add Vulkan build instructions · devilcoder01/llama-cpp-python@843e77e · GitHub
[go: up one dir, main page]

Skip to content

Commit 843e77e

Browse files
committed
docs: Add Vulkan build instructions
1 parent 464af5b commit 843e77e

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -101,6 +101,14 @@ To install with hipBLAS / ROCm support for AMD cards, set the `LLAMA_HIPBLAS=on`
101101
CMAKE_ARGS="-DLLAMA_HIPBLAS=on" pip install llama-cpp-python
102102
```
103103

104+
#### Vulkan
105+
106+
To install with Vulkan support, set the `LLAMA_VULKAN=on` environment variable before installing:
107+
108+
```bash
109+
CMAKE_ARGS="-DLLAMA_VULKAN=on" pip install llama-cpp-python
110+
```
111+
104112
### Windows Notes
105113

106114
If you run into issues where it complains it can't find `'nmake'` `'?'` or CMAKE_C_COMPILER, you can extract w64devkit as [mentioned in llama.cpp repo](https://github.com/ggerganov/llama.cpp#openblas) and add those manually to CMAKE_ARGS before running `pip` install:

0 commit comments

Comments
 (0)
0