8000 Update README.md · Dpaste20/llama-cpp-python@952ba9e · GitHub
[go: up one dir, main page]

Skip to content

Commit 952ba9e

Browse files
authored
Update README.md
add windows server commad
1 parent 5f583b0 commit 952ba9e

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,12 +64,20 @@ This allows you to use llama.cpp compatible models with any OpenAI compatible cl
6464

6565
To install the server package and get started:
6666

67+
Linux
6768
```bash
6869
pip install llama-cpp-python[server]
6970
export MODEL=./models/7B/ggml-model.bin
7071
python3 -m llama_cpp.server
7172
```
7273

74+
Windows
75+
```cmd
76+
pip install llama-cpp-python[server]
77+
SET MODEL=\models\7B\ggml-model.bin
78+
python3 -m llama_cpp.server
79+
```
80+
7381
Navigate to [http://localhost:8000/docs](http://localhost:8000/docs) to see the OpenAPI documentation.
7482

7583
## Docker image

0 commit comments

Comments
 (0)
0