8000 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main · HardSoft2023/llama-cpp-python@fb57b94 · GitHub
[go: up one dir, main page]
Skip to content

Commit fb57b94

Browse files
abetlenabetlen
committed
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
2 parents f82d85f + 69f9d50 commit fb57b94

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

‎Dockerfile.cuda

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
1-
FROM nvidia/cuda:12.1.1-devel-ubuntu20.04
1+
ARG CUDA_VERSION=12.1.1
2+
FROM nvidia/cuda:${CUDA_VERSION}-devel-ubuntu22.04
23

34
# We need to set the host to 0.0.0.0 to allow outside access
45
ENV HOST 0.0.0.0
@@ -12,4 +13,4 @@ RUN python3 -m pip install --upgrade pip pytest cmake scikit-build setuptools fa
1213
RUN LLAMA_CUBLAS=1 python3 setup.py develop
1314

1415
# Run the server
15-
CMD python3 -m llama_cpp.ser 38CB ver
16+
CMD python3 -m llama_cpp.server

0 commit comments

Comments
 (0)
0