8000 Add chat.sh script · code-monad/llama.cpp@dc6a845 · GitHub
[go: up one dir, main page]

Skip to content

Commit dc6a845

Browse files
committed
Add chat.sh script
1 parent 6a61295 commit dc6a845

File tree

2 files changed

+10
-1
lines changed

2 files changed

+10
-1
lines changed

README.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -179,8 +179,11 @@ In this mode, you can always interrupt generation by pressing Ctrl+C and enter o
179179

180180
Here is an example few-shot interaction, invoked with the command
181181
```
182-
./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
182+
# default arguments using 7B model
183+
./chat.sh
183184
185+
# custom arguments using 13B model
186+
./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
184187
```
185188
Note the use of `--color` to distinguish between user input and generated text.
186189

chat.sh

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
#!/bin/bash
2+
#
3+
# Temporary script - will be removed in the future
4+
#
5+
6+
./main -m ./models/7B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt

0 commit comments

Comments
 (0)
0