8000 debug · themrzmaster/llama-cpp-python@014575f · GitHub
[go: up one dir, main page]
Skip to content

Commit 014575f

Browse files
luccazifoodluccazifood
committed
debug
1 parent 15dd7aa commit 014575f

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

‎llama_cpp/llama_chat_format.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3117,9 +3117,9 @@ def mixtral_function_calling(
31173117
mirostat_eta=mirostat_eta,
31183118
model=model,
31193119
logits_processor=logits_processor,
3120-
# grammar=llama_grammar.LlamaGrammar.from_string(
3121-
# initial_gbnf_tool_grammar, verbose=llama.verbose
3122-
# ),
3120+
grammar=llama_grammar.LlamaGrammar.from_string(
3121+
initial_gbnf_tool_grammar, verbose=llama.verbose
3122+
),
31233123
)
31243124
completion: llama_types.CreateCompletionResponse = completion_or_chunks # type: ignore
31253125
text = completion["choices"][0]["text"]

0 commit comments

Comments
 (0)
0