8000 feat: Generic chatml Function Calling (#957) · bellofils/llama-cpp-python@153a004 · GitHub
[go: up one dir, main page]
Skip to content

Commit 153a004

Browse files
abetlenabetlen
authored
feat: Generic chatml Function Calling (abetlen#957)
* Add demo notebook * Add initial chat handler * Update OpenAI types * Add generic chatml function calling (wip) * Update chatml generic function calling. * Progress on auto-tool calls * fix streaming functions * Remove print statements * fix: Suppress output from llama.cpp init and grammar creation * Add OpenAI v1 python api compatible chat completion function * Support non-streaming multi-tool calls * Format * Include function_call in response.
1 parent 69413ce commit 153a004

File tree

4 files changed

+1660
-60
lines changed

4 files changed

+1660
-60
lines changed

0 commit comments

Comments
 (0)
0