8000 Add Jinja template support by ochafik · Pull Request #11016 · ggml-org/llama.cpp · GitHub

Add Jinja template support#11016

Merged

ochafik merged 47 commits intoggml-org:masterfrom

Jan 21, 2025

Commits on Dec 30, 2024

Commits on Jan 13, 2025

Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Wire LLM_KV_TOKENIZER_CHAT_TEMPLATE_N in llama_model_chat_template
ochafik
committed
Refactor test-chat-template
ochafik
committed
Test templates w/ minja
ochafik
committed
Fix deprecation
ochafik
committed
Add --jinja to llama-run
ochafik
committed
Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Update common_chat_format_example to use minja template wrapper
ochafik
committed
Test chat_template in e2e test
ochafik
committed
Update utils.py
ochafik
committed
Update test_chat_completion.py
ochafik
committed
Update run.cpp
ochafik
committed

Commits on Jan 14, 2025

Update arg.cpp
ochafik
authored
Merge remote-tracking branch 'origin/master' into jinja
Olivier Chafik
committed

Commits on Jan 18, 2025

Refactor common_chat_* functions to accept minja template + use_jinja option
ochafik
committed
Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Attempt to fix linkage of LLAMA_CHATML_TEMPLATE
ochafik
committed
Revert LLAMA_CHATML_TEMPLATE refactor
ochafik
committed
Normalize newlines in test-chat-templates for windows tests
ochafik
committed
Forward decl minja::chat_template to avoid eager json dep
ochafik
committed
Flush stdout in chat template before potential crash
ochafik
committed
Fix copy elision warning
ochafik
committed
Rm unused optional include
ochafik
committed
Add missing optional include to server.cpp
ochafik
committed
Disable jinja test that has a cryptic windows failure
ochafik
committed
minja: fix vigogne (https://github.com/google/minja/pull/22)
ochafik
committed

Commits on Jan 20, 2025

Apply suggestions from code review

authored
Finish suggested renamings
ochafik
committed
Move chat_templates inside server_context + remove mutex
ochafik
committed
Update --chat-template-file w/ recent change to --chat-template
ochafik
committed
Refactor chat template validation
ochafik
committed
Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Guard against missing eos/bos tokens (null token otherwise throws in llama_vocab::impl::token_get_attr)
ochafik
committed
Warn against missing eos / bos tokens when jinja template references them
ochafik
committed
rename: common_chat_template[s]
ochafik
committed
reinstate assert on chat_templates.template_default
ochafik
committed
Update minja to https://github.com/google/minja/commit/b8437df626ac6cd0ce3b333b3c74ed1129c19f25
ochafik
committed

Commits on Jan 21, 2025

Update minja to https://github.com/google/minja/pull/25
ochafik
committed
Update minja from https://github.com/google/minja/pull/27
ochafik
committed
rm unused optional header
Olivier Chafik
committed

0