Skip to content

Ignore HF's generation tags in jinja templates - #437

Open
gakada wants to merge 1 commit into
theroyallab:mainfrom
gakada:main
Open

Ignore HF's generation tags in jinja templates#437
gakada wants to merge 1 commit into
theroyallab:mainfrom
gakada:main

Conversation

@gakada

@gakada gakada commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

This allows to load e.g. Laguna-XS-2.1, otherwise it will give an error:

jinja2.exceptions.TemplateSyntaxError: Encountered unknown tag 'generation'. Jinja was looking for the following tags: 'elif' or 'else' or 'endif'. The innermost block that needs to be closed is 'if'.

and chat completion won't work.

IgnoreGenerationTags extension is taken from llama-cpp-python.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant