8000 Broken phi4 model · Issue #37464 · huggingface/transformers · GitHub
[go: up one dir, main page]

Skip to content 10000
Broken phi4 model #37464
@JohnConnor123

Description

@JohnConnor123

System Info

Maybe the Phi-4 tokenizer conversion is broken at transformers side.
More info with images here: vllm-project/vllm#16510

Who can help?

@ArthurZucker @itazap

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

All info here: vllm-project/vllm#16510

Expected behavior

Anything but that:
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0