Description
Prerequisites
- I am running the latest code. Mention the version if possible as well.
- I carefully followed the README.md.
- I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
$ ./convert_hf_to_gguf.py /data/
6578
models/Qwen2.5-VL-7B-Instruct --outtype auto --verbose --dry-run
INFO:hf-to-gguf:Loading model: Qwen2.5-VL-7B-Instruct
ERROR:hf-to-gguf:Model Qwen2_5_VLForConditionalGeneration is not supported
The model git lfs link:
https://cnb.cool/ai-models/Qwen/Qwen2.5-VL-7B-Instruct.git
Motivation
The more type of model to support, the better.
Possible Implementation
No response