8000 runs perfectly with the regular models, but not the quantized ones · Issue #993 · ggml-org/whisper.cpp · GitHub
[go: up one dir, main page]

Skip to content
runs perfectly with the regular models, but not the quantized ones #993
@patrickfconnolly

Description

@patrickfconnolly

I have run quantization on ggml-small.en.bin to produce ggml-small.en.bin-q5_0.bin
Quantization proceeded without any errors.

When I run the model, it attempts to load, but throws the following:
GGML_ASSERT: ggml.c:4288: wtype != GGML_TYPE_COUNT
Abort trap: 6

Same issue occurs when I try 8-bit quantization.

Running on a 2015 Macbook Air, if this is any use.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0