8000 When I using pipeline to inference the valid dataset, I got the different results with evaluation result during training! · Issue #37526 · huggingface/transformers · GitHub
[go: up one dir, main page]

Skip to content
When I using pipeline to inference the valid dataset, I got the different results with evaluation result during training! #37526
@kingman1980

Description

@kingman1980

I am working with three classes image classification task.
I got the confusion matrix at 30th epoch during training like this confusion matrix:
[[230, 0, 1], [1, 28, 2], [1, 10, 3727]]
And I used the pipeline with the model's checkpoint at 30th epoch to infer the same test dataset, I got the confusion matrix like this:
[[230, 1, 0], [0, 31, 0], [8, 166, 3564]]

the model is timm/mobilenetv3_small_100.lamb_in1k
Anybody knows why?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0