8000 loss_scale bug when meeting <image> by mangoyuan · Pull Request #3036 · modelscope/ms-swift · GitHub
[go: up one dir, main page]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

loss_scale bug when meeting <image> #3036

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

loss_scale bug when meeting <image> #3036

wants to merge 2 commits into from

Conversation

mangoyuan
Copy link
@mangoyuan mangoyuan commented Feb 8, 2025 •
edited
Loading

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Models or Datasets Support

PR information

当训练数据assistant的content包含多媒体，例如<image>时，如果同时启用loss_scale，会出现loss_scale维度错误。

Experiment results

Paste your experiment result here(if needed).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mangoyuan
0