8000 【招募】XTuner 中支持 GaLore · InternLM Tutorial · Discussion #574 · GitHub

【招募】XTuner 中支持 GaLore #574

pppppM started this conversation in Task

pppppM
Mar 12, 2024

目标

在 XTuner 中添加微调算法 GaLore，会有核心开发者进行指导

前置知识

GaLore Paper: https://arxiv.org/abs/2403.03507
MMEnginge 中 Optimizer 的进阶用法：https://mmengine.readthedocs.io/zh-cn/latest/tutorials/optim_wrapper.html

资源支持

InternStudio 算力

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

0