We present the first comprehensive empirical study, comparing different calibration languages for pruning multilingual models across diverse tasks, models, and ...
Aug 26, 2024 · In this paper, we set out to investigate calibrating the pruning of multilingual language models for monolingual applications. We present the ...
Sep 30, 2024 · We present the first comprehensive empirical study, comparing different calibration languages for pruning multilingual models across diverse tasks.
Aug 28, 2024 · In this paper, we set out to explore effective strategies for calibrating the pruning of multilingual language models. We present the first ...
Aug 26, 2024 · This paper explores effective strategies for calibrating the pruning of multilingual language models across diverse tasks, models, ...
7 days ago · Multilingual large language models (MLLMs), trained on multilingual balanced data, demon- strate better zero-shot learning performance.
Oct 29, 2024 · Calibrating on the target language consistently yields the lowest perplexity (Section 4.1, but will not guarantee optimal performance on ...
May 25, 2024 · These experiments aim to provide insights into the factors influencing model performance post- pruning, identify optimal pruning methods ...
Aug 27, 2024 · Language-specific Calibration for Pruning Multilingual Language Models paper: https://arxiv.org/abs/2408.14398 · 2:38 AM · Aug 27, 2024.
Language-Specific Pruning for Efficient Reduction of Large Language Models ... Language-specific Calibration for Pruning Multilingual Language Models Simon ...