8000 SpecForge/examples at main · sgl-project/SpecForge · GitHub
[go: up one dir, main page]
Skip to content

Latest commit

 

History

History

examples

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
run_deepseek_v2_lite_eagle3_online.sh
run_deepseek_v2_lite_eagle3_online.sh
 
 
run_deepseek_v3_671b_eagle3_offline.sh
run_deepseek_v3_671b_eagle3_offline.sh
 
 
run_deepseek_v3_671b_eagle3_online.sh
run_deepseek_v3_671b_eagle3_online.sh
 
 
run_gemma3_1b_eagle3_online.sh
run_gemma3_1b_eagle3_online.sh
 
 
run_gpt_oss_120b_eagle3_online.sh
run_gpt_oss_120b_eagle3_online.sh
 
 
run_gpt_oss_20b_eagle3_online.sh
run_gpt_oss_20b_eagle3_online.sh
 
 
run_ling_flash_2.0_eagle3_offline.sh
run_ling_flash_2.0_eagle3_offline.sh
 
 
run_ling_flash_2.0_eagle3_online.sh
run_ling_flash_2.0_eagle3_online.sh
 
 
run_llama3.1_8b_eagle3_offline.sh
run_llama3.1_8b_eagle3_offline.sh
 
 
run_llama3.1_8b_eagle3_online.sh
run_llama3.1_8b_eagle3_online.sh
 
 
run_llama3.3_70b_eagle3_online.sh
run_llama3.3_70b_eagle3_online.sh
 
 
run_llama4_scout_eagle3_online.sh
run_llama4_scout_eagle3_online.sh
 
 
run_longcat_flash_dflash_online.sh
run_longcat_flash_dflash_online.sh
 
 
run_longcat_flash_eagle3_online.sh
run_longcat_flash_eagle3_online.sh
 
 
run_phi4_eagle3_online.sh
run_phi4_eagle3_online.sh
 
 
run_qwen2.5_32b_vl_eagle3_online.sh
run_qwen2.5_32b_vl_eagle3_online.sh
 
 
run_qwen2.5_7b_vl_eagle3_online.sh
run_qwen2.5_7b_vl_eagle3_online.sh
 
 
run_qwen3_235b_a22b_eagle3.sh
run_qwen3_235b_a22b_eagle3.sh
 
 
run_qwen3_30b_a3b_eagle3_online.sh
run_qwen3_30b_a3b_eagle3_online.sh
 
 
run_qwen3_8b_dflash_online.sh
run_qwen3_8b_dflash_online.sh
 
 
run_qwen3_8b_eagle3_online.sh
run_qwen3_8b_eagle3_online.sh
 
 
run_qwen3_coder_30b_a3b_eagle3_online.sh
run_qwen3_coder_30b_a3b_eagle3_online.sh
 
 
run_qwen3_coder_eagle3_offline.sh
run_qwen3_coder_eagle3_offline.sh
 
 
run_qwen3_coder_eagle3_online.sh
run_qwen3_coder_eagle3_online.sh
 
 
run_qwen3_next_80b_eagle3_online.sh
run_qwen3_next_80b_eagle3_online.sh
 
 
run_qwq_eagle3_online.sh
run_qwq_eagle3_online.sh
 
 

README.md

Run SpecForge Examples

This folder contains the examples of running SpecForge on different models. The scripts can be invoked by the following command:

bash examples/<script-name>.sh [NUM_GPUS] [TP_SIZE]

We use the ShareGPT dataset for all the examples for now, but you can replace it with more robust datasets such as perfectblend, magpie-qwen2.5-pro-1m-v0.1, etc.
0