8000 feat(README): pointers to leaderboard · ise-uiuc/magicoder@6a91f9b · GitHub
[go: up one dir, main page]
Skip to content

Commit 6a91f9b

Browse files
UniverseFlyUniverseFly
authored
feat(README): pointers to leaderboard
1 parent fbff59d commit 6a91f9b

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

‎README.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,10 @@
2222

2323
* 🎩**Magicoder** is a model family empowered by 🪄**OSS-Instruct**, a novel approach to enlightening LLMs with open-source code snippets for generating *low-bias* and *high-quality* instruction data for code.
2424
* 🪄**OSS-Instruct** mitigates the *inherent bias* of the LLM-synthesized instruction data by empowering them with *a wealth of open-source references* to produce more diverse, realistic, and controllable data.
25-
* [Magicoder-*S*-DS-6.7B](https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B) outperforms `gpt-3.5-turbo-1106` and [Gemini Ultra](https://deepmind.google/technologies/gemini/) on HumanEval (**76.8** vs. [72.6 and 74.4])!
25+
26+
> [!IMPORTANT]
27+
> * [Magicoder-*S*-DS-6.7B](https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B) outperforms `gpt-3.5-turbo-1106` and [Gemini Ultra](https://deepmind.google/technologies/gemini/) on HumanEval (**76.8** vs. [72.6 and 74.4])!
28+
> * Find more detailed comparisons with other SOTA models on the **[🏆 EvalPlus Leaderboard 🏆](https://evalplus.github.io/leaderboard.html)**!
2629
2730
![Overview of OSS-Instruct](assets/overview.svg)
2831
![Overview of Result](assets/result.png)

0 commit comments

Comments
 (0)
0