Highlights
- Pro
-
-
open-korean-instructions Public
언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
-
-
lm-evaluation-harness Public
Forked from EleutherAI/lm-evaluation-harness2023/7/17 버전
Python MIT License UpdatedJun 13, 2024 -
EasyJailbreak Public
Forked from EasyJailbreak/EasyJailbreakAn easy-to-use Python framework to generate adversarial jailbreak prompts.
Python GNU General Public License v3.0 UpdatedApr 23, 2024 -
EasyDeL Public
Forked from erfanzar/EasyDeLEasyDeL is an OpenSource Library to make your training faster and more Optimized With cool Options for training and serving Both in Python And Mojo🔥
Python Apache License 2.0 UpdatedApr 18, 2024 -
torch-xla-SPMD Public
Pytorch/XLA SPMD Test code in Google TPU
-
-
AutoDAN Public
Forked from SheltonLiu-N/AutoDANThe official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models".
Python UpdatedFeb 12, 2024 -
llama-moe Public
Forked from pjlab-sys4nlp/llama-moe⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
Python Apache License 2.0 UpdatedFeb 6, 2024 -
transformers Public
Forked from huggingface/transformers🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Python Apache License 2.0 UpdatedJan 14, 2024 -
trl-xla Public
Forked from huggingface/trlTrain transformer language models with reinforcement learning.
Python Apache License 2.0 UpdatedJan 13, 2024 -
KoLLaVA Public
Forked from tabtoyou/KoLLaVAKoLLaVA: Korean Large Language-and-Vision Assistant (feat.LLaVA)
Jupyter Notebook Apache License 2.0 UpdatedJan 12, 2024 -
korouge Public
Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리
-
GTA Public
Code for paper "GTA: Gated Toxicity Avoidance for LM Performance Preservation" accepted to Findings of EMNLP 2023
-
ko-lm-eval-harness Public
lm-eval-harness의 polyglot branch + 여타 구현체들 모음
Python MIT License UpdatedNov 25, 2023 -
optimum-neuron Public
Forked from huggingface/optimum-neuronEasy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
Python Apache License 2.0 UpdatedOct 19, 2023 -
-
RLHF-Korean-Friendly-LLM Public
Forked from VAIV-2023/RLHF-Korean-Friendly-LLMDeveloping a Korean LLM model : Hate Speech Filtering, Improving conversational skills, Finetuning with the RLHF method
Python UpdatedSep 24, 2023 -
-
language-model Public
한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)
-
-
-
qax Public
Forked from davisyoshida/qaxIf it quacks like a tensor...
Python MIT License UpdatedJul 20, 2023 -
polyglot-jax-inference Public
Forked from affjljoo3581/polyglot-jax-inferenceTPU에서 한국어용 LLM 추론을 위한 Jax/Flax 구현체입니다.
Jupyter Notebook MIT License UpdatedJul 12, 2023 -
Easy-LM Public
Forked from young-geng/EasyLMLarge language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Python Apache License 2.0 UpdatedJun 28, 2023 -
-
-
latent-diffusion-lm Public
Forked from megagonlabs/coopLatent Diffusion Language Model
Jupyter Notebook BSD 3-Clause "New" or "Revised" License UpdatedDec 22, 2022 -
Chart-to-text Public
Forked from vis-nlp/Chart-to-textGNU General Public License v3.0 UpdatedDec 15, 2022