End-to-End Speech Processing Toolkit

CVPR 2024 Research Paper with Code

微调Whisper语音识别模型，支持无时间戳数据训练，有时间戳数据训练、无语音数据训练。加速推理，支持Web部署、Windows桌面部署和Android部署

1st place solution for TBrain 2023 SinoPac AIGO House Price Prediction

Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets from huggingface.

Language sample analysis tooling built around CLAN and CHAT transcripts. Dev branch is feat/next.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Model for All.

Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

Entailment self-training

[WIP] Scripts for fine-tuning Whisper

Multimodal-GPT

A youtube-dl fork with additional features and fixes

GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

Python module for evaluating ASR hypotheses (e.g. word error rate, word recognition rate).

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

中文LLaMA&Alpaca大语言模型+本地CPU/GPU部署 (Chinese LLaMA & Alpaca LLMs)

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

CNN-based audio segmentation toolkit. Allows to detect speech, music and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.

We extend CoT data to Alpaca to boost its reasoning ability. We are constantly expanding our collection of instruction-tuning data, and integrating more LLMs together for easy use. （我们将CoT数据扩展到Alpa…

BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation

A python package for calculating the PESQ.

🔊 Text-prompted Generative Audio Model - With the ability to clone voices