Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Ready] F5-TTS Training Recipe for WenetSpeech4TTS #1846

Merged
merged 20 commits into from
Jan 27, 2025
Merged

Conversation

yuekaizhang
Copy link
Collaborator

@yuekaizhang yuekaizhang commented Dec 24, 2024

Added F5-TTS Icefall style training codes based on https://github.com/SWivid/F5-TTS.

Training logs and results: https://huggingface.co/yuekai/f5-tts-small-wenetspeech4tts-basic

Model Seed-TTS test_zh WER Comment
vall-e 150M 4.33 Icefall codebase reproduced, wenetspeech basic 7k hours
f5-small 150M 32 steps 2.42 Icefall codebase reproduced, wenetspeech basic 7k hours
f5-base 300M 32 steps 1.52 F5-TTS pretrained, Emilia zh&en 100k hours

Samples:

seen1_text19.mov
seen2_text20.2.mov

@yuekaizhang yuekaizhang marked this pull request as draft December 24, 2024 07:40
@yfyeung
Copy link
Collaborator

yfyeung commented Dec 24, 2024

Nice work

@yuekaizhang yuekaizhang marked this pull request as ready for review January 20, 2025 09:52
@yuekaizhang yuekaizhang changed the title [WIP] F5-TTS Training Recipe for WenetSpeech4TTS [Ready] F5-TTS Training Recipe for WenetSpeech4TTS Jan 20, 2025
@yuekaizhang yuekaizhang requested a review from JinZr January 20, 2025 09:55
@JinZr
Copy link
Collaborator

JinZr commented Jan 21, 2025 via email

egs/wenetspeech4tts/TTS/prepare.sh Outdated Show resolved Hide resolved
egs/wenetspeech4tts/TTS/f5-tts/speech_synthesis.py Outdated Show resolved Hide resolved
@JinZr
Copy link
Collaborator

JinZr commented Jan 26, 2025

hi! i just finished reviewing this pr and it looks great!

i've left a few comments in it, please take a look when you have a moment

thank you!

@JinZr
Copy link
Collaborator

JinZr commented Jan 27, 2025

i make a few commits to fix the flake8 and black formatting err, and i think this pr is good to go now.

@JinZr JinZr merged commit dd5d7e3 into k2-fsa:master Jan 27, 2025
131 of 213 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants