Adds radio data recipe #1400
Open
Adds radio data recipe #1400
+185
−0
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pzelasko
requested changes
Oct 10, 2024
lhotse/recipes/radio.py
Outdated
|
|
||
| from lhotse.parallel import parallel_map | ||
| from lhotse.audio import set_ffmpeg_torchaudio_info_enabled | ||
| import torchaudio |
There was a problem hiding this comment.
Make torchaudio imports local, it’s not a core dependency anymore.
There was a problem hiding this comment.
I think it should all be fixed now. I have an associated recipe in icefall for doing LID and geolocation that I am going to submit a pull request for. Part of that involves a custom dataset class, but it's fairly specific to this one task. I assume it would be better to just have that as part of the icefall recipe and not part of Lhotse?
pzelasko
reviewed
Oct 10, 2024
| from lhotse.supervision import SupervisionSegment, SupervisionSet | ||
| from lhotse.utils import Pathlike | ||
|
|
||
| set_ffmpeg_torchaudio_info_enabled(False) |
There was a problem hiding this comment.
One last request - don’t set these things in the global scope because it’ll be executed when Lhotse is imported. Move it to local scope (even better i think this one works like a context manager)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is the recipe for some radio data we collected and are able to distribute if someone emails us for it. We may possibly have a way of releasing it with some restrictions in the future, but for now it is just a prepare script. The paper it corresponds to is
https://aclanthology.org/2024.naacl-long.286.pdf
The main use is for geolocating speech, self-supervised model pretraining, or language id.