data_preparation.md

Data preparation

Format description

The training set should be arranged as follows:

PATH_AUDIO_FILES  
│
└───spkr1
│   └───...
│         │   seq_11.wav
│         │   seq_12.wav
│         │   ...
│   
└───spkr2
    └───...
          │   seq_21.wav
          │   seq_22.wav

The spkrN information can then be used to sample sequences when training the model (within- or across- sampling)

Pre-filtering strategies

1. Remove non-speech segments

If you want to discard non-speech segments from your training set, you can use:

• The voice type classifier if your dataset consists of long-form recordings
• However, a pretrained pyannote.audio voice activity detection model will likely return more accurate segments if your data is clean

Both return .rttm files indicating where there is speech in each audio file. If you used the voice type classifier (as I did) you can run:

python data/extract_segments.py --audio_path /path/to/audio --rttm_path /path/to/rttm --output_path /path/to/output \
  --durations [8, 16, 32, 64, 128] --sampling random --classes [MAL,FEM] --min_dur 1.5

This will create 8h, 16h, ..., 128h training sets with segments produced by male and female speakers whose duration is at least 1.5s.

2. Remove noisy and/or reverberated segments

If you want to discard noisy and/or reverberated segments from your training set, you can use Brouhaha.