WHAM 噪音数据集

音视频
0 下载
11,975 浏览
2020-12-31

数据集简介

The WSJ0 Hipster Ambient Mixtures (WHAM!) dataset pairs each two-speaker mixture in the wsj0-2mix dataset with a unique noise background scene. We also created WHAMR!, an extension that adds artificial reverberation to the speech signals in addition to the background noise.

The noise audio was collected at various urban locations throughout the San Francisco Bay Area in late 2018. The environments primarily consist of restaurants, cafes, bars, and parks. Audio was recorded using an Apogee Sennheiser binaural microphone on a tripod between 1.0 and 1.5 meters off the ground.

The set of noise samples, referred to as "WHAM! noise dataset", is provided here, along with the scripts to build the WHAM! and WHAMR! datasets from the noise data and the WSJ0 dataset. We also provide the "WHAM!48kHz noise dataset", consisting of the noise recordings at their original sample rate and without segmenting the clips to the duration of WSJ0 clips. Both the WHAM! noise dataset and the WHAM!48kHz noise dataset have been processed to remove any segments containing intelligible speech. Because the WHAM!48kHz noise dataset has not been further segmented to the duration of WSJ0 clips, it has a wide distribution of clip durations.

This work is further described in our papers "WHAM!: Extending Speech Separation to Noisy Environments." and "WHAMR!: Noisy and Reverberant Single-Channel Speech Separation."

Download

The WHAM! noise dataset and variants, along with relevant data generation scripts are available for download:

Building the Dataset

The WHAM! dataset is built by mixing 2-speaker mixtures from the wsj0-2mix dataset with noise samples from the WHAM! noise dataset. Only the noise data is provided here, and users will need access (and license) to the WSJ0 dataset.

For WHAM!: Please refer to the README for detailed instructions on how to use the mixing scripts, which can be downloaded using the link above.

For WHAMR!: Please refer to the README for detailed instructions on how to use the mixing scripts, which can be downloaded using the link above.

Dataset Structure

The WHAM! noise dataset is split into training, validation, and test sets following the wsj0-2mix dataset.

Split Directory Duration (hr) No. of files
Training tr 58.03 20,000
Validation cv 14.65 5000
Test tt 9.00 3000

The clips are in 32-bit floating point WAV format with 2 channels and a sampling rate of 16 kHz. The average clip duration is 10 seconds with the shortest clip being 3.5 seconds and the longest 47.7 seconds.

Citation

WHAM! is a joint effort between Mitsubishi Electronics Research Laboratories (MERL) and Whisper. If you use WHAM! or WHAM!48kHz please cite our paper describing the dataset:

@inproceedings{Wichern2019WHAM,
    title     = {WHAM!: Extending Speech Separation to Noisy Environments},
    author    = {Wichern, Gordon and Antognini, Joe and Flynn, Michael and Zhu,
                 Licheng Richard and McQuinn, Emmett and Crow,
                 Dwight and Manilow, Ethan and Le Roux, Jonathan},
    booktitle = {Proc. Interspeech},
    year      = {2019},
    month     = sep
}

If you use WHAMR! please cite our paper describing the dataset:

@inproceedings{Maciejewski2020WHAMR,
    title     = {WHAMR!: Noisy and Reverberant Single-Channel Speech Separation},
    author    = {Maciejewski, Matthew and Wichern, Gordon and Le Roux, Jonathan},
    booktitle = {Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
    year      = {2020},
    month     = may
}

基本信息

记录数量未知
文件大小未知
文件格式未知
数据来源未知
噪音;语言识别;噪音数据集;语音数据集;声纹识别;

上架信息

数据集市运营
平台统一选品上架,经质量审核后公开
0 次下载

价格

免费