Adaptive Data Boosting Technique for Robust Personalized Speech Emotion in Emotionally-Imbalanced Small-Sample Environments.

Sensors (Basel) 2018 Nov 2;18(11). Epub 2018 Nov 2.

Department of Computer Science and Engineering, Kyung Hee University, (Global Campus), 1732, Deogyeong-daero, Giheung-gu, Yongin-si, Gyeonggi-do 17104, Korea.

Personalized emotion recognition provides an individual training model for each target user in order to mitigate the accuracy problem when using general training models collected from multiple users. Existing personalized speech emotion recognition research has a cold-start problem that requires a large amount of emotionally-balanced data samples from the target user when creating the personalized training model. Such research is difficult to apply in real environments due to the difficulty of collecting numerous target user speech data with emotionally-balanced label samples. Therefore, we propose the Robust Personalized Emotion Recognition Framework with the Adaptive Data Boosting Algorithm to solve the cold-start problem. The proposed framework incrementally provides a customized training model for the target user by reinforcing the dataset by combining the acquired target user speech with speech from other users, followed by applying SMOTE (Synthetic Minority Over-sampling Technique)-based data augmentation. The proposed method proved to be adaptive across a small number of target user datasets and emotionally-imbalanced data environments through iterative experiments using the IEMOCAP (Interactive Emotional Dyadic Motion Capture) database.

Download full-text PDF

Source
http://www.mdpi.com/1424-8220/18/11/3744
Publisher Site
http://dx.doi.org/10.3390/s18113744DOI Listing
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC6264012PMC
November 2018

Publication Analysis

Top Keywords

target user
24
training model
12
emotion recognition
12
speech emotion
8
personalized speech
8
personalized emotion
8
user speech
8
model target
8
robust personalized
8
cold-start problem
8
data boosting
8
adaptive data
8
user
6
target
6
personalized
5
data
5
speech
5
user creating
4
datasets emotionally-imbalanced
4
emotionally-balanced label
4

Similar Publications