Multimodal Mood Classification - A Case Study of Differences in Hindi and Western Songs

Braja Gopal Patra, Dipankar Das, Sivaji Bandyopadhyay


Abstract
Music information retrieval has emerged as a mainstream research area in the past two decades. Experiments on music mood classification have been performed mainly on Western music based on audio, lyrics and a combination of both. Unfortunately, due to the scarcity of digitalized resources, Indian music fares poorly in music mood retrieval research. In this paper, we identified the mood taxonomy and prepared multimodal mood annotated datasets for Hindi and Western songs. We identified important audio and lyric features using correlation based feature selection technique. Finally, we developed mood classification systems using Support Vector Machines and Feed Forward Neural Networks based on the features collected from audio, lyrics, and a combination of both. The best performing multimodal systems achieved F-measures of 75.1 and 83.5 for classifying the moods of the Hindi and Western songs respectively using Feed Forward Neural Networks. A comparative analysis indicates that the selected features work well for mood classification of the Western songs and produces better results as compared to the mood classification systems for Hindi songs.
Anthology ID:
C16-1186
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1980–1989
Language:
URL:
https://aclanthology.org/C16-1186
DOI:
Bibkey:
Cite (ACL):
Braja Gopal Patra, Dipankar Das, and Sivaji Bandyopadhyay. 2016. Multimodal Mood Classification - A Case Study of Differences in Hindi and Western Songs. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1980–1989, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Multimodal Mood Classification - A Case Study of Differences in Hindi and Western Songs (Patra et al., COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1186.pdf