Abstract
This paper proposes a new emotion recognition method from electroencephalogram (EEG) signals by leveraging video stimulus as privileged information, which is only required during training. A Restricted Boltzmann Machine (RBM) is adopted to model the intrinsic relations between stimulus videos and users’ EEG response, and to generate new EEG features. Then, the support vector machine is used to recognize users’ emotion states from the generated EEG features. Experiments on two benchmark databases demonstrate that stimulus videos as the privileged information can help EEG signals construct better feature space, and RBM can model the high-order dependencies between stimulus videos and users’ EEG response successfully. Our proposed emotion recognition method leveraging video stimulus as privileged information outperforms the recognition method only from EEG signals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Hinton, G.: A practical guide to training restricted boltzmann machines. Momentum 9(1), 926 (2010)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)
Soleymani, M., Koelstra, S., Patras, I., Pun, T.: Continuous emotion detection in response to music videos. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 803–808. IEEE (2011)
Soleymani, M., Lichtenauer, J., Pun, T., Pantic, M.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3(1), 42–55 (2012)
Subasi, A.: Eeg signal classification using wavelet feature extraction and a mixture of expert model. Expert Syst. Appl. 32(4), 1084–1093 (2007)
Torres-Valencia, C.A., Garcia-Arias, H.F., López, M.A.A., Orozco-Gutiérrez, A.A.: Comparative analysis of physiological signals and electroencephalogram (eeg) for multimodal emotion recognition using generative models. In: 2014 XIX Symposium on Image, Signal Processing and Artificial Vision (STSIVA), pp. 1–5. IEEE (2014)
Tseng, K.C., Lin, B.S., Han, C.M., Wang, P.S.: Emotion recognition of eeg underlying favourite music by support vector machine. In: 2013 International Conference on Orange Technologies (ICOT), pp. 155–158. IEEE (2013)
Vapnik, V., Vashist, A.: A new learning paradigm: learning using privileged information. Neural Netw. 22(5), 544–557 (2009)
Wang, H.L., Cheong, L.F.: Affective understanding in film. IEEE Trans. Circuits Syst. Video Technol. 16(6), 689–704 (2006)
Wang, S., Zhu, Y., Wu, G., Ji, Q.: Hybrid video emotional tagging using users eeg and video content. Multimedia Tools Appl. 72(2), 1257–1283 (2014)
Zhu, Y., Wang, S., Ji, Q.: Emotion recognition from users’ eeg signals with the help of stimulus videos. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2014)
Acknowledgement
This work has been supported by the National Natural Science Foundation of China (61175037, 61228304, 61473270), and Project from Anhui Science and Technology Agency(1508085SMF223).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Gao, Z., Wang, S. (2015). Emotion Recognition from EEG Signals by Leveraging Stimulus Videos. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9315. Springer, Cham. https://doi.org/10.1007/978-3-319-24078-7_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-24078-7_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24077-0
Online ISBN: 978-3-319-24078-7
eBook Packages: Computer ScienceComputer Science (R0)