Research Progress on Emotion Recognition Based on Physiological Signals_Journal of Biomedical Engineering

Authors：

ZHANGDi , WANBaikun ,  MINGDong

Department of Biomedical Engineering, School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China;

Corresponding author：

MINGDong, Email: richardming@tju.edu.cn

Keywords：

emotion model; emotion elicitation; physiological signal; emotion recognition

DOI：

10.7507/1001-5515.20150042

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Emotion recognition will be prosperious in multifarious applications, like distance education, healthcare, and human-computer interactions, etc. Emotions can be recognized from the behavior signals such as speech, facial expressions, gestures or the physiological signals such as electroencephalogram and electrocardiogram. Contrast to other methods, the physiological signals based emotion recognition can achieve more objective and effective results because it is almost impossible to be disguised. This paper introduces recent advancements in emotion research using physiological signals, specified to its emotion model, elicitation stimuli, feature extraction and classification methods. Finally the paper also discusses some research challenges and future developments.

Citation： ZHANGDi, WANBaikun, MINGDong. Research Progress on Emotion Recognition Based on Physiological Signals. Journal of Biomedical Engineering, 2015, 32(1): 229-234. doi: 10.7507/1001-5515.20150042 Copy

1.	BLANCHETTE I, RICHARDS A. The influence of affect on higher level cognition: A review of research on interpretation, judgement, decision making and reasoning[J]. Cogn Emot, 2010, 24(4): 561-595.
2.	FRANTZIDIS C A, BRATSAS C, KLADOS M A, et al. On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications[J]. IEEE Trans Inf Technol Biomed, 2010, 14(2): 309-318.
3.	CALVO R A, D'MELLO S. Affect detection: An interdisciplinary review of models, methods, and their applications[J]. IEEE Trans Affect Comput, 2010, 1(1): 18-37.
4.	WU N, JIANG H, YANG G. Emotion recognition based on physiological signals[J]. Advances in Brain Inspired Cognitive Systems, 2012, 7366: 311-320.
5.	刘飞, 蔡厚德.情绪生理机制研究的外周与中枢神经系统整合模型[J].心理科学进展, 2010, 18(4): 616-622.
6.	KREIBIG S D. Autonomic nervous system activity in emotion: a review[J]. Biol Psychol, 2010, 84(3): 394-421.
7.	LINDQUIST K A, WAGER T D, KOBER H, et al. The brain basis of emotion: a meta-analytic review[J]. Behav Brain Sci, 2012, 35(3): 121-143.
8.	谢晶, 方平, 姜媛.情绪测量方法的研究进展[J].心理科学, 2011, 34(2): 488-493.
9.	KIM J, ANDRÉ E. Emotion recognition based on physiological changes in music listening[J]. IEEE Trans Pattern Anal Mach Intell, 2008, 30(12): 2067-2083.
10.	郑璞, 刘聪慧, 俞国良.情绪诱发方法述评[J].心理科学进展, 2012, 20(1): 45-55.
11.	蒋军, 陈雪飞, 陈安涛.情绪诱发方法及其新进展[J].西南师范大学学报:自然科学版, 2011, 36(1): 209-214.
12.	SOLEYMANI M, LICHTENAUER J, PUN T, et al. A multimodal database for affect recognition and implicit tagging[J]. IEEE Trans Affect Comput, 2012, 3(1): 42-55.
13.	KOELSTRA S, MUHL C, SOLEYMANI M, et al. Deap: a database for emotion analysis using physiological signals[J]. IEEE Trans Affect Comput, 2012, 3(1): 18-31.
14.	TAI K, CHAU T. Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface[J]. J Neuroeng Rehabil, 2009, 6(39): 1-14.
15.	MANDRYK R L, ATKINS M S. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies[J]. Int J Hum Comput Stud, 2007, 65(4): 329-347.
16.	聂聃, 王晓韡, 段若男, 等.基于脑电的情绪识别研究综述[J].中国生物医学工程学报, 2012, 31(4): 595-606.
17.	陈继华, 李岚, 钱坤喜.基于多生理信号的情绪初步识别[J].生物医学工程研究, 2006, 25(3): 141-146.
18.	MOGHIMI S, KUSHKI A, POWER S, et al. Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy[J]. J Neural Eng, 2012, 9(2): 6022-6031.
19.	MURUGAPPAN M, RAMACHANDRAN N, SAZALI Y. Classification of human emotion from EEG using discrete wavelet transform[J]. J Biomed Sci Eng, 2010, 3(4): 390-396.
20.	HOSSEINI S A, NAGHI-SISTANI M B. Emotion recognition method using entropy analysis of EEG signals[J]. International Journal of Image, Graphics and Signal Processing(IJIGSP), 2011, 3(5): 30-36.
21.	KONSTANTINIDIS E I, FRANTZIDIS C A, PAPPAS C, et al. Real time emotion aware applications: a case study employing emotion evocative pictures and neuro-physiological sensing enhanced by Graphic Processor Units[J]. Comput Methods Programs Biomed, 2012, 107(1): 16-27.
22.	LIU Y, SOURINA O, NGUYEN M K. Real-time EEG-Based emotion recognition and its applications[J]. Transactions on computational scienceⅫ, 2011, 6670: 256-277.
23.	LIN Y P, WANG C H, JUNG T P, et al. EEG-based emotion recognition in music listening[J]. IEEE Trans Biomed Eng, 2010, 57(7): 1798-1806.
24.	WAGNER J, KIM J, ANDRE E. From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification[C]//IEEE International Conference on Multimedia and Expo. Amsterdam: 2005: 940-943.
25.	NIE D, WANG X W, SHI L C, et al. EEG-based emotion recognition during watching movies[C]//5th International Conference on Neural Engineering. Cancun: 2011: 667-670.
26.	XU Y, LIU G Y, HAO M, et al. Analysis of affective ECG signals toward emotion recognition[J]. J Electr, 2010, 27(1): 8-14.
27.	PETRANTONAKIS P C, HADJILEONTIADIS L J. A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition[J]. IEEE Trans Inf Technol Biomed, 2011, 15(5): 737-746.
28.	MAAOUI C, PRUSKI A. Emotion recognition through physiological signals for human-machine communication[J]. Cutting Edge Robotics, 2010, 20: 317-328.
29.	GU Y, TAN S L, WONG K J, et al. A biometric signature based system for improved emotion recognition using physiological responses from multiple subjects[C]//8th International Conference on Industrial Informatics. Osaka: 2010: 61-66.
30.	AGRAFIOTI F, HATZINAKOS D, ANDERSON A K. ECG pattern analysis for emotion detection[J]. IEEE Trans Affect Comput, 2012, 3(1): 102-115.

1. BLANCHETTE I, RICHARDS A. The influence of affect on higher level cognition: A review of research on interpretation, judgement, decision making and reasoning[J]. Cogn Emot, 2010, 24(4): 561-595.
2. FRANTZIDIS C A, BRATSAS C, KLADOS M A, et al. On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications[J]. IEEE Trans Inf Technol Biomed, 2010, 14(2): 309-318.
3. CALVO R A, D'MELLO S. Affect detection: An interdisciplinary review of models, methods, and their applications[J]. IEEE Trans Affect Comput, 2010, 1(1): 18-37.
4. WU N, JIANG H, YANG G. Emotion recognition based on physiological signals[J]. Advances in Brain Inspired Cognitive Systems, 2012, 7366: 311-320.
5. 刘飞, 蔡厚德.情绪生理机制研究的外周与中枢神经系统整合模型[J].心理科学进展, 2010, 18(4): 616-622.
6. KREIBIG S D. Autonomic nervous system activity in emotion: a review[J]. Biol Psychol, 2010, 84(3): 394-421.
7. LINDQUIST K A, WAGER T D, KOBER H, et al. The brain basis of emotion: a meta-analytic review[J]. Behav Brain Sci, 2012, 35(3): 121-143.
8. 谢晶, 方平, 姜媛.情绪测量方法的研究进展[J].心理科学, 2011, 34(2): 488-493.
9. KIM J, ANDRÉ E. Emotion recognition based on physiological changes in music listening[J]. IEEE Trans Pattern Anal Mach Intell, 2008, 30(12): 2067-2083.
10. 郑璞, 刘聪慧, 俞国良.情绪诱发方法述评[J].心理科学进展, 2012, 20(1): 45-55.
11. 蒋军, 陈雪飞, 陈安涛.情绪诱发方法及其新进展[J].西南师范大学学报:自然科学版, 2011, 36(1): 209-214.
12. SOLEYMANI M, LICHTENAUER J, PUN T, et al. A multimodal database for affect recognition and implicit tagging[J]. IEEE Trans Affect Comput, 2012, 3(1): 42-55.
13. KOELSTRA S, MUHL C, SOLEYMANI M, et al. Deap: a database for emotion analysis using physiological signals[J]. IEEE Trans Affect Comput, 2012, 3(1): 18-31.
14. TAI K, CHAU T. Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface[J]. J Neuroeng Rehabil, 2009, 6(39): 1-14.
15. MANDRYK R L, ATKINS M S. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies[J]. Int J Hum Comput Stud, 2007, 65(4): 329-347.
16. 聂聃, 王晓韡, 段若男, 等.基于脑电的情绪识别研究综述[J].中国生物医学工程学报, 2012, 31(4): 595-606.
17. 陈继华, 李岚, 钱坤喜.基于多生理信号的情绪初步识别[J].生物医学工程研究, 2006, 25(3): 141-146.
18. MOGHIMI S, KUSHKI A, POWER S, et al. Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy[J]. J Neural Eng, 2012, 9(2): 6022-6031.
19. MURUGAPPAN M, RAMACHANDRAN N, SAZALI Y. Classification of human emotion from EEG using discrete wavelet transform[J]. J Biomed Sci Eng, 2010, 3(4): 390-396.
20. HOSSEINI S A, NAGHI-SISTANI M B. Emotion recognition method using entropy analysis of EEG signals[J]. International Journal of Image, Graphics and Signal Processing(IJIGSP), 2011, 3(5): 30-36.
21. KONSTANTINIDIS E I, FRANTZIDIS C A, PAPPAS C, et al. Real time emotion aware applications: a case study employing emotion evocative pictures and neuro-physiological sensing enhanced by Graphic Processor Units[J]. Comput Methods Programs Biomed, 2012, 107(1): 16-27.
22. LIU Y, SOURINA O, NGUYEN M K. Real-time EEG-Based emotion recognition and its applications[J]. Transactions on computational scienceⅫ, 2011, 6670: 256-277.
23. LIN Y P, WANG C H, JUNG T P, et al. EEG-based emotion recognition in music listening[J]. IEEE Trans Biomed Eng, 2010, 57(7): 1798-1806.
24. WAGNER J, KIM J, ANDRE E. From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification[C]//IEEE International Conference on Multimedia and Expo. Amsterdam: 2005: 940-943.
25. NIE D, WANG X W, SHI L C, et al. EEG-based emotion recognition during watching movies[C]//5th International Conference on Neural Engineering. Cancun: 2011: 667-670.
26. XU Y, LIU G Y, HAO M, et al. Analysis of affective ECG signals toward emotion recognition[J]. J Electr, 2010, 27(1): 8-14.
27. PETRANTONAKIS P C, HADJILEONTIADIS L J. A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition[J]. IEEE Trans Inf Technol Biomed, 2011, 15(5): 737-746.
28. MAAOUI C, PRUSKI A. Emotion recognition through physiological signals for human-machine communication[J]. Cutting Edge Robotics, 2010, 20: 317-328.
29. GU Y, TAN S L, WONG K J, et al. A biometric signature based system for improved emotion recognition using physiological responses from multiple subjects[C]//8th International Conference on Industrial Informatics. Osaka: 2010: 61-66.
30. AGRAFIOTI F, HATZINAKOS D, ANDERSON A K. ECG pattern analysis for emotion detection[J]. IEEE Trans Affect Comput, 2012, 3(1): 102-115.

Previous Article
Application Status of Rapid Prototyping Technology in Artificial Bone Based on Reverse Engineering
Next Article
Study on the Regulatory Effects of Mechano Growth Factor on Soft Tissue Repair

Journal of Biomedical Engineering

Research Progress on Emotion Recognition Based on Physiological Signals

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content