Supervision : Christophe MARSALA

Co-supervision : RIFQI Maria, PINNA Andrea

Towards user-independent emotion recognition and implementation on hardware

This thesis investigates physiological-based emotion recognition in a digital game context and the feasibility of implementing the model on an embedded system. The following chanllenges are addressed: the relationship between emotional states and physiological responses in the game context, individual variabilities of the pschophysiological responses and issues of implementation on an embedded system. The major contributions of this thesis are:???? Firstly, we construct a multi-modal Database for Affective Gaming (DAG). This database contains multiple measurements concerning objective modalities such as physiological signals and subjective assessments. We presented statistics of the database and run a series of analysis on emotional moment detection and emotion classification, influencing factors of the overall game experience using various machine learning methods. Secondly, we investigate the individual variability and proposed a personalized group-based model by using the clustering techniques based on physiological traits deduced from optimal feature set. We showed that the proposed personalized group-based model performs better than the general model and user-specific model. Thirdly, we implemente the proposed method on an ARM A9 system and showed that the proposed method can meet the requirement of computation time.

2015-2018 Publications

• 2018
  • W. Yang : “Towards user-independent emotion recognition and implementation on hardware”, thesis, phd defence 02/27/2018, supervision Marsala, Christophe, co-supervision : Rifqi, Maria, Pinna, Andrea (2018)
  • W. YANG, M. Rifqi, Ch. Marsala, A. Pinna : “Physiological-Based Emotion Detection and Recognition in a Video Game Context”, IEEE International Joint Conference on Neural Networks (IJCNN), Rio, Brazil, pp. 194-201 (2018)
  • M. Liao, Q.‑D. To, C. Léonard, W. YANG : “Prediction of thermal conductance and friction coefficients at solid-gas interface from statistical learning of collisions”, Physical Review E, (American Physical Society (APS)) (2018)
• 2016
  • W. YANG, Ch. Marsala, A. Pinna, M. Rifqi, P. Garda : “Arbres de décision flous adaptatifs”, 25^e rencontres francophones sur la logique floue et ses applications (LFA), La Rochelle, France (2016)
• 2015
  • W. YANG, A. Gomes Da Silva, M.‑L. Picard : “COMPUTING DATA QUALITY INDICATORS ON BIG DATA STREAMS USING A CEP”, Computational Intelligence for Multimedia Understanding (IWCIM), 2015 International Workshop on, Prague, Czechia (2015)