skip to main content
10.1145/3290818.3290827acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccbbConference Proceedingsconference-collections
research-article

From Biosignals to Affective States: a Semantic Approach

Published:11 October 2018Publication History

ABSTRACT

The final goal of Affective Computing is in allowing to recognize human emotional states by means of automatic procedures. Despite scientific literature evidences the concrete usefulness of possible approaches based on biosignals analysis to detect and correctly classify emotions, existing systems and tools are generally too invasive for common subjects and in addition they are too intensive in terms of needed processing. Hence, practical application and effectiveness of such kind of solutions is really limited to laboratory-controlled contexts and this seriously compromises their porting to real scenarios. This paper aims to propose an innovative approach for the automatic interpretation of affective information. Biosignal features of subjects stimulated by emotions are extracted and annotated automatically adopting a semantically rich and non-ambiguous language. Logic-based matchmaking, leveraging non-standard inference algorithms, allows to detect the most probable emotional state of the subject. The proposed approach has been validated through the implementation and the experimental evaluation of a prototypical system.

References

  1. Picard R.W., Affective computing, MIT press, Cambridge, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ezzat T., Poggio T., MikeTalk: A Talking Facial Display Based on Morphing Visemes, Computer Animation Conference, IEEE, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Kolko, B. E., Representing bodies in virtual space: The rhetoric of avatar design, The Information Society, 15(3):177--186, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  4. Ekman P., Emotion in the human face, Pergamon Press, 1982.Google ScholarGoogle Scholar
  5. Ekman P., Friesen. W.V., Hager. J.C., Facial action coding system, Human Face, 2002.Google ScholarGoogle Scholar
  6. Scherer K., Schorr A., Johnstone T., Appraisal processes in emotion: Theory, methods, research, Oxford University Press, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  7. Barreto A., Non-intrusive physiological monitoring for affective sensing of computer users, in Human-Computer Interaction, New Developments, INTECH Open Access Publisher, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Filion D. L., Dawson M.E., Schell A.M., The psychological significance of human startle eyeblink modification: a review, Biol Psychol, 47:1--43, 1998.Google ScholarGoogle ScholarCross RefCross Ref
  9. Kim K., Bang S., Kim S., Emotion recognition system using short-term monitoring of physiological signals, Medical and biological engineering and computing, 42:419--427, 2004.Google ScholarGoogle Scholar
  10. Levenson R. Ekman P., Friesen W., Voluntary facial action generates emotion-specific autonomic nervous system activity, Psychophysiology, 27: 363--384, 1990.Google ScholarGoogle ScholarCross RefCross Ref
  11. Soleymani M., Lichtenauer J., Pun T., Pantic M., A multimodal database for affect recognition and implicit tagging, IEEE Transactions on Affective Computing. 3(1): 42--55, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Koelstra S., Mühl C., Soleymani M., Lee J.S., Yazdani A., Ebrahimi T., Patras I, Deap: A database for emotion analysis; using physiological signals, IEEE Transactions on Affective Computing, 3(1): 18--31, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Abadi M. K., Subramanian R., Kia S. M., Avesani P., Patras I., Sebe N., DECAF: MEG-based Multimodal Database for decoding affective physiological responses, IEEE Transactions on Affective Computing, 6(3): 209--222, 2015.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Rani P., Liu C., Sarkar N., Vanman E., An empirical study of machine learning techniques for affect recognition in human-robot interaction, Pattern Analysis & Applications, 9: 58--69, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Sasikumar M., Ramani S., Raman S. M., Anjaneyulu K. S. R., Chandrasekar R., Rule Based Expert Systems - A Practical Introduction, Narosa Publishers, 2007.Google ScholarGoogle Scholar
  16. De Virgilio R., Di Sciascio E., Ruta M., Scioscia F., Torlone R., Semantic-based RFID Data Management, in Unique Radio Innovation for the 21st Century: Building Scalable and Global RFID Networks, Springer Verlag, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  17. Berners-Lee T., Hendler J., Lassila O., The Semantic Web, Scientific American, 284(5): 34--43, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  18. Scioscia F., Ruta M., Loseto G., Gramegna F., Ieva S., Pinto A., Di Sciascio E., A mobile matchmaker for the Ubiquitous Semantic Web, International Journal on Semantic Web and Information Systems, 10(4): 77--100, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  19. Hampton J. R., ECG in Practice, 2nd ed., Churchill Livingstone, 1992.Google ScholarGoogle Scholar
  20. Kreibig S. D., Autonomic nervous system activity in emotion: a review, Biological Psychology, 84(3): 394--421, 2010.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. From Biosignals to Affective States: a Semantic Approach

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Other conferences
                ICCBB '18: Proceedings of the 2018 2nd International Conference on Computational Biology and Bioinformatics
                October 2018
                89 pages
                ISBN:9781450365529
                DOI:10.1145/3290818

                Copyright © 2018 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 11 October 2018

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed limited
              • Article Metrics

                • Downloads (Last 12 months)7
                • Downloads (Last 6 weeks)1

                Other Metrics

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader