skip to main content
10.1145/3107411.3107513acmconferencesArticle/Chapter ViewAbstractPublication PagesbcbConference Proceedingsconference-collections
short-paper

Confused or not Confused?: Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks

Authors Info & Claims
Published:20 August 2017Publication History

ABSTRACT

Brain fog, also known as confusion, is one of the main reasons of the low performance in the learning process or any kind of daily task that involves and requires thinking. Detecting confusion in human's mind in real time is a challenging and important task which can be applied to online education, driver fatigue detection and so on. In this paper, we applied Bidirectional LSTM Recurrent Neural Networks to classify students' confusions. The results show that Bidirectional LSTM model achieves the state-of-the-art performance compared with other machine learning approaches, and shows strong robustness as evaluated by cross-validation. We can predict whether or not a student is confused in the accuracy of 73.3%. Furthermore, we find the most important feature to detecting the brain confusion is gamma 1 wave of EEG signal. Our results suggest that machine learning is a potentially powerful tool to model and understand brain activities.

References

  1. Theoharis Constantin Theoharides, Julia M Stewart, and Erifili Hatziagelaki. Brain "fog," inflammation and obesity: key aspects of neuropsychiatric disorders improved by luteolin. Frontiers in neuroscience, 9:225, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  2. Laurent Vézard, Pierrick Legrand, Marie Chavent, Frédérique Faïta-Aïnseba, and Leonardo Trujillo. EEG classification for the detection of mental states. Applied Soft Computing, 32:113--131, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Mervyn VM Yeo, Xiaoping Li, Kaiquan Shen, and Einar PV Wilder-Smith. Can SVM be used for automatic EEG detection of drowsiness during car driving? Safety Science, 47(1):115--124, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  4. Abdulhamit Subasi and M Ismail Gursoy. EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Systems with Applications, 37(12):8659--8666, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, and Kai-min Chang. Using EEG to improve massive open online courses feedback interaction. In AIED Workshops, 2013.Google ScholarGoogle Scholar
  6. Y-lan Boureau, Yann L Cun, et al. Sparse feature learning for deep belief networks. In Advances in neural information processing systems, pages 1185--1192, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Mehdi Hajinoroozi, Tzyy-Ping Jung, Chin-Teng Lin, and Yufei Huang. Feature extraction with deep belief networks for driver's cognitive states prediction from EEG data. In Signal and Information Processing (ChinaSIP), 2015 IEEE China Summit and International Conference on, pages 812--815. IEEE, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  8. Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the 26th annual international conference on machine learning, pages 609--616. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. AA Petrosian, DV Prokhorov, W Lajara-Nanson, and RB Schiffer. Recurrent neural network-based approach for early recognition of alzheimer's disease in EEG. Clinical Neurophysiology, 112(8):1378--1387, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  10. Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167, 2015.Google ScholarGoogle Scholar
  11. Tim Cooijmans, Nicolas Ballas, César Laurent, Cauglar Gülccehre, and Aaron Courville. Recurrent batch normalization. arXiv preprint arXiv:1603.09025, 2016.Google ScholarGoogle Scholar
  12. Haohan Wang. EEG brain wave for confusion, 2016. Online: https://www.kaggle.com/wanghaohan/eeg-brain-wave-for-confusion.Google ScholarGoogle Scholar
  13. NeuroSky. NeuroSky's eSense meters and detection of mental state. 2009.Google ScholarGoogle Scholar
  14. César Laurent, Gabriel Pereyra, Philémon Brakel, Ying Zhang, and Yoshua Bengio. Batch normalized recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on, pages 2657--2661. IEEE, 2016.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9(8):1735--1780, 1997.endthebibliography Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Confused or not Confused?: Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ACM-BCB '17: Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology,and Health Informatics
        August 2017
        800 pages
        ISBN:9781450347228
        DOI:10.1145/3107411

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 August 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        ACM-BCB '17 Paper Acceptance Rate42of132submissions,32%Overall Acceptance Rate254of885submissions,29%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader