Skip to main content
SpringerLink
Log in

Methodology for Detection of ERD/ERS EEG Patterns Produced by Cut Events in Film Fragments

  • Conference paper
  • First Online:
Augmented Cognition. Theoretical and Technological Approaches (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12196))

Included in the following conference series:

Abstract

The goal of this communication is to create a framework to isolate the neural reactions registered through EEG as a consequence of a specific input, among all those caused by an audiovisual. In order to do that, we analysed the neuronal register of the power change reactions related to specific cinematographic techniques, in this case the shot change by cut.

To research the shot change by cut through the neuronal record, one could use ad hoc audiovisual material specifically made for the experiment were the inputs are artificially introduced, or one could work with commercial cinematographic material, in order to have a more ecological approach For the latter approach, a more complex signal analysis process is needed because in the neuronal register the cut reactions are difficult to isolate.

For this experiment we used the EEG records of 21 subjects watching fragments extracted from 4 feature films that represent different styles and technical approaches. From the 21 user’s records we created a model signal for each film and compared the power change between the different model signals of each films through permutations test, Spearman correlation and analysis of slopes. Through an automated process with sliding time windows, we were able to locate those temporal lapses, electrodes and frequency bands that show reactions to the shot change by cut in the power change that have synchronous reactions in all the model signals. We also located the neuronal reactions that suppose representative variations in the ERD/ERS due to the cut input.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ben-Yakov, A., Henson, R.: The hippocampal film-editor: sensitivity and specificity to event boundaries in continuous experience. bioRxiv, 273409 (2018)

    Google Scholar 

  2. Heimann, K., Uithol, S., Calbi, M., Umiltà, M., Guerra, M., Gallese, V.: “Cuts in action”: a high-density EEG study investigating the neural correlates of different editing techniques in film. Cogn. Sci. 41(6), 1–34 (2016). https://doi.org/10.1111/cogs.12439

    Article  Google Scholar 

  3. Smith, T.: An attentional theory of cinematic continuity. Projections 6, 1–50 (2012)

    Article  Google Scholar 

  4. da Silva, B., Bandeira, A., Tavares, M.: Cadavre exquis: a motion-controlled interactive film. In: 9th International Conference on Digital and Interactive Arts, Braga, Portugal, pp. 1–4 (2019)

    Google Scholar 

  5. António, R., da Silva, B., Rodrigues, J., Tavares, M.: Experimenting on film: technology meets arts. J. Creat. Interfaces Comput. Graph. 8(1), 54–56 (2017). https://doi.org/10.4018/IJCICG.2017010104

    Article  Google Scholar 

  6. Cohendet, R., da Silva, M., Gilet, A.-L., Le Callet, P.: Emotional interactive movie: adjusting the scenario according to the emotional response of the viewer. EAI Endorsed Trans. Creat. Technol. 4(10), 1–7 (2017). https://doi.org/10.4108/eai.4-9-2017.153053

    Article  Google Scholar 

  7. Nijholt, A.: Brain Art: Brain-Computer Interfaces for Artistic Expresion. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14323-7

    Book  Google Scholar 

  8. Heimann, K., Umiltà, M., Guerra, M., Gallese, V.: Moving mirrors: a high-density EEG study investigating the effect of camera movements on motor cortex activation during action observation. J. Cogn. Neurosci. 26(9), 2087–2101 (2014). https://doi.org/10.1162/jocn_a_00602

    Article  Google Scholar 

  9. Martín-Pascual, M.A.: Mirando la realidad observando las pantallas. Activación diferencial en la percepción visual del movimiento real y aparente audiovisual con diferente montaje cinematográfico. Un estudio con profesionales y no profesionales del audiovisual. (tesis doctoral). Universitat Autònoma de Barcelona, Barcelona, Spain (2016)

    Google Scholar 

  10. American Electroencephalographic Society: American electroencephalographic society guidelines for standard electrode position nomenclature. J. Clin. Neurophysiol. 8(2), 200–202 (1991). https://doi.org/10.1097/00004691-199104000-00007

    Article  Google Scholar 

  11. Sanz, J., Wulff-Abramsson, A., Aguilar-Paredes, C., Bruni, L., Sánchez, L.: Synchronizing audio-visual film stimuli in unity (version 5.5. 1f1): Game Engines as a Tool for Research (2019). arXiv:1907.04926

  12. Pfurtscheller, G., Neuper, C., Brunner, C., Lopes da Silva, F.: Beta rebound after different types of motor imagery in man. Neurosci. Lett. 378(3), 156–159 (2005). https://doi.org/10.1016/j.neulet.2004.12.034

    Article  Google Scholar 

  13. Pfurtscheller, G.: Functional brain imaging based on ERD/ERS. Vis. Res. 41(10–11), 1257–1260 (2001). https://doi.org/10.1016/S0042-6989(00)00235-2

    Article  Google Scholar 

  14. Pfurtscheller, G., Lopes Da Silva, F.: Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110(11), 1842–1857 (1999). https://doi.org/10.1016/S1388-2457(99)00141-8

    Article  Google Scholar 

  15. Lachaux, J.-P., Chavez, M., Lutz, A.: A simple measure of correlation across time, frequency and space between continuous brain signals. J. Neurosci. Methods 123(2), 175–188 (2003). https://doi.org/10.1016/S0165-0270(02)00358-8

    Article  Google Scholar 

  16. Heeren, T., D’Agostino, R.: Robustness of the two independent samples t-test when applied to ordinal scaled data. Stat. Med. 6(1), 19–90 (1987). https://doi.org/10.1002/sim.4780060110

    Article  Google Scholar 

  17. Neuhauser, M.: Nonparametric Statistical Tests: A Computational Approach. Chapman and Hall/CRC, Boca Raton (2011)

    Book  Google Scholar 

  18. Drexler, W., Fujimoto, J.: Optical Coherence Tomography. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-24817-2_8

    Book  Google Scholar 

  19. Wilsgaard, T., Jacobsen, B.: Lifestyle factors and incident metabolic syndrome: the Tromsø study 1979–2001. Diabetes Res. Clin. Pract. 78(2), 217–224 (2007). https://doi.org/10.1016/j.diabres.2007.03.006

    Article  Google Scholar 

  20. Lafond, C., Series, F., Lemiere, C.: Impact of CPAP on asthmatic patients with obstructive sleep apnoea. Eur. Respir. J. 29(2), 307–311 (2007). https://doi.org/10.1183/09031936.00059706

    Article  Google Scholar 

  21. Sims, R.: Bivariate Data Analysis: A Practical Guide. Nova Publishers, New York (2000)

    MATH  Google Scholar 

  22. Michels, L., Moazami-Goudarzi, M., Jeanmonod, D., Sarnthein, J.: EEG alpha distinguishes between cuneal and precuneal activation in working memory. Neuroimage 40(3), 1296–1310 (2008). https://doi.org/10.1016/j.neuroimage.2007.12.048

    Article  Google Scholar 

  23. Adam, A., Ibrahim, Z., Mokhtar, N., Shapiai, M.I., Mubin, M., Saad, I.: Feature selection using angle modulated simulated Kalman filter for peak classification of EEG signals. SpringerPlus 5(1), 1–24 (2016). https://doi.org/10.1186/s40064-016-3277-z

    Article  Google Scholar 

  24. Klimesch, W., Doppelmay, M., Pachinger, T., Ripper, B.: Theta band power in the human scalp an the encoding of new information. NeuroReport 7(7), 9–12 (1996). https://doi.org/10.1097/00001756-199605170-00002

    Article  Google Scholar 

  25. Doppelmayr, M., Klimesch, W., Pachinger, T., Ripper, B.: The functional significance of absolute power with respect to event-related desynchronization. Brain Topogr. 11(2), 133–140 (1998). https://doi.org/10.1023/A:1022206622348

    Article  Google Scholar 

  26. Gordon, E., Sim, M.: The EEG in presenile dementia. J. Neurol. Neurosurg. Psychiatry 30(3), 285 (1967)

    Article  Google Scholar 

  27. Rodriguez, E., George, N., Lachaux, J.-P., Martinerie, J., Renault, B., Varela, F.: Perception’s shadow: long-distance synchronization of human brain activity. Nature 397(6718), 430–433 (1999). https://doi.org/10.1038/17120

    Article  Google Scholar 

  28. Reber, T., et al.: Intracranial EEG correlates of implicit relational inference within the hippocampus. Hippocampus 26(1), 54–56 (2016). https://doi.org/10.1002/hipo.22490

    Article  Google Scholar 

  29. Lyerly, S.: The average Spearman rank correlation coefficient. Psychometrika 17(4), 421–428 (1952). https://doi.org/10.1007/BF02288917

    Article  MathSciNet  MATH  Google Scholar 

  30. Costa, T., Rognoni, E., Galati, D.: EEG phase synchronization during emotional response to positive and negative film stimuli. Neurosci. Lett. 406(3), 159–164 (2006). https://doi.org/10.1016/j.neulet.2006.06.039

    Article  Google Scholar 

  31. Krause, C.M., Viemerö, V., Rosenqvist, A., Sillanmäki, L., Aström, T.: Relative electroencephalographic desynchronization and synchronization in humans to emotional film content: an analysis of the 4–6, 6–8, 8–10 and 10–12 Hz frequency bands. Neurosci. Lett. 286(1), 9–12 (2000). https://doi.org/10.1016/S0304-3940(00)01092-2

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universitat de Barcelona, Barcelona, Spain

    Javier Sanz Aznar, Carlos Aguilar-Paredes & Lydia Sánchez-Gómez

  2. Aalborg University, Copenhagen, Denmark

    Luis Emilio Bruni & Andreas Wulff-Abramsson

Authors
  1. Javier Sanz Aznar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carlos Aguilar-Paredes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lydia Sánchez-Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luis Emilio Bruni
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andreas Wulff-Abramsson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Javier Sanz Aznar .

Editor information

Editors and Affiliations

  1. Soar Technology Inc., Orlando, FL, USA

    Dylan D. Schmorrow

  2. Design Interactive, Inc., Orlando, FL, USA

    Cali M. Fidopiastis

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sanz Aznar, J., Aguilar-Paredes, C., Sánchez-Gómez, L., Bruni, L.E., Wulff-Abramsson, A. (2020). Methodology for Detection of ERD/ERS EEG Patterns Produced by Cut Events in Film Fragments. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. Theoretical and Technological Approaches. HCII 2020. Lecture Notes in Computer Science(), vol 12196. Springer, Cham. https://doi.org/10.1007/978-3-030-50353-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50353-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50352-9

  • Online ISBN: 978-3-030-50353-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation