Ewan Nurse
ABSTRACT
Deep learning technology is uniquely suited to analyse neurophysiological signals such as the electroencephalogram (EEG) and local field potentials (LFP) and promises to outperform traditional machine-learning based classification and feature extraction algorithms. Furthermore, novel cognitive computing platforms such as IBM's recently introduced neuromorphic TrueNorth chip allow for deploying deep learning techniques in an ultra-low power environment with a minimum device footprint. Merging deep learning and TrueNorth technologies for real-time analysis of brain-activity data at the point of sensing will create the next generation of wearables at the intersection of neurobionics and artificial intelligence.
- O. Abdel-Hamid, A.-r. Mohamed, H. Jiang, and G. Penn. Applying convolutional neural networks concepts to hybrid nn-hmm model for speech recognition. In Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, pages 4277--4280. IEEE, 2012.Google Scholar
Cross Ref
- A. Amir, P. Datta, W. P. Risk, A. S. Cassidy, J. Kusnitz, S. K. Esser, A. Andreopoulos, T. M. Wong, M. Flickner, R. Alvarez-Icaza, et al. Cognitive computing programming paradigm: a corelet language for composing networks of neurosynaptic cores. In Neural Networks (IJCNN), The 2013 International Joint Conference on, pages 1--10. IEEE, 2013.Google Scholar
- Auviz systems. http://auvizsystems.com/products/auvizdnn/.Google Scholar
- M. Breakspear and C. J. Stam. Dynamics of a neural system with a multiscale architecture. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 360(1457):1051--1074, 2005.Google ScholarCross Ref
- D. R. Chialvo. Emergent complex neural dynamics. Nature physics, 6(10):744--750, 2010.Google ScholarCross Ref
- M. J. Cook, T. J. O'Brien, S. F. Berkovic, M. Murphy, A. Morokoff, G. Fabinyi, W. D'Souza, R. Yerra, J. Archer, L. Litewka, et al. Prediction of seizure likelihood with a long-term, implanted seizure advisory system in patients with drug-resistant epilepsy: a first-in-man study. The Lancet Neurology, 12(6):563--571, 2013.Google ScholarCross Ref
- S. Dieleman, P. Brakel, and B. Schrauwen. Audio-based music classification with a pretrained convolutional network. In ISMIR, pages 669--674, 2011.Google Scholar
- S. K. Esser, R. Appuswamy, P. Merolla, J. V. Arthur, and D. S. Modha. Backpropagation for energy-efficient neuromorphic computing. In Advances in Neural Information Processing Systems, pages 1117--1125, 2015.Google ScholarDigital Library
- D. R. Freestone, P. J. Karoly, A. D. Peterson, L. Kuhlmann, A. Lai, F. Goodarzy, and M. J. Cook. Seizure prediction: Science fiction or soon to become reality? Current Neurology and Neuroscience Reports, 15(11):1--9, 2015.Google ScholarCross Ref
- A. P. Georgopoulos, A. B. Schwartz, and R. E. Kettner. Neuronal population coding of movement direction. Science, 233(4771):1416--1419, 1986.Google ScholarCross Ref
- A. Graves, A.-r. Mohamed, and G. Hinton. Speech recognition with deep recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 6645--6649. IEEE, 2013.Google ScholarCross Ref
- L. R. Hochberg, D. Bacher, B. Jarosiewicz, N. Y. Masse, J. D. Simeral, J. Vogel, S. Haddadin, J. Liu, S. S. Cash, P. van der Smagt, et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature, 485(7398):372--375, 2012.Google ScholarCross Ref
- L. R. Hochberg, M. D. Serruya, G. M. Friehs, J. A. Mukand, M. Saleh, A. H. Caplan, A. Branner, D. Chen, R. D. Penn, and J. P. Donoghue. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature, 442(7099):164--171, 2006.Google ScholarCross Ref
- J. J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8):2554--2558, 1982.Google ScholarCross Ref
- G. Hotson, D. P. McMullen, M. S. Fifer, M. S. Johannes, K. D. Katyal, M. P. Para, R. Armiger, W. S. Anderson, N. V. Thakor, B. A. Wester, et al. Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject. Journal of neural engineering, 13(2):026017, 2016.Google Scholar
- Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. B. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In ACM Multimedia, volume 2, page 4, 2014. Google ScholarDigital Library
- A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1725--1732. IEEE, 2014. Google ScholarDigital Library
- A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097--1105, 2012.Google ScholarDigital Library
- Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. Nature, 521(7553):436--444, 2015.Google ScholarCross Ref
- P. A. Merolla, J. V. Arthur, R. Alvarez-Icaza, A. S. Cassidy, J. Sawada, F. Akopyan, B. L. Jackson, N. Imam, C. Guo, Y. Nakamura, et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science, 345(6197):668--673, 2014.Google ScholarCross Ref
- Movidius. http://www.movidius.com/solutions/vision-processing-unit.Google Scholar
- E. S. Nurse, P. J. Karoly, D. B. Grayden, and D. R. Freestone. A generalizable brain-computer interface (bci) using machine learning for feature discovery. PLoS ONE, 10(6):e0131328, 06 2015.Google ScholarCross Ref
- Nvidia jetson tk1 whitepaper. http://developer.download.nvidia.com/embedded/jetson/TX1/docs/jetson_tx1_whitepaper.pdf.Google Scholar
- J. Pavlus. The search for a new machine. Scientific American, 312(5):58--63, 2015.Google ScholarCross Ref
- Qualcomm zeroth. https://www.qualcomm.com/invention/cognitive-technologies/zeroth.Google Scholar
- S. J. Schiff. Neural control engineering: the emerging intersection between control theory and neuroscience. MIT Press, 2012.Google Scholar
- K. A. Sillay, P. Rutecki, K. Cicora, G. Worrell, J. Drazkowski, J. J. Shih, A. D. Sharan, M. J. Morrell, J. Williams, and B. Wingeier. Long-term measurement of impedance in chronically implanted depth and subdural electrodes during responsive neurostimulation in humans. Brain stimulation, 6(5):718--726, 2013.Google ScholarCross Ref
- Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1701--1708. IEEE, 2014. Google ScholarDigital Library
- Teradeep. http://teradeep.com/nnx.html.Google Scholar
- M. Velliste, S. Perel, M. C. Spalding, A. S. Whitford, and A. B. Schwartz. Cortical control of a prosthetic arm for self-feeding. Nature, 453(7198):1098--1101, 2008.Google ScholarCross Ref
- W. Wang, J. L. Collinger, A. D. Degenhart, E. C. Tyler-Kabara, A. B. Schwartz, D. W. Moran, D. J. Weber, B. Wodlinger, R. K. Vinjamuri, R. C. Ashmore, et al. An electrocorticographic brain interface in an individual with tetraplegia. PloS one, 8(2):e55344, 2013.Google ScholarCross Ref
- Z. Wang, S. Lyu, G. Schalk, and Q. Ji. Deep feature learning using target priors with applications in ecog signal decoding for bci. In Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pages 1785--1791. AAAI Press, 2013. Google ScholarDigital Library
- J. Wolpaw and E. W. Wolpaw. Brain-computer interfaces: principles and practice. Oxford University Press, 2012.Google ScholarCross Ref
- D. Wulsin, J. Gupta, R. Mani, J. Blanco, and B. Litt. Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement. Journal of neural engineering, 8(3):036015, 2011.Google Scholar
- M. Yang, S. A. Sheth, C. A. Schevon, G. M. M. II, and N. Mesgarani. Speech reconstruction from human auditory cortex with deep neural networks. In Sixteenth Annual Conference of the International Speech Communication Association, 2015.Google Scholar
Index Terms
- Decoding EEG and LFP signals using deep learning: heading TrueNorth
Recommendations
Epileptic Seizures Detection Using iEEG Signals and Deep Learning Models
AbstractEpilepsy is a common neurological disorder that affects millions of people worldwide, and many patients do not respond well to traditional anti-epileptic drugs. To improve the lives of these patients, there is a need to develop accurate methods ...
A transfer learning-based CNN and LSTM hybrid deep learning model to classify motor imagery EEG signals
AbstractIn the Motor Imagery (MI)-based Brain Computer Interface (BCI), users' intention is converted into a control signal through processing a specific pattern in brain signals reflecting motor characteristics. There are such restrictions as ...
Highlights- Data Augmentation by the cropping method to increase the number of trials.
- Time-...
Trends in Machine Learning and Electroencephalogram (EEG): A Review for Undergraduate Researchers
HCI International 2023 – Late Breaking PapersAbstractThis paper presents a systematic literature review on Brain-Computer Interfaces (BCIs) in the context of Machine Learning. Our focus is on Electroencephalography (EEG) research, highlighting the latest trends as of 2023. The objective is to ...
Comments