skip to main content
10.1145/3292500.3330921acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article
Public Access

GroupINN: Grouping-based Interpretable Neural Network for Classification of Limited, Noisy Brain Data

Published:25 July 2019Publication History

ABSTRACT

Mapping the human brain, or understanding how certain brain regions relate to specific aspects of cognition, has been and remains an active area of neuroscience research. Functional magnetic resonance imaging (fMRI) data---in the form of images, time series or graphs---are central in this research, but pose many challenges in phenotype prediction tasks (e.g., noisy, small training samples). Standardly employed handcrafted models and newly proposed neural network methods pose limitations in the expressive power and interpretability, respectively, in this context. In this work focusing on fMRI-derived brain graphs, a modality that partially handles some challenges of fMRI data, we propose a grouping-based interpretable neural network model, GroupINN, that effectively classifies cognitive performance with 85% fewer model parameters than baseline deep models, while also identifying the most predictive brain subnetworks within several task-specific contexts. Our method incorporates the idea of node grouping into the design of the neural network. That way, unlike other methods that employ clustering as a preprocessing step to reorder nodes, GroupINN learns the node grouping and extracts graph features jointly. Experiments on task-based fMRI datasets show that our method is $2.6-69\times$ faster than other deep models, while achieving comparable or better accuracy and providing interpretability.

References

  1. Ariana Anderson, Pamela K Douglas, Wesley T Kerr, Virginia S Haynes, Alan L Yuille, Jianwen Xie, Ying Nian Wu, Jesse A Brown, and Mark S Cohen. Nonnegative matrix factorization of multimodal mri, fmri and phenotypic data reveals differential changes in default mode subnetworks in adhd. NeuroImage, 102:207-- 219, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  2. Karsten M. Borgwardt and Hans-Peter Kriegel. Shortest-path kernels on graphs. In ICDM, pages 74--81. IEEE, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ed Bullmore and Olaf Sporns. Complex brain networks: graph theoretical analysis of structural and functional systems. Nature Reviews Neuroscience, 10(3):186, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  4. Edward T Bullmore and Danielle S Bassett. Brain graphs: graphical models of the human brain connectome. Annu Rev Clin Psychol, 7:113--140, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  5. Jessica R Cohen and Mark D'Esposito. The segregation and integration of distinct brain networks and their relationship to cognition. J Neurosci, 36(48):12083--12094, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  6. Michael W Cole, Danielle S Bassett, Jonathan D Power, Todd S Braver, and Steven E Petersen. Intrinsic and task-evoked network architectures of the human brain. Neuron, 83(1):238--251, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  7. MichaelWCole andWalter Schneider. The cognitive control network: integrated cortical regions with dissociable functions. Neuroimage, 37(1):343--360, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  8. Elizabeth N Davison, Kimberly J Schlesinger, Danielle S Bassett, Mary-Ellen Lynall, Michael B Miller, Scott T Grafton, and Jean M Carlson. Brain network adaptability across task states. PLoS comput biol, 11(1):e1004029, 2015.Google ScholarGoogle Scholar
  9. Ian J Deary, Lars Penke, and Wendy Johnson. The neuroscience of human intelligence differences. Nat rev neurosci, 11(3):201, 2010.Google ScholarGoogle Scholar
  10. Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. Convolutional neural networks on graphs with fast localized spectral filtering. In NeurIPS, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Bruce Fischl, David H Salat, Evelina Busa, Marilyn Albert, Megan Dieterich, Christian Haselgrove, Andre Van Der Kouwe, Ron Killiany, David Kennedy, Shuna Klaveness, et al. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron, 33(3):341--355, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  12. Aapo Hyvärinen, Juha Karhunen, and Erkki Oja. Independent component analysis, volume 46. John Wiley & Sons, 2004.Google ScholarGoogle Scholar
  13. Rex E Jung and Richard J Haier. The parieto-frontal integration theory (p-fit) of intelligence: converging neuroimaging evidence. Behavioral and Brain Sciences, 30(2):135--154, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  14. Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In ICLR, 2017.Google ScholarGoogle Scholar
  15. Risi Kondor and Horace Pan. The multiscale laplacian graph kernel. In NeurIPS, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Danai Koutra and Christos Faloutsos. Individual and Collective Graph Mining: Principles, Algorithms, and Applications. Synthesis Lectures on Data Mining and Knowledge Discovery. Morgan & Claypool Publishers, 2017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Danai Koutra, Yu Gong, Sephira Ryman, Rex Jung, Joshua Vogelstein, and Christos Faloutsos. Are all brains wired equally. In OHBM, 2013.Google ScholarGoogle Scholar
  18. Danai Koutra, Joshua T Vogelstein, and Christos Faloutsos. Deltacon: A principled massive-graph similarity function. In SDM, pages 162--170. SIAM, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  19. Nils M Kriege, Pierre-Louis Giscard, and Richard Wilson. On valid optimal assignment kernels and applications to graph classification. In NeurIPS, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jure Leskovec and Christos Faloutsos. Sampling from large graphs. In KDD, pages 631--636. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Martin A Lindquist et al. The statistical analysis of fmri data. Statistical science, 23(4):439--464, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  22. Huan Liu, Mianzhi Zhang, Xintao Hu, Yudan Ren, Shu Zhang, Junwei Han, Lei Guo, and Tianming Liu. Fmri data classification based on hybrid temporal and spatial sparse representation. In ISBI, pages 957--960. IEEE, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  23. Yike Liu, Tara Safavi, Abhilash Dighe, and Danai Koutra. Graph summarization methods and applications: A survey. CSUR, 51(3):62, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Aljoscha C Neubauer, Andreas Fink, and Dietmar G Schrausser. Intelligence and neural efficiency: The influence of task content and sex on the brain--iq relationship. Intelligence, 30(6):515--536, 2002.Google ScholarGoogle ScholarCross RefCross Ref
  25. Mark EJ Newman. Modularity and community structure in networks. PNAS, 103(23):8577--8582, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  26. Jonathan D Power, Alexander L Cohen, Steven M Nelson, Gagan S Wig, Kelly Anne Barnes, Jessica A Church, Alecia C Vogel, Timothy O Laumann, Fran M Miezin, Bradley L Schlaggar, et al. Functional network organization of the human brain. Neuron, 72(4):665--678, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  27. Tara Safavi, Chandra Sripada, and Danai Koutra. Scalable hashing-based network discovery. In ICDM, pages 405--414. IEEE, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  28. Saman Sarraf and Ghassem Tofighi. Deep learning-based pipeline to recognize alzheimer's disease using fmri data. In FTC, pages 816--820. IEEE, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  29. Yiru Shen, Chen Feng, Yaoqing Yang, and Dong Tian. Mining point cloud local structures by kernel correlation and graph pooling. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4548--4557, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  30. N. Shervashidze, S. V. N. Vishwanathan, T. Petri, K. Mehlhorn, and K. Borgwardt. Efficient graphlet kernels for large graph comparison. In AISTATS, volume 5, pages 488--495. JMLR: W&CP, 2009.Google ScholarGoogle Scholar
  31. Stephen M Smith, Aapo Hyvärinen, Gaël Varoquaux, Karla L Miller, and Christian F Beckmann. Group-pca for very large fmri datasets. Neuroimage, 101:738-- 749, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  32. Olaf Sporns, Giulio Tononi, and Rolf Kötter. The human connectome: a structural description of the human brain. PLoS computational biology, 1(4):e42, 2005.Google ScholarGoogle Scholar
  33. Chandra Sripada, Mike Angstadt, Saige Rutherford, Daniel Kessler, Yura Kim, Mike Yee, and Liza Levina. Fundamental units of inter-individual variation in resting state connectomes. bioRxiv, page 326082, 2018.Google ScholarGoogle Scholar
  34. Cornelis J Stam and Jaap C Reijneveld. Graph theoretical analysis of complex networks in the brain. Nonlinear biomedical physics, 1(1):3, 2007.Google ScholarGoogle Scholar
  35. Wei Tang, Zhengdong Lu, and Inderjit S Dhillon. Clustering with multiple graphs. In ICDM, pages 1016--1021. IEEE, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Kamil Ugurbil and David Van Essen. Hcp young adult. https://www. humanconnectome.org/study/hcp-young-adult, 2017.Google ScholarGoogle Scholar
  37. Heather L Urry, Carien M van Reekum, Tom Johnstone, and Richard J Davidson. Individual differences in some (but not all) medial prefrontal regions reflect cognitive demand while regulating unpleasant emotion. Neuroimage, 47(3):852-- 863, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  38. Martijn P van den Heuvel, Cornelis J Stam, René S Kahn, and Hilleke E Hulshoff Pol. Efficiency of functional brain networks and intellectual performance. J Neurosci, 29(23):7619--7624, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  39. S. V. N. Vishwanathan, Nicol N. Schraudolph, Risi Imre Kondor, and Karsten M. Borgwardt. Graph kernels. JMLR, 11:1201--1242, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Qi Wang, Mengying Sun, Liang Zhan, Paul Thompson, Shuiwang Ji, and Jiayu Zhou. Multi-modality disease modeling via collective deep matrix factorization. In KDD, pages 1155--1164. ACM, 2017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Shen Wang, Lifang He, Bokai Cao, Chun-Ta Lu, Philip S. Yu, and Ann B. Ragin. Structural deep brain network mining. In KDD, pages 475--484. ACM, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Yujun Yan, Mark Heimann, Di Jin, and Danai Koutra. Fast flow-based random walk with restart in a multi-query setting. In Proceedings of the 2018 SIAM International Conference on Data Mining, pages 342--350. SIAM, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  43. Yaoqing Yang, Chen Feng, Yiru Shen, and Dong Tian. Foldingnet: Point cloud auto-encoder via deep grid deformation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 206--215, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  44. Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. Hierarchical graph representation learning with differentiable pooling. In NeurIPS, pages 4800--4810, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Muhan Zhang, Zhicheng Cui, Marion Neumann, and Yixin Chen. An end-to-end deep learning architecture for graph classification. In AAAI, 2018.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. GroupINN: Grouping-based Interpretable Neural Network for Classification of Limited, Noisy Brain Data

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
        July 2019
        3305 pages
        ISBN:9781450362016
        DOI:10.1145/3292500

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 July 2019

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        KDD '19 Paper Acceptance Rate110of1,200submissions,9%Overall Acceptance Rate1,133of8,635submissions,13%

        Upcoming Conference

        KDD '24

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader