Skip to main content

Discovering Conversational Topics and Emotions Associated with Demonetization Tweets in India

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 798))

Abstract

Social media platforms, owing to its great wealth of information, facilitates one’s opportunities to explore hidden patterns or unknown correlations. It also finds its credibility in understanding people’s expressions from what they are discussing on online platforms. As one showcase, in this paper, we summarize the dataset of Twitter messages related to recent demonetization of all Rs. 500 and Rs. 1000 notes in India and explore insights from Twitter’s data. Our proposed system automatically extracts the popular latent topics in conversations regarding demonetization discussed in Twitter via the Latent Dirichlet Allocation (LDA)-based topic model and also identifies the correlated topics across different categories. Additionally, it also discovers people’s opinions expressed through their tweets related to the event under consideration via the emotion analyzer. The system also employs an intuitive and informative visualization to show the uncovered insight. Furthermore, we use an evaluation measure, Normalized Mutual Information (NMI), to select the best LDA models. The obtained LDA results show that the tool can be effectively used to extract discussion topics and summarize them for further manual analysis.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Srivastava, A., Sahami, M. (eds.) Text mining: Classification, Clustering and Applications, pp. 155–184. CRC Press, Boca Raton, FL

    Google Scholar 

  2. Wallach, H.M.: Topic modeling: beyond bag-of-words. In: Proceedings of the 23rd International Conference on Machine Learning (ICML ’06). ACM, New York, NY, USA, 977–984. 2006 https://doi.org/10.1145/1143844.1143967

  3. Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2, 1–2 (January 2008), 1–135. (2008) https://doi.org/10.1561/1500000011

    Article  Google Scholar 

  4. Twitter Streaming API-Twitter Developers. https://dev.twitter.com/streaming/overview

  5. MongoDB-MongoDB, Inc. https://www.mongodb.com/

  6. Tweets-Twitter Developers. https://dev.twitter.com/overview/api/tweets

  7. Text Mining Package in R. https://cran.r-project.org/web/packages/tm/tm.pdf

  8. Porter, M.F.: An algorithm for suffix stripping. In Program 14, 130–137 (1980)

    Article  Google Scholar 

  9. Salton, G., McGill, M.J.: In Introduction to Modern Information Retrieval. McGraw Hill Book Co (1983)

    Google Scholar 

  10. Yates, B.R., Neto, R.B.: Modern Information Retrieval. ACM Press, New York (1999)

    Google Scholar 

  11. Blei, David M.: Probabilistic topic models. Commun. ACM 55(4), 77–84 (2012)

    Article  Google Scholar 

  12. Blei, David M., Ng, Andrew Y., Jordan, Michael I.: Latent Dirichlet Allocation. J. Machine Learning Res. 3, 993–1022 (2003)

    MATH  Google Scholar 

  13. Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. National Acad. Sci. 101(suppl 1), 5228–5235 (2004)

    Article  Google Scholar 

  14. Griffiths, T.: Gibbs sampling in the generative model of latent dirichlet allocation, 2002

    Google Scholar 

  15. Zhai, Z., Liu, B., Xu, H., Jia, P.: Constrained LDA for Grouping Product Features in Opinion Mining. In: Huang, J. Z., Cao, L., Srivastava, J. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2011. Lecture Notes in Computer Science, vol. 6634. Springer, Berlin, Heidelberg (2011)

    Chapter  Google Scholar 

  16. Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon, Saif Mohammad and Peter Turney, In: Proceedings of the NAACL-HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, June 2010, LA, California

    Google Scholar 

  17. Plutchik, R.: Integration, differentiation, and derivatives of emotion. Evol. Cognition 7(2), 114–125 (2001)

    Google Scholar 

  18. McDaid, A.F., Greene, D., Hurley, N.: Normalized mutual information to evaluate overlapping community finding algorithms, CoRR. Aug 2013. arXiv:1110.2515v2 [physics.soc-ph]

  19. Syuzhet. https://cran.r-project.org/web/packages/syuzhet/index.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mitodru Niyogi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Niyogi, M., Kumar Pal, A. (2019). Discovering Conversational Topics and Emotions Associated with Demonetization Tweets in India. In: Verma, N., Ghosh, A. (eds) Computational Intelligence: Theories, Applications and Future Directions - Volume I. Advances in Intelligent Systems and Computing, vol 798. Springer, Singapore. https://doi.org/10.1007/978-981-13-1132-1_17

Download citation

Publish with us

Policies and ethics