Abstract
Social media platforms, owing to its great wealth of information, facilitates one’s opportunities to explore hidden patterns or unknown correlations. It also finds its credibility in understanding people’s expressions from what they are discussing on online platforms. As one showcase, in this paper, we summarize the dataset of Twitter messages related to recent demonetization of all Rs. 500 and Rs. 1000 notes in India and explore insights from Twitter’s data. Our proposed system automatically extracts the popular latent topics in conversations regarding demonetization discussed in Twitter via the Latent Dirichlet Allocation (LDA)-based topic model and also identifies the correlated topics across different categories. Additionally, it also discovers people’s opinions expressed through their tweets related to the event under consideration via the emotion analyzer. The system also employs an intuitive and informative visualization to show the uncovered insight. Furthermore, we use an evaluation measure, Normalized Mutual Information (NMI), to select the best LDA models. The obtained LDA results show that the tool can be effectively used to extract discussion topics and summarize them for further manual analysis.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Srivastava, A., Sahami, M. (eds.) Text mining: Classification, Clustering and Applications, pp. 155–184. CRC Press, Boca Raton, FL
Wallach, H.M.: Topic modeling: beyond bag-of-words. In: Proceedings of the 23rd International Conference on Machine Learning (ICML ’06). ACM, New York, NY, USA, 977–984. 2006 https://doi.org/10.1145/1143844.1143967
Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2, 1–2 (January 2008), 1–135. (2008) https://doi.org/10.1561/1500000011
Twitter Streaming API-Twitter Developers. https://dev.twitter.com/streaming/overview
MongoDB-MongoDB, Inc. https://www.mongodb.com/
Tweets-Twitter Developers. https://dev.twitter.com/overview/api/tweets
Text Mining Package in R. https://cran.r-project.org/web/packages/tm/tm.pdf
Porter, M.F.: An algorithm for suffix stripping. In Program 14, 130–137 (1980)
Salton, G., McGill, M.J.: In Introduction to Modern Information Retrieval. McGraw Hill Book Co (1983)
Yates, B.R., Neto, R.B.: Modern Information Retrieval. ACM Press, New York (1999)
Blei, David M.: Probabilistic topic models. Commun. ACM 55(4), 77–84 (2012)
Blei, David M., Ng, Andrew Y., Jordan, Michael I.: Latent Dirichlet Allocation. J. Machine Learning Res. 3, 993–1022 (2003)
Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. National Acad. Sci. 101(suppl 1), 5228–5235 (2004)
Griffiths, T.: Gibbs sampling in the generative model of latent dirichlet allocation, 2002
Zhai, Z., Liu, B., Xu, H., Jia, P.: Constrained LDA for Grouping Product Features in Opinion Mining. In: Huang, J. Z., Cao, L., Srivastava, J. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2011. Lecture Notes in Computer Science, vol. 6634. Springer, Berlin, Heidelberg (2011)
Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon, Saif Mohammad and Peter Turney, In: Proceedings of the NAACL-HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, June 2010, LA, California
Plutchik, R.: Integration, differentiation, and derivatives of emotion. Evol. Cognition 7(2), 114–125 (2001)
McDaid, A.F., Greene, D., Hurley, N.: Normalized mutual information to evaluate overlapping community finding algorithms, CoRR. Aug 2013. arXiv:1110.2515v2 [physics.soc-ph]
Syuzhet. https://cran.r-project.org/web/packages/syuzhet/index.html
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Niyogi, M., Kumar Pal, A. (2019). Discovering Conversational Topics and Emotions Associated with Demonetization Tweets in India. In: Verma, N., Ghosh, A. (eds) Computational Intelligence: Theories, Applications and Future Directions - Volume I. Advances in Intelligent Systems and Computing, vol 798. Springer, Singapore. https://doi.org/10.1007/978-981-13-1132-1_17
Download citation
DOI: https://doi.org/10.1007/978-981-13-1132-1_17
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1131-4
Online ISBN: 978-981-13-1132-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)