Skip to main content
SpringerLink
Log in

Detection of situational information from Twitter during disaster using deep learning models

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

Twitter is an excellent resource for communicating between the victims and organizations during a disaster. People share opinions, sympathies, situational information, etc., in the form of tweets during a disaster. Detecting the situational tweets is a challenging task, which is very helpful to both humanitarian organizations and victims. There is a chance that both situational and non-situational information may be present in a tweet. Most of the existing works focused on identifying single-information-type tweets like situational information, actionable information, useful information, etc. Detecting the mixture of situational and non-situational information tweets remains a challenging task. Although existing works designed an SVM classifier using low-level lexical and syntactic features for classifying situational and non-situational tweets, their method does not work well for a mixture of situational and non-situational information tweets. This paper addresses the problem of detecting the situational tweets using different deep learning architectures such as Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), Bi-directional Long Short-Term Memory (BLSTM) and Bi-directional Long Short-Term Memory with attention (BLSTM attention). Moreover, deep learning models are applied to Hindi language tweets besides English language tweets for identifying the situational information during a disaster. Some of the tweets are posted in the Hindi language, where the information is not available in the English language in countries like India during the disaster. Experiments are performed on various disaster datasets such as Hagupit cyclone, Hyderabad bomb blast, Sandhy shooting, Nepal Earthquake and Harda rail accident in both in-domain and cross-domain. The results of deep learning models demonstrate that it outperforms the existing traditional approach, such as the SVM classifier with low-level lexical and syntactic features for detecting the situational tweets during the disaster. Additionally, to our best knowledge, this is the first attempt in applying the deep learning models to identify the Hindi language situational tweets during the disaster.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1

Similar content being viewed by others

References

  1. Imran M, Castillo C, Diaz F and Vieweg S 2015 Processing social media messages in mass emergency: a survey. ACM Comput. Surv. 47: 1–38

    Article  Google Scholar 

  2. Madichetty S and Sridevi M 2020 Improved classification of crisis-related data on Twitter using contextual representations. Proc. Comput. Sci. 167: 962–968

    Article  Google Scholar 

  3. Madichetty S and Sridevi M 2018 A survey on event detection methods on various social media. In: Recent Findings in Intelligent Computing Techniques, pp. 87–93

  4. Varga I, Sano M, Torisawa K, Hashimoto C, Ohtake K, Kawai T, Oh J-H and De Saeger S 2013 Aid is out there: looking for help from Tweets during a large scale Disaster. ACL, vol. 1, pp. 1619–1629

    Google Scholar 

  5. Sreenivasulu M and Sridevi M 2020 Comparative study of statistical features to detect the target event during disaster. Big Data Min. Anal. 3(2): 121–130

    Article  Google Scholar 

  6. Rudra K, Goyal P, Ganguly N, Imran M and Mitra P 2019 Summarizing situational Tweets in crisis scenarios: an extractive–abstractive approach. IEEE Trans. Comput. Soc. Syst. 6: 981–993

    Article  Google Scholar 

  7. Madichetty S and Sridevi M 2020. Detecting informative tweets during disaster using deep neural networks. In: Proceedings of the 2019 11th International Conference on Communication Systems & Networks (COMSNETS). IEEE, pp. 709–713

  8. Rudra K, Goyal P, Ganguly N, Mitra P and Imran M 2018 Identifying sub-events and summarizing disaster-related information from microblogs. In: Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 265–274

  9. Rudra K, Sharma A, Ganguly N and Ghosh S 2018 Characterizing and countering communal microblogs during disaster events. IEEE Trans. Comput. Soc. Syst. 5: 403–417

    Article  Google Scholar 

  10. Saroj A and Pal S 2020 Use of social media in crisis management: a survey. Int. J. Disaster Risk Reduct. 48: 1–19

    Article  Google Scholar 

  11. Madichetty S and Sridevi M 2020 Classifying informative and non-informative tweets from the twitter by adapting image features during disaster. Multimed. Tools Appl., 79:1–23

  12. Madichetty S and Sridevi M 2019 Disaster damage assessment from the tweets using the combination of statistical features and informative words. Soc. Netw. Anal. Min. 9: 1–11

    Article  Google Scholar 

  13. Purohit H, Castillo C and Pandey R 2020 Ranking and grouping social media requests for emergency services using serviceability model. Soc. Netw. Anal. Min. 10: 1–17

    Article  Google Scholar 

  14. Madichetty S and Sridevi M 2017 Mining informative words from the tweets for detecting the resources during disaster. In: Proceedings of the International Conference on Mining Intelligence and Knowledge Exploration, pp. 348–358

  15. Purohit H, Castillo C, Diaz F, Sheth A and Meier P 2013 Emergency-relief coordination on social media: automatically matching resource requests and offers. First Monday 19: 1–6

    Google Scholar 

  16. Madichetty S and Sridevi M 2020. Identification of medical resource tweets using majority voting-based ensemble during disaster. Soc. Netw. Anal. Min. 10: 1–18

    Article  Google Scholar 

  17. Basu M, Ghosh S, Jana A, Bandyopadhyay S and Singh R 2017. Resource mapping during a natural disaster: a case study on the 2015 nepal earthquake. Int. J. Disaster Risk Reduct. 24: 24–31

    Article  Google Scholar 

  18. Madichetty S and Sridevi M 2018 Re-ranking feature selection algorithm for detecting the availability and requirement of resources tweets during disaster. Int. J. Comput. Intell. IoT 1: 207–211

    Google Scholar 

  19. Madisetty S and Desarkar M S 2017 NSEmo at EmoInt-2017: an ensemble to predict emotion intensity in tweets. In: Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp. 219–224

  20. Madisetty S and Desarkar M S 2017 An ensemble based method for predicting emotion intensity of tweets. In: Proceedings of the International Conference on Mining Intelligence and Knowledge Exploration. Springer, pp. 359–370

  21. Roy S, Mishra S and Matam R 2020 Classification and summarization for informative Tweets. In: Proceedings of the 2020 IEEE International Students’ Conference on Electrical, Electronics and Computer Science (SCEECS), pp. 1–4

  22. Madisetty S and Desarkar M S 2018 A neural network-based ensemble approach for spam detection in Twitter. IEEE Trans. Comput. Soc. Syst. 5(4): 973–984

    Article  Google Scholar 

  23. Gupta H, Jamal M S, Madisetty S and Desarkar M S 2018 A framework for real-time spam detection in Twitter. In: Proceedings of the 2018 10th International Conference on Communication Systems & Networks (COMSNETS). IEEE, pp. 380–383

  24. Verma S, Vieweg S, Corvey W J, Palen L, Martin J H, Palmer M, Schram A and Anderson K M 2011 Natural language processing to the rescue? Extracting “situational awareness” tweets during mass emergency. In: Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, pp. 385–392

  25. Rudra K, Sharma A, Ganguly N and Ghosh S 2016 Characterizing communal microblogs during disaster events. In: Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 96–99

  26. Rudra K, Ganguly N, Goyal P and Ghosh S 2018 Extracting and summarizing situational information from the Twitter social media during disasters. ACM Trans. Web 12: 1–35

    Article  Google Scholar 

  27. Rudra K, Ghosh S, Ganguly N, Goyal P and Ghosh S 2015 Extracting situational information from microblogs during disaster events: a classification-summarization approach. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 583–592

  28. Imran M, Castillo C, Lucas J, Meier P and Vieweg S 2014 AIDR: artificial intelligence for disaster response. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 159–162

  29. Sen A, Rudra K and Ghosh S 2015 Extracting situational awareness from microblogs during disaster events. In: Proceedings of the 2015 7th International Conference on Communication Systems and Networks (COMSNETS), pp. 1–6

  30. Avvenuti M, Cresci S, Del Vigna F, Fagni T and Tesconi M 2018 rismap: a big data crisis mapping system based on damage detection and geoparsing. Inf. Syst. Front. 20: 993–1011

    Article  Google Scholar 

  31. Nguyen D T, Al Mannai K A, Joty S, Sajjad H, Imran M and Mitra P 2017 Robust classification of crisis-related data on social networks using convolutional neural networks. In: Proceedings of the Eleventh International AAAI Conference on Web and Social Media

  32. Subramani S, Wang H, Vu H Q and Li G 2018 Domestic violence crisis identification from facebook posts based on deep learning. IEEE Access 6: 54075–54085

    Article  Google Scholar 

  33. Alam F, Joty S and Imran M 2018 Graph based semi-supervised learning with convolution neural networks to classify crisis related tweets. In: Proceedings of the Twelfth International AAAI Conference on Web and Social Media

  34. Imran M, Mitra P and Castillo C 2016 witter as a lifeline: human-annotated twitter corpora for nlp of crisis-related messages. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Paris, France, May 2016. European Language Resources Association (ELRA)

  35. Kim Y 2014 Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882

  36. Palangi H, Deng L, Shen Y, Gao J, He X, Chen J, Song X and Ward R 2016 Deep sentence embedding using long short-term memory networks: analysis and application to information retrieval. IEEE/ACM Trans. Audio Speech Lang. Process. 24: 694–707

    Article  Google Scholar 

  37. Sutskever I, Vinyals O and Le Q V 2014 Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, pp. 3104–3112

  38. Johnson R and Zhang T 2016 Supervised and semi-supervised text categorization using LSTM for region embeddings. arXiv:preprint arXiv:1602.02373

  39. Zhou P, Qi Z, Zheng S, Xu J, Bao H and Xu B 2016 Text classification improved by integrating bidirectional LSTM with two-dimensional max pooling. arXiv preprint arXiv:1611.06639

  40. Chollet F et al 2015 Keras. https://github.com/fchollet/keras

  41. Bojanowski P, Grave E, Joulin A and Mikolov T 2016 Enriching Word Vectors with Subword Information. arXiv preprint arXiv:1607.04606

  42. Grave E, Bojanowski P, Gupta P, Joulin A and Mikolov T 2018 Learning word vectors for 157 languages. In: Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018)

  43. Cresci S, Tesconi M, Cimino A and Dell’Orletta F 2015 A linguistically-driven approach to cross-event damage assessment of natural disasters from social media messages. In: Proceedings of the 24th International Conference on World Wide Web, pp. 1195–1200

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology, Tiruchirappalli, India

    Sreenivasulu Madichetty & Sridevi Muthukumarasamy

Authors
  1. Sreenivasulu Madichetty
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sridevi Muthukumarasamy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sreenivasulu Madichetty.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Madichetty, S., Muthukumarasamy, S. Detection of situational information from Twitter during disaster using deep learning models. Sādhanā 45, 270 (2020). https://doi.org/10.1007/s12046-020-01504-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12046-020-01504-0

Keywords

Search

Navigation