ABSTRACT
In this paper, we present a deep learning based approach to assign POS tags to words in a piece of text given to it as input. We propose an unsupervised approach owing to the lack of a large Sanskrit annotated corpora and use the untagged Sanskrit Corpus prepared by JNU for our purpose. The only tagged corpora for Sanskrit is created by JNU which has 115,000 words which are not sufficient to apply supervised deep learning approaches. For the tag assignment purpose and determining model accuracy, we utilize this tagged corpus. We explore various methods through which each Sanskrit word can be represented as a point multi-dimensional vector space whose position accurately captures its meaning and semantic information associated with it. We also explore other data sources to improve performance and robustness of the vector representations. We use these rich vector representations and explore autoencoder based approaches for dimensionality reduction to compress these into encodings which are suitable for clustering in the vector space. We experiment with different dimensions of these compressed representations and present one which was found to offer the best clustering performance. For modelling the sequence in order to preserve the semantic information we feed these embeddings to a bidirectional LSTM autoencoder. We assign a POS tag to each of the obtained clusters and produce our result by testing the model on the tagged corpus.
- S. Adinarayanan and N. S. Ranjaniee. 2015. Part-of speech tagger for sanskrit. A state of art survey, International Journal of Applied Engineering Research 10 (2015), 24173--24178.Google Scholar
- Hammad Ali. 2010. Unsupervised Parts-of-Speech Tagger for the Bangla language. Department of Computer Science. University of British Columbia.Google Scholar
- Waleed Ammar, Chris Dyer, and Noah A. Smith. 2014. Conditional Random Field Autoencoders for Unsupervised Structured Prediction. In NIPS 14 Proceedings of the 27th International Conference on Neural Information Processing, Systems. 3311--3319. Google ScholarDigital Library
- Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2017. Enriching Word Vectors with Subword Information. Transactions of the Association for Computational Linguistics 5 (2017), 135--146.Google ScholarCross Ref
- R. Chandrashekar. 2007. Parts-of-Speech Tagging for Sanskrit. Ph.D. Dissertation. Jawaharlal Nehru University.Google Scholar
- Oliver Hellwig. 2007. SanskritTagger: a stochastic lexical and pos tagger for Sanskrit. In First International Sanskrit Computational Linguistics Symposium.Google Scholar
- Md. Fasihul Kabir, Khandaker Abdullah-Al-Mamun, and Mohammad Nurul Huda. 2016. Deep Learning Based Parts of Speech Tagger for Bengali. In International Conference on Informatics, Electronics and Vision.Google Scholar
- Michael Lamar, Yariv Maron, Mark Johnson, and Elie Bienenstock. 2010. SVD and Clustering for Unsupervised POS Tagging. In Proceedings of the ACL 2010 Conference Short Papers. 215--219. Google ScholarDigital Library
- Chu-Cheng Lin, Waleed Ammar, Chris Dyer, and Lori Levin. 2015. Unsupervised POS Induction with Word Embeddings. In Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL. 1311--1316.Google Scholar
- TomÃąÅą Mikolov, Ilya Sutskeve, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality.. In Adv. NIPS. Google ScholarDigital Library
- M. S. Kumar R. M. Prashanthi and R. R. Sree. 2013. Pos tagger for sanskrit. International Journal of Engineering Sciences Research (IJESR) 4 (2013), 32--41.Google Scholar
- Hinrich Shutze. 1995. Distributional part-of-speech tagging. In Seventh Conference on European Chapter of the Association for Computational Linguistics. Morgan Kaufmann Publishers Inc., 141--148. Google ScholarDigital Library
- Namrata Tapaswi and Suresh Jain. 2012. Treebank based deep grammar acquisition and part-of-speech tagging for Sanskrit sentences. In In Software Engineering (CONSEG), 2012 CSI Sixth International Conference on. IEEE, 1--4.Google ScholarCross Ref
Index Terms
- Deep Learning Based Unsupervised POS Tagging for Sanskrit
Recommendations
Part-of-Speech (POS) Tagging Using Deep Learning-Based Approaches on the Designed Khasi POS Corpus
Part-of-speech (POS) tagging is one of the research challenging fields in natural language processing (NLP). It requires good knowledge of a particular language with large amounts of data or corpora for feature engineering, which can lead to achieving a ...
Toward an Effective Igbo Part-of-Speech Tagger
Part-of-speech (POS) tagging is a well-established technology for most Western European languages and a few other world languages, but it has not been evaluated on Igbo, an agglutinative African language. This article presents POS tagging experiments ...
Coupling an annotated corpus and a lexicon for amazigh POS tagging
This paper investigates how to best couple hand-annotated data with information extracted from an external lexical resource to improve part-of-speech tagging performance. Focusing mostly on Amazigh tagging, we introduce a decision tree and Markov model ...
Comments