Abstract
Transformation-based learning, a technique introduced by Eric Brill (1993b), has been shown to do part-of-speech tagging with fairly high accuracy. This same method can be applied at a higher level of textual interpretation for locating chunks in the tagged text, including non-recursive “baseNP” chunks. For this purpose, it is convenient to view chunking as a tagging problem by encoding the chunk structure in new tags attached to each word. In automatic tests using Treebank-derived data, this technique achieved recall and precision rates of roughly 93% for baseNP chunks (trained on 950K words) and 88% for somewhat more complex chunks that partition the sentence (trained on 200K words). Working in this new application and with larger template and training sets has also required some interesting adaptations to the transformation-based learning approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abney, S. 1991. Parsing by chunks. In Berwick, Abney, and Tenny, editors, Principle-Based Parsing. Kluwer Academic Publishers, pp. 257–278.
Bourigault, D. 1992. Surface grammatical analysis for the extraction of terminological noun phrases. In Proceedings of the Fifteenth International Conference on Computational Linguistics, pp. 977–981.
Brill, E. 1993a. Automatic grammar induction and parsing free text: A transformation-based approach. In Proceedings of the DARPA Speech and Natural Language Workshop, 1993, pp. 237–242.
Brill, E. 1993b. A Corpus-Based Approach to Language Learning. Ph.D. thesis, University of Pennsylvania.
Brill, E. 1993c. Rule based tagger, version 1.14. Available via ftp from the directory ftp://ft.p.cs.jhu.edu/pub/brill/programs/.
Brill, E. 1994. Sonie advances in transformation-based part of speech tagging. In Proceedings of the Twelfth. National Conference on Artificial Intelligence, pp. 722–727.
Brill, E. and Resnik, P. 1994. A rule-based approach to prepositional attachment disambiguation. In Proceedings of the Fifteenth International Conference on Computational Linguistics, Kyoto, Japan.
Church, K. 1988. A stochastic parts program and noun phrase parser for unrestricted text. In Second Conference on Applied Natural Language Processing. Association for Computational Linguistics.
Ejerhed, E. I. 1988. Finding clauses in unrestricted text by finitary and stochastic methods. In Second Conference on Applied Natural Language Processing,pp. 219–227. Association for Computational Linguistics.
Gee, J. P. and Grosjean, F. 1983. Performance structures: A psycholinguistic and linguistic appraisal. Cognitive Psychology, 15, pp. 411–458.
Kupiec, J. 1993. An algorithm for finding noun phrase correspondences in bilingual corpora. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pp. 17–22.
Mitchell, M., Kim, G., Marcinkiewicz, M. A., Maclntyre, R., Bies, A., Ferguson, M., Katz, K. and Schasberger, B. 1994. The Penn Treebank: A revised corpus design for extracting predicate argument structure. In Human Language Technology, ARPA March 1994 Workshop. Morgan Kaufmann.
Ramshaw, L. A. and Mitchell, P. M. 1994. Exploring the statistical derivation of transformational rule sequences for part-of-speech tagging. In Proceedings of the Balancing Act Workshop on Combining Symbolic and Statistical Approaches to Language, Association for Computational Linguistics, pp. 86–95.
Voutilainen, A. 1993. NPToo1, a detector of English noun phrases. In Proceedings of the Workshop on Very Large Corpora, pp. 48–57. Association for Computational Linguistics.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Ramshaw, L.A., Marcus, M.P. (1999). Text Chunking Using Transformation-Based Learning. In: Armstrong, S., Church, K., Isabelle, P., Manzi, S., Tzoukermann, E., Yarowsky, D. (eds) Natural Language Processing Using Very Large Corpora. Text, Speech and Language Technology, vol 11. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-2390-9_10
Download citation
DOI: https://doi.org/10.1007/978-94-017-2390-9_10
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-5349-7
Online ISBN: 978-94-017-2390-9
eBook Packages: Springer Book Archive