Michael Granitzer
Maya Hristakeva
ABSTRACT
Social research networks such as Mendeley and CiteULike offer various services for collaboratively managing bibliographic metadata. Compared with traditional libraries, metadata quality is of crucial importance in order to create a crowdsourced bibliographic catalog for search and browsing. Artifacts, in particular PDFs which are managed by the users of the social research networks, become one important metadata source and the starting point for creating a homogeneous, high quality, bibliographic catalog. Natural Language Processing and Information Extraction techniques have been employed to extract structured information from unstructured sources. However, given highly heterogeneous artifacts that cover a range of publication styles, stemming from different publication sources, and imperfect PDF processing tools, how accurate are metadata extraction methods in such real-world settings? This paper focuses on answering that question by investigating the use of Conditional Random Fields and Support Vector Machines on real-world data gathered from Mendeley and Linked-Data repositories. We compare style and content features on existing state-of-the-art methods on two newly created real-world data sets for metadata extraction. Our analysis shows that two-stage SVMs provide reasonable performance in solving the challenge of metadata extraction for crowdsourcing bibliographic metadata management.
- ParsCit: An open-source CRF Reference String Parsing Package. European Language Resources Association, 2008.Google Scholar
- L. Bottou. Large-scale machine learning with stochastic gradient descent. In Y. Lechevallier and G. Saporta, editors, Proceedings of the 19th International Conference on Computational Statistics (COMPSTAT'2010), pages 177--187, Paris, France, August 2010. Springer.Google ScholarCross Ref
- M. Granitzer, M. Hristakeva, R. Knight, and K. Jack. A comparison of metadata extraction techniques for crowdsourced bibliographic metadata management. In Proceedings of the 27th Symposium On Applied Computing (poster), page to appear. ACM New York, NY, USA, 2012. Google ScholarDigital Library
- H. Han, C. L. Giles, E. Manavoglu, H. Zha, Z. Zhang, and E. A. Fox. Automatic document metadata extraction using support vector machines. In JCDL'03, pages 37--48, 2003. Google ScholarDigital Library
- H. Han, E. Manavoglu, H. Zha, K. Tsioutsiouliklis, C. L. Giles, and X. Zhang. Rule-based word clustering for document metadata extraction. In Proceedings of the 2005 ACM symposium on Applied computing - SAC '05, page 1049, New York, New York, USA, 2005. ACM Press. Google ScholarDigital Library
- J. D. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01, pages 282--289, San Francisco, CA, USA, 2001. Morgan Kaufmann Publishers Inc. Google ScholarDigital Library
- M. Luong, T. Nguyen, and M. Kan. Logical structure recovery in scholarly articles with rich document features. Journal of Digital Library Systems. Forthcoming, 2011.Google Scholar
- G. Michael. Results and raw experimental data on the e-prints data set for a comparison of metadata extraction techniques for crowed-source bibliographic metadata management. http://goo.gl/WHfU9, 2011.Google Scholar
- F. Peng and A. McCallum. Accurate information extraction from research papers using conditional random fields. In Proceedings of Human Language Technology Conference, pages 329--336. HLT-NAACL04, 2004.Google Scholar
- K. Seymore, A. McCallum, and R. Rosenfeld. Learning hidden Markov model structure for information extraction. In Proceedings of AAAI 99 Workshop on Machine Learning for Information Extraction, pages 37--42, 1999.Google Scholar
- F. Wu and D. Weld. Open information extraction using wikipedia. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 118--127. Association for Computational Linguistics, 2010. Google ScholarDigital Library
Index Terms
- A comparison of layout based bibliographic metadata extraction techniques
Recommendations
A Heuristic Baseline Method for Metadata Extraction from Scanned Electronic Theses and Dissertations
JCDL '20: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020Extracting metadata from scholarly papers is an important text mining problem. Widely used open-source tools such as GROBID are designed for born-digital scholarly papers but often fail for scanned documents, such as Electronic Theses and Dissertations (...
A comparison of metadata extraction techniques for crowdsourced bibliographic metadata management
SAC '12: Proceedings of the 27th Annual ACM Symposium on Applied ComputingSocial research networks such as Mendeley and CiteULike offer various services for collaboratively managing bibliographic metadata and uploading textual artifacts. One core problem thereby is the extraction of bibliographic metadata from the textual ...
Evaluation of header metadata extraction approaches and tools for scientific PDF documents
JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital librariesThis paper evaluates the performance of tools for the extraction of metadata from scientific articles. Accurate metadata extraction is an important task for automating the management of digital libraries. This comparative study is a guide for developers ...
Comments