skip to main content
10.1145/3571662.3571666acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccipConference Proceedingsconference-collections
research-article

Hybrid Deep Learning CNN-Bidirectional LSTM and Manhattan Distance for Japanese Automated Short Answer Grading: Use case in Japanese Language Studies

Published:03 January 2023Publication History

ABSTRACT

This paper discusses the development of an Automatic Essay Grading System (SIMPLE-O) designed using hybrid CNN and Bidirectional LSTM and Manhattan Distance for Japanese language course essay grading. The most stable and best model is trained using hyperparameters with kernel sizes of 5, filters or CNN outputs of 64, a pool size of 4, Bidirectional LSTM units of 50, and a batch size of 64. The deep learning model is trained using the Adam optimizer with a learning rate of 0.001, an epoch of 25, and using an L1 regularization of 0.01. The average error obtained is 29%.

References

  1. Michael Mohler and Rada Mihalcea. 2009. Text-to-text semantic similarity for automatic short answer grading. Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics on - EACL '09 (2009). DOI:http://dx.doi.org/10.3115/1609067.1609130Google ScholarGoogle ScholarCross RefCross Ref
  2. Pedro Henrique Calais Guerra, Adriano Veloso, Wagner Meira, and Virgílio Almeida. 2011. From bias to opinion. Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '11 (2011). DOI:http://dx.doi.org/10.1145/2020408.2020438Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Kristen DiCerbo. 2020. Assessment for learning with diverse learners in a Digital World. Educational Measurement: Issues and Practice 39, 3 (2020), 90–93. DOI:http://dx.doi.org/10.1111/emip.12374Google ScholarGoogle ScholarCross RefCross Ref
  4. Wim Westera, Mihai Dascalu, Hub Kurvers, Stefan Ruseti, and Stefan Trausan-Matu. 2018. Automated essay scoring in Applied Games: Reducing the teacher bandwidth problem in online training. Computers & Education 123 (2018), 212–224. DOI:http://dx.doi.org/10.1016/j.compedu.2018.05.010Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ellis B. Page. 1967. Statistical and linguistic strategies in the computer grading of essays. Proceedings of the 1967 conference on Computational linguistics - (1967). DOI:http://dx.doi.org/10.3115/991566.991598Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. T. Ishioka and M. Kameda. 2004. Automated japanese essay scoring system:Jess. Proceedings. 15th International Workshop on Database and Expert Systems Applications, 2004. (2004). DOI:http://dx.doi.org/10.1109/dexa.2004.1333440Google ScholarGoogle ScholarCross RefCross Ref
  7. Cagatay Neftali Tulu, Ozge Ozkaya, and Umut Orhan. 2021. Automatic short answer grading with SEMSPACE sense vectors and malstm. IEEE Access 9 (2021), 19270–19280. DOI:http://dx.doi.org/10.1109/access.2021.3054346Google ScholarGoogle ScholarCross RefCross Ref
  8. Akmal Ramadhan Arifin, Prima Dewi Purnamasari, and Anak Agung Putri Ratna. 2021. Automatic essay scoring for Indonesian short answers using siamese Manhattan long short-term memory. 2021 International Conference on Electrical, Communication, and Computer Engineering (ICECCE) (2021). DOI:http://dx.doi.org/10.1109/icecce52056.2021.9514223Google ScholarGoogle ScholarCross RefCross Ref
  9. Amanda Nur Oktaviani, Marwah Zulfanny Alief, Lea Santiar, Prima Dewi Purnamasari, and Anak Agung Ratna. 2021. Automatic Essay Grading System for japanese language exam using CNN-LSTM. 2021 17th International Conference on Quality in Research (QIR): International Symposium on Electrical and Computer Engineering (2021). DOI:http://dx.doi.org/10.1109/qir54354.2021.9716165Google ScholarGoogle ScholarCross RefCross Ref
  10. IBM Cloud Education. What are neural networks? Retrieved December 14th, 2021 from https://www.ibm.com/cloud/learn/neural-networksGoogle ScholarGoogle Scholar
  11. IBM Cloud Education. What are convolutional neural networks? Retrieved December 14th, 2021 from https://www.ibm.com/cloud/learn/convolutional-neural-networksGoogle ScholarGoogle Scholar
  12. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780. DOI:http://dx.doi.org/10.1162/neco.1997.9.8.1735Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Omar Alharbi. 2021. A deep learning approach combining CNN and BiLSTM with SVM classifier for Arabic sentiment analysis. International Journal of Advanced Computer Science and Applications 12, 6 (2021). DOI:http://dx.doi.org/10.14569/ijacsa.2021.0120618Google ScholarGoogle ScholarCross RefCross Ref
  14. Wang Yue and Lei Li. 2020. Sentiment analysis using word2vec-CNN-BILSTM classification. 2020 Seventh International Conference on Social Networks Analysis, Management and Security (SNAMS) (2020). DOI:http://dx.doi.org/10.1109/snams52053.2020.9336549Google ScholarGoogle ScholarCross RefCross Ref
  15. Sakirin Tam, Rachid Ben Said, and O.Ozgur Tanriover. 2021. A convbilstm deep learning model-based approach for Twitter sentiment classification. IEEE Access 9 (2021), 41283–41293. DOI:http://dx.doi.org/10.1109/access.2021.3064830Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    ICCIP '22: Proceedings of the 8th International Conference on Communication and Information Processing
    November 2022
    219 pages
    ISBN:9781450397100
    DOI:10.1145/3571662

    Copyright © 2022 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 3 January 2023

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    ICCIP '22 Paper Acceptance Rate61of301submissions,20%Overall Acceptance Rate61of301submissions,20%
  • Article Metrics

    • Downloads (Last 12 months)65
    • Downloads (Last 6 weeks)2

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format