skip to main content
10.1145/3486011.3486530acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteemConference Proceedingsconference-collections
research-article

Experts’ Judgment for Evaluation of an E-Learning Entrepreneurship Course in Higher Education

Published:20 December 2021Publication History

ABSTRACT

Today's education is in accelerated digital transformation, mainly promoted by the crisis with COVID-19. Face-to-face courses have had to be switched to virtual mode without many educational institutions being fully prepared for this change, which causes problems, especially with the quality of the courses offered. Therefore, strategies should emerge to evaluate the use of Information Technologies (ICTs) in education. One of these methodologies is expert judgment, so this work aims to present an assessment of an e-learning entrepreneurship course conducted by nine experts at a university in Mexico to analyze whether the course proposal was appropriate to achieve students' learning objectives. The results obtained showed that the course activities are appropriate for fulfilling the proposed objectives and the structure and variety of content were suitable for fostering the entrepreneurial spirit in students. It is considered that educational institutions can use this strategy to evaluate courses before implementation by experienced professionals in the study taking into consideration the current requirements caused by COVID-19 and that will remain with its effects for a more prolonged period.

References

  1. Dahlan Nariman. 2021. Impact of the Interactive e-learning Instructions on Effectiveness of a Programming Course. In Complex, Intelligent and Software Intensive Systems. CISIS 2020, vol 1194, L. Barolli, A. Poniszewska-Maranda and T. Enokido, Eds. Cham: Springer. https://doi.org/10.1007/978-3-030-50454-0_61Google ScholarGoogle ScholarCross RefCross Ref
  2. Julio Cabero Almenara and J. Ruiz Palmero. 2017. Technologies of Information and Communication for inclusion: reformulating the “digital gap” [Las tecnologías de la información y la comunicación para la inclusión: reformulando la brecha digital”]. International Journal of Educational Research and Innovation (IJERI), 9, 16-30. https://dialnet.unirioja.es/servlet/articulo?codigo=6182959Google ScholarGoogle Scholar
  3. Marcela Gómez-Zermeño, Lorena Alemán de la Garza, May Portuguez Castro and Manuel Medina Labrador. 2019. Systematic Literature Review: Development And Use of Technologies in Education [Revisión sistemática de literatura: Desarrollo y uso de tecnologías en la educación]. In Educational innovation: research and trends [Innovación educativa: investigación y tendencias], María Soledad Ramírez Montoya and Ricardo Valenzuela González. Eds. Barcelona: Editorial Octaedro.Google ScholarGoogle Scholar
  4. Esteban Vázquez-Cano, Eloy López Meneses, Esther Fernández Márquez and Cristóbal Ballesteros Regaña. 2018. The New Virtual Environments Of Lifelong Learning (MOOC) And Their Educational Possibilities In Social And Educational Scenarios. Píxel-Bit. Revista de Medios y Educación, 53, 179-192. doi:http://dx.doi.org/10.12795/pixelbit.2018.i53.12Google ScholarGoogle Scholar
  5. Amelie Dorn, Eveline Wandl-Vogt, Anna Romano, Thomas Jekel, and Anna Gawin. 2020. Evaluating Effectiveness Of Innovative Education Formats For 21st Century Skills: The Example of DaVinciLab YouthHackathon Workshops 2019/2020. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’20), October 21–23, 2020, Salamanca, Spain. ACM, New York, NY, USA, 7 pages. https://doi.org/10.1145/3434780.3436671Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Kiomi Matsumoto-Royo and María Soledad Ramírez-Montoya. 2020. Teaching and Assessment Strategies In A Practice-Based Teacher Education Program. Instrument Validation. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’20), October 21– 23, 2020, Salamanca, Spain. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3434780.3436557Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. May Portuguez Castro and Marcela Georgina Gómez Zermeño. 2020. Educational Innovation Supported by ICT to Identify Entrepreneurial Skills in Students in Higher Education. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’20), October 21–23, 2020, Salamanca, Spain. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3434780.3436556Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. María José Rodríguez-Conde, Susana Olmos-Migueláñez, Adriana Gamazo, José Carlos Sánchez-Prieto, and Joe O'Hara. 2020. Challenges in Evaluation in Education and Guidance: A Perspective from 2020. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’20), October 21–23, 2020, Salamanca, Spain. ACM, New York, NY, USA, 5 pages. https://doi.org/10.1145/3434780.3436715Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Adriana Valencia Álvarez and Valenzuela González. 2017. Disruptive Innovation, Systematic Innovation and Continuous Improvement Processes… Do They Imply Different Competencies to Develop? In Educational innovation: Research, training, linking and visibility, María Soledad Ramírez Montoya and Ricardo Valenzuela González, Eds., Madrid: Síntesis, 2017.Google ScholarGoogle Scholar
  10. Neil Anderson, Kristina Potočnik and Jing Zhou. 2014. Innovation and Creativity in Organizations. A State-Of-The Science Review, Prospective Commentary, And Guiding Framework. Journal of Management, 40, 1297–1333. https://doi.org/10.1177/0149206314527128Google ScholarGoogle ScholarCross RefCross Ref
  11. Gabriele Faßauer. 2018. Linking Deviation with Innovation: Behavioral Effects Of Management Control Through The Lens Of A Theory Of Deviance. Journal of Management Control, 29, 275-293. https://doi.org/10.1007/s00187-018-00271-8Google ScholarGoogle ScholarCross RefCross Ref
  12. OCDE/CERI. 2010. Inspired by Technology, Driven by Pedagogy: A Systemic Approach To Technology-Based School Innovation. Educational Research and Innovation. Paris: OECD Publishing.Google ScholarGoogle Scholar
  13. Manuel Baltodano and Marcela. Gómez Zermeño. 2017. Pedagogical, Curricular and Didactic Element Involved in The Creation Of An E-Learning Environment: The Case Of A Costa Rican University. Turkish Online Journal of Distance Education, 18, 104-118. https://doi.org/10.17718/tojde.340396Google ScholarGoogle ScholarCross RefCross Ref
  14. Esteban Vázquez-Cano, Eloy López Meneses and Alicia Jaén Martínez. 2017. A. The Group E-Portfolio to Improve Teaching Learning Process at University. Journal of e-Learning and Knowledge Society, 13, 65-76. https://doi.org/10.20368/1971-8829/1221Google ScholarGoogle Scholar
  15. Mahmudul Hasan, Eijaz Khan and Noor Un Nabi. 2017. Entrepreneurial Education at University Level And Entrepreneurship Development. Education + Training, 59, 888-906. https://doi.org/10.1108/ET-01-2016-0020Google ScholarGoogle Scholar
  16. Siti Roffeei, Farra Yusop, and Yusniza Kamarulzaman. 2018. Determinants of Innovation Culture amongst Higher Education Students. Turkish Online Journal of Educational Technology, 17(4), 37-50. https://doi.org/10.22452/mojem.vol5no4.1Google ScholarGoogle Scholar
  17. María José Alcalá del Olmo and José David Gutiérrez Sánchez. 2020. Sustainable Development as A Pedagogical Challenge For The 21st Century University. Anduli, 19, 59-80. DOI: https://10.12795/anduli.2020.i19.03Google ScholarGoogle Scholar
  18. Cheonjae Lee and Walter Timo de Vries. 2019. Sustaining a Culture of Excellence: Massive Open Online Course (MOOC) on Land Management. Sustainability, 11(12), 3280. https://doi.org/10.3390/su11123280Google ScholarGoogle Scholar
  19. James Phelan. 2015. The Use of ELearning in Social Work Education. Social Work, 60(3), 257–264. https://www.jstor.org/stable/24881489Google ScholarGoogle ScholarCross RefCross Ref
  20. Shirley Cherry and Bethany Flora. 2017. Radiography Faculty Engaged in Online Education: Perceptions of Effectiveness, Satisfaction, And Technological Self-Efficacy. Radiologic Technology, 88, 249–262. https://pubmed.ncbi.nlm.nih.gov/28298576/Google ScholarGoogle Scholar
  21. John Huss, Orly Sela and Shannon Eastep. 2015. A Case Study of Online Instructors and Their Quest for Greater Interactivity In Their Courses: Overcoming The Distance In Distance Education. Australian Journal of Teacher Education, 40(4), 72–86. https://doi.org/10.14221/ajte.2015v40n4.5Google ScholarGoogle Scholar
  22. Laura Racovita-Szilagyi, Domingo Carbonero Muñoz and Mioara Diaconu. 2018. Challenges and Opportunities to Elearning In Social Work Education: Perspectives from Spain and the United States. European Journal of Social Work, 21(6), 836-849. https://doi.org/10.1080/13691457.2018.1461066Google ScholarGoogle ScholarCross RefCross Ref
  23. Mauro Marino-Jiménez 2016. E-Learning Design: Seven Essential Components For A Communication Course In The University Context. Revista Q, 10 (20), 24-51. https://doi.org/10.18566/revistaq.v10n20.a02Google ScholarGoogle ScholarCross RefCross Ref
  24. Pablo Rivera Vargas, Cristina Alonso Cano and Juana Sancho Gil. 2017. From Distance Education To E-Learning: Emergence, Evolution and Consolidation. Revista Educación y Tecnología, 10, 1-13. https://doi.org/10.18566/revistaq.v10n20.a02Google ScholarGoogle Scholar
  25. Lorena Alemán de la Garza, Marcela Gómez-Zermeño, Yoko Mochizuki and Éric Bruillard 2019. Rethinking Pedagoy. Exploring the Potential of Digital Technology In Achieving Quality Education. New Delhi: UNESCO MGIEP.Google ScholarGoogle Scholar
  26. May Portuguez Castro and M. Gómez Zermeño. 2020. Challenge Based Learning: Innovative Pedagogy for Sustainability through e-learning in Higher Education. Sustainability, 12(10), 1-15. https://doi.org/10.3390/su12104063Google ScholarGoogle Scholar
  27. Papia Bawa. 2016. Retention in Online Courses: Exploring Issues and Solutions—A Literature Review. SAGE Open, 1-11. https://doi.org/10.1177/2158244015621777Google ScholarGoogle Scholar
  28. Valentina Arkorful and Nelly Abaidoo. 2015. The Role Of E-Learning, Advantages and Disadvantages Of Its Adoption In Higher Education. Instructional Technology and Distance Learning, 2(12), 29-44. https://www.ijern.com/journal/2014/December-2014/34.pdfGoogle ScholarGoogle Scholar
  29. Francisco García-Peñalvo and Antonio Seoane Pardo. An Updated Review of The Concept of Elearning Tenth Anniversary. Education in the Knowledge Society, 16(1), 119-144. https://doi.org/10.14201/eks2015161119144Google ScholarGoogle Scholar
  30. Jennifer Iriti, William Bickel, Christian Schunn and Mary Kei Stein. 2016. Maximizing Research and Development Resources: Identifying and Testing “Load-Bearing Conditions” For Educational Technology Innovations. Educational Technology Research & Development, 64, 245–262. https://doi.org/10.1007/s11423-015-9409-2Google ScholarGoogle ScholarCross RefCross Ref
  31. Iván Claros, Ruth Cobos and César Collazos. 2016. An approach based on social network analysis applied to a collaborative learning experience. IEEE Transactions on Learning Technologies, 9(2), 190–195. https://doi.org/10.1109/tlt.2015.2453979Google ScholarGoogle ScholarCross RefCross Ref
  32. José López Islas. 2017. Institutional Indicators to Measure Innovation. In Educational Innovation: Research, Training, Linking And Visibility, María Soledad Ramírez Montoya and Jaime Ricardo Valenzuela González. Madrid: Síntesis.Google ScholarGoogle Scholar
  33. OCDE. 2016. Innovating Education and Educating for Innovation: The Power of Digital Technologies and Skills. Paris: OECD Publishing.Google ScholarGoogle Scholar
  34. Jennifer Lai and Matt Bower. 2019. How Is the Use of Technology in Education Evaluated? A Systematic Review. Computer & Education, 133, 27-42. https://doi.org/10.1016/j.compedu.2019.01.010Google ScholarGoogle ScholarCross RefCross Ref
  35. Julio Cabero Almenara. 2013. The Application Of Expert Judgment As A Technique For Evaluating Information And Communication Technologies (ICT). Revista de Tecnología de Información y Comunicación en Educación, 7, 11-22. https://doi.org/10.51302/tce.2015.27Google ScholarGoogle Scholar
  36. Robert Branch. 2009. Instructional Design: The ADDIE approach. New York: Springer Science Business Media, LLC.Google ScholarGoogle ScholarCross RefCross Ref
  37. May Portuguez Castro and Marcela Gómez Zermeño. 2020. Mentoring in Online Entrepreneurship Course: Systematization Of An Experience In Higher Education. Formación Universitaria, 13(6), 267-282. https://doi.org/10.4067/s0718-50062020000600267Google ScholarGoogle Scholar
  38. Lewis, Aiken. 1985. Three Coeficients for Analyzing the Reliability and Validity of Ratings. Educational and Psychological Measurement, 45, 131-142. https://doi.org/10.1177/0013164485451012Google ScholarGoogle ScholarCross RefCross Ref
  39. Luis Miguel Escurra Escurra, M. L. (1988). Cuantificación de la Validez de Contenido por Criterio de Jueces. Revista De Psicología, 6(1-2), 103-111.Google ScholarGoogle Scholar
  40. César Coll. 2004. Pedagogy and Curriculum. A Psychological Approach to The Development of The School Curriculum. Buenos Aires: Paidós.Google ScholarGoogle Scholar
  41. Viviana Rodríguez Aranmendiz and Katherina Gallardo Córdova. 2019. Decisions In Evaluation: Postgraduate Virtual Environments, An Ex Post-Facto Study. Revista de Educación a Distancia, 19(59), 1-19. https://doi.org/10.6018/red/59/06Google ScholarGoogle Scholar
  42. Nathalie Duval-Couetil, Teri Reed Roads and Shiva Haghighi. 2011. Engineering students and entrepreneurship education: Involvement, Attitudes and Outcomes. International Journal of Engineering Education, 28, 425-435. https://doi.org/10.1109/fie.2011.6142996Google ScholarGoogle Scholar
  43. Valeria Cantú González, Leonardo Glasserman Morales and María Soledad Ramírez-Montoya. 2019. Metric Behavior On Evaluation Of Entrepreneurship Education. Investigación Bibliotecológica: Archivonomía, Bibliotecología E Información, 33 (79), 99-117. http://dx.doi.org/10.22201/iibi.24488321xe.2019.79.57902Google ScholarGoogle Scholar
  44. May Portuguez Castro and Marcela Gómez Zermeño. 2020. Being an entrepreneur post-COVID-19- Resilience in times of crisis: a systematic literature review. Journal of Entrepreneurship in Emerging Economies, vol. forthcoming. https://doi.org/10.1108/jeee-07-2020-0246Google ScholarGoogle Scholar

Index Terms

  1. Experts’ Judgment for Evaluation of an E-Learning Entrepreneurship Course in Higher Education
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        TEEM'21: Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21)
        October 2021
        823 pages
        ISBN:9781450390668
        DOI:10.1145/3486011
        • Editors:
        • Marc Alier,
        • David Fonseca

        Copyright © 2021 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 December 2021

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate496of705submissions,70%
      • Article Metrics

        • Downloads (Last 12 months)10
        • Downloads (Last 6 weeks)0

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format