ABSTRACT
Notions of what constitutes quality in design in traditional on-campus or online teaching and learning may not always translate into scaled digital environments. The DesignLAK17 workshop builds on the DesignLAK16 workshop to explore one aspect of this theme, namely the opportunities arising from the use of analytics in scaled assessment design. New paradigms for learning design are exploiting the distinctive characteristics and potentials of analytics, trace data and newer kinds of sensory data usable on digital platforms to transform assessment. But, characteristics of quality assessment design need to be reconsidered, and new metrics for capturing quality are required. This symposium and workshop focuses on what might be appropriate quality metrics and indicators for assessment design in scaled learning. It aims to build a community of interest round the topic, to share perspectives, and to generate design and research ideas.
- David Boud and Elizabeth Molloy. 2013. Rethinking models of feedback for learning: the challenge of design. Assessment & Evaluation in Higher Education 38, 6 (2013), 698--712.Google ScholarCross Ref
- Nancy Law, Dale S Niederhauser, Rhonda Christensen, and Linda Shear. 2016. A multilevel system of quality technology-enhanced learning and teaching indicators. Journal of Educational Technology & Society 19, 3 (2016), 72--83.Google Scholar
- Allison Littlejohn and Chris Pegler. 2007. Preparing for blended e-learning. Routledge. Google ScholarDigital Library
- Wenting Ma, Olusola O Adesope, John C Nesbit, and Qing Liu. 2014. Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology 106, 4 (2014), 901.Google ScholarCross Ref
- Geoff N Masters. 2013. Reforming educational assessment: Imperatives, principles and challenges. (2013).Google Scholar
- Sandra Kaye Milligan and Patrick Griffin. 2016. Understanding Learning and Learning Design in MOOCs: A Measurement-Based Interpretation. Journal of Learning Analytics 3, 2 (2016), 88--115.Google ScholarCross Ref
- Ulla Ringtved, Sandra Milligan, and Linda Corrin. 2016. Learning design and feedback processes at scale: stocktaking emergent theory and practice. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 479--480. Google ScholarDigital Library
- Marlene Scardamalia, John Bransford, Bob Kozma, and Edys Quellmalz. 2012. New assessments and environments for knowledge building. In Assessment and teaching of 21st century skills. Springer, 231--300.Google Scholar
- Valerie Shute and Matthew Ventura. 2013. Stealth assessment: Measuring and supporting learning in video games. MIT Press. Google ScholarDigital Library
Index Terms
- DesignLAK17: quality metrics and indicators for analytics of assessment design at scale
Recommendations
From theory to action: developing and evaluating learning analytics for learning design
LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & KnowledgeThe effectiveness of using learning analytics for learning design primarily depends upon two concepts: grounding and alignment. This is the primary conjecture for the study described in this paper. In our design-based research study, we design, test, ...
Learning design and feedback processes at scale: stocktaking emergent theory and practice
LAK '16: Proceedings of the Sixth International Conference on Learning Analytics & KnowledgeDesign for learning in scaled courses is shifting away from replication of traditional on-campus or online teaching towards exploiting the distinctive characteristic and potentials of scale to transform both teaching and learning. Scaled learning ...
Small to big before massive: scaling up participatory learning analytics
LAK '14: Proceedings of the Fourth International Conference on Learning Analytics And KnowledgeThis case study describes how course features and individual & social learning analytics were scaled up to support "participatory" learning. An existing online course was turned into a "big open online course" (BOOC) offered to hundreds. Compared to ...
Comments