How should we measure online learning activity?

Tim O'Riordan; David E. Millard; John Schulz

doi:10.3402/rlt.v24.30088

How should we measure online learning activity?

Tim O'Riordan School of Electronics and Computer Science, University of Southampton, Southampton, UK http://orcid.org/0000-0003-4905-7430
David E. Millard School of Electronics and Computer Science, University of Southampton, Southampton, UK
John Schulz Southampton Education School, University of Southampton, Southampton, UK

DOI: https://doi.org/10.3402/rlt.v24.30088

Keywords: CMC, CSCL, content analysis, learning analytics, MOOCs, pedagogical frameworks

Abstract

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom’s Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.

Keywords: CMC; CSCL; content analysis; learning analytics; MOOCs; pedagogical frameworks

(Published: 29 July 2016)

Citation: Research in Learning Technology 2016, 24: 30088 - http://dx.doi.org/10.3402/rlt.v24.30088

Downloads

Download data is not yet available.

Published

2016-07-29

How to Cite

O’Riordan T., Millard D. E., & Schulz J. (2016). How should we measure online learning activity?. Research in Learning Technology, 24. https://doi.org/10.3402/rlt.v24.30088

Download Citation

Issue

Vol. 24 (2016)

Section

Original Research Articles

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors contributing to Research in Learning Technology retain the copyright of their article and at the same time agree to publish their articles under the terms of the Creative Commons CC-BY 4.0 License (http://creativecommons.org/licenses/by/4.0/) allowing third parties to copy and redistribute the material in any medium or format, and to remix, transform, and build upon the material, for any purpose, even commercially, under the condition that appropriate credit is given, that a link to the license is provided, and that you indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.