This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
England and Australia have introduced new learning areas, teaching computer science to children from the first year of school. This is a significant milestone that also raises a number of big challenges: the preparation of teachers and the development of resources
Despite the growing ubiquity of digital technologies (DT), university enrolments within information communication technologies (ICTs) remain relatively low (Koppi
Australia is one nation leading a recent wave to introduce CS education into schools (Gander
MOOCs have been adopted as a means to deliver content (usually freely) across distributed environments to anyone with an Internet connection and computer. Further, social media have been integrated and offer the potential for supporting online community building, collaboration and knowledge sharing, despite learner locations. This approach to large-scale learning may provide a means to deliver content for free and allow teachers to develop a community where teachers can engage in flexible PD. Although online learning is not a new concept, little is known about what constitutes effective MOOC design, particularly for a purpose such as teacher PD.
In this paper, we describe an approach to develop a free teacher PD MOOC targeting the Australian DT learning area. This paper describes our MOOC design and findings about our participant audience and their engagement and experience in the course.
Over the past decade, the need to rethink our education systems in terms of the treatment of CS and information technology has gained global attention (Gander
New computing curricula introduced in England (Department for Education
Discussions taking place in Europe (Gander
Despite significant changes in education with the emergence of technologies and software in recent decades, online teacher professional development (oTPD) has not necessarily adapted to such innovations (Brooks and Gibson
In a review of the literature, Brooks and Gibson (
Characteristics of MOOC and online professional development approaches.
| oTPD | xMOOCs | TMPL | cMOOCs | |
|---|---|---|---|---|
|
|
||||
| Structure | Structured, Internet-based learning. | Structured, Internet-based learning, including video content, online quizzes, peer or self-assessment. | Less structure – ‘just-in-time learning’. | Less structure – distributed networks. |
| Focus | Online learning, self-directed study, course or module completion. Individualised models and cohort models. | Online learning, self-directed study, course completion. Some courses offer optional levels of engagement. | Blend of online and face-to-face learning. Social media (created and teacher-initiated groups). | Online-networked learning. Registrants create knowledge and engage in online publishing activities and self- or peer assessment, depending on personal learning goals. |
| Platform | Learning management system (LMS) as core. | Core platform for content delivery and modules – perhaps through a service provider. | Online learning and face-to-face blended. Teacher-initiated networks and online communities. | Distributed networks. A common platform or content aggregator may be used as a hub. |
| Learning principles | Behavioural, mastery learning and knowledge-retrieval. | Behavioural, mastery learning and knowledge-retrieval. | Connectivist, constructivist. | Connectivist, communities of practice |
| Teacher emphasis | Content and delivery. Discussion forums for support. | Content and delivery. Discussion forums for support. | Encouraging networking (face-to-face and online), co-construction of knowledge and community support networks. | Encouraging online networking and professional community formation and co-construction of knowledge. |
However, which approach is suitable for delivering PD where participants must acquire new content knowledge, develop pedagogical knowledge and view exemplars linked to curriculum objectives? The approach of the TMPL model may work for promoting teacher professional learning networks and the co-creation of resources: an issue needing to be addressed in F-6 DT education. The model of TMPL acknowledges that teachers are not only drawn by the technological affordances of an online space but that they are participating in teacher communities or within online spaces and social network technologies out of specific curricular needs or collegial support. Essentially, TMPL also supports ‘just-in-time’ learning by seeking support in online professional networks, which can be an advantage for teachers needing support during implementation periods. However, for a new learning area some content will need to be delivered in logical sequences aligned with curriculum learning objectives, which will require the adoption of a more structured pace, but with a flexible and networking aspect to accommodate teacher workload and existing knowledge of the topics.
A key reason that teachers become engaged in online professional learning, across a number of studies reviewed, was due to the strong connections among the curriculum, student learning and teaching approaches (Brooks and Gibson
MOOCs offer one means to deliver education at a broad scale to individuals with technological means and Internet access. Although online learning is not new, it has been argued that the difference between online learning and MOOC environments are the (1) combination of teaching approaches course instructors use, (2) massive levels of participation and (3) openness (Glance, Forsey, and Riley
Typically, two different types of MOOCs have been identified, one being based on existing university courses that embrace the use of videos to deliver content and online assessment (‘xMOOCs’) (Glance, Forsey, and Riley
Enrolment in MOOCs have reported significantly high enrolment rates, with edX and MITx reporting a total of 841,687 registrations from the fall of 2012 to the summer of 2013 across a number of their courses (Ho
In comparison, cMOOCs measure enrolment based on members who ‘subscribe’ to the course via mailing lists or by signing up to the course platform. cMOOC enrolment figures have been found to be ranging from the hundreds to the low-thousands. Researchers of cMOOCs typically report engagement through social media activity, for example, in MobiMOOC, the course generated 1827 discussion threads, 1123 Twitter contributions and 335 links shared on Delicious (de Waard
The literature so far suggests that the majority of registrants are professionals and enrol in the courses for PD, personal interest and to develop knowledge (Belanger
While research has begun to pedagogically evaluate MOOCs (Glance, Forsey, and Riley How can we design a MOOC, as a large-scale professional development approach to address the challenge and support teachers with the implementation of a new computing curriculum?
In this paper, we describe our design process and rationale, followed by preliminary results relating to participation, engagement and teacher experiences. We conclude the paper with directions for future research and online PD in this field.
In Australia, ‘primary school’ includes the first year of school, called Foundation (F) followed by year 1, and so on, until year 6 or 7, (depending on the state) and secondary school (also known as high school) includes years 7 or 8 to year 12. In 2013, there were a total of 9,393 schools in Australia (Australian Bureau of Statistics [ABS],
The average age of primary teachers is 42.1 and 44.5 for high school teachers, with leadership roles being held by those around 50 years of age (Cordova, Eaton, and Taylor
The Australian primary and secondary school system is undergoing a significant period of change, with the introduction of the Australian Curriculum. In 2014, the Australian Curriculum Assessment and Reporting Authority (ACARA) released a series of curricula for learning areas, with DT being one F-10 learning area, awaiting final minister endorsement. The new Australian curriculum has been developed recently to provide a national framework for states and territories, which can be implemented at their discretion.
In the DT curriculum, students learn CS knowledge and skills, and have opportunities to create digital solutions through designing and visual programming. However, a significant focus is on developing computational thinking, logic and problem-solving capabilities (ACARA
Australian primary school teachers are typically generalist teachers, with 80% reportedly teaching in generalist classrooms (Cordova, Eaton, and Taylor
In identifying a need to resolve the challenges introduced with the introduction of new computing curriculum, the need to provide teachers with appropriate support to ensure DT education is implemented effectively, and not perceived as ‘digital literacy’, we initiated the idea of a PD MOOC to support Australian teachers. The team working on the project involved three individuals from the CS education research group at The University of Adelaide. Team members on the MOOC development team included two CS education lecturers with significant experience in introductory programming, problem-based learning and CS education pedagogy. The third team member was a research associate with experience in CS education research and qualifications in education and primary school teaching.
The development of the MOOC involved content development and the more technical development of the course website through course builder. Although Google Course Builder is a free platform, technical development (in the form of coding) was required to initially construct the course using the web guides, as well as support and maintenance, which could be done by one of the CS lecturers.
Unlike previous MOOCs, where the content may have already been available from existing university courses or through aggregating web information, F-6 CS education lacks resources and content and so the majority of effort involved developing web content, 5-minute (average) concept videos and worked examples that linked to the Australian curriculum learning objectives. The development of content was achieved through brainstorming sessions between the team, drawing on their various expertise, experience and knowledge. We drew on and adapted existing lesson ideas from existing organisations and initiatives such as CS Unplugged and Code.org, and drew on lesson ideas and approaches from education texts in other learning areas, such as Mathematics, Science and Literacy. We worked closely with curriculum developers and curriculum elaborations to align content and lesson ideas to the Australian DT learning objectives. As previously mentioned, forethought is essential in online learning as lessons cannot easily be adapted (Beetham and Sharpe
The MOOC development process.
There were initial outlay costs associated with acquiring equipment to produce the course videos, such as lighting, software (Camtasia), a green-screen, a computer, microphone and video camera. As we were also based in a tertiary institution, we were required to purchase resources, such as blocks, craft materials, robots, and tablet applications, that could be used to showcase lesson exemplars. We also purchased education textbooks about teaching other learning areas so that we could make cross-comparisons and develop teaching and learning approaches for this new F-6 learning area.
To determine what empirical pedagogical literature was available for CS education, we began by undertaking a semi-systematic review of research papers about CS education, implemented for children between the ages of 5 and 18, using Simon's system (
Learning from our review of online PD and MOOC pedagogy, we designed an approach that combined both oTPD/xMOOCs and TMPL/cMOOCs. In doing so, we are able to not only deliver discipline content knowledge in CS combined with learning objectives and classroom activities but also create an environment where teachers can share knowledge and collaborate, as well as seek and provide ad-hoc advice. Adapting these approaches and using a MOOC allows for teachers to engage in professional learning, where they are part of a larger community, and are undertaking a series of modules that are relevant to their practice and are on-going (rather than a one-off event).
One of the challenges we identified was that, as a new learning area, the content would be unfamiliar and potentially overwhelming for many teachers. Therefore, the course was designed around a series of topics that align with the Australian curriculum, delivered in a logical order, suitable for someone learning CS for the first time.
Our goal in the first unit was to provide an introduction that showcases the application and creation of DT to solve real problems, with an equal representation of males, females and youth as creators to dispel misperceptions that CS careers typically involve ‘programming’, are for ‘males’ or ‘nerds’. Further, we wanted to establish different terminology for DT (e.g. computing and CS) and distinguish between
For each unit, we introduced the topic (e.g. ‘digital systems’) and the Australian learning objectives relating to the topic. Each unit was broken into sub-topics and for each sub-topic a concept video was created (or an existing suitable video used) in which the concept was explained and supported with analogies and real-world examples. For each unit, two full lesson exemplars about the sub-topics and a web resource with various lesson activity ideas were included. Links were made to the Australian curriculum ‘expected outcomes’ for children and assessment strategies were suggested. The goal was to provide core content knowledge and lesson idea inspiration so that teachers could feel comfortable creating and thinking of their own lessons to meet the learning objectives. The sequence of units for the DT course is outlined in
Unit topics and core and non-core components of the course.
We introduced algorithms and visual programming last, with the deliberate goal to demonstrate that CS is more than just programming and that the learning area can include ‘plugged’ and ‘unplugged’ activities. Further, we wanted to explicitly demonstrate the importance of teaching concepts and computational thinking and to have teachers establish a sound understanding of the concepts, prior to visual programming.
Teachers were provided with a list of ‘core components’ and optional components (identified in
We have adopted a series of online course ‘spaces’ and technologies that support particular aspects of the course. In
The course ‘spaces’ and technology: rationale and purpose.
| Technology | Features | Purpose/rationale |
|---|---|---|
|
|
||
| Main course ‘spaces’ | ||
|
|
||
| Google Course Builder Platform | Course modules; Forum; Announcements (also emailed); Information About the Course; Additional resources; Details about Q&A Hangout Sessions. | This is the key platform for content, course information and task specifications. The core platform has an announcements page and a forum space for course questions. |
| Google+ Community | The community page was organised into ‘topics’, where participants post their Task or assignment activity for each unit. An additional topic was created to share additional resources and events. | This space allowed participants to network, share ideas and activities and to collectively build an online series of resources corresponding to topic areas. It allowed for community feedback and ‘ad-hoc’ learning. |
| Supporting online space for additional resources | ||
|
|
||
| ‘Boards’ with pinned content sorted into topic areas that aligned with the Course Units. | Pinterest is popular among teachers for sharing and ‘bookmarking’ teaching ideas and resources. Even without an account participants can view content. Participants could locate additional resources, lesson ideas & tools for F-10 DT Education. Content shared by participants also pinned to relevant board. | |
| YouTube | ‘Concept videos’ about F-6 DT content and lesson ideas created and embedded into Course Builder module lessons. | Uploading content videos to YouTube allowed for us to access viewer analytics and maintain these for public access – an outreach initiative to promote and support CS Education. |
| Google+ On Air Hangouts | Google On Air Hangouts were scheduled weekly for the first several weeks. They were automatically recorded and uploaded to YouTube for later-viewing. Q&A question poll was on for viewer questions. | These hangouts allowed for instructors to build a connection with participants watching, discuss common course questions, respond to questions posted and showcase guest speakers working in areas of F-12 CS Education and outreach. |
| Additional course spaces | ||
|
|
||
| To share research and news about F-12 CS Education. | To maintain wide user-engagement and promote the course & CS Education. | |
| Google+ Page | To share research and news about F-12 CS Education. | To maintain wide user-engagement and promote the course & CS Education. |
Two assessment tasks were included: one as a peer assessment task based on the creation of a teaching resource and the last as a lesson plan portfolio. For each unit, teachers were asked to post a task on the Google+ community page for the course. These tasks were designed to be informal and promote the exchange of tools, resources and lesson ideas. In all cases, teachers were provided with three options so that we could have a variation of content being shared. For example, ‘Find and share a useful data source that teachers could use as a resource for classroom activities. Please share with the community, along with your ideas on how this data source could be used in the classroom’. The final task involved a ‘lesson plan portfolio’. Teachers were asked to create two detailed lesson plans or briefly described sequence of activities about any of the topics covered in the course. Participants were to share this to the Google Community page and peer-review two others’ portfolios with a post ‘comment’.
In terms of PD accreditation, each state and territory differs; however, teachers are able to secure recognition for PD hours if they demonstrate committed hours towards activities. Therefore, we created an optional completion document, whereby participants could formally submit their unit tasks and associated content to receive a certificate, linked to the Australian professional standards for teachers (Australian Institute for Teaching and School Leadership [AITSL]
The course was self-paced, allowing for teacher flexibility and the completion of modules in any order, at any pace. Unlike previous MOOCs, our concern was not ‘enrolment’ and ‘completion’ statistics. We were satisfied if teachers were enrolling to access and use the resources and content without formal completing tasks. We initially released the first three units, weekly from the 22 March 2014, and then released all subsequent modules at once, allowing educators to work at their own pace, through the units, up and until the 30 June 2014.
We were able to obtain data about participant demographics, participation and experiences through various avenues, such as through YouTube analytics, Course Builder learner analytics, Google+ Community page and voluntary surveys. During the course, participants were informed through course information that their data may be collected and analysed for research purposes and to improve future courses. Data collection and analysis were approved by the University of Adelaide Human Research Ethics Committee.
Overall, we had 1378 people enrol in the course, via the course website, and 473 participants continued to connect to the Google+ Community page. Although not core requirements of the course, engagement with Twitter and Pinterest was reasonable; however, the majority of the engagement occurred with the course and in the Google+ community space (
Enrolment/subscription statistics for the course ‘spaces’.
| Site | Enrolled/subscribed |
|---|---|
|
|
|
| Google Course Builder | 1378 |
| Google+ Community Page | 473 |
| 294 | |
| Pinterest (10 boards, 637 pins) | 336 |
In unit 2, participants were provided with a voluntary anonymous survey, requesting their location as part of an exemplar activity to be presented back to participants. Although the participation rate is low (n=174), we can see that the majority of participants appear to be from South Australia, Queensland, New South Wales and Victoria. Advertising and visits generally covered these areas, suggesting that for future courses, more targeted advertisements and connections need to be made to Western Australia, Northern Territory and Tasmania (
Number of participants by location (according to voluntary survey, n=174).
| Queensland | 46 | |
|---|---|---|
|
|
||
| New South Wales | 33 | |
| Victoria | 32 | |
| South Australia | 31 | |
| Tasmania | 15 | |
| Australian Capital Territory | 8 | |
| Western Australia | 3 | |
| Northern Territory | 2 | |
| International | 4 | |
| Grand Total | 174 | |
Unsurprisingly, with the majority of teachers being female in Australia (81%) and the average age of teachers being between 40 and 50, the majority of the cohort were female and between the age bracket of 45–64 (see
Gender and age bracket of cohort (via YouTube analytics – based on 4,565 views from 19 March to 29 June 2014, across 26 videos).
This is quite a different audience to the often ‘young professional male’ enrolling in edX and MITx courses. However, this demonstrates that we were able to target our intended audience and attract a female demographic that is significantly lacking in post-secondary courses and careers (Koppi
Of the 1378 enrolled in the course, 99 participants completed the course and 438 did not engage in the course any further than enrolling. As a result, we have a 7.2% completion rate, or 10.5% completion rate for those who went ahead and began the course. When considering completion rates, and measures of MOOC engagement, we consider engagement across all course components, and within core components specifically. Our completion rate overall was 7.2%, with a further 5.73% of participants exploring half or more of the course (without completion) and 56.39% of the participants completing less than half of the course. In terms of core components only, 8.13% of the participants explored half or more of the core components (without completion) and 52.3% of the cohort (group of MOOC participants) explored less than 50% of the core components. Our completion rate for explorers was 55.7%, and 46.9% when considering core components only.
Overall, across the course platform and the Google+ community, the completion rates were mostly in-line with what one would expect to see in MOOCs in terms of enrolment and completion. However, 34.3% of the cohort (n=473) viewed and/or engaged with the online community – a significant increase in engagement over typical MOOCs. The completion rate relative to those that engaged with the community is 20.9%. A key motivating factor for this engagement was tying the course tasks in with the use of the Google+ community – a strategy that resulted in the co-creation of F-6 DT resources and lesson plans. Many of the teachers highly valued the resources being shared, the sense of community and the content that they created together. One pre-service participant even expressed that ‘although I have finished this course, I keep coming back to make use of all the resources this community has to offer and to make further comments’.
In accordance with the participation and engagement described previously, we had a high number of viewers watching videos during the first unit (n=462), slowly decreasing during each module (to 66 in unit 7). According to the YouTube analytics, the average video length created by the Computer Science Education Research group, was 5.8 minutes – ranging from around 1 minute to 11 minutes. This timeframe is typical of the ‘Khan Academy’ and xMOOC style video length and as the results suggest are the desired length as the average length watched was 4.37 minutes. The results suggest that small concept videos work; however, designers need to consider presenting important information at the beginning.
We invited course participants to respond to an online survey and to provide a reflection about their course experience after they had completed the final module of the course. We received 50 responses, which we acknowledge are biased towards participants who completed the final module. We were interested to know if the course had had any impact on their perception of CS and careers in CS, to which 26 of the 50 said that the course influenced their perceptions a great deal as they were not previously aware of career opportunities and 16 said they learnt more than what they had previously known.
The challenging topics reported by participants were around binary mathematics, with two teachers mentioning that the topic was challenging. One of the teachers said they felt they ‘still don't really get it … [because] mathematical logic is not my forte’. While a number of participants reported the later topics being more challenging – from Unit 4 onwards – they thought they were ‘more interesting, provoking’ or ‘challenging but not difficult’. It appeared that demystifying some of the concepts and breaking down the language into examples and definitions assisted teachers in learning the content. One respondent, more comfortable in the topics, reported that: ‘Nearly all the modules were new in name but as I started to go through the MOOC I realised there was so much that I already did and understood’. For those who were new to the content, many had commented on the language and that the process of learning what concepts meant made implementing the learning area a lot less scary and ‘foreign’. For example, one respondent commented: ‘the language was the most challenging part [but once] you saw what ‘visual programming’ or ‘algorithms and programming’ encompassed it took the anxiety out of the topic’. Drawing on these comments suggest that making concept videos supported with everyday examples and exemplar activities can potentially assist teachers in understanding new discipline content.
We have received generally positive comments from participants, via the questionnaire or informally via email. Teachers have expressed gratitude for the opportunity to participate in the course. One comment that stresses this appreciation was from a remote participant who expressed ‘Thank you for providing this course and also making it freely available. Living in country areas it is not always easy or affordable to go to PD sessions. It has allowed me to network with other teachers who share the same interest and gather valuable resources’. However, in our current analysis we are lacking the perspective of teachers who have not completed the course and their experience. Understanding the motivations and experience of those who did not complete the last module may provide insight into how we can improve the MOOC and meet various needs and expectations.
The participation and engagement rates in this MOOC have been successful, in terms of the level of participation MOOCs generally receive. Particularly, the use of the Google+ community to share and build a repository of online resources, the short concept videos, the flexible learning pathways, the blend of content and exemplars as well as breaking down discipline language and concepts into relatable items, have proven to be positive design features of the course. A key to delivering content for a new learning area to educators appears to be finding the right balance of ‘challenge’ for teachers. New content and activities need to provide educators new to the discipline area with the fundamental knowledge but also opportunities for educators who are more comfortable with the learning area to extend themselves and act as mentors for others.
We have also learnt about areas for improving our course, namely, providing clear videos and instructions for participants who are not overly familiar with the technology and platform being used; reducing some of the compulsory workload for the courses or condensing the content in general. A concern expressed by a digital learning leader who was participating in the course was that they were lacking in confidence to develop and publicly share lesson plans in the community – something that they commented we often willingly assume teachers will do openly. This poses an interesting challenge: do we offer alternative tasks that are private, and if so, what trade-off would this have on the development of resources and community activity? In this case, we foresaw the need to develop F-6 resources urgently, with all participants benefiting from one another's resources.
While Google+ community appeared vibrant, we are unsure as to the extent that the community helped facilitate offline connections. Future work will investigate how to better facilitate these connections in subsequent courses through the use of technology and/or course design as well as the extent that the teachers continue to use the community for support.
We have trialled a MOOC approach to deliver PD to Australian teachers to support them with the implementation of a new computing curriculum. The process and course design described in this paper were intended to make a strong connection between the DT curriculum, CS content and teaching approaches (Brooks and Gibson
This MOOC paper should provide a framework and ideas for others encountering new curriculum implementation. The partnerships developed through this MOOC have been valuable and the process of developing this course has cemented the importance of interdisciplinary and cross-institutional relationships to address the challenge of supporting teachers to implement new computing curriculum in terms of the development of professional learning courses, appropriate resources and for increasing awareness among the education community. International relationships are equally important as implementation of computing curriculum is a global challenge and sharing best practice and strategies will play a vital role in developing effective pedagogy, professional learning and resources so that the introduction of computing education can have the desired effect on student learning and engagement in CS career pathways.
We thank Google for supporting the development of this teacher professional development MOOC as well as the journal reviewers for their valuable feedback.