This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
The learning design studio is a collaborative, blended, project-based framework for training teachers in effective and evidence-based use of educational technology. Arguably, teachers are the primary change agents in any educational system. Several decades of research have produced an extensive body of scientific knowledge of effective ways to use technology to support learning. Yet, if we want to mainstream this knowledge and use it to improve educational systems, we need to make this knowledge available to educational practitioners. The dominant model of teacher education assumes that teachers should be provided with a solid theoretical curriculum, which they will then apply in their practice. This article argues for an alternative – the design-inquiry model and presents the learning design studio as a manifestation of this model.
This article presents the Learning Design Studio (LDS), a course format aimed at enculturation of educational professionals into design inquiry of learning.
Arguably, teachers are the primary change agents in any educational system. Teachers operate in a complex and dynamic domain – the background knowledge and practices of their students constantly change, the technologies and resources at their disposal are perpetually evolving, and the guidance and directives they receive are frequently updated. Within this domain, they need to habitually devise new means for achieving educational goals – engendering change in their students’ knowledge, behaviours or attitudes. This calls for a repositioning of educational professionals: from conveyors of knowledge to designers of learning (Mor
The question which follows is: how do we train educators as effective learning designers? How do we empower them to make informed innovations in their daily practice, systematically analysing the context in which they operate, articulating educational challenges, considering the relevant scientific and practical knowledge, and introducing innovations to effectively address the challenges they choose to confront?
This article argues for Design Inquiry of Learning (DIL) as an appropriate pedagogical approach for addressing this question and presents the LDS as an effective manifestation of this approach. We evaluate the LDS format by reviewing two courses that implemented it and discuss its merits and limitations.
Teacher education is dominated by the “technical-rationality” model (Korthagen
In recent years, an alternative view has emerged, positioning teachers as learning designers and focusing on the practical process of devising effective learning experiences (Beetham and Sharpe
Laurillard (
Inquiry-based learning attempts to shape educational experiences in the model of scientific investigation. Similarly, a design-inquiry approach to the training of educational practitioners should mimic the form of design research in education.
Design-based research progresses through cycles of theoretical analysis, conjectures, design, implementation, analysis and evaluation – which feed into adjusting the theory and deriving practical artefacts (Mor
The design inquiry of learning cycle.
Kolodner
The LDS adopts the studio-based instructional format (Green and Bonollo
The first phase of the LDS focuses on defining the context in which projects will be situated and the pedagogical challenge they attempt to address within this context. Students were asked to propose an idea for a project they would like to develop. They form groups based on common interests and spend the majority of the course time working on their joint project. Students document and describe the material, social and intentional factors which define the environment in which they will work, and represent the relations between these factors in a suitable form, such as a force map (Mor
Based on their articulation of the context and challenge, and the outcomes of their preliminary research, students develop an initial scenario: an outline of the proposed solution and a storyboard depicting the learner's envisioned activities and expected learning trajectory. In the process, students consult the design principles database (Kali
The LDS is scaffolded by a website which students use as a collaborative workspace. Students also maintain a learning journal throughout the LDS and comment on their peers work. When the project is completed, students edit their website to present their work – the design process, its outputs and their reflections. At this phase, students review the record of their work and produce a design narrative, recounting their experience and the lessons they learned.
The LDS format was trialled in two courses at the Technologies in Education postgraduate programme at the University of Haifa during the academic year 2010–2011. This programme, situated in the faculty of education, offers masters and doctoral studies for educational professionals. The first was a course on “games and learning” and the second a course on “mobile learning” (Mor and Mogilevsky
The first question that needs to be considered is the pedagogical effectiveness of the LDS: does it indeed enculturate students into a practice of DIL and learning design? Does it enhance their theoretical perspective, as well as their practical skills?
The innovative nature of the LDS also raises questions regarding the students’ experiences: what were the challenges and dilemmas of students induced by the DIL methodology, and how did the students deal with those challenges? To illuminate this question, we analysed at the end of the course the students’ project websites, their design narratives and their learning journals.
We examined these questions using a mixed method approach. To assess the pedagogical effectiveness of the LDS, we analysed the students’ work at the end of the two courses. This gave us an indication of the LDS's immediate effect. We also surveyed students 2 years after the course ended to assess the LDS's long-term effect.
To understand the learner's experience, we used an autoethnographic research method (one of the authors of this article participated as a student in the course). The main data of this study are the course participants’ narratives. Therefore, a narrative research approach was adopted. Narrative research, according to the definition by Josselson and Lieblich (
At the beginning of the analysis process, the data were mapped and organised by numbers. We counted the numbers of students, projects, narratives, and so on. Our main data were the narratives that the students wrote: the design narratives have been written by the project groups, and the learning journals have been written individually.
The content of the students’ narratives was encoded based on the criteria of research question: identifying words expressing difficulties, challenges or dilemmas, descriptions relating to the manner of dealing with these dilemmas as well as reports on solutions and successes.
At the first step of the analysis, the verbal data were categorised into units according to the stages of the design process. We followed each stage and had a review of the texts accordingly, highlighting words relating each one of the stages (without carrying about the meaning of the words). The second step was to focus on each of the stages (for two rotations) and identify the relevant words and their meanings respectively to the research questions (
Description of the analysis process.
| Analysis steps | Division of verbal data into categories | |
|---|---|---|
|
|
||
| 1 | Project websites | Formulating initial idea |
| Design narratives | Concretisation of theories and abstract ideas | |
| Learning journals | Experiment | |
| Assessment | ||
| Reflection | ||
| Abstraction | ||
| 2 | Encoding text | |
| (A) First rotation: identifying words expressing difficulties, challenges or dilemmas in each one of the categories. | ||
| (B) Second rotation: identifying descriptions relating to the manner of dealing with dilemmas in each one of the categories. | ||
Example of sorting the quotations according to two of the categories.
| Categories/stages in the design process | (A) First rotation words expressing difficulties, challenges or dilemmas | (B) Second rotation descriptions relating to the manner of dealing with dilemmas |
|---|---|---|
|
|
||
| Formulating initial idea | “There are a lot of indecision about the subject…. I felt that we were still scattered and there is no consensus within the group.” | “The interaction within our group was excellent and we started to build the perception of the project that we wanted to lead.” |
| Concretisation of theories and abstract ideas | “I see the big picture; I know exactly what I want and what I need to do in the learning process. But it is difficult for me to pull apart the picture into little units and analyze every unit.” | “By building the scenario we dismantled the problem and thought about all kinds of practical options in which technology can help.” |
Each step in the learning process in the course was addressed by the students, whether positive or negative. This gave us an indication to assess the effectiveness of the learning studio system and to examine closely the perspective of students and their changing attitudes about the learning process.
We first present a case study of a student project. This provides an illustration of the student's experience, as well as the immediate outcomes of the LDS. Next, we present some themes emerging from the narrative analysis of students’ design narratives and learning journals, illustrated by selected examples. Finally, we present the outcomes of the student project evaluation and long-term effect questionnaire.
A group of three students from the mobile learning course decided to design a mobile learning environment for biology at upper secondary school. As part of their matriculation exams, pupils are required to conduct a biotope study (we use “students” to refer to the mobile learning course participants and “pupils” to refer to the secondary school students). The project group included two experienced teachers, one of whom was working at a secondary school and had access to biology teachers there.
As the first step of the design process, students were requested to define the learning context. To do this, they interviewed a biology teacher at one of the group member's school and constructed a model of the learning and teaching practices related to biotope studies; how do the pupils conduct their inquiries, in the field, at home and in class? How much is the teacher involved in her pupils’ learning process and their fieldwork?
The group analysed these practices to identify any gaps and tensions which might impede the pupils’ learning. Some of these concerned access to information during fieldwork and a common environment for sharing the collected data. These issues were defined as the design challenge which the project will address. To inform their design, the group reviewed several case studies and possible technologies.
Drawing on the analysis of the context and challenge, and the review of case studies and technologies, the group outlined a solution, which was designed to reinforce the connectivity among the classroom space, the pupils’ fieldwork and the teacher. The group proposed a combination of web and mobile technologies to address these needs (
Biophone website. The boxes include: project management tools, data handling, mobile aids, workbench, reference books and search the web.
The next phase was an intensive and iterative process of prototyping, role-playing, experimenting, reviewing and refining the proposed solution. This resulted in a guiding website that combines mobile technologies. This website also provides a portable reference tool, with content, work instructions and tools for collecting data and field notes.
This site was presented to the teacher and her pupils for evaluation. The evaluation group consisted of nine biology pupils, aged 17, and divided into three groups. The pupils were highly proficient mobile users, owning a variety of devices (iPad, Android phones and iPhones). They were enthusiastic about participating in the study, and particularly motivated to use their mobile phones in the course of their field studies.
Pupils used the website frequently in the course of their work. They reported that the interface is user friendly and contains necessary details and can be used independently. In addition, using the links from the website for obtaining information was crucial for them in the field and in real time. The pupils entered observation data via online forms and received the data in an organised and clear fashion, for analysis and processing as part of their follow-up desk research.
The biology teacher was very satisfied with the use of the Biophone website to support the Biotope study. She acknowledged the contribution of the organised data and the collected information to the learning process. In addition, she saw an advantage to the feedback that she can offer as a result of the visibility of the regularly processed data.
Reflection on the process as a whole, one student noted: “It took a long way to accomplish the goal. It wasn't easy to design such a learning space. It was big effort for us to transfer the general ideas we had in mind into real ones. We feel that we got useful and practical tools during the ‘mobile learning’ course for doing the design process. Our experience with collaborative project such as ‘Biophone’ helped us understand what mobile learning is.”
The data suggest that students initially found the design-inquiry approach confusing and engaged with it at a superficial level: Looking back at our work method, and our way of thinking, it was reverse. Instead of specifying a problem or challenge, then look for a solution to the problem if this application or any other software, we specifically chose the application and tried to put on the program, this method had delayed our progress.
However, these expressions also indicate that in retrospect, students acknowledged the advantages of the design-inquiry approach. To an extent, the initial confusion was alleviated by the iterative dynamics of the design-inquiry process: The first iteration was a very important catastrophe, whereupon I changed a lot of what I thought as success until that moment. In the second and the third iteration more significant things have happened…. Iterations showed me how much there is more to do…. But I was satisfied, that does not mean that the time had been wasted - really not. Over this period I learned a lot about how these processes are conducted, I work in a structured and thorough manner, and experienced in many areas that were completely new to me.
A recurring theme in students’ reflection is their difficulty in concretisation of theories and abstract ideas. This observation is in line with the findings of Fuhrmann and Kali ( There is no doubt that an implementation of mobile learning is not so easy, there is a need to do a combination of many complicated factors, I thought I know exactly how I want that our activity will occur until this lesson. When we started to discuss as a group about the scenario I understood how much there is a lot of work to do. Suddenly very important issues came up and there were many things that we had to decide about.
The design-inquiry process at the centre of this course was supported by a variety of tools, methods and representations: a project site template, a design scenario template, force maps, design principles, storyboards, and so on. Indeed, students acknowledged the value of these tools: “Creating a story board focused us … the story board enabled us to think deeper about our project, it focused our thoughts and showed us that we made some mistakes about things that we thought will work well.” “We started to connect the design principles to our project, through the drawing and the ideas arrangement we reached to an amazing subject and into more deeply project that is more relevant to the research … and the picture that we sketched helped us to discover and analyse every step in this progress.” “The use of templates was very helpful especially with issues that I don't give them much attention, for example: How can I measure success of a project? How can I do preceding research etc.”
Classroom sessions focused on guided group work and groups’ presentation of their progress to the course assembly. Students commented on the contribution of these interactions to their learning: When we saw the work of other teams I saw how different perspectives in the community can help us to add, delete, improve and modify various aspects of our project. Other points of view sometimes direct us in our actions and especially in the process of consolidation of the ideas behind them.
All 29 students completed the courses successfully, and their feedback (at the end of course survey) suggests that they valued its contribution to their understanding of the core issues presented, as well as the pragmatic considerations of implementing these ideas in realistic educational contexts.
Students expressed notable criticism about the courses’ administrative aspects, as well as the workload, which exceeded their expectations. Despite these shortcomings, the students all acknowledged the effectiveness of the design studio approach, some noting that it has changed their attitude to the course subjects and to technology-enhanced education in general.
Six projects were in the mobile learning course, completed and are now available as open resources (in Hebrew) at courses.edtech.haifa.ac.il/mlearning/projects. Nine projects were completed in the games and learning course and are available at courses.edtech.haifa.ac.il/games/projects
Upon completion, the projects were evaluated according to the rubric in
Project evaluation rubric.
| Theory and case studies | Does the project review relevant theoretical works and case studies? Is the review critical and systematic? Do the outcomes inform the design? |
|---|---|
|
|
|
| Design and development | Is the context adequately described? Is the problem well-defined? Is the proposed solution viable, robust, creative and fit for purpose? |
| Enactment | Was the designed solution trailed in authentic conditions, as appropriate for the context and problem description and project constraints? |
| Evaluation | Were data from the design, development and enactment phases collected and analysed systematically to assess the effectiveness of the solution, and reflect back on the theory, the design and its implementation? |
| Presentation | Is the project presented in a clear, informative, and attractive manner? |
Evaluation of projects in the mobile learning course.
| Id | Theory and case studies | Design and development | Enactment | Evaluation | Presentation | Total |
|---|---|---|---|---|---|---|
| Weight | 10 | 10 | 10 | 10 | 10 | 50 |
|
|
||||||
| 1 | 7 | 10 | 10 | 8 | 10 | 45 |
| 2 | 7 | 10 | 10 | 8 | 7 | 42 |
| 3 | 10 | 10 | 10 | 8 | 8 | 46 |
| 4 | 7 | 10 | 10 | 10 | 10 | 47 |
| 5 | 6 | 10 | 10 | 8 | 10 | 44 |
| 6 | 7 | 9 | 5 | 9 | 9 | 39 |
| Average | 7.71 | 9.86 | 9.29 | 8.71 | 9.14 | 44.71 |
Evaluation of projects in the games and learning course.
| Id | Theory and case studies | Design and development | Enactment | Evaluation | Presentation | Total |
|---|---|---|---|---|---|---|
| Weight (gamification/application project) | 10 | 10 | 5 | 15 | 10 | 50 |
| Weight (development project) | 10 | 20 | 0 | 10 | 10 | 50 |
|
|
||||||
| 1 | 10 | 10 | 5 | 10 | 8 | 43 |
| 2 | 10 | 10 | 5 | 15 | 10 | 50 |
| 3 | 8 | 16 | 5 | 12 | 10 | 51 |
| 4 | 9 | 18 | 5 | 10 | 8 | 50 |
| 5 | 7 | 20 | 5 | 10 | 9 | 51 |
| 6 | 7 | 15 | 5 | 10 | 9 | 46 |
| 7 | 5 | 10 | 5 | 15 | 10 | 45 |
| 8 | 5 | 7 | 5 | 10 | 8 | 35 |
| 9 | 10 | 10 | 5 | 15 | 6 | 46 |
| Average | 7.89 | 12.89 | 5.00 | 11.89 | 8.67 | 46.33 |
Several students chose to continue their projects as a final project for their degree. At least one team is still developing their project and collecting data. One student reported that the core features of his project were incorporated into a large-scale initiative run by a national school network. These examples suggest that the courses had an impact which extended far beyond its presentation cycle – and one which affected participants’ long-term professional practices.
In order to test this hypothesis, we surveyed the students again 2 years after the course completion. The web-based survey consisted of nine questions. Students were invited by email using the mailing lists created at the time of the course presentations. Sixteen students responded (seven from the mobile learning course, nine from the games and learning course). The results are shown in
Results from the long-term effect survey.
These results indicate that students acknowledge the long-term effects of the courses, both in terms of enhancing their theoretical knowledge and in terms of improving their professional practice.
Inquiry learning stems from the realisation that learning is more effective when grounded in active exploration of questions which are meaningful to the learners. This is also true for adults wishing to make use of technology in their teaching. In the model presented in this article, student projects were grounded in a context meaningful to them, thus making the course content personally relevant. Theories and case studies were not discussed in the abstract: they were scrutinised and used with regard to personally meaningful dilemmas. Inquiry learning proceeds through a cycle of asking questions, investigating those questions by conducting observations, collecting data, analysing and modelling it, and deriving conclusions, creating new understandings by synthesising the outcomes of the investigation, discussing these understandings with peers and teachers, and finally reflecting on the process and deriving new questions for the next cycle of inquiry (Anastopoulou
A design-inquiry approach is driven by the pedagogical objectives and a pragmatist exploration of the potentials of technology to address those – rather than working from the tool to its possible uses. Students were asked to identify educational needs, define a pedagogical approach and then subject the choice of technologies to those. Although some reported that at first this requirement caused confusion and frustration, by the end of the course all acknowledged its value.
Kolodner
However, LBD, as Kolodner
Educational work is always highly contextualised. The courses devoted significant attention to documenting and articulating the context in which the pedagogical challenge is situated, and carefully referring to that context in the design of the solution. As discussed by Mor (
In this article, we described “Biophone” as an exemplar project which was developed as part of the mobile learning course. The description of this project illustrates how the students applied the LDS methodology and developed a practical product. “Biophone” project constitutes the formulation of concept and its way through various milestones up to the transformation into existing invention. Doing such a successful project in a short semester course reinforces the fact that the teaching methods of the course and the tools given during it were successful.
Main success factors, evidence and limitations.
| Factor | Evidence | Limitations |
|---|---|---|
|
|
||
| Authentic design challenge | All 15 projects were driven by challenges students identified in contexts which were meaningful for them. |
This approach was suitable for active practitioners. It may be more difficult to implement for inexperienced trainees, e.g. pre-service teachers. |
| Inquiry cycle | Student feedback noted how the design phase linked between the theoretical investigation and implementation. The evaluation and reflection phases allowed students to internalise the lessons learnt from experience, and make tacit knowledge explicit. This is reflected in their testimonies 2 years later. | The inquiry cycle does not readily lend itself to modularisation. It is difficult to shorten the process, and the benefits from completing only part of it are non-proportionally reduced. This was demonstrated recently when trying to use the same model in a MOOC. |
| Scaffolds | The courses incorporated several levels of scaffolding: a site template to scaffold the design-inquiry cycle, templates to scaffold specific tasks, case studies and design principles to scaffold actual design work. |
These scaffolds relied on bespoke technology solutions. Such solutions carry their own overhead, in terms of development time and technical learning time on behalf of the students. |
| Frequent formative self, peer, and tutor assessment. | The courses incorporated several formative assessment mechanisms: a personal learning journal, peer feedback between project sites, debates and discussions within project teams. Most importantly, in keeping with the tradition of studio learning, the main bulk of class time was devoted to reviewing and discussing students’ work. |
(Non-automated) Formative feedback is labour intensive, both for the learners and the tutors. |
Students consistently reported high workload and confusion. The main cause for this was the triple learning challenge: students were required to take on an unconventional pedagogy, using unfamiliar tools, to confront novel subject matter.
In order to scale up the LDS to a general framework for teacher education, the model and the supporting resources need to be refined, extended and evaluated at greater length. The model needs to be documented and explained in a comprehensive manner. Examples need to be provided for each phase and task. A unified, comprehensive, streamlined technological environment needs to be developed to support the process.
Looking back over several decades of research, technology-enhanced learning has established itself as a significant field of scientific inquiry. Yet projecting the outputs of research into practice remains a challenge. Teacher training needs to address this gap, and there are several reasons for adopting a design-inquiry approach, where students learn through developing techno-pedagogical innovations in their domain of practice.
Specifically, as demonstrated above, the LDS model appears to have the potential to achieve several aims, which are critical to the understanding and application of technology-enhanced learning: Acknowledging the importance of context, and developing tools for documenting and articulating context. Working from a pedagogical challenge grounded in a concrete educational context, rather than from a technological innovation stance in search of an application. Adapting rigorous habits of design inquiry modelled after the ideal of the design experiment ideal – but adapted to the needs and constraints of educational practitioners. Combining personal construction and reflection with collaboration and communication as drivers of effective learning.
Educational practitioners often operate on the basis of their intuition and find it difficult to bind these to pedagogical theory. To counter this tendency, and to allow them to retain their tacit pragmatic knowledge while adopting an attitude of scientific rigor, they need to acknowledge their role as designers of learning experiences. The suggested model may serve as a framework for those who aim to train educators as clear and conscious decision makers. With well-defined guidelines and a supportive environment, teachers may become better learning designers. It allows educational professionals to connect scientific research to their practice and acquire the skills to identify educational challenges and devise effective means for addressing them.