ORIGINAL RESEARCH ARTICLE
Shixin Fanga, Yi Lua*, Guijun Zhanga and Wenjuan Qinb
aInstitute of Higher Education, Fudan University, Shanghai, China;
bCollege of Foreign Languages and Literature, Fudan University, Shanghai, China
(Received: 8 February 2023; final version received: 11 September 2023; Published: 6 March 2024)
Facilitation strategies play a critical role in helping instructors teach effectively in an online environment. However, there is a lack of research on how different facilitation strategies impact the online learning experience. To address this gap, our study surveyed 5980 college students from two universities in China and analysed the associations between facilitation strategies and student satisfaction using multivariate and logistic regression analyses. Our findings reveal that facilitation strategies aimed at managerial and technical purposes have different effects on student satisfaction with instructors compared to their satisfaction with their own achievement and engagement. Additionally, we found that student group discussion had a negative association with student satisfaction, potentially due to a preference for hierarchical learning in Confucian-heritage culture. In contrast, after-class learning materials were positively associated with student satisfaction. These findings offer important implications for pedagogical practices that aim to enhance the online learning experience for Chinese students on a large scale.
Keywords: China; online learning; college students; facilitation strategies; higher education
*Corresponding author. Email: luyi61@fudan.edu.cn
Research in Learning Technology 2024. © 2024 Shixin Fang et al. Research in Learning Technology is the journal of the Association for Learning Technology (ALT), a UK-based professional and scholarly society and membership organisation. ALT is registered charity number 1063519. http://www.alt.ac.uk/. This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for any purpose, even commercially, provided the original work is properly cited and states its license.
Citation: Research in Learning Technology 2024, 32: 3020 - http://dx.doi.org/10.25304/rlt.v32.3020
Facilitation strategies hold significant research significance within the domain of online learning due to their pivotal role in fostering interaction and establishing a sense of connectedness between instructors and students. With the continuous emergence of novel technologies, tools, and pedagogical practices, a diverse array of facilitation strategies has been devised to cater to the evolving demands of online education. However, existing studies examining the efficacy of these strategies in promoting student engagement and enhancing learning achievement have exhibited limitations, such as restricted by small and homogeneous sample sizes, or focusing solely on asynchronous interactions (e.g. Muir et al., 2020). Consequently, there is a pressing need for further exploration of facilitation strategies. Such investigations have the potential to not only assist instructors in designing and implementing effective online learning experiences on a larger scale but also augment the overall quality of online resources within higher education institutions.
The present study aims to investigate the relationship between online facilitation strategies and college student satisfaction in China, a context that has received limited attention in previous research on online learning (Yunusa & Umar, 2021). The study’s findings hold practical significance, as they contribute to a better understanding of how effective facilitation strategies can enhance student satisfaction in online learning. This knowledge can inform higher education institutions and instructors on the future design and operation of online classes for East Asian students on a larger scale, thereby improving the quality of online education.
Student satisfaction is widely recognised as a crucial measure of how effective an online class is, and this is supported by research conducted by various scholars (Kauffman 2015; Rahman et al., 2017; Yukselturk & Yildirim, 2008). Measuring student statisfaction allows instructors to receive valuable feedback directly from students, which in turn helps them make improvements and optimise their online classes (Levitz 2016; Reinhart & Schneider 2001). Therefore, monitoring student satisfaction is vital for enhancing the quality of online education and improving the overall learning experience.
Student satisfaction can be complex and multifaceted, encompassing their perceptions of instructors, themselves, and the different evaluation standards may lead to varied ratings proposed in the literature (Gopal et al., 2021). While overall satisfaction ratings provide a useful summary, they may not fully capture the class’s quality due to the many factors influencing students’ online experiences. For example, research suggests that student ratings may be influenced more by instructors’ personal charisma rather than their actual teaching effectiveness (Shelvin et al., 2000). Thus, students may rate instructors highly but still express dissatisfaction with the entire online class. On the other hand, students may be satisfied with their own engagement and learning achievement but disappointed with their instructors’ teaching effectiveness. Student satisfaction scores can vary across different dimensions and aspects, and some studies have attempted to identify these dimensions when evaluating online classes (Stewart et al., 2004). However, there is limited research that compares student satisfaction with themselves versus their satisfaction with their instructors. Therefore, the current study aims to assess student satisfaction with both themelves and their instructors, aiming to provide a more comprehensive understanding of the online learning experience.
Despite Chinese students representing a significant proportion of the global college student population, their satisfaction with online learning has received limited attention in the existing literature, which predominantly focuses on Western populations (Yunusa & Umar, 2021). However, it is essential to acknowledge that Chinese students’ satisfaction with online classes may differ from their Western counterparts due to the prevalent Confucian-heritage culture in China, which potentially gives rise to distinct learning preferences and attitudes (Chan, 1999; Sit, 2013). In Chinese culture, teachers are typically regarded as authoritative figures of knowledge, and students tend to prefer guided learning rather than independent exploration or peer interaction (Chan, 1999; Liu et al., 2010). The expression and perception of how knowledge may be enhanced through various facilitation strategies may also vary between Eastern and Western cultures, potentially influencing students’ rating of satisfaction. Consequently, the present study aims to investigate Chinese college students’ evaluations of themselves, their instructors, and their overall learning achievement using a large sample, with the goal of gaining a comprehensive understanding of the specific factors that influence Chinese students’ satisfaction with online learning.
The term ‘facilitation strategies’ encompasses a range of techniques and approaches employed by instructors to enhance the online learning experience, which may involve the utilisation of diverse technological tools and pedagogical practices (Martin et al., 2018). Berge’s (1995) theoretical model offers a framework that categorises 12 facilitation strategies into four dimensions, namely, managerial, social, pedagogical, and technical, based on their primary functions. Each facilitation strategy can belong to multiple categories depending on the specific teaching practices and objectives. For instance, group discussions can be classified under both pedagogical and social categories. Scholars have utilised Berge’s model to assess the effectiveness of facilitation strategies in various studies. For instance, Martin et al. (2018) identified 12 beneficial facilitation strategies from prior research, and they classified and tested these strategies according to Berge’s (1995) model. Their findings revealed that the ability to contact instructors was the most advantageous facilitation strategy, while interactive visual syllabi were deemed the least helpful in the context of online learning.
In this study, the selection of facilitation strategies was based on the practices and needs of instructors and students during the large-scale online learning period in China amidst the COVID-19 pandemic. Building upon Berge’s (1995) and Martin et al.’s (2018) models, we reconfigured the categories of facilitation strategies into two groups: social/pedagogical and managerial/technical. The four categories were merged into two groups because the facilitation strategies selected in our studies have multiple functions, which could be fit into more than one category. The social/pedagogical group focused on aspects such as pedagogy, intellectual engagement, and interactive elements within online classes. On the other hand, the managerial/technical group included strategies related to organisational aspects, procedures, and administrative functions.
To assess the interactive nature and effectiveness of the social/pedagogical facilitation strategies, we drew upon Moore’s (1989) theory of three types of interaction and applied it to interpret Chinese students’ perceptions of facilitation strategy effectiveness within the Eastern cultural context, in comparison to the Western culture. Moore (1989) classified interaction into three types: instructor-student interaction (ISI), student-student interaction (SSI), and student-content/material interaction. ISI involves two-way communication between instructors and learners within the class (Moore & Kearsley 2005). SSI refers to the two-way communication among students, which may occur both in the presence or absence of the instructor. Lastly, student-content/material interaction represents the process by which learners actively engage with the subject matter or class content through reflection and elaboration (Moore, 1989).
Although facilitation strategies for interaction are intended to promote the quality of online learning, researchers have debated the levels of effectiveness of different types of interaction. Some researchers argue that ISI is a better predictor of student satisfaction, and SSI may not be as helpful as the former (Battalio, 2007; Bolliger & Martindale, 2004; Irons et al., 2002; Rodriguez, 2006; Swan, 2001; Thurmond, 2003). Conversely, another group of researchers maintains that SSI is a better predictor of student satisfaction than ISI (Irons et al., 2002; Rodriguez, 2006). Student interaction can foster online community building and connection among students, which can alleviate the isolation caused by the absence of physical contact (Abrahamson, 1998; Palloff et al., 2001).
The controversy surrounding the effectiveness of different types of interaction in online learning can be attributed to two factors. Firstly, the design of activities and the level of instructor involvement in the process, which are related to the social and pedagogical aspects of facilitation strategies, may have a greater impact than the specific types of interaction. Secondly, cultural differences in learning preferences may also contribute to this debate. Students from a Confucian-heritage culture tend to prioritise learning from instructors rather than peers (Chan, 1999), whereas Western students may value both types of interaction if appropriately designed and guided. Therefore, it is imperative for this study to investigate how facilitation strategies incorporating different types of interactions can influence student satisfaction, thereby addressing the existing research gap.
Most studies agree that facilitation strategies that promote interactive learning lead to higher student satisfaction. For instance, a scoping review focusing on online classes identified instructors’ behaviour and interactions as critical factors determining student satisfaction (Yunusa & Umar, 2021). Further research emphasised the significance of instructors’ responsiveness and attitudes, which influence students’ satisfaction with the classes (Sun et al., 2008). In line with this, a study involving 100 instructors found that timely feedback was considered the most beneficial facilitation strategy (Martin et al., 2020). Additionally, instructors’ competence and course design were identified as key predictors of student satisfaction and improved performance in online learning (Gopal et al., 2021). In light of these findings, it becomes evident that the presence and interaction of instructors play a significant role in facilitating online classes and explaining student satisfaction.
Thus, our study aims to assess students’ subjective evaluations of the effectiveness of each facilitation strategy and explore their relationship with student satisfaction at the conclusion of the semester. Despite the existing body of research, several limitations need to be addressed. Firstly, previous studies have often failed to compare the effectiveness of different facilitation strategies, making it challenging to rank each strategy based on its association with student satisfaction. To address this gap, our study will measure and compare the most commonly utilised facilitation strategies. Secondly, Chinese students, who possess unique learning preferences, have received limited attention in these studies. Therefore, our study specifically focuses on Chinese students to gain insights into their perspectives. Lastly, many previous studies were constrained by small sample sizes, limiting the generalisability of their findings to large-scale online learning settings. To overcome this limitation, our study utilises a dataset with a large sample size, providing a more comprehensive and representative depiction of the online learning experience.
The study aims to address the following two main research questions:
1) Patterns of college student satisfaction in online learning:
a. How do students perceive the effectiveness of different types of facilitation strategies?
b. How satisfied are students with instructors’ engagement, students’ own engagement, and learning achievement?
c. What is the likelihood of students recommending the online classes to other students?
2) Associations of online facilitation strategies with college student satisfaction: specifically, would receiving different online facilitation strategies predict higher or lower student satisfaction?
d. Are different facilitation strategies associated with student satisfaction with instructors’engagement?
e. Are different facilitation strategies associated with student satisfaction with their own engagement?
f. Are different facilitation strategies associated with student satisfaction with their own learning achievement?
g. Are different facilitation strategies associated with students’ intention to recommend online classes to others?
The present study utilised data obtained from the ‘Chinese University Course Evaluation (CUCE)’ project, which aimed to evaluate the quality of general education classes offered at universities in China. General education classes, also referred to as common core classes, were designed to equip students with a diverse range of skills and knowledge, enabling them to lead more enriching lives as well-informed citizens. These courses cover a wide array of subjects and aim to provide students with a solid foundation of knowledge and competencies. Students were required to earn a specific number of general education credits based on their individual preferences and academic requirements.
To collect data for the CUCE project, an online survey was administered to students at the conclusion of each semester. Participation in the survey was voluntary, and students were sent emails containing a survey link. To enhance response rates, the academic affairs office sent multiple reminder emails until the response rate for each class reached a minimum threshold of 50%.
The data utilised in this study was obtained from the spring semester of 2020, a period when the COVID-19 pandemic necessitated the transition of all classes to online platforms. While synchronous instruction was mandatory for all classes, instructors employed varied approaches. Some instructors provided pre-recorded lectures as learning materials, while others played self-created videos during class sessions to simulate an asynchronous learning experience within synchronous courses. The majority of instructors utilised a combination of synchronous and asynchronous methods, with classes typically lasting 90 min.
The present study utilised evaluation data from general education classes obtained from two public universities participating in the CUCE project. Specifically, the sample consisted of 5980 undergraduate students, with 4029 students from University A and 1951 students from University B. The sample included a total of 2418 female students and 3562 male students, spanning across four class levels. Additionally, there were 20 fifth-year students who had deferred their graduation. These details are summarised in Table 1.
The comprehensive class evaluation survey comprised over 150 items, which were developed by the researchers based on insights gained from pilot interviews. These pilot interviews involved conducting semi-structured interviews with various stakeholders, including administration officers, instructors, and students, to gather practical insights and identify their specific needs. During the pilot interviews, administration officers were consulted to ascertain their requirements for the understanding of the quality of general education courses and future curriculum design and reform. Instructors were interviewed to gather feedback on the types of information they needed for course evaluations. Additionally, students were engaged in discussions to understand their perspectives, feelings, and experiences, which helped shape the design of each survey item. For the current study, only specific sections of the survey were adopted, focusing on students’ demographic information, online facilitation strategies, student satisfaction, and the likelihood of recommending the class to others. These sections were deemed most relevant to the research objectives and aligned with the study’s focus.
All the facilitation strategies collected from pilot-interviews of students regarding their learning experience and received teaching methods. In the survey, types of facilitation strategy were presented in the question ‘do you think the following online facilitation strategies used by the instructor are effective?’ All items in this question used three-point scales with ‘yes, it was used and effective’, ‘yes, it was used but not effective’, and ‘no, it was not used’. To facilitate data analysis, the study transformed these items into dummy variables, with ‘it was used’ coded as 1, indicating this strategy was employed in this class, and ‘not used’ coded as 0, indicating this strategy was not utilised. Each facilitation strategy was treated as a separate item in the multivariate regression or logistic regression models, as each strategy holds distinct practical significance. Therefore, validity and reliability testing of the facilitation strategy items were not conducted. Categorising the facilitation strategies into distinct groups was done for the convenience of interpreting the results.
The facilitation strategy items were divided into two categories, as presented in Table 2: six pedagogical and social items, and four managerial and technical items. Additionally, within the pedagogical and social category, the items were further classified into three subgroups based on Moore’s (1989) interaction model: ISI, SSI, and student-material interaction (SMI). The managerial and technical category included four items: ‘live-streaming’, ‘watching videos or listening to audio recorded by the instructor’, ‘screen-sharing’, and ‘taking attendance’.
Student satisfaction was operationalised as a multidimensional construct encompassing four variables: (1) student satisfaction with the instructor’s engagement, (2) student satisfaction with their own engagement, (3) student satisfaction with their own learning achievement, and (4) the likelihood of recommending the class to others. The second and third variables aimed to capture students’ subjective evaluations of their performance within the online classes. Specifically, student satisfaction with their engagement assessed their perception of their level of dedication to the classes. On the other hand, satisfaction with learning achievement measured the extent to which they believed they had acquired knowledge and skills from the classes. These four variables were treated as dependent variables in subsequent multivariate regression analysis, allowing for a comprehensive examination of their relationships with other study factors.
Student satisfaction with the instructor’s engagement, their own engagement, and learning achievement was assessed using three separate questions. Specifically, students were asked to rate their satisfaction with the instructor’s engagement in the classes, their own engagement in the classes, and their satisfaction with their learning achievement. A five-point Likert scale ranging from ‘1 = not satisfied’ to ‘5 = very satisfied’ was employed for these questions. Higher scores on the scale indicated higher levels of satisfaction. In addition to the aforementioned variables, the final dependent variable focused on whether students would recommend the class to others. This variable was measured using a three-point scale, with response options of ‘no = 1’, ‘not sure = 2’, and ‘yes = 3’. This question aimed to gauge students’ inclination to recommend the class to their peers, providing insights into their overall satisfaction and perception of the class.
The current study also incorporated the following control variables: the university, represented as a dummy variable (University A = 0; University B = 1); class level, treated as a continuous variable; majors, which were taken into account using three dummy variables: humanities (Major1 = 0), social science (Major2 = 1), natural science (Major3 = 1), and engineering (Major4 = 1); gender, represented as a dummy variable (female = 0); both parents’ education levels, treated as continuous variables with categories ranging from middle school or below (0) to high school (1), technical secondary school (2), community college (3), Bachelor’s degree (4), and Master’s degree or above (5); and weekly study time, treated as a continuous variable.
The current study employed three statistical methods. Firstly, descriptive statistics were utilised to address the initial set of research questions (questions a, b, c). The percentage of students who perceived a particular strategy as ineffective was calculated through dividing the number of students who considered the strategy as used but ineffective by the number of students who reported it as used and effective. This calculation yielded the ineffective ratio for each facilitation strategy, providing insights into its efficacy (Table 2). This analysis aimed to provide insights into the subjective ratings regarding the effectiveness of each strategy and answer research questions a, b, and c.
Secondly, to address the subsequent set of research questions (questions d, e, f, g), a series of multivariate regression analyses were conducted. These analyses aimed to examine the association between each facilitation strategy and student satisfaction with the instructor’s engagement, students’ own engagement, and learning achievement. Furthermore, multinomial logistic regression was employed to explore the relationship between each facilitation strategy and students’ likelihood of recommending the class to others. The data analysis process was carried out using IBM SPSS 26, ensuring adherence to the assumptions of multivariate and logistic regression. Heteroskedasticity was accounted for by utilising robust standard error estimation.
Table 2 presents the results of the descriptive statistics and the ineffective ratio for the facilitation strategy items. The findings indicate that among the managerial and technical strategies, ‘watching videos or listening to audios recorded by the instructor’ had the highest ineffective ratio at 7.63%. Conversely, ‘live-streaming’ emerged as the most favoured facilitation strategy, with only 3.88% of students reporting its ineffectiveness. Regarding the ISI items, all three strategies had ineffective ratios around 5%. However, the SSI item ‘group discussion among students’ had the highest ineffective ratio among all 10 facilitation strategies at 8.76%. Despite this, it was still a widely used strategy, with only 22.76% of students reporting that their instructors did not employ it. The third most ineffective strategy was ‘frequent assignments’ with an ineffective ratio of 7.30%. Interestingly, it was also the least commonly used strategy, as reported by 32.89% of students who stated that their instructors did not utilise it in online classes.
For student satisfaction (Table 3), all three satisfaction items had mean scores above four, indicating that students were generally satisfied with the online classes. Specifically, students gave the highest rating of satisfaction with the instructor’s engagement (Mean = 4.60, SD =0.62), and the lowest rating for their own engagement (Mean = 4.10, SD = 0.84). There were 80.30% of students willing to recommend the online classes they took to other students; 16.74% were uncertain, and 2.96% said no.
A series of multivariate regression models revealed different patterns of associations between facilitation strategies and student satisfaction (Table 4). First, it found that most facilitation strategies had significant associations with student satisfaction with instructors’ engagement, except ‘screen-sharing’ and ‘taking attendance’ (Model 1). The three items for ISI were all positive and significant. However, ‘watching videos or listening to audio recorded by the instructor’ (Beta = –0.09, SE= 0.02, p < 0.001), ‘group discussion among students’ (Beta = –0.10, SE =0.02, p < 0.001), and ‘frequent assignments’ (Beta = –0.06, SE = 0.02, p < 0.01) had negative associations with student satisfaction. These results suggested that when instructors used these facilitation strategies, students’ satisfaction scores with instructors’ engagement decreased.
| Model 1 | Model 2 | Model 3 | Model 4 | |||||
| Instructor’s engagement | Student’s engagement | Learning achievement | Recommendation | |||||
| Beta | S.E | Beta | S.E | Beta | S.E | Beta | S.E | |
| Intercept | 4.07*** | 0.08 | 3.24*** | 0.10 | 3.36*** | 0.10 | 1.43 | 0.75 |
| Universities | 0.02 | 0.02 | −0.23*** | 0.03 | −0.08*** | 0.02 | 0.85*** | 0.23 |
| Major2 | −0.04 | 0.04 | 0.06 | 0.06 | 0.03 | 0.06 | 0.32 | 0.49 |
| Major3 | −0.02 | 0.04 | 0.02 | 0.06 | 0.00 | 0.06 | −0.43 | 0.46 |
| Major4 | 0.03 | 0.04 | 0.06 | 0.06 | 0.06 | 0.05 | 0.29 | 0.45 |
| Edu_mo | 0.00 | 0.01 | 0.04*** | 0.01 | 0.03** | 0.01 | −0.07 | 0.08 |
| Edu_fa | 0.02* | 0.01 | 0.02* | 0.01 | 0.02 | 0.01 | 0.05 | 0.07 |
| Gender | −0.05** | 0.02 | 0.00 | 0.02 | 0.03 | 0.02 | 0.08 | 0.17 |
| Class levels | 0.01 | 0.01 | 0.04** | 0.01 | 0.06*** | 0.01 | 0.49** | 0.15 |
| Weekly study time | 0.05*** | 0.01 | 0.08*** | 0.01 | 0.07*** | 0.01 | 0.17* | 0.08 |
| Live-streaming | 0.17** | 0.06 | −0.13* | 0.07 | −0.02 | 0.07 | −0.64 | 0.55 |
| Watching videos or listening to audio recorded by the instructor | −0.09*** | 0.02 | 0.11*** | 0.02 | 0.06** | 0.02 | 0.15 | 0.17 |
| Screen-sharing | 0.06 | 0.03 | 0.04 | 0.05 | 0.06 | 0.04 | 0.16 | 0.34 |
| Taking attendance | −0.04 | 0.03 | 0.05 | 0.04 | −0.03 | 0.04 | −0.06 | 0.28 |
| Giving comments or feedback on assignments online | 0.07** | 0.02 | 0.12*** | 0.03 | 0.12*** | 0.03 | 0.83*** | 0.20 |
| Online text/voice discussions hosted by instructors | 0.15*** | 0.03 | 0.09* | 0.05 | 0.11* | 0.04 | 0.68* | 0.27 |
| Online voting or answering questions in class | 0.047* | 0.02 | 0.11*** | 0.03 | 0.11*** | 0.03 | 0.36 | 0.21 |
| Group discussion among students | −0.10*** | 0.02 | −0.03 | 0.03 | −0.07* | 0.03 | −0.56* | 0.26 |
| Providing materials for review after class | 0.11*** | 0.03 | 0.15*** | 0.04 | 0.17*** | 0.04 | 0.40 | 0.23 |
| Frequent assignments | −0.06** | 0.02 | 0.03 | 0.03 | −0.04 | 0.03 | −0.71*** | 0.21 |
| Adjusted R2 | 0.04 | 0.07 | 0.05 | 0.04 | ||||
| Error df | 5799 | 5799 | 5799 | 5799 | ||||
| Note: Model 1 to 3 are multivariate regression and uses standardised coefficient; *p < 0.05; **p < 0.01, ***p < 0.001; Edu_mo = mother’s education levels; Edu_fa = father’s education levels; Major2 = Social science; Major3 = Natural science; Major4 = Engineering Technology Science; Model 4 shows the multinomial logistic regression results for the ‘yes, I would’ group compared to ‘no, I would not’ group. | ||||||||
Another regression model examined the association between each facilitation strategy and students’ engagement (Model 2). Results showed that among four managerial and technical items, ‘watching videos or listening to audios recorded by the instructor’ had a significantly positive (Beta = 0.11, SE = 0.02, p < 0.001) association with students’ engagement, while ‘live-streaming’ showed a negative association (Beta = –0.13, SE = 0.07, p < 0.05). The other two items were not significant.
All three ISI items had significant and positive relationships with students’ engagement [(Beta = 0.09, SE = 0.05, p < 0.05); (Beta = 0.12, SE = 0.03, p < 0.001); (Beta = 0.11, SE = 0.03, p < 0.001)], while the SSI item ‘group discussion among students’ was not significant. For two SMI items, only ‘providing materials for review after class’ was significantly and positively associated with students’ engagement (Beta = 0.15, SE = 0.04, p < 0.001).
For student satisfaction with learning achievement (Model 3), among the four managerial and technical items, only ‘watching videos or listening to audios recorded by the instructor’ had a significantly positive effect (Beta = 0.06, SE = 0.02, p < 0.01). The three ISI items all showed significantly positive associations with student satisfaction with learning achievement, with standardised coefficients ranging from 0.11 to 0.12 [(Beta = 0.11, SE = 0.04, p < 0.05); (Beta = 0.12, SE = 0.03, p < 0.001); (Beta = 0.11, SE = 0.03, p < 0.001)]. However, the SSI item ‘group discussion among students’ had a significantly negative association with the dependent variable (Beta = –0.07, SE = 0.03, p < 0.05). Regarding the SMI item, ‘frequent assignments’ did not show an association, but ‘providing materials for review after class’ had a significant association with student satisfaction with learning achievement (Beta = 0.17, SE = 0.04, p < 0.001).
A multinomial logistic model was conducted to examine the relationship between facilitation strategies and whether students would recommend the class to others (Model 4). None of the facilitation strategies in the managerial and technical categories were significant. Among the three ISI items, ‘online text/voice discussions hosted by instructors’ (Beta = 0.68, SE = 0.27, p < 0.05) and ‘giving comments or feedback on assignments online’ (Beta = 0.83, SE = 0.20, p < 0.001) were positively and significantly related to whether the student would recommend the class. However, the SSI item ‘group discussion among students’ was negatively associated with students’ likelihood of recommendation (Beta = –0.56, SE = 0.26, p < 0.05). For the two SMI items, ‘frequent assignments’ (Beta = –0.71, SE = 0.21, p < 0.001) was negatively and significantly associated with students’ reported likelihood to recommend the class to others.
The current study examines the association of facilitation strategies with student satisfaction in a sample of 5980 college students in China. Results revealed that first, managerial and technical facilitation strategies may have different effects on student satisfaction with their own class engagement versus the instructor’s class engagement. Chinese college students use different evaluation criteria for themselves and their instructors. Second, students did not favour ‘group discussion among students’, which contradicted previous literature. Third, giving assignments frequently was likely to diminish student satisfaction, but students preferred to have materials to review after class. It also demonstrates that not all types of SMI are related to higher student satisfaction.
Based on our findings, it appears that the ratings students assign to instructors’ engagement can be influenced by the level of direct interaction or presence demonstrated through various facilitation strategies. Our results indicate that certain strategies, such as ‘watching videos or listening to audio recorded by the instructor’, ‘group discussion among students’, and ‘frequent assignments’, were associated with lower student satisfaction scores regarding instructors’ engagement. Conversely, strategies such as ‘live-streaming’ and ‘giving comments or feedback on assignments online’ were more likely to promote student satisfaction with instructors. These findings are consistent with previous research indicating that students prefer online classes where instructors exhibit a strong social presence and actively interact with them (Kuo et al., 2014; Rodriguez, 2006). It appears that students’ evaluations of instructors’ engagement are influenced more by the observable workload and instructors’ presence in utilising facilitation strategies than by the effectiveness of those strategies in promoting engagement and learning in the classroom (Gursoy & Umbreit, 2005).
In contrast to the results regarding student satisfaction with instructors, the use of ‘live-streaming’ decreased while ‘watching videos or listening to audio recorded by the instructor’ increased student satisfaction with their own engagement. This finding aligns with previous studies that have shown videos created by instructors to be associated with higher levels of student satisfaction, engagement, and connection with instructors (Draus et al., 2014; Rose, 2009). However, the negative association between ‘live-streaming’ and student satisfaction with their own engagement was surprising, considering that previous researchers have argued that synchronous online classes would be helpful in promoting communication and instructor presence (Watts, 2016). Our results suggest that while students may be satisfied with the effort instructors put into live-streaming, they may not be satisfied with their own engagement when receiving instructor-centred and one-way lecturing. Live-streaming by instructors may impose time constraints and internet connectivity difficulties for students (Park & Bonk, 2007), leading to decreased satisfaction with their own engagement. Research has shown that synchronous classes require asynchronous learning components to be effective for online learning (Zeng & Wang, 2021). Therefore, facilitation strategies that incorporate both synchronous and asynchronous elements with interactive components may be ideal for enhancing student satisfaction.
We encountered another surprising result in our study, indicating that ‘watching videos or listening to audio recorded by the instructor’ increases student satisfaction with their own engagement and learning achievement but decreases their satisfaction with instructors’ engagement. One possible explanation for this finding is that students perceive these activities as a lack of engagement on the part of instructors. However, an alternative explanation for the positive association with satisfaction with engagement is that videos or audio materials are provided to students as supplementary learning resources or effectively used by instructors to aid students’ understanding of new concepts presented in class, particularly if they are instructor-created (Pan et al., 2012). Both explanations suggest that the incorporation of videos or audio materials in the classroom can enhance SMI, resulting in increased satisfaction with their own engagement and learning achievement. Conversely, one-way live-streaming lectures may lead to student disinterest and reduced concentration. However, a brief video or audio clip can recapture students’ attention and make online classes more engaging (Stilbore & MacGibbon, 2001). While the use of audio or video materials in online classes may negatively impact student satisfaction with instructors’ engagement, if employed effectively, it can facilitate student engagement and improve their learning achievement (Brecht, 2012).
The inconsistent findings regarding student satisfaction with their own engagement and instructors’ engagement in our study are consistent with prior literature suggesting that student satisfaction should be assessed using multiple dimensions (Griffiths et al., 2007). Relying solely on a single score may not accurately reflect students’ true experiences. This underscores the potential for subjectivity and bias in student reports (Bertrand & Mullainathan, 2001). To enhance future studies and teaching practices, it is recommended to differentiate student satisfaction into various aspects, including satisfaction with engagement, performance, improvement, as well as satisfaction with instructors’ efforts, engagement, and effectiveness. Adopting a diversified rating approach can provide a more comprehensive and precise evaluation of online classes.
Our study has produced unexpected findings regarding students’ lower satisfaction with group discussions in online classes, which contradict previous research suggesting that SSI enhances satisfaction in online learning (Sher, 2009). It indicates that group discussions may require certain preconditions to function effectively in online classes; otherwise, they may have a negative impact. One possible explanation is that student discussions are less effective in the absence of direct instructor participation, which holds particular significance in Confucian-heritage Chinese culture (Sit, 2013). While SSI has been identified as a positive predictor of satisfaction in Western research (Kuo et al., 2014), it may not be perceived as an effective facilitation strategy in Chinese culture. This finding aligns with previous research demonstrating that Chinese students prefer one-way lecturing from instructors and view their instructors as knowledgeable figures who possess all necessary knowledge (Chan, 1999). Interestingly, in our sample, ‘online text/voice discussions hosted by instructors’ emerged as a significant positive factor in explaining student satisfaction. This suggests that the instructor’s presence is crucial for facilitating effective discussions in Chinese culture. Additionally, Gulati (2008) argues that mandatory group discussions may not align with student-centred teaching practices, as some students prefer to learn individually through silent engagement with online lectures and learning materials. In such cases, group discussions may diminish their satisfaction with online learning.
One notable finding from our study is that ‘frequent assignments’ did not significantly contribute to student satisfaction with their engagement and learning achievement, and in some cases, it was associated with lower ratings for both instructors and the class. Conversely, ‘providing learning materials for review after class’ was found to be a positive factor linked to student satisfaction. This finding is consistent with previous research indicating that students generally do not appreciate mandatory and heavy assignments in online classes, and instructors should offer greater flexibility and guidance in terms of assignments (Hassan et al., 2021; Lee et al., 2011). In contrast, providing learning materials for review allows students more freedom and flexibility in choosing what and how to learn, which is a significant advantage of online learning characterised by convenience and self-regulation. However, this convenience also presents challenges associated with online learning, such as high workload and the need for self-discipline (Mukhtar et al., 2020).
The present study has several limitations that should be acknowledged when interpreting the results. Firstly, our focus was limited to general education classes, and the findings may not generalise to other types of classes or disciplines where instructors may employ different facilitation strategies. It is important to consider that students’ performance and behaviours could vary across different types of classes. Secondly, we did not collect data on certain important factors that could influence students’ experience during emergency remote learning. This includes the demographic characteristics of instructors, the quality of the online learning system, the technology and equipment utilised, and the specific learning environment in which students were situated. These factors could potentially have an impact on students’ satisfaction and overall learning experience. Additionally, our study did not involve qualitative interviews with students and faculty members during the COVID-19 pandemic. Qualitative data could have provided deeper insights and additional context to support the assumptions and explanations presented in our findings. Including interviews could have allowed us to capture the perspectives, experiences, and challenges faced by students and instructors in a more comprehensive manner. Future research should address these limitations to obtain a more comprehensive understanding of students’ online learning satisfaction.
The current study’s findings have important implications for our understanding of the complex relationships between facilitation strategies, student satisfaction, and learning outcomes in different contexts. Higher education institutions (HEIs) and instructors should consider the influence of culture on student learning preferences when designing and delivering online classes (Lim 2004). While social constructivism emphasises student-centred learning and peer interactions (Amineh & Asl, 2015; Anderson, 2008), our findings highlight the need for instructors to assume a more dominant role in the Chinese context of online learning. The structure and design of online classes based on social constructivism may need to be adjusted to align with the hierarchical approach to teaching and learning valued in Chinese culture. Further research should explore the intersection of social constructivism, Chinese culture, online learning preferences, and their collective impact on student learning outcomes.
From a pedagogical perspective, Chinese instructors should consider implementing more structured and scaffolded interactive activities to ensure that students feel guided and connected with their instructors. Chinese students who are new to student-centred learning activities may require additional time and education on why and how to construct their knowledge independently or through interaction with peers. It is crucial to communicate the goals of course activities clearly to engage students in the learning process (Berry, 2022).
Furthermore, our findings emphasise the need for caution when using student reports as the sole basis for assessing instructors’ teaching performance, as they can be subject to bias. A comprehensive assessment of instructors’ teaching effectiveness should incorporate multiple sources of evaluation to derive a valid conclusion.
In addition, our research has significant implications for the effective implementation of facilitation strategies in future online teaching applications, particularly in the context of emerging technology-based teaching methods and mediums. Firstly, our findings suggest that instructors should incorporate more student-centred and interactive activities, such as group discussions, with the instructor leading the discussion and providing clear and structured feedback. Secondly, when conducting live-streaming classes, instructors should maintain an interactive and student-focused approach instead of relying solely on one-way lecturing. This can be achieved by introducing activities such as online voting to engage students and solicit their opinions. Lastly, instructors should provide structural guidance and interaction when using videos or audio in online classes to help students understand the relevance of the content to the course. They could lead discussions or pose questions related to the material and even use it as an after-class learning tool by assigning assignments based on video content.
Our research highlights the importance of carefully considering the effectiveness of adding more technology or pedagogical facilitation strategies to online classes. Instructors should focus on selecting the most appropriate and effective strategies that promote student learning behaviours and outcomes. For example, experimental studies could be conducted to investigate the effects of assignment frequency and instructors’ feedback on students’ satisfaction and learning achievement. Additionally, it is crucial to recognise that using student reports alone to evaluate instructors’ teaching performance may introduce bias, and thus it is essential to use multiple sources of evaluation to generate valid conclusions.
Furthermore, our research has significant implications for the development of online learning and degree programmes, which have been on the rise in China and other developing countries in recent years. The COVID-19 pandemic has altered the attitudes of both instructors and students towards online learning (Adedoyin & Soykan, 2023). While Chinese teachers have shown enthusiasm for innovating online learning, they did not anticipate wide-scale acceptance in the near future (McConnell, 2018). Traditional preferences for face-to-face lecturing and the lack of research and experience in online learning have been major obstacles to the development of online education. Our study sheds light on how to improve the quality of online learning on a large scale by leveraging new technologies and challenging traditional learning beliefs among teachers and students who are new to online education. It provides new incentives for the long-term development of online higher education on a larger scale.
The datasets generated and/or analysed during the current study are not publicly accessible, but are available from the corresponding author on reasonable request.
The authors declare that they have no competing interests.
| Abrahamson, C. E. (1998). Storytelling as a pedagogical tool in higher education. Education, 118(3), 440–451. |
| Adedoyin, O. B. & Soykan, E. (2023). COVID-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 31(2), 863–875. https://doi.org/10.1080/10494820.2020.1813180 |
| Amineh, R. J. & Asl, H. D. (2015). Review of constructivism and social constructivism. Journal of Social Sciences, Literature, and Languages, 1(1), 9–16. |
| Anderson, T. (2008). Towards a theory of online learning. In T. Anderson (Ed.), The theory and practice of online learning, AU Press, Edmonton, 45–74. |
| Battalio, J. (2007). Interaction online: A reevaluation. Quarterly Review of Distance Education, 8(4), 339–352. Retrived from https://www.proquest.com/openview/b037f4ef8605c6e2052f8e73e204a5ae/1?pq-origsite=gscholar&cbl=29705 |
| Berge, Z. L. (1995). The role of the online instructor/facilitator. Educational Technology, 35(1), 22–30. Retrieved from https://myweb.fsu.edu/ajeong/eme5457/readings/Berge1995_RolesOfInstructor.pdf |
| Berry, S. (2022). Creating inclusive online communities: Practices that support and engage diverse students. New York: Stylus Publishing, LLC. |
| Bertrand, M. & Mullainathan, S. (2001). Do people mean what they say? Implications for subjective survey data. American Economic Review, 91(2), 67–72. https://doi.org/10.1257/aer.91.2.67 |
| Bolliger, D. U. & Martindale, T. (2004). Key factors for determining student satisfaction in online courses. International Journal on E-Learning, 3(1), 61–67. Retrieved from https://www.learntechlib.org/primary/p/2226/ |
| Brecht, H. D. (2012). Learning from online video lectures. Journal of Information Technology Education, 11(1), 227–250. Retrieved from http://jite.informingscience.org/documents/Vol11/JITEv11IIPp227-250Brecht1091.pdf |
| Chan, S. (1999). The Chinese learner – A question of style. Education + Training, 41(6/7), 294–305. https://doi.org/10.1108/00400919910285345 |
| Draus, P. J., Curran, M. J. & Trempus, M. S. (2014). The influence of instructor-generated video content on student satisfaction with and engagement in asynchronous online classes. Journal of Online Learning and Teaching, 10(2), 240–254. Retrieved from https://jolt.merlot.org/vol10no2/draus_0614.pdf |
| Gopal, R., Singh, V. & Aggarwal, A. (2021). Impact of online classes on the satisfaction and performance of students during the pandemic period of COVID-19. Education and Information Technologies, 26, 6923–6947. https://doi.org/10.1007/s10639-021-10523-1 |
| Griffiths, J. R., Johnson, F. & Hartley, R. J. (2007). User satisfaction as a measure of system performance. Journal of Librarianship and Information Science, 39(3), 142–152. https://doi.org/10.1177/0961000607080417 |
| Gulati, S. (2008). Compulsory participation in online discussions: Is this constructivism or normalisation of learning? Innovations in Education and Teaching International, 45(2), 183–192. https://doi.org/10.1080/14703290801950427 |
| Gursoy, D. & Umbreit, W. T. (2005). Exploring students’ evaluations of teaching effectiveness: What factors are important? Journal of Hospitality & Tourism Research, 29(1), 91–109. https://doi.org/10.1177/1096348004268197 |
| Hassan, S. U. N. et al. (2021). Academic self-perception and classe satisfaction among university students taking virtual classes during the COVID-19 pandemic in the Kingdom of Saudi-Arabia (KSA). Education Sciences, 11(3), 134. https://doi.org/10.3390/educsci11030134 |
| Irons, L. R., Jung, D. J., & Keel, R. O. (2002). Interactivity in distance learning: The digital divide and student satisfaction. Journal of Educational Technology & Society, 5(3), 175–188. Retrieved from https://www.jstor.org/stable/pdf/jeductechsoci.5.3.175.pdf |
| Kauffman, H. (2015). A review of predictive factors of student success in and satisfaction with online learning. Research in Learning Technology, 23, 26507. https://doi.org/10.3402/rlt.v23.26507 |
| Kuo, Y. C. et al. (2014). Interaction, internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education classes. The Internet and Higher Education, 20, 35–50. https://doi.org/10.1016/j.iheduc.2013.10.001 |
| Lee, S. J. et al. (2011). Examining the relationship among student perception of support, classe satisfaction, and learning outcomes in online learning. The Internet and Higher Education, 14(3), 158–163. https://doi.org/10.1016/j.iheduc.2011.04.001 |
| Levitz, R. N. (2016). 2015–16 national online learners satisfaction priorities report. Cedar Rapids: Ruffalo Noel Levitz. Retrieved from https://files.eric.ed.gov/fulltext/ED602841.pdf |
| Lim, D. H. (2004). Cross cultural differences in online learning motivation. Educational Media International, 41(2), 163–175. https://doi.org/10.1080/09523980410001685784 |
| Liu, X. et al. (2010). Cultural differences in online learning: International student perceptions. Journal of Educational Technology & Society, 13(3), 177–188. Retrieved from https://www.jstor.org/stable/jeductechsoci.13.3.177 |
| Martin, F., Wang, C. & Sadaf, A. (2018). Student perception of helpfulness of facilitation strategies that enhance instructor presence, connectedness, engagement and learning in online classes. The Internet and Higher Education, 24, 52–65. https://doi.org/10.1016/j.iheduc.2018.01.003 |
| Martin, F., Wang, C. & Sadaf, A. (2020). Facilitation matters: Instructor perception of helpfulness of facilitation strategies in online classes. Online Learning, 24(1), 28–49. https://doi.org/10.24059/olj.v24i1.1980 |
| McConnell, D. (2018). E-learning in Chinese higher education: The view from inside. Higher Education, 75(6), 1031–1045. https://doi.org/10.1007/s10734-017-0183-4 |
| Muir, T., Douglas, T. & Trimble, A. (2020). Facilitation strategies for enhancing the learning and engagement of online students. Journal of University Teaching & Learning Practice, 17(3), 1–19. https://doi.org/10.53761/1.17.3.8 |
| Mukhtar, K. et al. (2020). Advantages, limitations and recommendations for online learning during COVID-19 pandemic era. Pakistan Journal of Medical Sciences, 36(COVID19S4), COVID19-S27-S31. https://doi.org/10.12669/pjms.36.COVID19-S4.2785 |
| Moore, M. G. (1989). Editorial: Three types of interaction. American Journal of Distance Education, 3(2), 1–7. https://doi.org/10.1080/08923648909526659 |
| Moore, M. G. & Kearsley, G. (2005). Distance education: A systems view. Belmont, CA: Thomson Wadsworth. |
| Palloff, R. M., Pratt, K., & Stockley, D. (2001). Building learning communities in cyberspace: Effective strategies for the online classroom. The Canadian Journal of Higher Education, 31(3), 175–178. Retrieved from https://www.proquest.com/docview/221229996?pq-origsite=gscholar&fromopenview=true |
| Pan, G. et al. (2012). Instructor-made videos as a learner scaffolding tool. MERLOT Journal of Online Learning and Teaching, 8(4), 298–311. Retrieved from https://jolt.merlot.org/vol8no4/pan_1212.pdf |
| Park, Y. J., & Bonk, C. J. (2007). Synchronous learning experiences: Distance and residential learners’ perspectives in a blended graduate classe. Journal of Interactive Online Learning, 6(3), 245–264. Retrieved from https://www.ncolr.org/jiol/issues/pdf/6.3.6.pdf |
| Rahman, M. N. A., Zamri, S. N. A. S., & Eu, L. K. (2017). A meta-analysis study of satisfaction and continuance intention to use educational technology. International Journal of Academic Research in Business and Social Sciences, 7(4), 1059–1072. https://doi.org/10.6007/IJARBSS/V7-I4/2915 |
| Reinhart, J., & Schneider, P. (2001). Student satisfaction, self-efficacy, and the perception of the two-way audio/video distance learning environment: A preliminary examination. Quarterly Review of Distance Education, 2(4), 357–365. Retrieved from https://www.learntechlib.org/p/92806/ |
| Rodriguez, R. F. M. (2006) Learner characteristic, interaction and support service variables as predictors of satisfaction in Web-based distance education. Albuquerque: The University of New Mexico. |
| Rose, K. K. (2009). Student perceptions of the use of instructor-made videos in online and face-to-face classes. MERLOT Journal of Online Learning and Teaching, 5(3), 487–495. Retrieved from https://jolt.merlot.org/vol5no3/rose_0909.pdf |
| Shelvin, M. et al. (2000). The validity of student evaluation of teaching in higher education: Love me, love my lectures?. Assessment & Evaluation in Higher Education, 25(4), 397–405. https://doi.org/10.1080/713611436 |
| Sher, A. (2009). Assessing the relationship of student-instructor and student-student interaction to student learning and satisfaction in web-based online learning environment. Journal of Interactive Online Learning, 8(2), 102–120. Retrieved from https://www.ncolr.org/jiol/issues/pdf/8.2.1.pdf |
| Sit, H. H. W. (2013). Characteristics of Chinese students’ learning styles. International Proceedings of Economics Development and Research, 62(8), 36–39. https://10.7763/IPEDR.2013.62.8 |
| Stewart, I., Hong, E. & Strudler, N. (2004). Development and validation of an instrument for student evaluation of the quality of web-based instruction. The American Journal of Distance Education, 18(3), 131–150. https://doi.org/10.1207/s15389286ajde1803_2 |
| Stilbore, L. & MacGibbon, P. (2001). Video/video conferencing in support of distance education. The Commonwealth of Learning. Retrieved from http://hdl.handle.net/11599/127 |
| Sun, P. C. et al. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202. https://doi.org/10.1016/j.compedu.2006.11.007 |
| Swan, K. (2001). Virtual interaction: Design factors affecting student satisfaction and perceived learning in asynchronous online courses. Distance Education, 22(2), 306–331. https://doi.org/10.1080/0158791010220208 |
| Thurmond, V. A. (2003). Examination of interaction variables as predictors of students’ satisfaction and willingness to enroll in future web-based courses while controlling for student characteristics. In C. Crawford, N. Davis, J. Price, R. Weber & D. Willis (Eds.), Proceedings of SITE 2003 – Society for Information Technology & Teacher Education International Conference, Albuquerque, New Mexico, 528–531. Retrieved from https://www.learntechlib.org/p/17955/ |
| Watts, L. (2016). Synchronous and asynchronous communication in distance learning: A review of the literature. Quarterly Review of Distance Education, 17(1), 23–32. |
| Yukselturk, E. & Yildirim, Z. (2008). Investigation of interaction, online support, classe structure and flexibility as the contributing factors to students’ satisfaction in an online certificate program. Educational Technology & Society, 11(4), 51–65. Retrieved from https://www.jstor.org/stable/jeductechsoci.11.4.51 |
| Yunusa, A. A. & Umar, I. N. (2021). A scoping review of critical predictive factors (CPFs) of satisfaction and perceived learning outcomes in e-learning environments. Education and Information Technologies, 6(1), 1223–1270. https://doi.org/10.1007/s10639-020-10286-1 |
| Zeng, X. & Wang, T. (2021). College student satisfaction with online learning during Covid-19: A review and implications. International Journal of Multidisciplinary Perspectives in Higher Education, 6(1), 182–195. https://doi.org/10.32674/jimphe.v6i1.3502 |