Interdisciplinary project-based learning : technology for improving student cognition

The article studies a way of enhancing student cognition by using interdisciplinary project-based learning (IPBL) in a higher education institution. IPBL is a creative pedagogic approach allowing students of one area of specialisation to develop projects for students with different academic profiles. The application of this approach in the Ural State University of Economics resulted in a computer-assisted learning system (CALS) designed by IT students. The CALS was used in an analytical chemistry course with students majoring in Commodities Management and Expertise (‘expert’ students). To test how effective the technology was, the control and experimental groups were formed. In the control group, learning was done with traditional methods. In the experimental group, it was reinforced by IPBL. A statistical analysis of the results, with an application of Pearson x test, showed that the cognitive levels in both IT and ‘expert’ experimental groups improved as compared with the control groups. The findings demonstrated that IPBL can significantly enhance learning. It can be implemented in any institution of higher or secondary education that promotes learning, including the CALS development and its use for solving problems in different subject areas.


Introduction
Extensive literature describes complex engineering, technical, research, educational and social projects whose design and development are based on cross-disciplinary knowledge and that are run by interdisciplinary teams (Carpenter et al. 2007;Goff et al. 2006;Maxim 2006;Piunno et al. 2014;Pooley et al. 2014;Shea et al. 2008;Stetter et al. 2006;Whitney 2014;Yan, Prodanovic, and Taheri 2014).Some authors (Alshara and Ibrahim 2007;Loncar-Vickovic et al. 2012;Rabb, Rogers, and Chang 2008) focus on cooperative learning of students with mixed subject specialism.They suggest that this organisational structure is important, allowing the interdisciplinary team to synchronise their efforts, each contributing their individual strengths and resources to promote student learning.Student involvement into interdisciplinary practical and research activities is not limited by carrying out some work supervised by teachers or specialists.These authors report that project work helps students to overcome some barriers erected by disciplinary egocentrism.It develops creativity and enables a balance in student independent learning.This is essential both for problem solution and effective learning and teaching (Mc Goldrick et al. 2013;Rahal 2008;Ramos, Lozano, and Caldero E ´n 2014;Richter and Paretti 2009;Tan et al. 2006).An intensive development of STEM (science, technology, engineering and math) and STEAM (science, technology, engineering, art and math) education has been recently articulated (Donohue, Hunter, and Richards 2012;Schaffer et al. 2012;Tseng et al. 2013).
The issue of interdisciplinary integration in professional education pursues both a radical restructuring of the whole learning process by constructing a model of an innovative education institution, and the introduction of modern pedagogical methodologies and techniques and IT (Chu et al. 2010;Crampton, Ragusa, and Cavanagh 2012;Di Blas et al. 2014;Gendjova and Yordanova 2009;Sampson et al. 2014).
Different subject areas may make use of various software applications.These differences encourage science teachers and students to collaborate with IT specialists.This collaboration may take a variety of forms: cooperation between departments and academic staff (Chang and Lee 2010;Gaynor and Brown 2012), interdisciplinary computing classes (Carter 2014), using open-source electronic platforms to enhance technology-oriented training of students (Urban 2014).Among these forms a prominent place belongs to interdisciplinary project-based learning (IPBL).
Project-Based Learning (PBL) is an educational process, where learners led by the teacher are motivated to gain knowledge, understanding and skills.Learners are actively involved in the learning process by developing projects related to the solution of practically important issues.For many years in university practice, project development has been used as a form of student final assessment.
Findings of pedagogical research reflect the fact that PBL arouses student interest in the subject course, enhances student motivation and engagement in the learning process, and eventually improves levels of cognition (Johnson and Delawsky 2013).Interdisciplinary collaboration may have different applications in the university class.Barak and Dori (2005) described the integration of PBL in an IT environment into three undergraduate chemistry courses, each including both experimental and control students.Students in the experimental group volunteered to carry out an individual IT-based project, whereas the control students solved only traditional problems.The results indicated that incorporating IT-rich project-based learning can enhance students' understanding of chemical concepts and theories.Dekhane and Tsoi (2010) devised a cross-disciplinary 'business' relationship: the software engineering students were 'hired' by the students enrolled in an organic chemistry course to design and develop a mobile application in order to help teach some organic chemistry concepts.A system approach proposed by Jehlicka (2010) to teaching programming emphasises the interdisciplinary interconnection between physics, informatics and mathematics, thus contributing to the interdisciplinary nature of programming.
The study by Biasutti and El-Deghaidy, undertaken in 2012 and administered in Egypt and Italy, reported on the use of Wiki as an online didactic tool to develop teachers' professional skills.The results of the study suggest that IPBL (Wikis in this case) can develop knowledge management processes and fulfil student's satisfaction while collaborating in designing interdisciplinary projects.Other studies also support these findings (Biasutti and El-Deghaidy 2014;Butler and Christofili 2014;Martı ´nez, Herrero, and de Pablo 2011;Yueh, Liu, and Lin 2015).IPBL arouses students' interest in the subject, increases their motivation and involvement in the learning process, contributes to personal growth, development of critical thinking, ability to work in teams and, ultimately, increases the level of cognition and satisfaction of achieved learning outcomes.To sum up, the literature review demonstrates the need, relevance and importance of different forms of interdisciplinary integration, including IPBL.
In the present study we define IPBL as activities, performed by IT students and supervised by experienced staff members of the Computer Science department and other subject teachers.These activities aim to develop e-learning resources (ELR) of different types targeting the solution of subject specialism issues.IPBL involves the following sequence of activities: understanding of the subject content of the problem, that is, students have to 'immerse' themselves in the discipline area in order to develop a project Á ELR; design of an algorithm for the ELR content component; design of an algorithm for the technological component of the ELR interface; design of a code for ELR application software; ELR code checkout; ELR experimental approval in the learning process; ELR post-approval adjustment; ELR introduction in the learning process; ELR maintenance for an academic year; presentation of the findings (conference presentation, article publication, software certification, report writing, etc.).In this interpretation IPBL needs to address specific interdisciplinary problems related to the simulation of processes studied by one discipline with the application of tools from another discipline.From this point of view IPBL is closely linked with problem-based learning.However, if the problem-based approach can be limited to a simple statement of the problem (whose solution may be unknown to the teacher), the project-based learning provides for a specific decision path (which is generally known to the teacher).Students, then, can pursue this path during project work and project-based learning.Thus, IPBL is tied to Bloom's taxonomy of educational objectives as it contributes to students' progression from the basic level (knowledge) to the upper level (creativity) (Pappas, Pierrakos, and Nagel 2013;Stockman and Nyland 2010).
The feature of IPBL described in this work is the fact that the relations between all participants are based on mutual interest in developing professional competence and enhancing learning rather than on business outcomes.The use of IPBL in the Ural State University of Economics (USUE) in Ekaterinburg, Russia, has become possible due to the following factors.USUE educates specialists for various sectors of the economy (trade, food safety, banking, management, marketing, macro-and microeconomics, economics and law, hospitality business, computer engineering, etc.).It means that learning Á in line with widespread use of information technologies in the tertiary sector Á calls for the development of educational resources (computer-assisted learning technologies, assessment methods, simulation systems, hardware, database, etc.), which might be difficult without advanced programming skills.
The bachelor-degree programme Mathematical Software and Information Systems Administration is in fact a combination of Computer Science and Computer Engineering approaches to learning.The attained level of programming skills allows students to use Borland Delphi, C'', Visual Basic, Microsoft FrontPage, Adobe Flash, Adobe Photoshop, Corral Draw, and multimedia-advanced scripting languages such as JavaScript, jQuery library, PHP Á Hypertext Markup Language (HTML) and the formal language of cascading stylesheets CSS, while designing application software.This training aids students in solving serious problems, including those attributed to the development of ELR for various subject areas.In our case the development of ELR within the framework of IPBL does not require utilisation of a web-based learning platform like Moodle.Students communicate with each other and the teacher via the group site.The group site is created as part of USUE virtual learning environment and can be accessed via a university portal.
The aim of our study is to consider possibilities of applying the proposed pedagogic approach to IPBL for attaining two complementary objectives, namely: to improve learning of undergraduate students with Mathematical Software and Information Systems Administration specialty (hereinafter referred to as 'IT students') and to enhance performance of students majoring in 'Commodities Management and Expertise' (hereinafter referred to as 'expert students') for whom Computer Science is not a core subject.Thus, the objectives of the work are the learning process monitoring, the statistical analysis of the learning outcomes and the assessment of IPBL impact on student knowledge, understanding and skills.

Materials
The quality of the learning process and learning outcomes were evaluated by reference to student cognitive levels.The hierarchy of the levels used in this work is based on Bloom's Taxonomy (Bloom 1956), which has been modified to meet the study objectives.The aim of our research was to observe the impact of IPBL on student cognition.To achieve the objectives we considered it possible to use a less detailed revised version of Bloom's taxonomy proposed by Russian researchers but barely known in the international academic world (Bespalko 1993;Maximova 2010).The revised Bloom's taxonomy has four levels of cognition where the six tiers in Bloom's taxonomy are paired: the basic level (knowledge and comprehension), the middle level (application and analysis) and the upper level (synthesis and evaluation).In addition to these three levels the lower level of cognition (identification) was introduced to evaluate poor knowledge.Nowadays, in some countries including Russia, young people demonstrate a decreased level of competence in basic science (Elı ´as 2009;Jerrim and Choi 2014;Kostova 2015;Ogura 2005;PISA 2012).That is why the lower cognitive level can be introduced to describe the 'primary knowledge' that students have about a complex discipline before its study.
At the lower cognitive level students are able to identify or recognise previously learned information and to copy it.However, students need some assistance (e.g. a set of prompts) in order to perform certain actions with this information.At the basic level students are able to independently recall and apply appropriate, previously learned information to typical and familiar situations.At the middle level of cognition students are able to apply previously learned information (or knowledge) to new and unfamiliar situations by breaking down information into parts, or examining it.At the upper level of cognitive learning students are able to apply prior knowledge and skills to combine elements into a pattern that is new, and make a judgment according to a set of criteria.Thus, the revised cognitive domain consists of four tiers: the basic, middle and upper levels show positive learning outcomes; the lower level is not disregarded, but is not considered satisfactory.
To follow the revised Bloom's model, the tests consisted of three groups of tasks.Group 1 included the tasks that required reproduction of acquired knowledge.The tasks in Group 2 focused on application, differentiation and analysis.Group 3 consisted of integrated tasks of producing new aspects of the knowledge, including cross-disciplinary.Students' achievements were graded as follows: the upper level of cognition Á 70% or greater of tasks completed in all three groups; the middle level of cognition Á 70% or greater of tasks completed in any two of the groups; the basic level of cognition Á 70% or greater of tasks completed in one group (usually Group 1); the lower level of cognition Á less than 70% was gained in any of the three groups of tests (meaning that the material had not been learned).The final exam grade was calculated as the average for three groups of tasks using a 100-point scale.
Testing enabled us to identify the proportion of students who acquired the subject knowledge, understanding and skills at the lower, basic, middle or upper level.This technique resulted in obtaining comparable data and statistically reliable indicators that can characterise the level of cognition in a particular academic discipline.

Ethics
All students were tested with their consent.They were interested in receiving unbiased and objective evaluation of their cognitive level.Assessment methods and confidentiality were agreed with students.The test questions did not address any privacy issues and posed no risk.Thus, the ethical aspects of testing were implicitly accepted by both students and teachers.

Procedure
The study had two parts.Each part was further divided into three stages: ascertaining, formative and conclusive.At the ascertaining stage experimental groups were formed and the initial level of students' knowledge was determined.At the formative stage an educational process was carried out in the control (traditional education) and experimental (traditional education in combination with IPBL) groups.At the conclusive stage the statistical analysis of data was performed.The level of cognition for each group of students was assessed at each stage.
Part 1 of the study involved IT students.In the ascertaining stage the control and experimental groups (52 and 44 IT students respectively) were formed in accordance with student academic groups.The main hypothesis put forward in Part 1 of the study stated that IPBL improves the cognitive level of IT students, who are involved in designing interdisciplinary projects, in core modules.The following modules were considered 'core' for IT students: Network IT; Information Systems Administration; Operating Systems; User Environment and Frames; Computer Architecture.Most study hours are allocated to these modules, and their acquisition significantly contributes to professional competence in undergraduates.
In the ascertaining stage we tested whether the initial cognitive levels of IT students fit to the normal distribution.We also tested the homogeneity of the control and experimental groups.For this purpose we analysed the results of the Computer Programming exam which was taken prior to the study of core modules, with an application of Student's t-test and Pearson x 2 test for the significance level a 00.05.In the conclusive stage and 6 months later, homogeneity/non-homogeneity of the groups was tested with the results of final exams in core subjects (modules).In the formative experiment stage IT students studied core modules.In the control group learning was carried out via traditional methods.In the experimental group traditional methods were combined with the computer-assisted learning system (CALS) in analytical chemistry (Stozhko, Tchernysheva, and Mironova 2014).The CALS includes a set of computer-based packages written in Delphi, multimedia-advanced scripting languages such as JavaScript, HTML and the formal language of cascading stylesheets CSS.The CALS contains two sub-systems for laboratory work and independent learning.Facing the challenge of designing software, IT students had to apply the existing professional knowledge and skills as well as to immerse themselves in understanding of certain analytical chemistry concepts.
For statistical analysis of the test results, Pearson x 2 test was applied for the significance level a 00.05.
where A and B Á minimum and maximum value of the original sample; k Á number of distribution intervals, k 01'3.3 lg n; n Á sample size; M Á mean of the original sample; S Á average squared deviation of the original sample; y j Á middle of j-interval (j01, 2,. .., k); degree of freedom, v 0k (3.
A set of tests was developed in order to determine how many experimental and control IT students had attained a certain cognitive level in each core module.
Part 2 of the research involved 'expert' students who enrolled in the analytical chemistry module as part of their curriculum.The main hypothesis was put forward that the analytical chemistry course (module) coupled with the CALS, designed within the framework of IPBL, enhances the 'expert' students' cognitive level.
The procedure for Part 2 of the experiment was repeated.In the ascertaining stage the control and experimental groups (57 and 46 students respectively) were formed.In the formative stage, 'expert' students studied the analytical chemistry module.In the control group learning was carried out by traditional methods.In the experimental group learning combined traditional methods and CALS.

Results and discussion
During the 2011Á2013 academic years within the framework of IPBL, IT students were working on developing computer programs for the CALS in analytical chemistry, which were certified by the Federal Service for Intellectual Property, Patents and Trademarks of the Russian Federation.

Part 1: findings
A null statistical hypothesis H 0 stated that the control and experimental groups of IT students are homogeneous in terms of the level of their initial knowledge of Computer Programming.It is worth mentioning that USUE employs a unified information system that enables student academic performance to be graded on a 100-point scale.The data are entered into academic groups' electronic journals and exam records.Then students are automatically rated by their final grades.This system ensures the transparency of the grading process, reduces the impact of human factor and overall provides unbiased student assessment.The hypothesis H 0 was tested by analysing the results of the Computer Programming exam which was taken prior to the study of core modules.
For the degree of freedom v0n'p (2094, the calculated value of Student's t-test (T cal ) was 1.9, its corresponding table value (T tab ) was 2. As the calculated value is lower than the table value, the null hypothesis H 0 can be accepted as plausible for the significance level a 0 0.05.This, in turn, means that the control and experimental groups of IT students were homogeneous with regard to the results in the Computer Programming exam.In the ascertaining stage a null statistical hypothesis H 0 (1) was put forward whereby the results of the control and experimental groups in Computer Programming are described as normally distributed.For the significance level a 00.05, n 096 and degree of freedom v 05, Pearson x 2 test was calculated x 2 cal 02.23.Its corresponding table value was x 2 tab 011.1.As x 2 cal Bx 2 tab (2.23B11.1),then for the significance level a 00.05 and degree of freedom v05, the null statistical hypothesis H 0 (1) does not contradict the obtained data, that is, the empirical distribution describing the results of the Computer Programming exam can be taken as normal.
In the concluding stage of Part 1 of the experiment, a null statistical hypothesis H 0 (2) was put forward, whereby IT students in the control and experimental groups are homogeneous in terms of the cognitive levels in core disciplines.
The results in Table 1 show how homogeneous IT students were in the control and experimental groups.The data are based on the results of the tests on core modules obtained in the concluding stage.According to the results, the computed values of Student's t-test do not exceed the corresponding table value (T tab 02.0), which allows us to accept the hypothesis H 0 (2) as a plausible statement.Six months after the completion of the core modules, a null statistical hypothesis H 0 (3) was put forward, whereby the control and experimental groups of IT students are homogeneous in terms of the cognitive levels in core disciplines and belong to one universal set.
The results of re-testing IT students' knowledge and understanding 6 months after the completion of the core modules are presented in Table 2  (3) , whereby the control and experimental groups of IT students are not homogeneous and belong to different universal sets by the level of cognition in all core modules.
Distribution of the experimental and control IT students by cognitive level in core module on the basis of test results is presented in Table 3.
It is apparent from the data in Table 3 that the number of IT students in the experimental group (with IPBL) who achieved the middle and upper levels of cognition in core modules is higher than in the control group with traditional learning.At the same time IT students never demonstrated this lower level at any stage of testing.Table 3 shows that the number of students who attained the middle and upper cognitive levels in each core module is higher in the experimental group as compared with the control group.Table 4 presents a comparative analysis of the cumulative percentage of the control and experimental IT students who attained the middle and upper levels of cognition in core modules.
Thus, the outcomes of Part 1 of the study demonstrate that, on average, 79.5% of IT students in the experimental group (who combined the study of core modules with IPBL) have achieved the middle and upper levels of cognitive learning, which is 2.3 times higher than the results of the control group.It allows us to conclude that the main hypothesis put forward in Part 1 is a plausible statement.The control and experimental groups, which initially had been practically identical, came to belong to different universal sets by the end of the experiment.Moreover, students in the  experimental group demonstrated much better achievements.Thus, IPBL improves the cognitive level of IT students, who are involved in designing interdisciplinary projects.

Part 2: findings
Testing homogeneity of the control and experimental groups of 'expert' students with regard to their cognitive level in analytical chemistry showed that in the control group 53% of the students had the basic level, 40% had the middle level and 7% had the upper level of cognition.In the experimental group 52% of the students had the basic level; 39% the middle level; and 9% the upper level of cognitive learning.These test results suggest that the control and experimental groups of 'expert' students can be considered homogeneous.
In the ascertaining stage a null statistical hypothesis H 0 (4) stated that the distribution of 'expert' students' test results in analytical chemistry in both control and experimental groups obeys the normal distribution law.For the significance level a 00.05, n 0103, and degree of freedom v 05, Pearson x 2 test was calculated x 2 cal 04.38.Its corresponding table value was x 2 tab 011.1.As x 2 cal Bx 2 tab (4.38B11.1), the null statistical hypothesis H 0 (4) can be accepted as a plausible statement.The null statistical hypothesis H 0 (5) about homogeneity of the control and experimental student groups was tested in the conclusive stage (upon the completion of the analytical chemistry course) by calculating Student's t-test and was accepted to be true: t cal 00.32, or lower than t crit 02.1 (t crit !t cal ).This allows us to accept the null statistical hypothesis H 0 (5) , whereby the control and experimental groups are homogeneous in terms of cognitive levels in analytical chemistry after the completion of the module.Six months later a null statistical hypothesis H 0 (6) was put forward, whereby the experimental and control groups are homogeneous and belong to one universal set.
Re-testing 'expert' students on analytical chemistry 6 months after the completion of the course showed the following.For the control 'expert' group (k 07; v04; x 2 crit 09.5) x 2 cal 044.25.For the experimental group (k 06; v03; x 2 crit.07.8) x 2 cal 019.62.For both groups x 2 cal was always higher than the table values, which allows us to reject the hypothesis H 0 (6) in favour of the alternative hypothesis H 1 (6) , whereby the control and experimental groups are not homogeneous and belong to different universal sets in terms of levels of cognition in analytical chemistry.The test results allowed us to identify the proportion of 'expert' students with the relevant cognitive level in analytical chemistry.Table 5 summarises the results of comparative analysis of the cognitive level in analytical chemistry for the control and experimental groups of 'expert' students before and after the use of traditional learning and the CALS.
The majority of 'expert' students in the control and experimental groups attained the basic cognitive level and above, while at the beginning of the experiment this proportion was below 50%.Moreover, the students' achievements in the experimental group were much better.The cumulative proportion of 'expert' students in the experimental group, who achieved the basic, middle and upper cognitive levels in analytical chemistry after the use of the CALS, is 90%, which is 1.4 times higher than the results for the control group (65%).This allows us to suggest that Part 2 of the main hypothesis is a plausible statement.It should be noted that in the course of training with CALS 'expert' students used enhanced IT skills to be operationally effective in the specialist subject area.Thus, the undertaken study showed the effectiveness of the IPBL approach that was developed and implemented in the learning process in USUE.

Conclusion
Interdisciplinary integration is one of the general trends in the development of tertiary educational systems worldwide.It meets the demands of the competence approach in teaching and learning and contributes to a higher level of professionalism in graduates.An effective form of interdisciplinary integration is interdisciplinary project-based learning, directly implementing the principles of practice (or context)-based learning.One of the IPBL approaches was developed in the Ural State University of Economics (Russia).It was tested on the groups of students enrolled in the bachelor-degree programs Mathematical Software and Information Systems Administration (IT students) and Commodities Management and Expertise ('expert' students).IPBL is used as part of IT students' research and final qualification work.Computer programs for the CALS in analytical chemistry designed by IT students are used for training 'expert' students.
While working on designing interdisciplinary projects, IT students were able to use core knowledge and skills in the area of specialisation.At the same time they learned how to apply professional competencies to other subject areas, analytical chemistry in particular.Statistical analysis of the pedagogical experiment findings has resulted in some quantitative data which show that the use of IPBL has a positive impact on student cognition; namely, the cognitive level in the experimental group of IT students has exceeded the cognitive level in the control group by 2.3 times.For the group of 'expert' students this increase has been 1.4 times.IPBL promotes the development of a range of both intellectual and practical skills in graduates.Our experiment has demonstrated a positive influence of IPBL on the learning effectiveness in IT students.The projects developed by IT students offered the 'expert' students additional ways of learning the disciplines.IPBL, discussed in the article, can be recommended for use in universities and colleges that have IT programs and promoted using IT projects as part of an educational process in various academic departments.

Table 1 .
The results of assessing homogeneity of control and experimental IT groups.
Note: M c and m c Á an average exam mark and its error component of the mean in the control group; M e and m e Á an average exam mark and its error component of the mean in the experimental group; n and p Á number of students in the control and the experimental group; v-degrees of freedom (v0n'p(2); T tab Á table value of Student's t-test: T cal Á calculated value of Student's t-test T cal ¼ ðM c ÀM e Þ ffiffiffiffiffiffiffiffiffiffi Citation: Research in Learning Technology 2015, 23: 27577 -http://dx.doi.org/10.3402/rlt.v23.27577favour of the alternative hypothesis H 1

Table 2 .
The results of re-testing IT students on core modules.

Table 3 .
Distribution of control and experimental IT students by cognitive levels in core modules.

Table 4 .
Cumulative percentage of IT students with the middle and upper cognitive levels in core modules.

Table 5 .
Comparative analysis of cognitive levels in analytical chemistry in control and experimental 'expert' groups.