Is it cheating or learning the craft of writing ? Using Turnitin to help students avoid plagiarism

Plagiarism is a growing problem for universities, many of which are turning to software detection for help in detecting and dealing with it. This paper explores issues around plagiarism and reports on a study of the use of Turnitin in a new university. The purpose of the study was to inform the senior management team about the plagiarism policy and the use of Turnitin. The study found that staff and students largely understood the university’s policy and Turnitin’s place within it, and were very supportive of the use of Turnitin in originality checking. Students who had not used Turnitin were generally keen to do so. The recommendation to the senior management team, which was implemented, was that the use of Turnitin for originality checking should be made compulsory where possible at the time of the study the use of Turnitin was at the discretion of programme directors. A further aim of the study was to contribute to the sector’s body of knowledge. Prevention of plagiarism through education is a theme identified by Badge and Scott (2009) who conclude an area lacking in research is ‘‘investigation of the impact of these tools on staff teaching practices’’. Although a number of recent studies have considered educational use of Turnitin they focus on individual programmes or subject areas rather than institutions as a whole and the relationship with policy.


Introduction
Canterbury Christ Church University is a new university, originally established in 1962 as a teacher training college.It is the largest provider of programmes for the public services (notably education, health and social care and policing) in Kent and has around 18,000 students, many of them part-time and mature students, across five campuses.A total of 1,500 students are from overseas, around a third of these from outside the EU.
The aim of the study was to develop the University's policy and practice through establishing staff and student understanding of the plagiarism policy and how Turnitin relates to it, strategies for using Turnitin and the role of Turnitin in education to avoid plagiarism.
A further aim was to contribute to the sector's body of knowledge.In 2009 Badge and Scott concluded that in relation to plagiarism detection an area lacking in research is ''investigation of the impact of these tools on staff teaching practices''.Although a number of recent studies have considered the educational use of Turnitin (Davis and Carroll 2009;Flynn 2010;McCarthy and Rogerson 2009;Wiggins 2010), they focus on individual programmes or subject areas rather than institutions as a whole and the relationship with policy.Our understanding was that at the time this study was undertaken (2010/11), this was the first institution-wide study of the use of Turnitin.

Review of literature
The problem of plagiarism Plagiarism is a growing problem for universities.A Daily Telegraph headline (Barrett 2011) highlighted ''the cheating epidemic at Britain's universities'' with ''thousands of students caught plagiarising, trying to bribe lecturers and buying essays from the Internet.''Higher education institutions (HEIs) have met concerns over the increasing problem of plagiarism with a range of measures, particularly electronic detection systems.The UK national licence for Turnitin was only introduced in 2002/ 3 but by 2009 the software was used by over 95% of HEIs [Barrie 2008 cited in Badge and Scott (2009)] and is now used worldwide by over 10,000 institutions in 126 countries (iParadigms 2012).SafeAssign, launched by Blackboard in 2007, processed one million papers in its first year (Blackboard 2008).None of the systems available actually detect plagiarism, they merely detect and flag up non-original text (text that matches to another source), which may well be legitimate, e.g.correctly cited direct quotations.
Detecting non-original text is one issue but defining plagiarism is another.As de Jager and Brown (2010) point out, plagiarism is complex and can involve a number of different behaviours, ranging from deliberate dishonesty or negligence to ignorance of what plagiarism is or an inability to deal with it.In the West, plagiarism is usually defined as taking someone else's work and passing it off as your own: in an academic context plagiarism is regarded as dishonesty or cheating, and penalties can be severe.Definitions of plagiarism have varied over time and differ between cultures.Historically painters and others were encouraged to copy the works of the masters Á it was even thought presumptuous for writers to invent their own plots Á and in some cultures it is still seen as a mark of respect to incorporate someone else's work into your own (Hayes and Introna 2005, p. 215).
On the question of detection, Woessner (2004) says that unless the penalties and consequences of plagiarism are made clear to students, detecting plagiarism will offer no deterrent but there is a growing view that not all incidences of plagiarism are the same, and treating them all as academic misconduct may not be appropriate as some students struggle to acquire the skills of academic writing.English as a foreign language and science students often use the ''mosaic technique'' (Ashworth, Bannister, and Thorne 1997, p. 201) or ''patchwriting'' (Howard 1999) (weaving together a paper from different sources, properly referenced, but where the writer's input is merely to thread the material together) to learn the academic writing style of their discipline through imitation (Eckel 2010).This may not be deliberately deceptive (Howard 1999;Pecorari 2003) and may be regarded as acceptable by students who can be confused by what teachers actually mean by plagiarism (Ashworth, Bannister, and Thorne 1997).
Plagiarism has become more of an issue in recent years (Larkham and Manns 2002, and others), partly through the increase in university student numbers, often without a corresponding increase in resources, but mainly through the growth of the Internet with the easy availability of essays for purchase and other ways in which students can ''cheat''.''. . .after Google's launch in 1998 the Internet became a public elixir of information of increasingly dubious origin, seemingly meeting steadily rising student demand'' (Mainka, Raeburn, and Earl 2006, p. 13).The availability of information on the Internet also makes it more difficult for academics to identify plagiarism, which was easier when students tended to access just a few significant texts that were well known to staff.

Dealing with plagiarism
There is no common view of how plagiarism should be handled and as McGowan (2005) points out ''One of the consequences of stating or implying that ''all'' plagiarism is ''unacceptable'' is that the default situation is necessarily a disciplinary rather than an educational one'' (p.3).Procedures and penalties related to plagiarism vary significantly across UK HEIs Á Carroll (2007) makes the point that not all institutions have policies and strategies in place to deal with it.In their survey, Tennant, Rowell, and Duggan (2007) found a large minority of HEIs using policies that give only limited guidance regarding penalties to be applied but if individual teachers can interpret the policy and respond in different ways ''it puts students in a perilous situation, and undermines the efforts of the university community to create a culture of honesty, featuring a set of shared values and shared standards for judging transgressions against those values'' (Pecorari and Shaw 2010).

Originality checking and detecting plagiarism
Ninety-three of the 100 HEIs that responded to a survey in 2007 (Tennant, Rowell, and Duggan 2007), reported 9,229 cases of plagiarism, equivalent to 7.2 cases per 1,000 students, with wide variation between institutions, from 3.1 to 13.7 cases per 1,000 students.Larger institutions reported proportionally more cases of plagiarism and stricter penalties.
It is difficult to make comparisons over time as few institutions have baseline data on plagiarism detection (Badge and Scott 2009).Culwin (2006aCulwin ( , 2006b) ) and other studies) has undertaken a number of studies considering the use of plagiarism detection tools in his own university.He found that the average percentage of nonoriginality detected in first year work over four years had increased from 17.2 to 28%.This, he thought, was due to the improvement in plagiarism detection software and the availability of online materials for students to use.He also found a correlation between the amount of non-originality and the likelihood of non-completion of the first year.
for example by ''designing out'' plagiarism.At the time of the study, the use of Turnitin for originality checking was not compulsory and was undertaken in around 40 programmes in 17 of the 23 teaching departments across all five faculties, involving around 5,000 students.There was planned use for around 1,500 more students in at least a further 10 programmes, including a further three teaching departments.Turnitin submission statistics show a total of 26,271 originality reports produced with the majority Á 19,563 Á in the 12 months up to January 2011.
University procedures at the time of the study stated that where Turnitin was used it must be applied to all students taking an assignment, not to individual or small groups of students, students must be advised of its use in advance (no retrospective application) and students must have a formative experience of Turnitin before it is used summatively.Apart from this, how Turnitin was applied was at the discretion of programme leaders, e.g.whether students had access to their originality reports and the number of draft assignments they were permitted to submit.
Staff in programmes or departments using Turnitin were offered training by their Faculty Learning Technologist with online support available.Students received guidance from their tutors at the beginning of their programmes or when the first assignment was due, often both, with online support.Programme handbooks were included with information on the use of Turnitin (where applicable) and the plagiarism policy.

Methodology
The research was a case study of one university, with data collected via surveys and follow up interviews.All students and teaching staff were invited to take part in online surveys (using the Bristol Online Survey service) on their understanding, perceptions and experiences of Turnitin, plagiarism and University policy.Where possible the staff and student surveys had identical questions, to facilitate comparison.Three hundred and sixty-seven students and 62 staff responded, of whom 166 (45%) and 39 (63%) had used Turnitin for originality checking, respectively.A follow-up e-mail ''interview'' (using an extended questionnaire) was undertaken with 34 students who volunteered to take part, 21 of whom (62%) had used Turnitin.Face-to-face, semi-structured interviews were held with 26 staff, of whom 15 were teaching staff and the others in various related academic and professional service roles.Qualitative analysis of the free text responses and interviews was undertaken, supported by quotations from the participants.The research was conducted within the University's ethical guidelines.Interviewees gave their written consent.Those who participated in the online survey and emails were fully informed about the project and taken to have given their consent by virtue of taking part.The students who participated in the study were spread across all faculties and all levels of study with the highest number (34.3%) at Level 4/first year undergraduates.

Findings
The following findings are from the online survey of staff and students and the email survey of some of the students, which explored the same issues in the online survey but in greater depth.This is a similar finding to the study by Rolfe (2011) where all the students who responded to a survey (n052) had positive experiences of using Turnitin.In Ireland, Ledwith and Rasquez (2008) found that students thought their academic environment was fairer since the introduction of Turnitin: in this study a few students who were not using Turnitin thought it could be useful in terms of fairness:

Knowledge and understanding of Turnitin and plagiarism
If people are not willing to use it then they must be worried about plagiarism.I am not worried about this as I try my hardest to reference my work correctly.
Means the work we do is our work and will stop people cheating and gaining marks they don't deserve.
Cheating is wrong and the university should go to whatever lengths deemed necessary/ economically viable in order to oust offenders.Plagiarism is allowing those who work hard to get levelled by people who put in little or no effort at all! Anything that promotes fair education and qualifications, I'm up for it!
Other comments revealed a lack of understanding, even fear, about how Turnitin might be used: I am not sure whether it would be something to trust . . .I was told that it is used to detect plagiarism, not to avoid it, therefore I am afraid of how it works, how accurate it is, how difficult it will be to use.I would be happy to but I would be worried that I might be accused of plagiarism even though I did not plagiarise.
Student concern about inadvertent plagiarism was also found by Dahl (2007).
Staff and students who had used Turnitin were asked how it had been used: Staff were asked why they had used Turnitin with their students, and students were asked why they thought they had been required to use Turnitin: The other reasons given for using Turnitin were all around electronic submission of work, apart from one student who commented: To make your life difficult It is not possible to make direct comparisons across programmes or subjects but it is clear from the above that staff and student views about why Turnitin has been used are roughly in-line.

Yes No
Staff were asked whether they had any direct experience of Turnitin leading to an alleged case of plagiarism 20 52.6% 18 47.4% Staff were asked what effect they thought Turnitin had had on plagiarism in the University (up to three responses allowed) To date, the University has not formally recorded the involvement of Turnitin in alleged cases of plagiarism but around half of the teaching staff involved in the research who had used Turnitin had direct experience of it leading to an alleged case of plagiarism.Teaching staff commented that Turnitin helps cut down on the work involved in detection (e.g.Googling) and provides documentary evidence for panels.
It is seen as particularly useful in detecting collusion between students, although it cannot apportion blame, which can be frustrating.It was suggested that Turnitin is very helpful in alleged cases of plagiarism because it provides some ''evidence'' which is a basis for discussion with the student . . . it has been useful in identifying substantial plagiarism in a piece of work.The student is denying they plagiarised so this provides clear evidence and a basis for the initial discussion with the student.
Helped to spot all the minor plagiarism in a report with large chunks of copied material.Better evidence.It's unlikely that the case would have been brought to my attention without Turnitin.
Understanding the policy and rationale for using Turnitin The online survey shows that most students who have used Turnitin understand what it technically does and what the University's approach to using it is.Most were aware that the University's approach combines education with detection and punishment but they thought it was more about detection (79%) and deterrence (54%) than education to avoid plagiarism (45%) and helping improve academic skills (33%).Around two-thirds of students interviewed describe the University's approach to plagiarism as being mainly about standards, definitions and rigour.They referred to

Research in Learning Technology
Citation: Research in Learning Technology 2013; 21: 17218 -http://dx.doi.org/10.3402/rlt.v21i0.17218 the University working to raise students' awareness and warning them about plagiarism more than actively helping them to avoid it.Other studies (Abasi and Graves 2008;Devlin 2006) have found that university policies on plagiarism contain little if any reference to an educative approach or to helping students improve their academic writing.
My understanding is that the University take a very strong stance when plagiarism is concerned, this can lead to movement through the disciplinary hierarchy, removal of work from submission and of the student from the programme.I think it is really good that they take it very seriously; some of the talks we had are a bit scary, but students need that so that they don't just ''copy and paste'' articles and quotes.
Around a third described the approach as more educative.
It teaches me how to avoid it.It encourages me to read more and support my ideas with empirical evidence.
Staff tended to see the education message as stronger than that of detect and punish, whereas students saw the detect/punish message as the stronger one.Most staff interviewees (69%) understood the University's increasingly educational approach to dealing with plagiarism and were supportive of this although a small number were not, feeling that the new approach is too lenient and allowing students who may have plagiarised resubmissions without penalty to be unfair to other students.
What's the point of detecting it when students who are found to have plagiarised still remain on the course?Differing views from academics were also found by Crisp (2007), with some academics regarding plagiarism as an education and training issue and others seeing it related to ''honesty and reputation'' (p.3).
The student survey shows a third of students who use Turnitin were able to see their originality report for final submissions but is unclear on their on-going ability to submit drafts.Over half (62%) of students interviewed who use Turnitin reported on-going educational use, e.g.being able to submit draft assignments, representing almost half of the programmes covered.Almost half the students interviewed were able to view the originality report for their final submissions and almost a quarter were able to submit a draft for every assignment.At the time of the study, there was consideration/planning on several programmes for allowing draft submissions beyond the initial formative experience.

Training and support
From the online survey, most students who had used Turnitin (134) said their help and support had come from tutors, although there was also support from online tutorials and other students.Only half of the students surveyed who use Turnitin (84/166) said they had received help and advice about plagiarism, perhaps suggesting that some students do not fully understand what the Turnitin reports are showing them.Support for staff had come mainly from Faculty Learning Technologists and online tutorials.Tutors said they had given students advice about what plagiarism is (31), helped with referencing (35) and provided other help to improve academic writing (35).
There was clear evidence from the academic staff interviews that those who use Turnitin want to ensure that students have full information about using Turnitin and avoid plagiarism through handbooks, lectures and seminars and discussion.There was a general feeling amongst staff that students received plenty of support, although they would always say that they needed more.It was clear that although a wide range of learning support is offered, not all students engage with this unless it is a compulsory part of their course.Rolfe (2011) suggests that both students and staff need more help in interpreting originality reports, so that they can use Turnitin in a ''self-service'' way and improve a wider range of academic skills.

Staff views
The academic staff interviewees who were using Turnitin in their programmes viewed the education of students about plagiarism and the use of Turnitin as very important, introducing it early in programmes as an important element of study skills.A few lecturers saw Turnitin as a tool that works in isolation, not something that they could use within and to support their teaching.
There was a feeling amongst staff that some international students, where quoting from an expert is seen as a mark of respect and an appropriate thing to do, have difficulty understanding the concept of plagiarism.Writing in Australia McCarthy and Rogerson (2009) also found that other nationalities can have a different perspective regarding the sharing of work, a view supported by Hayes and Introna (2005): many overseas students, on arriving at UK universities, are more familiar with a ''textbook based'' teaching approach than one that requires them to consult a number of sources.In Asian, Chinese, and Greek universities, lectures often systematically cover the material in the textbook, and the exam requires students to demonstrate that they can recall all relevant material from one textbook and their lecture notes*often verbatim.Often there is minimal or no interpretation or commentary expected from the student.(p. 225) Others thought this might just be an excuse, and several staff commented in the interviews that the only cases of plagiarism they had dealt with were from Home students.Of the nine EU/International students interviewed, six perceived Turnitin to be advantageous, both for helping them to avoid plagiarism and for catching ''cheats''.None voiced any perceived disadvantages.
I cannot say there is the importance in this case whether we are from EU or from UK, because it helps everyone.However, it was something new for me and I can see it an advantage, because in my country there is no such programme for plagiarism . . .
In the interviews, a small number of staff felt that some students deliberately referred to more obscure journals or conference papers that are not part of the Turnitin database to avoid detection Sometimes I fear that it may encourage a ''cleverer'' type of plagiarism for those students who want to cheat and realise that all they need to do is find more obscure textbooks that are not online.
Staff valued Turnitin in enabling them to detect plagiarism more quickly but a small number commented on the amount of effort needed to set up Turnitin and to

Research in Learning Technology
Citation: Research in Learning Technology 2013; 21: 17218 -http://dx.doi.org/10.3402/rlt.v21i0.17218monitor/read originality reports as being a waste of time.Software detection tools appear to provide an objective measure of plagiarism but in practice they offer evidence that must be subject to academic interpretation and judgement, so the way they are implemented plays a key role in their effectiveness (Badge and Scott 2009).A number of studies have shown that academics have welcomed the time saved by using electronic detection to investigate individual plagiarism cases but as the most widely used tools only display matching text, there has been an increase in the time they need to spend checking plagiarism reports in order to apply academic judgement (Mulcahy and Goodacre 2004;Sutherland-Smith and Carr 2005) or to help students with writing skills (Maloney and O'Kane 2007) as well as needing training in order to be able to interpret the reports.
It is very useful in confirming suspicions or the reverse, although of course it can't show whether the ''plagiarism'' was intentional or not, that can be followed up by the lecturer.Turnitin is an obvious time-saver for markers and discourages plagiarism simply by being there.Some staff who were interviewed commented on the need for greater consistency in the use of Turnitin across the University.This includes whether Turnitin is used or not as well as how it is used, e.g.allowing drafts, seeing originality reports for final submissions.Most agreed with the increasingly formative approach.

The role of Turnitin in reducing plagiarism
It is not possible to measure the direct impact of Turnitin in avoiding plagiarism.Although there is an increased number of reported cases of plagiarism across the University, this could be due to a number of reasons, including increasing student numbers, greater efforts to detect plagiarism or more weaknesses in students' writing skills.
Over half of students interviewed who use Turnitin say it has helped them avoid plagiarism with just under half reporting that it has helped improve their referencing and just over a quarter that it has improved their writing generally.All of the students who regard themselves as less confident about avoiding plagiarism reported that Turnitin helped them, compared with two-fifths of the students who regard themselves as more confident.Perhaps surprisingly, there was no correlation between the on-going formative use of Turnitin and students reporting that it had helped them to avoid plagiarism.Students on programmes that only have an initial formative experience were as likely to report that Turnitin had helped them avoid plagiarism as those on programmes which provide on-going opportunities to submit drafts or access to originality reports.Various studies, including Ledwith and Rasquez (2008) and Barrett and Malcolm (2006) have shown that there is a dramatic drop in the amount of non-originality detected in second drafts, although the fact that these studies have generally been conducted only with a single module or class led Badge and Scott (2009) to question issues around longer term effectiveness.
A quarter of students surveyed who use Turnitin, and who commented on the survey, referred to the value of Turnitin in helping them to avoid plagiarism It was helpful to see if there were any issues with my work that I needed to rephrase, reference or delete. . . .at first it made me panic but now I understand that it is a great tool to improve your academic writing.
Over half of the staff surveyed who use Turnitin thought it had directly contributed to reduced plagiarism, improved referencing and better writing.One lecturer asks all new undergraduate students to bring in a marked A level essay from their recent school days and runs them through Turnitin Á students are said to be shocked at the amount of non-original material in their work.

Conclusion
The results of the study suggest that Turnitin is seen as a useful tool by students and may help up to half of students to avoid plagiarising, particularly the less confident students.
There was a general understanding of the University's reasons for using Turnitin and staff as a basis for helping students to avoid plagiarism valued it.The originality reports were seen to be very useful in discussions with students, particularly those having problems understanding plagiarism and academic writing requirements.Although the research was set up to assess the extent of the formative use of Turnitin, not its impact, it was clear, particularly from the interviews with academic staff, that Turnitin is a valuable tool in teaching students to understand, and avoid, plagiarism.
Perhaps the most surprising finding was that there was no correlation between the on-going formative use of Turnitin and students reporting that it had helped them to avoid plagiarism.Students on programmes that only have an initial formative experience were as likely to report that Turnitin had helped them avoid plagiarism as those on programmes which provide on-going opportunities to submit drafts or access to originality reports.This perhaps suggests that with initial training and support, followed by the opportunity to submit an assignment through Turnitin and receive formative feedback, students feel confident that they understand how to write their assignments with accurate referencing.As the study did not set out to look at the difference in impact between initial and on-going formative use of Turnitin, further research is needed.
There was a strong feeling from students involved in the study that they would like Turnitin to be available more widely, and this is in accord with the University's policy of equity for students.The report of this study for the Senior Management Team recommended that the use of Turnitin should be rolled out across the University, accompanied by more information and training for both students and staff.This was accepted, and from September 2011 the use of Turnitin for originality checking was made compulsory for all assignments for which it is suitable.
detection by tutors of possible plagiarism 24 Decreased overall amount of plagiarism 15 Increase in actual numbers of plagiarism cases brought 9 No effect on overall amount of plagiarism 6 Decrease in actual numbers of plagiarism cases brought 4 No effect in actual numbers of plagiarism cases brought 4 No effect on detection by tutors of possible plagiarism 2 Increased overall amount of plagiarism 0 Decreased detection by tutors of possible plagiarism 0