Tag Archives: Turnitin

Turnitin2 Webinar

originality_sm-2010-10-12-20-58.pnggrademark_sm-2010-10-12-20-58.pngpeermark_sm-2010-10-12-20-58.png

On Tuesday, October 12th Instructional Support presented a webinar for COCE instructors on the new features of Turnitin2. Thank you to COCE Faculty Development for scheduling this with us and thank you to all who attended!

For those of you who could not make it or were unaware, you can view the recording of the session. Turnitin2 now includes a slightly revised plagiarism prevention tool called OriginalityCheck and bundles two products previously sold separately. These are GradeMark and PeerMark. GradeMark significantly enhances your grading options and PeerMark is a robust tool for peer review assignments.

If you have questions after reviewing the recorded webinar or would like to schedule training for yourself or your department, please contact one of the Instructional Support staff.

 

Turnitin updates – coming September 4th!

Turnitin2 logo

On September 4th, 2010 Turnitin will receive a major upgrade which looks to be very promising. If you use Turnitin, I STRONGLY recommend that you review this information.

SNHU has been using Turnitin for several years and its utilization continues to grow but we have only ever used the plagiarism checker. On September 4th, iParadigms is launching their new product Turnitin2 which bundles the Turnitin OriginalityCheck (with which you are familiar) with its peer review and grading tools called PeerMark and GradeMark respectively.

This is an exciting upgrade because it automatically adds PeerMark and GradeMark to our license and enhances the usability of Turnitin. This opens up new avenues for us with regards to peer review assignments and grading of papers. In addition, as an instructor you can review the originality report, peer reviews, and grading comments all in one place. You will also now have the ability to add comments to an originality report that the student will see.

Before the change occurs I recommend that you review the new product overview. This is a detailed overview and walk-through video so rather than repeating things in this post, I encourage you to check it out.

Once Turnitin2 is live on September 4th and we (Instructional Support, that is) have had a couple days to test it, we will be available to provide training. I plan to use it for all of my Term One assignments so hope to have some good feedback.

If you have any questions about Turnitin or this upgrade, please feel free to contact me or post a comment here.

~ Aaron

 

It’s not plagiarism, its “mixing”!

This weekend I was looking through my “Stuff to Read” folder. This is the folder into which I dump all the interesting articles, blog posts, and papers that I come across and don’t have time to read. When I have time I go through the folder. It has been a couple months since I last reviewed this folder and in it I found a couple interesting pieces on plagiarism that I wanted to share. This may be old news to some.

The first is an article that ran in the February 11th New York Times titled “Author, 17, Says It’s ‘Mixing,’ Not Plagiarism”. The title caught my eye because I can hear a teenager saying this to justify unethical behavior. While I am not tolerant of plagiarism and find myself frustrated with students who don’t “get” why it is wrong, I understand that it is my job and the job of every other instructor to teach them why it is wrong then teach and reinforce the proper behaviors and punish the bad behaviors. What struck me about this article was not that the author, Helene Hegemann plagiarized, lots of people do it and she isn’t the first to get caught doing so, but the fact that she was essentially being rewarded for it. Even after the plagiarism was uncovered and made public, her plagiarized work was still nominated as a finalist in the fiction category of the Leipzig Book Fair and became a best seller. Thankfully she didn’t win if I’m reading this page correctly. Even though she didn’t win, what kind of message does this send? That it’s OK to plagiarize? That it’s no big deal? I hope not. I hope that Hegemann’s views on plagiarism are not typical of her generation and/or her culture but that she is an outlier.

In a world where information is accessible from so many sources and it only takes two mouse clicks to plagiarize, how do we get our students to understand that plagiarism is wrong? My experience is that many students just don’t know how to appropriately cite references and therefore plagiarize out of ignorance. These students can be taught how to do things correctly. It is the students that knowingly plagiarize because they are lazy, think they can get a better grade, or waited until the last minute that I worry about. How can we teach them to do things correctly? Do they already know? If we can’t teach them not to plagiarize, how can we prevent them from doing so?

One way is to use Turnitin. Sometimes just telling students that you use Turnitin is enough prevention. If not, the Originality Report is a useful tool. While Turnitin doesn’t tell an instructor if something has been plagiarized, it does clearly mark out textual matches to other sources. If there is a match there should be a reference and if there is not a reference then it is likely plagiarism. Once the matches are identified it is much easier for the instructor to determine if the student is plagiarizing and take action. Sometimes action means educating the student, sometimes punishing. SNHU has been using Turnitin since 2002 and has had it integrated into Blackboard since 2006. In the eight years that we have used Turnitin, approximately 53,800 papers have been submitted for review. Since we have such a long history I was curious to see what our Turnitin statistics looked like. I ran reports for each of the past four years (since the Bb integration for fair comparison) and this is I found. The Y-axis represents the Originality Report score. The higher the score, the higher the likelihood of plagiarism. Remember, the Originality Report still reports on properly referenced text so it is up to the instructor to make the final determination. Most papers submitted fall between 0 and 24% match on the originality reports. This means that between 0 and 24% of the paper matches other sources. Since the generally accepted rule is that around 10% of a paper can be cited material this is the category I would expect most paper submissions to fall into. I would like more granularity in this category but alas, this is the way it is reported. Smaller numbers of papers fall into the higher categories which is what we’d like to see as the higher categories indicate higher likelihood of plagiarism. The data shows that the counts have remained relatively static over the past four years. While the number of papers that score in the 75-100% match category (indicating blatant plagiarism) have dropped by a percent, the 50-74% and 25-49% categories have remained constant or gone up slightly. Are we making progress against plagiarism? I’m not sure but we don’t appear to be losing ground. I’d be curious to hear how others interpret this data. While Turnitin is a good deterrent and identifier of plagiarism, we can also create assignments that are more likely to discourage it.

Screenshot2010-05-10at3.06.40PM.png

We can discourage plagiarism by giving assignments that aren’t as easy to plagiarize. Term papers or other “traditional” papers are easy to plagiarize. Why not give “alternative” assignments? The Tomorrow’s Professor Blog posted some interesting examples in the post Plagiarism and Assignments That Discourage It. Maybe some of these ideas may help.

I would like to hear your thoughts on plagiarism, the Turnitin stats, and even assignment ideas. Please leave a comment.

If you would like more information on Turnitin please contact me (a.flint@snhu.edu) and take a look at our Turnitin Training Resources.

 

Turnitin – students not appearing correctly

A problem has been identified with Turnitin assignments created in Blackboard.  Some faculty have found that the roster of students in their Turnitin assignments is incorrect and that it is not corrected by doing a roster sync.  Some students enrolled in the class do not appear in Turnitin and some students not enrolled in the class do appear.

Instructional Support has been working with Turnitin over the past week or so and after extensive work we have been able to identify the cause of the problem.  Without going into a lot of detail here is an explanation of the problem…  The Blackboard database uses a numerical identification code to identify each student.  In turn, Turnitin uses this code to identify students in the Turnitin assignments database.  It appears that some of the ID codes in Blackboard have changed or been reassigned from old students to new ones.  This likely occurred automatically during the Blackbaord maintenance performed on December 28th.  As a result, when Turnitin sees an ID number, there is a mismatch and the wrong student appears in the Turnitin assignment.  While the problem is ultimately with the way that Blackboard assigns the identifiers, we are working closely with Turnitin to see if they can make modifications to their program to pull from another data field that is more consistent and does not change.  We do not have a timeframe on resolution at this time.

The number of students and therefore Turnitin assignments affected is relatively small.  If you encounter a problem with your course roster, please send info to Aaron Flint at a.flint@snhu.edu.  Until a fix is in place, instructors can manually submit assignments for affected students to Turnitin.

As updates are received they will be posted on this blog.  If you have questions, please email Aaron Flint or post a comment below.

Blogged with the Flock Browser
 

Turnitin enhancements coming (January 2nd)

On Saturday, January 2nd 2010 Turnitin will be unavailable from 6am to 2pm eastern time while the software is upgraded.  This upgrade is being conducted by Turnitin and affects all of their customers, not just SNHU.  On Monday, January 4th Instructional Support will upgrade the Blackboard Building Block so that all new features are available through Blackboard.

The upgrade will bring with it some enhancements to the instructor and student dashboards with which users will need to become familiar.  You can read about the enhancements by clicking here.  Please note that SNHU only subscribes to Turnitin.  We do not currently have the Peermark/Peer Review/Write Cycle products so please disregard those feature announcements.

Instructional Support will provide training if needed after the upgrade.

 

Turnitin – issues, news, and training

You are likely familiar with Turnitin, the plagiarism detection and prevention tool that has been used at SNHU for the past six years or so. It is widely used by instructors to identify plagiarism but also to educate students on appropriate writing and citation. If you are not familiar with Turnitin, check out the Turnitin website or Instructional Support’s User Guide.

Between September 1, 2008 and April 21, 2009 546 instructors have used Turnitin to review 10,640 papers submitted by 4755 students. That’s a significant amount of usage! You can view more usage stats here.

The reason that I am writing about Turnitin today is threefold. First, as the Turnitin administrator for SNHU I have received a few questions in recent weeks that have bubbled up from a disgruntled instructor and a couple of unhappy students. These individuals, who I did not speak with directly or know by name, are unhappy with SNHU’s use of Turnitin. It appears to me that their complaints stem from a lack of understanding about what Turnitin actually does and how it is used at SNHU. I hope to clarify a few points.

Second, a federal appeals court recently affirmed that Turnitin does not violate the copyright of students (one of the complaints from topic #1).

Third, I want to make you aware of several training opportunities for Turnitin.

So here we go…

Topic #1: How is Turnitin used at SNHU?

Complaints about Turnitin are few and far between at SNHU but it seems that every couple of years we get one or two complaints about the use of this tool.

When an instructor has students submit their papers to Turnitin these papers are kept in a database so that they may be used for future comparisons. This is useful in preventing students from swapping/selling/reusing papers in violation of the academic honesty policy. Some individuals have a philosophical problem with this. They feel that Turnitin is profiting from students’ work and that is not appropriate. In one way Turnitin IS profiting from student work. The more papers cataloged in the database, the more comprehensive the plagiarism detection is. The more comprehensive the detection is, the more Turnitin is worth. While Turnitin may benefit financially, they are not doing so at the expense of the students. Turnitin is not using student work in any way that violates their copyright or prevents students from using their own work. Instructors that have a philosophical objection to Turnitin do not have to use the tool. The use of Turnitin is not required – it is a tool made available by SNHU to use at the instructor’s discretion.

If instructors do want to use Turnitin, I recommend making this known in the syllabus. I usually add the following two paragraphs to my Academic Honesty section. You will notice that the second paragraph provides an opt-out for students objecting to Turnitin. Just as instructors are not required to use Turnitin, we can’t mandate that students use it. For those that object, the alternate assignment is provided. In my six years using Turnitin I have not had a single student opt out and do the alternate assignment.


Turnitin.com will be used to review all papers submitted in this course.

Students agree that by taking this course all required papers are subject to submission for textual similarity review to Turnitin.com for the detection of plagiarism.  All submitted papers will be included as source documents in the Turnitin.com reference database solely for the purpose of detecting plagiarism of such papers.  Use of the Turnitin.com service is subject to the terms of use agreement posted on the Turnitin.com site.

Any student objecting to their work being submitted to Turnitin.com and being retained in the reference database must notify the instructor of their objections at least two weeks prior to the assignment due date. In lieu of submission to Turnitin.com for review the student must submit the following material along with the regular assignment, 1) a draft bibliography 1 week prior to submission of the assigned paper; and 2) the cover page and first cited page of each reference source with the final paper. These may be faxed or scanned and submitted via Blackboard. 3) for web-based resources: students must submit the URL and retrieval date of each page.

Turnitin has a fairly comprehensive usage policy and privacy pledge as well as a very detailed Student User Agreement that students accept prior to using Turnitin for the first time. All of this looks fairly straight-forward and not much different than other user agreements that we blindly accept every day. My conversations with Turnitin indicate that they value the privacy of student data and they only catalog papers in their database for the detection of plagiarism. I will note that a section of the Student User Agreement titled “License to Use Communications and Papers Submitted” stood out to me. This section seems a bit “strong” in its language but conversations with Turnitin staff have allayed my concerns. I have been told that Turnitin does not take any intellectual property rights from the student. While the papers are put into a database, the only two individuals that can access that paper are the student and the instructor of the class for which it was submitted. In no way does Turnitin claim any property rights to the paper content. I tend to believe that it is typical legal wording to cover all bases and is not intended to be detrimental to student’s rights.

I believe that Turnitin is a valuable tool and I will continue to use it in my classes. It provides excellent detection of plagiarism and is a great learning tool for students who can review their originality report to see where citations are needed. Turnitin also out-performs its nearest competitor in my side-by-side comparisons.

Topic #2: U.S. Court of Appeals for the Fourth Circuit upholds ruling in Turnitin’s favor

Without going into a lot of detail, a group of students sued Turnitin in 2007 arguing that Turnitin took their papers against their will, profited from using them, and violated their copyright. A lower court found in favor of Turnitin and this was affirmed by the Appellate Court. Use of Turnitin falls under the “Fair Use” provision of copyright law. You can read more about this decision at The Chronicle of Higher Educations Wired Campus site, the E-Commerce and Tech Law Blog, and if you want all the details – the Appellate Court Opinion.

Topic #3: Turnitin Training Opportunities

There are a number of training opportunities for Turnitin.

You can contact Instructional Support for individualized training sessions specific to your needs. One of the Instructional Support staff will meet with you and go over the creation of Turnitin assignments, review of Originality Reports, and more. Contact us to set up an appointment.

You can also watch Instructional Support’s short training videos.

Lastly, you can attend one of Turnitin’s online training sessions which are offered twice per day. Click here to view the schedule. Additionally, you can watch self-guided videos created by Turnitin.

Posted April 22, 2009 by Aaron Flint

 

Some usage statistics

SNHU makes many teaching tools available to faculty for use in the classroom. My staff and I field questions daily but I always wonder how many people (instructors and students) are using these tools. Over the past few days I have run some statistics and wanted to share them with you. Maybe you will find them interesting too.

Turnitin:

Over the past four years the number of instructors, and a a result students, has grown significantly. With only 5 months of data for 08/09 the year is shaping up to previous years usage.
picture3.png
To date over 31,000 student papers have been submitted to Turnitin for review. The chart below shows the number of originality reports per year broken out into bands based on the percent of the paper that matched other sources. Overall, this data looks good. The papers where 75-100% of the paper matched other sources represent a relatively small percentage (<5%) of all papers. These papers are clearly (or very likely) plagiarized. The number of papers in the 25-50% ranges are also quite low which is promising. The largest numbers are in the 0-24% range which is what we want to see. This is an appropriate range for appropriately cited papers.

picture2.png

RefWorks:

RefWorks is an online bibliographic management tool that is available to all students and faculty for free. Usage continues to grow steadily and new features are being added frequently (see an upcoming blog post for more). Following are statistics from the past 12 months which show a slow but steady increase.

picture4.png

Qualtrics:

Qualtrics is an online survey tool that is available to the entire campus community. It is like Survey Monkey and Zoomerang but much better. It has been well received by faculty interested in survey research as well as for use in class research projects.

picture5.png
picture6.png

Posted February 2, 2009 by Aaron Flint

 

Turnitin System Maintenance

Turnitin will be unavailable on both Saturday, December 20th and Tuesday, December 30th from 6:00 AM to 2:00 PM for routine system and hardware maintenance and upgrades.

If you have a Turnitin assignment due within these time periods, students will be unable to submit. Please plan accordingly and inform your students if necessary.

Posted by Aaron Flint, December 18, 2008.

 

Turnitin Assignments in Blackboard

Some Turnitin resources including an Instructor Guide and two videos on creating Turnitin assignments and reading Originality Reports have been posted on the User Guides page. Take a look!

 

Plagiarism Detection Tools Compared

SNHU’s recent upgrade to Blackboard 8 brought with it a new plagiarism detection tool called SafeAssign. Owned by Blackboard, SafeAssign is built in to the Blackboard Course Management System. It does essentially the same thing as Turnitin, the plagiarism detection tool that we have been using for the past six years but which tool is better? To find out, Instructional Support has done some research and has tested both tools. Following is a side-by-side comparison of SafeAssign and Turnitin to help you make an informed decision when choosing which tool to use.

Both Turnitin and SafeAssign are marketed as plagiarism detection and prevention tools but this can be a bit misleading. Neither one detects plagiarism, they only make it much easier for instructors to detect it. Both tools analyze electronically submitted papers for textual matches between the student’s paper and a variety of source material (more on this later). Both generate a report which identifies the parts of the student’s paper that match these sources. It is then up to the instructor to determine if plagiarism exists or not, usually by looking for appropriate citations. The prevention claim comes from the student’s knowledge that instructors are using one of these tools. If they know you are using a tool that looks for plagiarism (OK – textual matches), they are less likely to plagiarize. Both tools provide concrete evidence via their reports when instructors are trying to deal with the punitive aspect of plagiarism but they are also an excellent teaching tool to help teach students about appropriate citation use.

While Turnitin and SafeAssign do essentially the same thing, there are significant differences in how they do it as well as features available. The table below provides a side-by-side comparison of features.

Feature Comparison:

Category: picture28.png picture18.png
Originality Reports Side-by-side comparison of student paper and original material Original material matches listed at top of report with student matches listed below
Able to exclude specific sources from report Yes – instantly Yes – but must reprocess the report
Able to include or exclude quoted text Yes No
Able to include or exclude bibliography Yes No
Databases Searched
Active Internet content Yes Yes
Archived Internet content Yes No
Student papers from all schools using tool Yes (currently contains approx. 51 million papers with approx. 75,000 added each day) Yes – but only papers students voluntarily submit
Student papers from SNHU Yes (almost 28,000 SNHU student papers submitted to date) Yes (starting from zero)
Proprietary Database(s) Gale InfoTrac OneFile

(10,000 titles covering more than 60 million articles)
Emerald
ABC-Clio

ProQuest ABI/Inform

(1,100 titles covering 2.6 million articles)

Technical Support SNHU Instructional Support
Turnitin help desk via email
Turnitin help desk via phone
SNHU Instructional Support only
Availability outside of Blackboard Yes – not tied to our use of Bb No – tied to our use of Bb
Usage statistics available? Yes – for instructors and administrators No
Supported File Types .docx (Word 2007 or Word 2008 for Mac)

.doc (Word, earlier versions)
.txt (Plain text)
.pdf (Adobe Acrobat PDF)
.rtf (Rich Text Format
.wp (Word Perfect)
.ps (Post Script)
HTML

.docx (Word 2007 or Word 2008 for Mac)

.doc (Word, earlier versions)
.txt (Plain text)
.pdf (Adobe Acrobat PDF)
.rtf (Rich Text Format
.odt (Open Office Word)
.zip
HTML

What happens to student papers when submitted? Automatically added to Turnitin’s global database of papers from all institutions. This is described in the agreement screen students see the first time they use Turnitin Automatically submitted to SNHU’s database

Inclusion in SafeAssign’s global database is on a voluntary basis only

Test Results:

To see how Turnitin and SafeAssign performed we created a Turnitin Assignment and a SafeAssign assignment in Blackboard. Using our test student accounts we submitted five papers to Turnitin and the same five papers to SafeAssign. The papers were in different formats including docx, doc, rtf, pdf, and html.

The papers also contained different types of content. The first was a letter of recommendation which we knew would have little if any textual match. The second was a paper submitted in one of Aaron Flint’s Intro to Sociology sections. The third was a free paper downloaded from a paper mill (123helpme.com). Fourth was an article downloaded directly from a library database. Fifth was text copied and pasted directly from a web page. We believe that this gives a fair representation of the variety of content students might submit.

From a student perspective submitting papers was fairly easy. Uploading the paper to SafeAssign and Turnitin was straightforward required very little beyond browsing to find the file on the computer.

From an instructor perspective it was simple as well. There are two things an instructor must do. First, a SafeAssign or Turnitin assignment must be created. This will create a link for students to submit their papers to. Once submitted, instructors can review the originality reports and download papers from the drop box. Links to short instructional videos are coming soon.

Now to the results…

Paper Turnitin SafeAssign Comments
Letter of recommendation (.doc) 3% match – found the mailing address from the letter on another site 5% match – matched a sentence from the letter to text on a Washington Redskins Fan Site While the Turnitin match was expected, SafeAssign was not. SafeAssign took one sentence from the letter and partially matched it to the Redskins site. Click here to see match from report.
Student Sociology paper 58% match 38% match Turnitin did a better job of identifying matches. The report is not included here for privacy reasons as this is an actual student paper.
Paper Mill paper 100% match – see report 1% match -see report Turnitin identified that the entire paper was from another source. Although it didn’t identify 123helpme.com as the source that’s OK. As Turnitin scours the web and its databases, it stops comparing specific sections of text once it hits on a match. SafeAssign’s results are disappointing as the paper was pulled from a publicly available web page.
Library Database article 88% match – see report 100% match – see report We had expected a 100% match from Turnitin but the 88% is not bad. It appears that Turnitin could not match some of the data tables. While SafeAssign shows a 100% match, review of the report shows several sections of text not highlighted meaning that it didn’t find a match. If it didn’t find a match, why the 100% score. It appears that SafeAssign had difficulty with some of the same sections that Turnitin did.
Copy and Paste from Web Page 97% match – see report 100% match – see report Interestingly both identified the exact source of the copy in its entirety. So why the discrepancy in score? Turnitin recognized some of the HTML tags that copied over from the web to the Word file and excluded them from the report.

Overall, both tools performed fairly well. Use of either one is better than trying to identify textual matches manually. While the results are close there are some things that stood out to us in the review. These are:

  1. SafeAssign seems to match by individual sentences or partial sentences making the report more difficult to read and resulting in some inaccurate/weird results as with the letter of recommendation. Turnitin’s matching of larger text blocks seemed to be more accurate and easier to read. Also, the side-by-side reports from Turnitin seem to be easier to read than SafeAssign’s.
  2. Turnitin seemed to do a better job of identifying matches, especially with paper mills. This may be due to the greater breadth and depth of Turnitin’s search capability including searches of archived web pages.
  3. Turnitin’s match percentages appear to be more accurate than SafeAssign’s.
  4. Turnitin automatically submits student papers to the global database. Some instructors take issue with Turnitin keeping student’s work in their database and therefore making a profit from it. Others don’t have a problem with it. While student’s do agree to a Turnitin agreement the first time they submit a paper, it is unlikely that they actually read it. Instructional Support and Turnitin recommend adding a Turnitin statement to your syllabus, usually appended to the Academic Honesty Policy section. This clearly explains the database and gives an alternate assignment if a student objects. In six years we have yet to have a student object.
  5. While Turnitin automatically submits papers to the global database, SafeAssign does not. Students have to check a box with every paper submission to allow this. If students can opt out it limits the effectiveness of the tool

Based on this comparison, either tool would work but we believe that Turnitin is a better tool overall based on accuracy, features, ease of use, and availability outside of Blackboard.

Instructional Support can provide training to instructors as needed. We tend not to schedule workshops as we prefer to make arrangements on an individual or departmental basis. We can offer training face-to-face or live online using Adobe Acrobat Connect. If you would like training on Turnitin or SafeAssign, contact Aaron Flint.