Tuesday, January 31, 2017

Timed, in-class quizzes: workshopping improvements and alternatives

Contributed by: Leah Renwick

Students may dislike or dread timed, in-class quizzes. Anecdotally, frequent quizzes at the beginning of every lecture are often stressful for students and thus not conducive to student engagement during the rest of class.

What are alternative tools to assess recall and understanding?
The UC Davis “TA’s Guide to Effective Teaching at UC Davis”  and accompanying “Dig Deeper: Additional Resources for UC Davis Instructors” outline several tools that could be used, summarized here:

Recall/Understanding Assessment Tool
Background knowledge probe
Questionnaire at beginning of course/unit
Entry slips
Before class: students answer a question or complete a sentence related to a new topic
Focused listing
Choose an important concept and ask students to list related concepts and ideas.
KWL chart
Before class: What do you KNOW? What do you WANT TO KNOW? After class: What did you LEARN?
Minute paper
One-minute quick write: What is the most significant thing you learned today?
The muddiest point
What was the most unclear concept for you in the last lecture?
In-class or online polling
Feedback on background knowledge, preparation for class, or how well students understood material covered in class

Some of these tools lend themselves to assessing student understanding but also assigning grades (e.g. online polling/quiz), while others lend themselves more to improving teaching (e.g. the muddiest point). Overall, GTC members favored using most of these tools only sporadically throughout a quarter or semester, since some of them could be time consuming to review systematically. GTC members also suggested that doing the “muddiest concept” in groups rather than individually could make it more time-efficient and that the “minute paper” technique could be used to outline a larger assignment.

Should quizzes be scrapped, or just improved?
GTC members advocated improving quizzes but supporting students’ study process and perhaps modifying the quiz structure or setting. Suggestions for improvement:
  • Provide study questions to guide students’ reading of journal articles and reviews of the previous lecture (most popular idea!)
  • Consider including a reading comprehension workshop to build students’ capacity to read academic articles or providing relevant resources, for example:
  • Intersperse quiz questions throughout lecture e.g. 3 questions, 1-2 minutes, T/F, grading includes points for participation and correctness.
  • Move quiz from in class to online campus learning management system (e.g. Canvas at UC Davis) to reduce stress of in-class, timed quizzes, and make quiz multiple choice in order for grades to input directly into gradebook.

References and links

Link 1:
UC Davis, The TA’s Guide to Effective Teaching at UC Davis (2015): http://cee.ucdavis.edu/docs/TA_Guide_2015-Accessible.pdf

Link 2:
UC Davis, Dig Deeper: Additional Resources for UC Davis Instructors (2016): http://cee.ucdavis.edu/docs/2016/2016_TAGuide_Compiled-Dig-Deepers.pdf

Link 3:
Frederique Laubepin (2013) “How to Read (and Understand) a Social Science Journal Article”: http://www.icpsr.umich.edu/files/instructors/How_to_Read_a_Journal_Article.pdf

Link 4:
Kevin Barnhurst’s “Reading in the Social Sciences”: http://kgbcomm.people.uic.edu/didact/pdf/readsocsci.pdf

Tuesday, January 24, 2017

Plagiarism, Patchwriting, and Undergraduate Students

Contributed by: Stacy Wittstock

Plagiarism has been in the news a lot lately, due to the recent discovery that Monica Crowley, one of President Trump’s appointments for a security post, had plagiarized a significant portion of a book she had published. (For more on this: http://money.cnn.com/interactive/news/kfile-monica-crowley-dissertation-plagiarism/)

What is plagiarism?
Plagiarism is most often conflated with the idea of “cheating.” And it’s true—outright plagiarism is a form of intellectual and academic dishonesty, akin to cheating on a test. However, the Council of Writing Program Administrators (CWPA) argue that intentionality plays an important role in cases of possible plagiarism.

  • CWPA defines plagiarism as: “In an instructional setting, plagiarism occurs when a writer deliberately uses someone else’s language, ideas, or other original (not common-knowledge) material without acknowledging its source.”
  • They go on to argue that: “Most current discussions of plagiarism fail to distinguish between: 1) submitting someone else’s text as one’s own or attempting to blur the line between one’s own ideas or words and those borrowed from another source, and 2) carelessly or inadequately citing ideas and words borrowed from another source” (CWPA).

How do students use sources?
This brings up the questions of how students actually use sources when writing in college, and what types of sources they use. The Citation Project (2011), and its primary researchers Rebecca Moore Howard, Sandra Jamieson, and Tricia Serviss, aimed to answer these questions: “The Citation Project is a multi-institution research project responding to educators’ concerns about plagiarism and the teaching of writing. Although much has been written on this topic and many have expressed concerns, little empirical data is available to describe what students are actually doing with their sources. At present, therefore, educators must make policy decisions and pedagogy based on anecdote, personal observation, media reports, and the claims of corporations that sell ‘solutions’” (“What is the Citation Project”).

Through their research, Howard, Jamieson, and Serviss distinguish between two major forms of source use: paraphrasing and patchwriting.

  • Paraphrasing:
    • “Restating a phrase, clause, or one or two sentences while using no more than 20% of the language of the source.  This 20% does not include accurate synonyms, articles, prepositions, proper names, technical terms, or other keywords. This 20% does include words whose morphology is changed (a change in verb tense, for example)” (“Terms and Definitions,” The Citation Project)
  • Patchwriting
    • “Restating a phrase, clause, or one or more sentences while staying close to the language or syntax of the source” (“Terms and Definitions,” The Citation Project)
  • For more, here is a link to the results of the Citation Project: http://site.citationproject.net/results/phase-i-data/

So what does this tell us?
In the Citation Project pilot study, Howard, Rodrigue, and Serviss argue that “Instead of focusing on students’ citation of sources, educators should attend to the more fundamental question of how well students understand their sources and whether they are able to write about them without appropriating language from the source” (2010, p. 177). They argue that the instances of misuse of sources were more indicative of students’ inability to comprehend, and therefore accurately paraphrase or summarize, the sources they were using, than straight intentional “cheating.”

Suggestions for Pedagogy
  • When grading student writing, consider intentionality when you suspect poor source use:
    • Is there a citation but no quotation marks?
    • Did the student intentionally copy without citation, or do they appear to be trying to paraphrase with little success?
    • Or did they intentionally poach the Wikipedia page on “Poaching” (true story!)
  • If you have time (or the ability to design your own activities for class time), consider building in a reading comprehension workshop
    • Some students may have high reading comprehension skills in one field, but low skills in another.
    • Some may have very little experience with peer-reviewed, scholarly writing.

Additional Resources