Peer ranking is now possible using
WebAssign. The following instructions give an overview of creating a ranking
assignment. It is assumed that the user is somewhat familiar with WebAssign
- (you need to know how to create an essay question and how to create an assignment).
It is important to realize that not every type of essay is appropriate for use as a ranking exercise. If the essay has multiple parts to it, the students will not be sure on which criteria to rank it. For the most part, the essay needs to be a simple question with one answer and an explanation. This does not mean it can not be a long essay or an essay that requires a long answer - just that it is straightforward with only one element. The following are two examples, the first is an essay that would not work well, and the second is one that would work well.
There are currently two "methods" of using peer ranking. The first method is method = "rank". This is the default method of peer ranking and it is described below. The other method is method = "review_essay". In this mode, the students will see the answer they had for a previous question. (see below for details)
The current ranking process is actually
2 assignments. The first assignment is a normal essay question.
The second assignment is the ranking assignment. Thus the first step is
to create an assignment with an essay question and make it available to students.
You will need to know two things about this - the essay question ID number and
the assignment ID number. It is helpful to let the students know that
their essay will be viewed (anonymously) by other students and that this is
the first part of a two part assignment. *Don't forget to weight your essay
The best way to see how to create
a ranking question is to first see an example. Below is a ranking question
that has been used. (Question ID = 134202 on webassign.net)
<eqn use Peer; ''>
<eqn $number_of_bins=3; $a=85670; $q=130245; ''>
<eqn $method='rank'; ($essays,$bins)=Peer::GET_ESSAYS($a,$q,$number_of_bins); $MODULE='Peer'; $GRADER='SPEARMANR';''>
<eqn @bounds = (22,15);''>
<eqn $MIN = 6;''>
Below are 3 essays that you
are to rank from 1 (best) to 4 (worst). No two
essays are allowed to have the same rank, so even if two essays seem to be
equally good, you must assign a unique rank number to each of them.(No ties
allowed!) You may find it helpful to first read each essay and determine a
numerical grade for each one, which can
then be used to help decide the rank order.<P>
the following needs to be in the answer box
The four red phrases are the ones that will most likely need to be changed.
|Bin number||Essay score range|
|1||10 - 9||Best essays|
|2||7 - 8.9||Good essays|
|3||5 - 6.9||Not so good essays|
|4||0 - 4.9||Bad essays|
The essays must be graded in the normal fashion for WebAssign, but there are a couple of things to note. It is not necessary for essays to be ranked, scored is fine and ties are fine as well. In the example shown above, grading was based on what bin it should go into. It is important to make sure that there is at least one essay in each bin.
In some instances, you may wish to use an instructor created exemplar essay that all students see. If this is the case, a few changes need to be made.
About this assignment
This is the first part of a two part
peer ranking assignment. All students will answer this essay question. In part
this assignment, you will have the task of ranking 5 anonymous essays from other students in this class.
1.  Two students are discussing
the motion of a ball that is thrown straight up into the air. One student says
that the acceleration at the highest point
is zero, the other student says that it is not zero. Which student is correct and why? (Be sure to give a full explanation as other students will be anonymously ranking your essay.)
About this assignment
Ball essay ranking exercise
This is part two of the two-part
assignment that started with your submission of your essay question. In this
are given 4 random essays to rank from other students.
1.  Below are 4 essays that
you are to rank from 1 (best) to 4 (worst). No two essays are allowed to have
the same rank, so even if two essays seem
to be equally good, you must assign a unique rank number to each of them.(No ties allowed!) You may find it helpful to first read each essay and determine a numerical grade for each one, which can then be used to help decide the rank order.
The "review_essay" method does not actually require the students to rank essays, but it does use some of the features of peer ranking. Review_essay allows a question to be created that shows the student one of their answers to a previous question. The way that this has been used is in having the student revise an essay question, but it could be used to have them expand on an essay question, or comment on one of their old responses. (An example of the review_essay method can be see in question 59158)
There must be a previous essay question that you want the students to see again. The assignment number and question number of this essay need to be known.
Now you must write a review_essay question. Below is a sample question (the important parts are highlighted in red):
<eqn use Peer; ''>
<EQN $method = 'review_essay'; ''>
<EQN $a = 13707; $q = 59153; ''>
<EQN $essay = &GET_ESSAYS($a,$q,$username); ''>
You answered the following question:
<p>You are at the state fair and want to play a game where the object is to knock over a heavy board by throwing something at it. The vendor offers you a choice of things to throw, a tennis ball, or a ball of clay - both have the same mass. Which object would you choose to throw and why?</p>
<p>Your previous answer was:<br>
Give your previous answer a score from 0 - 10 and explain why it should be rated as you did (justify the score you gave yourself).