GRADER Test Scoring Services
Introduction
At Creighton University, Information Technology offers faculty a test-scoring service called GRADER. Faculty members are able to provide for their classes two types of test-grading services (Cut-sheet and Grader). With CUT-SHEET and GRADER, objective examinations are scored quickly and economically.
- Grader Services has two types of answer sheets for fixed alternative objective tests: five-response and ten-response answer sheets.
- The five-response answer sheets allow a total of 200 questions for each exam.
- The ten-response answer sheets allow a total of 120 questions for each exam.
- The five- and ten-response answer sheets cannot be combined into one test.
- Both types of answer sheets contain information about the student and course. For BlueLine Grader, the student name and student netids will be used and are preprinted on the answer sheets. This process is known as "slugging." On Wednesdays, preprinted tests for the next week are available for pick-up at the Information Technology front desk.
- Only one response is allowed per question. If the student erases and changes the response, the scanner will pick up the darkest mark on the bubble sheet.
- Reports analyzing student performance and characteristics of the examination are produced on 8 1/2" x 11" cut-sheet laser paper.
- With the Cut-sheet, the reports may be sent to the faculty electronically to the faculty desktop. Blueline Grader will receive electronic reports and a text file (for Blueline import). For the electronic reports, the instructor will need to contact the grader coordinator and provide a password.
- In some courses, the instructor may wish to give more than one answer key for the test. An alternate key is defined as a different sequential ordering of the same pool of questions. The maximum number of such forms allowed in GRADER is four. To use multiple forms, students are instructed to mark the form number in column P. This information is used to reorder the student response to a common order. The instructor must provide the sequence of questions for each form used. Click here to review or print the Multiple Master Instructions. Click here to print a copy of the multi-form master. This feature is available in Cut-Sheet & Grader.
- Response turnaround is one business day, except during mid-semester and finals week, turnaround is two - three business days. Unless there are questions about the exam or waiting on an instructor response.
The exam software was purchased from NCS/Pearson. Its commercial title is Remark.
Cut-Sheet
An instructor wishing only to computer-score an individual exam need only contact the grader coordinator at 280-2252 to arrange to pick up sufficient copies of blank (5 or10 response) answer sheets. During the exam, the instructor informs the students to fill in the "NAME" field of the answer sheet and an appropriate response for each question. The answer forms, along with the KEY answer sheet, must then be returned to Information Technology to the grader coordinator where they are processed.
Reports are produced, based on the information the students have penciled in and the key that is provided by the instructor.
Cut-sheet reports include:
- Student Statistics Report - creates a report for each student containing:
- Raw score
- Percent score
- Number right, number wrong, number missing
- Test Statistics Report - gives the instructor formulated statistics using Remark:
- Total possible points
- Number of students in test group
- Mean Score, highest score, lowest score
- Standard Deviation
- Kuder-Richardson or Reliability Coefficient
- Detailed Item Analysis Report - creates all currently displayed data as well as:
- Statistics on each question
- Point Biserial
- Response Frequencies for each question and response
- Student Grade Report - gives students' responses
- Student response for each question
Blueline Grader
Blueline Features
- Course cumulative reports will be available to the instructor in Blueline.
- Instructors will receive a text file that they may import into Blueline.
- Grader IDs are the students' NetIDs. JKL numbers are no longer used.
- The pre-printed bubble sheets will include the student name & NetID.
- To send electronic reports and text file, a unique password will be required. The instructor must provide this password to Grader Services prior to sending any reports. Grader Services uses WinZip to compress the electronic reports and text file.
Student Statistics Report - creates a report for each student containing:
- Raw score
- Percent score
- Number right, number wrong, number missing
Test Statistics Report - gives the instructor formulated statistics using Remark:
- Total possible points
- Number of students in test group
- Mean Score, highest score, lowest score
- Standard Deviation
- Kuder-Ricardson or Reliability Coefficient
Detailed Item Analysis Report - creates all currently displayed data as well as:
- Statistics on each question
- Point Biserial
- Response Frequencies for each question and response
Student Grade Report - gives students response marked on bubble sheet
- Student response for each question
To arrange for Blueline training, please e-mail aet@creighton.edu.
FAQ
Question: What is the difference between a five response and a ten response form?
Answer: The five-response answer sheets allow a total of 200 questions for each exam.
The ten-response answer sheets allow a total of 120 questions for each exam.
Question: Can I mix the forms?
Answer: No, unfortunately the scanner that reads the bubble sheets is not designed to read both types of answer sheets for one test.
Question: Can I use a five response form on one test, and a ten response on another?
Answer: Yes, the instructor would need to inform Grader Services of the change.
Question: What is a multi-key or multi-master?
Answer: In some courses, the instructor may wish to give more than one answer key for the test. An alternate key is defined as a different sequential ordering of the same pool of questions. The maximum number of such forms allowed in GRADER is four. To use multiple forms, students are instructed to mark the form number in column P. This information is used to reorder the student response to a common order. The instructor must provide the sequence of questions for each form used. The multi-master form and instructions are available for download on the Grader web site. This feature is available in Cut-Sheet & Grader.
Question: I want to prevent cheating. Can I mix up the questions or the answers? Can I do both?
Answer: The current exam software (Remark) has the ability to mix the questions, not the answers.
Question: Why would I want to get the results via e-mail?
Answer: Primarily convenience. Instructors don't have to walk over or send someone to pick up the results during specific office hours. Additionally, results can be accessed using CUMAIL over the web.
Questions: Why do I need to give you a password to get the results via e-mail?
Answer: To enhance security when sending test results over the network.
Question: I've forgotten my password for the test results. Who do I call?
Answer: Grader Services, extension 2252.
Question: Can I have more than one password?
Answer: No, one password for each instructor regardless of the number of courses.
Question: What is Blueline?
Answer: Blueline is the Learning Management System for Creighton University.
Question: How do I use Blueline?
Answer: e-mail aet@creighton.edu for information on Blueline
Question: What is a Blueline import file?
Answer: This is a text file that the instructor imports into his or her Blueline course. This allows instructors and students to use Blueline to view tests results online.
Question: Can Grader Services update Blueline with the test results?
Answer: It is each instructor's responsibility to import grades into Blueline for any courses they teach.
Question: I want to use Blueline, but I misplaced the test you printed for me. How should the students fill out the blank forms for the netid?
Answer: Two steps:
- In the last three columns of the name field, pencil and bubble in the three alpha characters of the student's netid, on the bubble sheet.
- Using the five digits of the student's netid, pencil and bubble in the boxes and columns H through L in the lower left hand corner of the bubble sheet.
Question: Do I have to use Blueline?
Answer: No, you can still use the pre-printed forms and not use Blueline. You will need to let Grader Services know that you don't require the import file.
Question: Why are you sending me a Blueline import file, when I don't use it?
Answer: You didn't inform grader Services that you didn't want the file or Grader Services forgot your request and inadvertently sent you the file. Instructors can delete the import file.
Question: Can I get test forms printed the same day I request them?
Answer: Unfortunately, no. A lead time of several days is required to process the request and print the bubble sheets.
Question: How long does it take to get pre-printed forms, after I request them?
Answer: Pre-printed bubble sheets are printed on Tuesday evening, a week before the exam is given.
Question: I want pre-printed forms, but I haven't decided on the test dates. Can I still get them?
Answer: No, Grader Services needs the exam dates to create and print the bubble sheets.
Question: Can I get forms pre-printed without any student information on them?
Answer: Yes, these exams would be run as cut-sheets, since there is no name and netid.
Question: I made a mistake on the answer key, can I get it corrected?
Answer: Yes, send an e-mail to grader@creighton.edu with the correction. The instructor will receive updated reports.
Question: Can I have more than one correct answer for a question?
Answer: Yes, please include a notation on the key, giving the question number and correct answers.
Question: Can I require two (or more) correct answers for a question?
Answer: Unfortunately, no. The scanner can only read one response, and that will be the darkest response on the bubble sheet.
Question: What if a student marks two (or more) answers as correct?
Answer: The scanner will not read the two marks. The Remark software will indicate multiple responses. The procedure is to not record any answer for that student's response.
Question: My tests are different from other instructors’. Can you handle them?
Answer: Contact Grader Services.
Question: Can you pre-print sheets with just the instructor's name and course name?
Answer: Yes. This is considered a special request. Instructors need to contact Grader Services.
Question: Can I have a special request test done during midterms or finals week?
Answer: Contact Grader Services.
Question: I use a Mac, not Windows. Can I still get the results emailed to me?
Answer: Yes. The best way to view your reports is to have Mac Office installed on your computer.
Question: Can I read the results on a Mac?
Answer: Yes you can.
Question: What format are the reports in?
Answer: RTF (Rich text format).
Question: Why did you choose RTF for the e-mailed reports?
Answer: Grader Services chose RTF because the reports are easier to read.
Question: What is RTF?
Answer: Rich Text Format is a widely used format for digital files. Microsoft Word is one of many software packages that work with RTF files and can be used to view your reports.
Question: I just want you to scan the sheets. I want to score them myself. Can you just send me that data?
Answer: Yes. Grader Services would need to know this before the exam was processed. Grader Services would also need a password for security purposes.
Question: What reports does Grader Services provide?
Answer: There are four reports that are available from the instructor's exam. Student Statistics,
Test Statistics, Detailed Item Analysis and the Student Grade Report.
Question: Can I get the reports printed, and a Blueline import file e-mailed to me?
Answer: Yes.
Question: I'd like to have the test results emailed to me, but I'd also like a hardcopy. Is that possible?
Answer: Yes, be sure to let Grader Services know your specific wishes when you are arranging the service.
Question: What is the turnaround time when for an exam/test?
Answer: Turnaround is twenty-four hours, except during mid-semester and finals week, when turnaround is 48 to 72 hours. Grader Services is not open during the weekends.
Question: I used blank forms and had the students fill them out. Why are some student names blank in the reports?
Answer: The student(s) did not pencil in the bubbles in the name field.
Question: I have a question, but it's not answered here. How can I get an answer?
Answer: There are two options to answer a question. Instructors can e-mail grader@creighton.edu or call extension 2252.
Plugged In highlights go here, news, initiatives, spotlight, designed to draw the user who is done finding or browsing, further into our content.