Multiquest Optical

Mark Reader (OMR)

Aims and Learning Objectives

By the end of this course you will be able to:
• Create a filing system for examination files
• Create a candidate list suitable for Multiquest
• Set a new multiple choice question (MCQ) examination in Multiquest
• Create a master answer sheet
• Understand the role of Print Services and submit the examination for marking
• Deal with student answers that the OMR machine was unable to read
• Create Multiquest reports
• Withdraw and re-score examination questions
• Export examination results to Excel
• Optionally, report on sub-examinations

Prerequisites
This document assumes:
• A basic familiarity with Microsoft Windows NT, 9x, 2000, or XP
• A basic familiarity with Microsoft Excel 97, 2000, or XP
• An understanding of your department’s examination system

University of Bristol Information Services document omr-t1

Document Information

Format Conventions
The following format conventions are used in this document:
Computer input that you type is shown in a bold http://www.bristol.ac.uk
Courier font
Computer output, menu names and options, Save, Go to, Refresh
buttons, URLs are shown in a Courier font
Text that you must replace is shown in italics Enter your username
Computer keys that you must press are in a bold <Enter>, <n>, <N>, </>
Courier font and enclosed in angle brackets
Notes and warnings are displayed in a shaded area. Example text like this

Related documentation and getting help

For more details about the use of the Multiquest software, consult its online help system:
• From the Help menu, select Contents or Search.
All users of the OMR should consult the OMR web pages for the latest information about:
• How to register to use the service, costs, and the Service Level Agreement
• The latest timetable of action and events
• How to obtain and install the Speedwell Multiquest software
• Dates and booking arrangements for OMR training sessions
• Answers to Frequently Asked Questions (FAQs) and how to get further help
• Updates to the service and to this document
• Question types not covered in this document (for instance, EMIQs)

World Wide Web: http://www.bristol.ac.uk/omr

Enquiries that are not covered by the above may be sent to the OMR support team mailbox:

Help Mailbox [email protected]

All who attend OMR Service training will automatically be registered on the OMR mailing
list for announcements about the service. Others may subscribe to this list on request.

OMR mailing list [email protected]

Multiquest Optical Mark Reader (02.04) http://www.bristol.ac.uk/omr/Documents/omr-t1

If you have any comments or queries about this document mail [email protected].
This document may be used wholly or in part by the academic community, providing suitable
acknowledgment is made. It may not be used for any commercial or profit-making purpose without
permission. © 2004 University of Bristol. All rights reserved.
Multiquest OMR

Contents
Format Conventions .................................................................................................. 1
Related documentation and getting help ................................................................. 1
Task 1 Multiquest files and security ............................................................ 3
Task 2 Creating a candidate list (Excel)...................................................... 4
Task 3 Exporting a candidate list (Excel).................................................... 7
Task 4 Setting a new exam in Multiquest.................................................... 8
Task 5 Copying the response files to floppy disk...................................... 15
Task 6 Filling in the master answer sheet ................................................. 16
Task 7 Providing instructions to students................................................. 18
Task 8 The marking and return of the examination ................................ 19
Task 9 Copying response files to the Multiquest filing system................ 20
Task 10 Correcting unscanned student responses...................................... 21
Task 11 Generating reports.......................................................................... 23
Task 12 Adjusting exam scores and withdrawing questions ..................... 26
Task 13 Exporting results to Excel .............................................................. 28
Task 14 Archiving the examination ............................................................. 31
Task 15 Setting sub-exams (optional).......................................................... 32
Task 16 Reporting sub-exams (optional)..................................................... 33
Appendix A Consistent exam names................................................................. A-1
Appendix B Request form ................................................................................. B-1
Appendix C Timetable of events ....................................................................... C-1

Multiquest OMR (omr-t1) 1

 Introduction
This course covers the use of the Speedwell Multiquest software version 2.38 and related
administrative processes for marking examinations using the Optical Mark Reader (OMR)
Service, from the point of view of academic departments.
When using the OMR Service there are, essentially, five stages:
• Setting up prior to the exam (Task 1 on page 3 to Task 6 on page16)
• The exam itself (Task 7 on page18)
• The scanning of answer sheets by Print Services (Task 8 on page 19)
• Correcting of unscanned responses (Task 9 on page 20 and Task 10 on page21)
• Reporting on and (as necessary) adjusting the exam and archiving the finalised results
(Task 11 on page 23 to Task 14 on page31)
The course shows how to process an exam that uses Multiple Choice Questions (MCQs).
Instructions for using other question types, such as Extended Matching Index Questions
(EMIQs), are on the Web at http://www.bristol.ac.uk/omr/Documents

Registering to use the OMR Service and Multiquest

This document requires access to Multiquest version 2.38. This can be downloaded by
departments registered to use the OMR Service from
http://www.bris.ac.uk/omr/Documents/omr-r1.html
A list of registered departments and details of the cost of registering to use the OMR Service
can be viewed at http://www.bris.ac.uk/omr/Registration/

Example files
This document uses prepared example files, which it assumes are stored on the PC. If you are
doing this practical in a training room in the Computer Centre, these files are stored in the
folder C:\User\Multiquest. If you want to do the practical on your own system, you
need to download these files from http://www.bristol.ac.uk/omr/Documents.

Timetable of actions and events

A timetable of events to which users of the OMR Service must adhere is shown in
Appendix . The actions prior to the examination (steps 0 to 0 in Appendix ) must be
carried out by the department well in advance of the examination as support in case of
problems cannot be guaranteed at short notice.

Multiquest Optical Mark Reader (omr-t1) 2

Task 1 Multiquest files and security
Objectives To examine a suitable folder structure for Multiquest files.
Method Using Windows Explorer or My Computer.
For each examination that you set up, Multiquest creates three files called the
response files. The response files all have the same name (the name of the
examination, which you supply) and have extensions .RES, .RST and .RSX.
You can create your own folder structure to organise the response files for your
various examinations, but the recommended folder structure is:
academic year\programme\year of study

Warning Since the files used by Multiquest contain confidential exam data, it is essential
that they are stored in a secure location. Such files on a PC or network drive
must be in a restricted-access folder, with appropriate file permissions
protected by a confidential password. When setting up your Multiquest folder
structure you are strongly advised to involve your department’s Computer
Support Officer and read the additional information on security and backup at
http://www.bristol.ac.uk/omr/Technical

1.1 Start Windows Explorer or My Computer.

1.2 Go to the Multiquest folder (in training rooms, C:\User\Multiquest).

Note the folder for the academic year (02_03).

Inside are folders for the programme (Vets and Med).

Inside these are folders for the year of study (or other category for which you
will be setting an exam), for example, Sci_2. It is at this level in the folder
structure that you create new response files when you set up an examination.
1.3 Examine the folder \Multiquest\02_03\Vets\Sci_2 (Figure 1). This
contains examples of the response files used by Multiquest to record each exam.

Note You may find it easier to work in Details view (select from the View menu).

Figure 1 - suggested folder structure for Multiquest response files

Multiquest Optical Mark Reader (omr-t1) 3

Task 2 Creating a candidate list (Excel)
Objectives To produce a list of examination candidates for Multiquest.
Method You will use an Excel function called Concatenation to create a candidate list in
Excel in a form suitable for exporting to Multiquest.
Comments If your candidate list is not already in an Excel file, it should be imported or copied
into Excel. Multiquest requires the candidate numbers and names.
Bristol University currently uses 5-digit candidate numbers, but may at some point
introduce 8 digits. In anticipation, University of Bristol answer sheets and Multiquest
decodes have been designed for 8-digit candidate numbers.

Warning The OMR Service requires the addition of three trailing zeros to 5-digit candidate
numbers. Fewer than 8-digits in candidate number fields in Multiquest, or in the
candidate number box on master or student answer sheets, will result in serious
errors (the entire exam or papers will not scan).
Multiquest also needs the candidates’ name in a single field (column) in the form:
Surname Forename Middlenames
Therefore, the candidate list for export to Multiquest should look as follows:
Candidate No. Candidate Name
00045000 SPARROW Anne Frances

If the data already looks as above then proceed to Task 3 on page 7. If, however, the
candidate list for export to Multiquest looks as follows:
Candidate No. Surname Forename Middlenames
00045 SPARROW Anne Frances

• Three trailing zeros must be added to 5-digit candidate numbers

• The components of the candidates’ names that are in separate fields
(columns) in Excel must be concatenated into a single column

2.1 Start Excel and open the file:

C:\User\Multiquest\02_03\Vets\Sci_1\Sci 1 candidates.xls.
2.2 Select Sheet 1. This is an example of data with each component of the candidates’
names in a separate field and 5-digit candidate numbers.
2.3 Select the sheet named Suitable for Multiquest. This has an example of
how to convert the Sheet 1 data into the right format.

Examine the formula cell B2. This formula joins together the three name
columns (Surname, Firstname and Middlenames) of Sheet 1:
=CONCATENATE('Sheet 1'!B2," ",'Sheet 1'!C2," ",'Sheet 1'!D2)
Concatenate means “join together”; " " means a space. So the formula means, ‘Join
together the data in cells B2, C2 and D2 with spaces between the words’.

Examine the formula in cell A2. This formula joins three trailing zeros to the
Candidate No. column of Sheet 1.
=CONCATENATE('Sheet 1'!A2,"000")

Multiquest Optical Mark Reader (omr-t1) 4

 The following steps show how to copy the data in Sheet 1 onto a new blank sheet,
concatenating the candidate numbers and names as you do so.
2.4 First, supply names for the columns of data, as follows:

Select the sheet Your Work.

Enter the headings Candidate No. and Candidate Name (or similar) in
cells A1 and B1 respectively.
Note It is important that the data on the new sheet starts in cell A1, that there are no empty
rows between the headings and the rest of the data, and no empty columns in the data.

2.5 Copy the 5-digit candidate numbers onto the sheet Your Work, concatenating them
with 3 trailing zeros as you do so, as follows:

In the sheet Your Work, click in cell A2 (the cell on the new worksheet to
receive the candidate number)

Click the Paste Function button. . Available Paste Functions are displayed.

Select Text and Concatenate, (Figure 3), then click on OK.

Figure 2 – Excel’s paste functions

A wizard appears (Figure 3). Point to any empty grey part of the wizard dialog box
and pull it down and to the right of column D, so you can see columns A and B clearly.

In the wizard dialog, click in the box marked Text 1. Go to Sheet 1 and click
in cell A2 (which contains the 5-digit candidate number 00045).

Click in the box marked Text 2 and type “000” (it is necessary to include the
quotes otherwise 000 is treated as a numerical value and truncated).

Figure 3 – Excel’s concatenate wizard

Multiquest Optical Mark Reader (omr-t1) 5


Click OK to finish. The result is an 8-digit candidate number in A2 (00045000).

Copy the formula in A2 to other cells that should contain candidate numbers (A3:A6).
2.6 Copy and concatenate the candidate names onto the sheet My Work, as follows:

Click in cell B2 and click the Paste Function button.

Select Text and Concatenate, then click on OK.

Point to any empty grey part of the wizard dialog box and pull it down so that
you can see columns A and B clearly.

Click in the box marked Text 1. Go to Sheet 1 and click in cell B2 (which
has the surname, SPARROW). This cell reference will be entered into the box.

Click in the box marked Text 2. Press the keyboard’s <spacebar> to create a
space after the surname.

Click in Text 3. Go to Sheet 1 and click in cell C2 (firstname, Anne).

Click in Text 4. Press the keyboard’s <spacebar>.

Click in Text 5. Go to Sheet 1 and click in cell D2 (middlename, Frances).
The contents of the wizard dialog should now be as shown in Figure 4.

Figure 4 – concatenating cells B2, C2 and D2 from Sheet 1, with spaces between

Click OK to finish. The result should be SPARROW Anne Frances in cell B2.

Copy the formula in cell B2 to cells B3:B6.

Multiquest Optical Mark Reader (omr-t1) 6

Task 3 Exporting a candidate list (Excel)
Objectives To export a candidate list to Multiquest.
Method You will export the candidate data from Excel in a format that Multiquest can import
(a tab delimited text file).
Comments The data to export must contain values only (no formulae). If there are no formulae,
proceed from step 3.2 below.
When your examination is sent for scanning, Print Services require that you include:

a printed candidate list in candidate number order

and a printed candidate list in candidate name order.
You cannot print candidate lists from Multiquest prior to the examination being
scanned, but these lists can be printed from your Excel file at this stage and
clearly annotated by hand after the exam to show those who were absent.

3.1 If the candidate list in Excel contains formulae (for instance, concatenation formulae
created in Task 2 on page 4), the data must first be copied to another worksheet as
values only. To do this in the example spreadsheet:

Select the Your Work sheet.

Select the entire candidate list (A1:B6) and from the Edit menu, choose Copy.

Select the Final Version sheet.

Click on cell A1 and from the Edit menu, choose Paste Special.

Choose Values and then click OK.
3.2 To save the example candidate list as a tab delimited text file:

Ensure the Final Version sheet is selected.

From the File menu, choose Save As.

In Save as type, select Text (Tab delimited) (as in Figure 5).

Figure 5 – exporting candidate list from Excel as a tab-delimited text file

Supply a suitable file name (for example, Sci 1 candidates.txt) and

save to the folder C:\User\Multiquest\02_03\Vets\Sci_1. Two
warnings will be given as you save. Choose OK and Yes respectively.
Note The Excel file used in this practical work has four sheets, but when the exported file
is opened in another program such as Word or Multiquest it will show only the data
that was on the sheet that was active in Excel at the time of export.
3.3 Close the Excel worksheet (failure to do this will result in an error when you try
to open the exported file in Multiquest).

Multiquest Optical Mark Reader (omr-t1) 7

Task 4 Setting a new exam in Multiquest
Objectives To create new (unpopulated) response files for an examination which specify, for the
OMR machine, your exam style and candidate list. These files will be sent to Print
Services on floppy disk along with the student answer sheets for scanning.

Warning You should prepare your response files (this task) and master answer sheet
(Task 6 on page 16) well in advance of the examination - although these will not
be required until after the exam it is wise to allow ample time for problems to be
resolved.

Method In Multiquest, you will choose the exam style (here, 50 questions with 5 parts each) ,
set other options, import a tab delimited candidate list, and create the response files.
Comments The name of the exam should be in the following format:
Unit name Year of study Paper number Exam date
For instance, Sci 1 paper 1 220503
The exam name should be used consistently throughout and quoted on all materials
sent to Print Services (see Appendix A).
This document illustrates how to set up a 50 TFD MCQ examination, which allows
for up to 50 questions, each with up to five parts (A-E), each part to be marked True,
False or Don’t Know (TFD). An image of the answer sheet for this style of exam is
shown in Figure 18 on page 17.
You obtain answer sheets from Print Services on the Print Services Request Form
Part 1: Request for Student Answer Sheet supply (Appendix B).
Multiquest and the OMR machine need to be told how to interpret the machine-
readable answer sheets. This is achieved by the use of decodes, which are files
installed in the Multiquest program folder. Each style of examination, for instance,
50 TFD, requires its own decode. The available decodes are installed when
Multiquest is first installed on the PC and additional decodes may be copied to the
Multiquest program folder later (for instance, if a new style of answer sheet is
introduced then the appropriate decode for it must be obtained from the OMR pages
on the web at http://www.bristol.ac.uk/omr).
Note The names of the decodes currently used in the University are shown below,
corresponding to the available styles of answer sheet.

Multiquest decode Style of exam answer sheet Order as

Bristol Physiology – 50 TFD 50 question, 5 part, True, False, Don’t know 50TFD
Bristol Anatomy – 60 A to E 60 question, 5 part, single choice MCQ 60A-E
Medical 130 A to Z 130 extended matching index questions 130EMI

Do not use decodes with names other than the above unless you understand why that
decode is installed on your PC and why and when you might use it.

The available styles of answer sheet may be viewed at

http://www.bristol.ac.uk/omr/Documents and ordered using the code
above. Additional explanation and instructions for using the 130EMI style of
examination question are at http://www.bristol.ac.uk/omr/EMI/

The names of the decodes cannot be changed, although any department may use them.

Multiquest Optical Mark Reader (omr-t1) 8

 4.1 Start Speedwell’s Multiquest
4.2 To create a new examination in Multiquest (Figure 6):

Click the New button (top left).

Select an existing examination style decode. On the OMR training course we
will use Bristol - Physiology 50 TFD.

Click the New button (bottom right) to create the exam

1. Click New

2. Select a decode

3. Click New

Figure 6 – selecting the decode required to set up for your style of exam

4.3 Enter the exam details in the Select Sheet/Master Exam dialog box (Figure 7):

Figure 7 – supplying details of the exam

Enter the exam name in the form Unit name Year of study Paper number Date,
in this case Sci 1 paper 1 220503

In Column Heading, type Total.
This will be used as a column heading in various reports.

First Response should contain 1.
Responses in an exam are always numbered from 1, this being the first response
on the first paper.

In Number of Responses, type 250
See the explanation of this field in the note below.

Multiquest Optical Mark Reader (omr-t1) 9


The Weighted Score Range is normally 0 – 100.
The weighted score is the score given to a candidate who gains full marks. A
weighted score of 100 gives scores as percentages.

Note Be careful when setting the Number of Responses. This tells the OMR machine
how far down the answer sheet it needs to read. A response is a single answer given
by the candidate. A question on the paper may have five parts, in which case there are
five responses to that question. So, if your exam has 50 questions, each with 5 parts
(A-E, each of which may be answered T, F or D), the number of responses is
50 x 5 =250 (even though the questions may be numbered from 1 to 50 on the paper).
This tells the machine to read the first 250 positions on the answer sheet grid and then
stop (see the example answer sheet, Figure 18 on page 17).

If you set only 40 questions, each with 5 options, the machine needs to know to stop
reading when it has reached the point on the answer sheet at the end of
40 x 5 = 200 positions on the answer sheet grid (i.e., up to part E of question 40).

However, if you set 40 questions but decide only to have 4 parts to each question
(A-D), the number of responses is the same as if you had set 5 parts (A-E), i.e.:
40 x 5 = 200. This is because the machine still counts along all the possible positions
on the answer sheet grid (whether or not they are used for answers) and will know it
has reached part E of question 40 at this stage.

If you set question with only 4 parts, A-D, ensure the students are told that they
must not make any mark under option E on their answer sheet.
4.4 Use the Define button to look up the Grade Scheme and only create a new one if
necessary. A grade scheme shows the scores needed to a get a First, Upper Second
etc. It is used only in reporting and helps to show the spread of degree classes
(Figure 8)

Figure 8 – grade scheme for the exam(s)

4.5 To set up a grade scheme for the first time:

Click New (Figure 8).

Enter your faculty as the name of the scheme.

Multiquest Optical Mark Reader (omr-t1) 10


Choose Weighted and Greater or Equal.

Type in appropriate Grades and Values.

Click Save.

Click OK. You are returned to the Select Sheet/Master Exam dialog box
(Figure 7).
4.6 When you have set up your exam, in the Select Sheet/Master Exam dialog
box, click Save. The exam name will appear as an item in the left hand window.

Note If you want to set up sub-exams (optional), you should do so at this point by
following the instructions in Task 15 on page 32.
4.7 Click OK. You are now asked to save the new response files. Proceed as below.

Navigate to the folder in which you wish to save the files (eg,
\Multiquest\02_03\Vets\Sci_1)

Supply a filename (eg: Sci 1 paper 1 220503). Multiquest creates three
response files with that name and extensions .RES, .RST and .RSX.

Figure 9 – saving the response files for the exam

Note The name given to the response files (Figure 9) should be the same as the exam name
you supplied to Multiquest in step 4.3 on page 9.

Click on Save. You will then see the window shown in Figure 10 and can
import the candidate list you exported from Excel in Task 3 on page 7.

Figure 10 – Multiquest is ready to import the candidate list

Note The choices made up to now can be changed before the exam is taken by using
File/New, selecting the exam name from the list and clicking Edit. The set up after
this point (i.e., the candidate list) cannot be changed, so the exam would need to be set
up from scratch to incorporate new candidates. Candidates who have withdrawn can just
be marked as absentees on the printed candidate listings prepared for Print Services.

Multiquest Optical Mark Reader (omr-t1) 11

 Importing the candidate list
4.8 Import the candidate list at the window shown below, as follows:

From the Data menu, select Import Candidate List.

Select ASCII.

Click Setup. You will see a list of the folders in the Multiquest folder.

Navigate to your candidate file (tab delimited text file) in
\Multiquest\02_03\Vets\Sci_1

Select the candidate file (Sci 1 candidates.txt)

Click the Open button. (Figure 11).

Figure 11 – opening the text file containing the candidate list

Note If you can’t see the candidates file, either you are looking in the wrong place or you
did not save the Excel file as a text (tab delimited) file. If you can see the file but
can’t open it, this is because the exported worksheet is still open in Excel and must be
closed before Multiquest can use the file.
4.9 You are now presented with three successive windows.

In the first window (Figure 12), choose Delimited then Next.

Delimited

Figure 12 – importing the candidate list into Multiquest, step 1 of 3

Multiquest Optical Mark Reader (omr-t1) 12


In the second window (Figure 13), tick Tab and First Row Contains
Field Names, but uncheck Comma, then click Next.

First row

Tab

Not comma

Figure 13 – importing the candidate list into Multiquest, step 2 of 3

In the third window (Figure 14), leave Auto set and and click Finish.

Auto

Figure 14 – importing the candidate list into Multiquest, step 3 of 3

Note If you see the error message Field name missing this is because you exported
columns from your Excel worksheet that do not have column headers. You can
proceed by clicking Back, unselecting First row contains field names.
Then, in step 4.10 on page 14, match the incoming unlabelled fields (Field 1, etc.)

Multiquest Optical Mark Reader (omr-t1) 13

 4.10 The Database Import Setup Box will appear (Figure 15).

Use the dropdown box to the right of Cand No. to match your Excel column
Candidate No to the Multiquest Cand No field.

Match your Excel Candidate Name to Mulitquest’s Candidate Name field.

Figure 15 – database import setup, matching the incoming fields

When done, click OK. You will see the imported list of candidates (Figure 16).

Figure 16 – importing the candidate list

Click OK again.
4.11 Close Multiquest.

Multiquest Optical Mark Reader (omr-t1) 14

Task 5 Copying the response files to
floppy disk
Objectives The unpopulated response files must be sent to Print Services on a clearly labelled
floppy disk along with the master and student answer sheets and printed
candidate/absentee lists (Appendix A). During marking the response files are
populated with students’ marks and then returned to you.
Method Using Windows Explorer or My Computer.
Comments The floppy disk must be labelled as shown below and kept securely in your
department until after the examination.

5.1 Open Windows Explorer or My Computer and locate the three response files that
have been created (Figure 17 - in Computer Centre Training Rooms these will be in
C:\User\Multiquest\02_03\Vets\Sci_1). The response files all have the
same filename (the name of the exam) but different extensions (.RES, .RST and .RSX).

Figure 17 – using Windows Explorer or My Computer to locate and copy the response files

5.2 Copy all three response files to a floppy disk.

Note You can select all three files for copying by clicking on the first and, with the <Ctrl>
key held down, clicking on the second and third files.
5.3 Label the floppy disk with:
• Name of the person responsible for exam.
• Internal phone number of that person.
• Faculty and Department
• Name of the exam

Note If you are on a training course you may also wish to copy and take away with you the
practice candidate list (Sci 1 candidates.xls) and the three practice
populated response files named Sci 2 paper 2 270503 which are in the folder
C:\User\Multiquest\02_03\Vets\Sci_2.

Multiquest Optical Mark Reader (omr-t1) 15

Task 6 Filling in the master answer
sheet
Objectives To understand how to fill in a master answer sheet.
Method You will discuss the sample 50 TFD answer sheet shown in Figure 18 on page 17.
Comments The correct responses to the examination questions should be marked on a blank
answer sheet that is designated the master answer sheet by giving it a candidate
number of eight zeros (00000000). However, if you wish to use variable marking
with Extended Matching Index Questions (130 EMI), it will not be possible to use a
Master Answer Sheet. Instructions on how to indicate the marks for variable marking
130 EMI are given at http://www.bris.ac.uk/omr/EMI/
Supply other exam details on the master as shown in Figure 18 on page 17. You can
find unit codes at http://www.bristol.ac.uk/tsu/unitcat
You will find examples and instructions for ordering and using all the available types
of answer sheet at http://www.bristol.ac.uk/omr/Documents
Note Unit organisers must verify that the master answer sheet is marked up correctly (i.e.,
T’s and F’s in the right places).

Keep the master answer sheet securely in the department. After the exam, send it to
Print Services along with all the student answer sheets and floppy disk containing the
unpopulated response files. The master answer sheet is fed through the OMR
machine at the start of marking.

Warning It is essential that no text or other marks are written outside the boxes on the
master answer sheet or the paper will be invalidated. Take care not to damage
the black track marks down the right hand side, or to dog-ear the page corners.

6.1 See Figure 18, page 17. You would fill in the following details:
• Master Answer Sheet in the Candidate Name box
• Name of the exam – the same as the exam filename,
for instance, Sci 1 paper 1 220503
• Candidate Number. The master is always 00000000. Enter the digits and
cross through the numbers as shown in the figure
• Unit code or programme name
• Exam date
6.2 For each question, mark each option A-E correctly as True or False by making a
horizontal line though T or F with an HB pencil. The machine will read ink but if any
mistakes are made in pen they will be difficult to rectify.
Note If you have only 40 questions and have used an exam style with up to 50 questions,
leave the last 10 questions blank. If questions have only 4 parts (A-D) then leave
option E blank on the master answer sheet. The OMR machine knows how many
questions to expect from the Number of Responses you specified in step 4.3
on page 9.

Multiquest Optical Mark Reader (omr-t1) 16

 CANDIDATE NAME
MASTER ANSWER SHEET SCI 1 PAPER1 220503

0 0 0 0 0 0 0 0 OR
PROGRAMME

22/05/03

Figure 18 - 50 TDF Answer sheet (filled in as a master answer sheet, with question 1 completed)

Multiquest Optical Mark Reader (omr-t1) 17

Task 7 Providing instructions to
students
Objectives To understand the instructions to be given students about completing answer sheets.
Method You will discuss the instructions for students at
http://www.bristol.ac.uk/omr/Documents.
Comments Invigilators should ensure that students have clear instructions. It is essential that no
text or other marks are written outside the boxes on the student answer sheet.
Students and others should take care not to damage the black track marks down the
right hand side, and not to bend or fold the forms or dog-ear the page corners.
If you set questions with only 4 parts, A-D, ensure the students are told that they must
not make any mark under option E on their answer sheet.

Warning If the forms are badly treated, or if students are poorly instructed in how to fill
in the answer sheets, the number of errors that pause the OMR machine and
require operator intervention will be large. Scanning times in excess of 15
minutes will be charged extra. For further details see
http://www.bristol.ac.uk/omr/Costs/

7.1 Examine the answer sheet shown in Figure 18 on page 17. For each question,
students should mark each option A-E as True or False or Don’t know by
making a horizontal line though T or F or D with an HB pencil.

Note It is important that students use pencil (HB preferred) to mark the answer sheet as
this allows errors to be corrected easily using a rubber.
7.2 A common reason for the OMR machine to reject an entire student answer sheet is
failure by the student to correctly fill in their candidate number.

It is crucial that
students fill in Current University 5-digit
the ‘candidate 0 2 4 6 8 0 0 0 candidate numbers must be
number’ box expanded to 8 digits by
correctly. adding trailing zeros and
marking these on the grid. If
For example, a any candidate number
student with the column is empty the answer
candidate sheet will be rejected by the
number 02468 OMR machine.
would fill in the
box thus:

Figure 19 – filling in the candidate number

The above illustration is available at

http://www.bristol.ac.uk/omr/Documents as a wordprocessed
document (Rich Text Format, .RTF) that can be adapted by the department as a
handout for students.
7.3 Departments are responsible for ensuring that blank answer sheets arrive in the
Examination Hall and for instructing invigilators in the use and care of the sheets.

Multiquest Optical Mark Reader (omr-t1) 18

Task 8 The marking and return of the
examination
Objectives To understand what needs to be sent to Print Services immediately after the exam,
what may be required of your department during marking, and what will be returned
to your department after successful marking.
Method You will discuss the procedures summarised in steps 0 to 0 in the Timetable of events
(Appendix ).
Comments Print Services will not return answer sheets and populated response files to the
department until all the answer sheets have been scanned. If a candidate number or
damaged answer sheet cannot be read by the OMR machine the contact person for the
examination will be required to attend a ‘surgery’ at Print Services.

8.1 After the exam, hand deliver to Print Services (in a box to avoid damage):
• The Master Answer Sheet, marked up as described in Task 6 on page 16.
• All completed Student Answer Sheets
• A floppy disk, labelled as shown in Task 5 on page 15, containing the
unpopulated response files created in Task 4 on page 8.
• Two printed listings of candidates (one in candidate number
order, the other in candidate name order), with absentees clearly marked.
These can be printed from the Excel file exported during Task 3 on page 7.
• A completed Print Services Request Form Part 2: Scanning of Answer
Sheets (Appendix B)
Note There is a Print Services Job Number (4 digits) on the Print Services Request Form. It is
essential to use the same Job Number (i.e., the same multi-part form) when requesting a
supply of answer sheets for an exam (by completing Part 1) and when requesting scanning
of the answer sheets for that exam (by completing Part 2 of the same Request Form
whose Part 1 was used to order the answer sheets for that particular examination).

If any answer sheets have failed to scan

8.2 The registered contact person for the examination will receive an email asking them to
ring to make an appointment for an academic to visit Print Services. Print Services will
advise on the steps necessary to ensure successful scanning of flawed answer sheets
(which may involve correcting Candidate Numbers and/or transcribing a student's
responses onto a fresh answer sheet). When all flawed sheets have been rescanned, all
items listed above will be returned to the department using secure delivery procedures.

When all the answer sheets have been scanned

8.3 You will receive back from Print Services, using secure delivery services:
• The Master Answer Sheet
• All the Student Answer Sheets, in two piles:
1) marked OK
2) had minor errors that can be corrected in the department (see Task 10 on page 21)
• The floppy disk containing the response files, now populated with the results
• The printed listings of candidates

Multiquest Optical Mark Reader (omr-t1) 19

Task 9 Copying response files to the
Multiquest filing system
Objectives The populated response files returned to you on floppy disk must be copied back to
your Multiquest filing system.
Method Using Windows Explorer or My Computer.
Comments Allow the populated response files to overwrite the unpopulated files of the same
name.

Warning NEVER OPEN THE RESPONSE FILES FROM THE FLOPPY DISK AS THIS
WILL CORRUPT THEM!

Note The exam data is not kept long term by Print Services. It is the department's
responsibility to securely store and archive the files. Loss of electronic files may
require re-scanning of the student answer sheets at the department's expense.

Note There is no need to do the steps below on the training course.

9.1 Use Windows Explorer or My Computer to copy the three populated response
files (.RES, .RST and .RSX) to the appropriate examination folder in your
Multiquest filing system, overwriting the unpopulated versions.
9.2 It is advisable to take an interim archive copy (backup) at this stage. For further
information on archiving, see
http://www.bristol.ac.uk/omr/Technical/
9.3 Lock away or reformat the floppy disk when the files have been copied.

Multiquest Optical Mark Reader (omr-t1) 20

Task 10 Correcting unscanned student
responses
Objectives To deal with student answers that the OMR machine has been unable to mark.
Method You will use Multiquest’s Responses option to manually amend a response file.
Comments Sometimes student responses to one or a few questions cannot be scanned by the
OMR machine. Multiquest defines a data error as, ‘missing responses or multiple
responses for the same question’ (e.g., because the student did not make a clear
horizontal strike through a single chosen option, or their answer sheet is dirty).
A member of academic staff should examine all data errors and make an informed
decision about how to treat them. The decision will be a matter of interpretation of
the candidates’ intentions (for instance, it may be clear that a student had intended to
change their answer to a certain one, but had not completely rubbed-out their first
response). When the intended answers are identified, these should be entered via
Multiquest into the populated response files. If the students’ intentions are not clear
then D (don’t know) might have to be entered.

Note To enable easy identification of scanning errors, Print Services will put a ring in
black ink on the student answer sheet around affected Question Number(s).

Warning All manually-entered corrections should be noted and signed on the reverse of
the student’s answer sheet.

10.1 In Multiquest, open the populated response file, for instance,

\Multiquest\02_03\Vets\Sci_2\Sci 2 paper 2 270503.RES.
You will see the columns of students’ numbers and names (Figure 20).

Figure 20 – selecting candidates in Multiquest

10.2 Select the candidate whose unscanned responses you want to enter manually, e.g.:
10462000, INCH, Stephanie

Multiquest Optical Mark Reader (omr-t1) 21

 Note You can use the Search menu to quickly locate candidates by name or number (Figure 22).

10.3 With the required candidate selected, press <Enter> or click on the Resps button to
open the candidate data window (Figure 21), which is a grid of that candidate’s
responses (Question numbers X Question parts)

Note Data errors will show as > and in a different colour (by default, red).

10.4 Click on the Next Error button to quickly find the first data error (unscanned
response) within the record of the candidate that is currently displayed.

Data error (response not scanned)

- missing data shown as >

This exam had only 4 parts per

question - unfilled data shown as <

Figure 21 – candidate data (responses)

10.5 Replace the contents of cells with data errors with F or T or D (your interpretation of
the student’s intended response). For example, for Stephanie Inch:

Replace part C of Question 15 with D (for Don’t know).

Click on any other cell in the grid to see that Multiquest has changed the colour
of the altered response for auditing purposes (by default, to blue).
Note In Multiquest you cannot use arrow or tab keys to move between data cells.

Replace part B of Question 20 with T (for True).

When finished with that candidate, click OK.

Note and sign for each correction on the reverse of the candidate’s answer sheet.
10.6 Find and correct all other scanning errors for this exam.

Note Candidate data can be searched for errors or for changes from the Search menu.

Figure 22 – searching for candidates, candidate errors, and changes to candidate data

Multiquest Optical Mark Reader (omr-t1) 22

Task 11 Generating reports
Objectives To examine and customise several Multiquest reports.
Method You will use Multiquest’s Print Reports facility.
Comments The detail and statistical basis of reports is beyond the scope of this document. For
further information on the report types see Multiquest help:
Help / Contents / Multiquest Features / Reporting Files

11.1 If it is not already open in Multiquest, open the populated response file, e.g.:
\Multiquest\02_03\Vets\Sci_2\Sci 2 paper 2 270503.RES.
You will see the columns of students’ numbers and names. If you wish to report on only
selected candidates, double click the check box next to their numbers (Figure 23).

Figure 23 – to report on selected candidates, double-click the check box to the left

11.2 Prior to generating reports it is advisable to check the weight given to particular responses.
Note Print Services set up the marking scheme for each exam when its Master answer sheet is
scanned, according to the preference you expressed on the Request Form Part 2:
Scanning of Answer Sheets. The score is 1 for each correct answer and 0 for
each wrong or don’t know answer, unless you asked for negative marking (in which
case the score is –1 for each wrong answer, with don’t know still scored as 0).
To check the marking scheme:

Click the Scores button. You will see the Correct Answers window and
can view (or adjust) the mark given for correct, incorrect and don’t know
answers (as described further in Task 12.3 on page 27).

Figure 24 – checking the marking scheme (in the Scores window)

When finished, click Cancel (or OK to accept any changes you made).

Multiquest Optical Mark Reader (omr-t1) 23

 11.3 Click on the Print button for the Print Reports window, with available reports.

Figure 25 – reports available in Multiquest

11.4 Look at any report, as follows:

Select a report from the list of Available Reports

Click on Print. You are asked to select some characteristics for the report

Select the Output Device (on training courses this should be Screen)

Figure 26 – setup for reports, selecting the output device

When ready to view the report, click on OK.

When you have finished viewing a report on screen, click Close.
Note Some reports are long (for instance, the Performance Breakdown report). It is
recommended that you first preview reports on the screen before printing them.

Multiquest Optical Mark Reader (omr-t1) 24

 11.5 View the following reports on the screen:

Candidate Listing
This shows the summarised exam results.

Figure 27 – candidate listing report. Note the zoom and page buttons (bottom left)

Absentee Report
Check this against the absentee list sent in to Print Services. If they do not tally
an answer sheet may have been lost.

Performance Breakdown Report
This is a detailed report that can run to hundreds of pages. It is not
recommended that it is printed.

Score Distribution Histogram.

Correct Answers Report
This shows the responses on the master answer sheet.

Item Analysis Report.
In the Print Reports window (the one that lists the available reports) the
Options button (bottom left) allows you to alter characteristics of the report.
11.6 Change the Options of the Item Analysis Report to simplify the information
displayed and preview it again to see the changes. The recommended settings are:

Deselect Item Discrimination

Deselect Point Biserial Correlation Coefficient

Deselect Thirds Analysis Table.
11.7 Change the Options of the Candidate Listing report to alter the data sort
order and the columns (fields) shown. For instance:

Sort the candidates by their Score.

Delete the column Total Raw Score.

Add the column Total Percentage.

Preview the report again to see the changes.
11.8 When finished, close the Preview and Print Reports windows.

Multiquest Optical Mark Reader (omr-t1) 25

Task 12 Adjusting exam scores and
withdrawing questions
Objectives To adjust the master scoring scheme of the examination.
Method You will use Multiquest’s Scores facility.
Comments The examination should be scrutinised to identify any questions that may have been
inherently inappropriate or incorrect, or for which an incorrect answer may have been
entered on the master answer sheet. Once you have reviewed the examination results
you may want to adjust the weight given to particular responses (including by
negative marking), withdraw a question or question part from the examination, or
change a question part’s expected answer.
Following such adjustments, all reports that you subsequently print or data that you
export from Multiquest will be recalculated automatically.
Printed copies of the following will be needed by whoever scrutinises the questions
and answers in the examination:
Item Analysis Report with options set as in Task 11.6 on page 25
Correct Answers Report (this is a printed version of the master answer sheet)
Score Distribution Histogram

Why might questions be withdrawn or master answers

corrected?
This is a good question and there is no single correct answer. If the item analysis
report shows that most students got a question wrong or declined to answer it
(especially if negatively marked) then it is good practice to review the question and
ask the following questions:
a. Is the expected answer the correct one? (transcription error on master answer sheet)
b. Is the question clear and unambiguous? (process of question revision)
c. Is the material covered by the lecturer? (curriculum content issue).
Regardless, if most students got it wrong then something is amiss and it might be
advisable to withdraw the question or correct the expected response on the master
answer sheet and draw it to the lecturer’s attention.

Warning Adjustments to the marking scheme should be done before final reports are
printed or data is exported from Multiquest to applications such as Excel.

Multiquest Optical Mark Reader (omr-t1) 26

 12.1 If it is not already open in Multiquest, open the populated response file
\Multiquest\02_03\Vets\Sci_2\Sci 2 paper 2 270503.RES.
You will see the columns of students’ numbers and names (Figure 28).

Figure 28 – response file open in Multiquest

12.2 To adjust the master marking scheme, click the Scores button.

To apply negative or weighted marking

12.3 To use negative marking, or to allocate more than one mark per correct answer:

In the Correct Answers box enter the score to be given for each correct
(for instance, 1.00 or 2.00) and incorrect answer (for instance, –1.00).

Figure 29 – Multiquest scores window (master answers)

To withdraw questions or parts

12.4 To withdraw a question part or a whole question, move the cursor to the question part
to be withdrawn and replace the F or T by a D. This will cause this part to have a zero
score in the examination. For instance:

Replace part A of Question 5 with D (withdraw part).

Replace all parts of Question 19 with D (withdraw question).

Preview the Item Analysis report and look at Questions 5 and 19 to see
that the relevant parts have been marked as withdrawn.
To change a question’s expected answer
12.5 As step 12.4 but replace T with F and F with T as appropriate.

Multiquest Optical Mark Reader (omr-t1) 27

Task 13 Exporting results to Excel
Objectives To export percentage scores to Excel for further manipulation.
Method You will use Multiquest’s Export command.
Comments Most papers marked by the OMR are just components in a larger examination and
scores need to be scaled and aggregated to obtain the overall mark for each student.
This generally means exporting exam scores into an application like Excel.
Multiquest supports quite sophisticated exports of scores, responses and statistics.

Creating the export file

13.1 If it is not already open in Multiquest, open the populated response file, for instance,
\Multiquest\02_03\Vets\Sci_2\Sci 2 paper 2 270503.RES.
13.2 From the File menu, select Export and ensure All Candidates is selected (Figure 30).

Figure 30 – Multiquest export options

Note If you wish to export only certain candidates, double click the check box next to their
candidate numbers and then export Selected Candidates
13.3 Ensure that the export will be to a comma-delimited file (or another type of your choice):

Click on the Record button to view the record layout options (Figure 31)

Ensure that Variable Length Fields and Export field names
as first row are checked.

Ensure that the Field Delimiter is set to Comma, then click OK.

Figure 31 – Multiquest export options (record layout)

Multiquest Optical Mark Reader (omr-t1) 28

 13.4 To select the fields that will be exported, click the Fields button to see the field
options (Figure 32). To export fields other than Candidate Number, Candidate
Name and Total Raw Score, select the field from Columns and click Add or
Delete. The columns (fields) are shown at the bottom of the box in the order they
will appear in the export file. So, to export percentage scores instead of raw score:

Delete the column Total Raw Score.

Add the column Total Percentage.

Ensure the required Sort Order is checked (eg, Candidate Name)

Figure 32 – Multiquest export options (fields)

Note To keep this export layout, click Save as and give a name to the layout. In future,
you will be able to select it from the Standard Layouts drop down list.

13.5 When finished with the export definition, click on OK.

13.6 Click on OK again to finish the export and:

Specify the folder to save to (this should be the same folder used for that exam’s
response files).

Name the file the same as the response file, but with the word Stats or
Marks as part of the name (Figure 33).

Then click Save.

Figure 33 – saving the exported data

Note The exported file will be given the extension .EXP.

Multiquest Optical Mark Reader (omr-t1) 29

 Opening exported files in Excel
13.7 Start Excel.
13.8 From the File menu, select Open.

Ensure you are looking for Files of Type All Files.

Navigate to the folder containing your exported file.

Select the file and click Open.
The Text Import Wizard will start.

At Step 1, choose Delimited, then click Next.

At Step 2, uncheck Tab and check Comma and, then click Next.

At Step 3 (Figure 34), click the Candidate No column and choose Text as
the Column Data Format (to ensure that leading zeros are not lost from
the number) and then click Finish.

2. Set to text

1. Click Candidate Number column

Figure 34 – Excel’s text import wizard, step 3 of 3

13.9 Save the file as an Excel file with an appropriate name.

Note If you subsequently resave the Excel file as a CSV file for use with other
applications, you will find that the CSV file, if re-opened in Excel will not show the
leading zeros for the candidate number. However, if the file is opened in Notepad it
can be seen that they are still there. If imported into a database, the leading zeros will
show if text format is chosen for the candidate number (or if number format is
specified as 00000). Leading zeros can be revealed in a CSV file that has been
opened in Excel by formatting the candidate numbers as follows:

Choose Format / Cells /Custom and type 00000000.

Multiquest Optical Mark Reader (omr-t1) 30

Task 14 Archiving the examination
Objectives To understand how to securely archive the examination results.
Method By discussion.
Comments It is the department’s responsibility to securely store and archive the examination
files. You are strongly advised to involve your department’s Computer Support
Officer when devising arrangements for secure archiving of files, and to read the
additional information on security and backup at:
http://www.bristol.ac.uk/omr/Technical/

Warning FLOPPY DISKS ARE EASILY CORRUPTED AND ARE NOT SUITABLE
FOR ARCHIVING.

14.1 Once you have finalised changes to the Multiquest response files and generated any
required Excel files of results, archive copies of at least the following files should be
created (or updated):
• The three Mulitquest response files for the exam (.RES, .RST and .RSX)
• Excel files (.XLS) containing finalised results
Note Two backup archive copies of populated response files should be kept (e.g. on CD)
and, preferably, stored in separate locations. Any copies on CD (or other removable
media) must be kept locked away and should be clearly labelled.
14.2 You may wish to tidy up the examination folder in your Multiquest filing system,
deleting any transitional files (e.g., export/import files).

Warning Remember that Windows delete commands do not fully erase data and may
preserve a copy in the Recycle Bin. It is advisable to reformat floppy disks used
to transport files used by Multiquest, or use a secure file deletion program to
completely destroy the files. The same considerations apply if a PC and/or
removable hard disk used for examination purposes is repurposed or scrapped.

Multiquest Optical Mark Reader (omr-t1) 31

Task 15 Setting sub-exams (optional)
Objectives To group an exam’s questions into sections, called sub-exams.
Method We will divide an example paper into two sub-exams.
Comments In a 40 question exam, you might wish to make the first 20 questions on anatomy and
the last 20 on physiology. If you wish to produce reports on student performance in
these sections separately, you must define them as sub-exams. You will still be able
to report on results in the main (overall) exam.

You should define your sub-exams at the time of setting up the exam
(as described in Task 4 on page 8, creating the sub-exams at the end of step 4.6 on
page 11). However, here you will add a sub-exam retrospectively.
15.1 In Multiquest’s Available Sheets/Exam Styles window (to get there, click
the New button), select the main exam for which you want to create sub-exams, for
instance, Sci 1 paper 1 220503.
15.2 Assume this is an exam with 40 questions of 5 options each, giving 200 responses in
all. The first 100 responses will be on anatomy, the last 100 on physiology. Click on
the New button and define the first sub-exam (anatomy), as follows:

Enter the name of the new sub-exam in the Name box on the right-hand side of
the screen, e.g., Section 1 of 2 Anatomy. This naming system will
prove invaluable on subsequent reports.

In Column Heading, type Total.

First Response should be 1.

Number of responses in this sub-exam is 100 (the first 20 questions of
5 parts each – for 4-part questions see the Warning on page 8).

Leave the Weighted Score Range (Percentage) as 0 – 100.

Choose the same grade scheme as you have used for the main exam.

Click the Save button. The newly defined sub-exam appears in the list on the
left-hand side of the screen below and to the right of the parent exam.
15.3 Repeat the above for physiology, making sure you create it as a sub-exam of Sci 1
paper 1 220503. The first response for this sub-section of the examination is
101, and the sub-exam has 100 responses (Figure 35).

Figure 35 – sub exams of Sci 1 paper 1 220505

15.4 Proceed from step 4.7 on page 11 (save the response file).

Multiquest Optical Mark Reader (omr-t1) 32

Task 16 Reporting sub-exams (optional)
Objectives To generate reports on sub-exams.
Method Using Multiquest’s Print facility.
Comments The exam file available for this course did not use sub-exams so this subject is
examined only in theory.

16.1 In Multiquest open the populated response file for the exam.
You will see the columns of students’ numbers and names.
16.2 If you wish to report on only selected candidates, double click the check box next to
their names.
16.3 Click on the Print icon. On the Exam drop down list you will see the main exam
and its sub-exams (Figure 36). Select the sub-exam whose results you wish to see.

Figure 36 – reporting on sub-exams

16.4 Select the report you wish to preview or print.

Multiquest Optical Mark Reader (omr-t1) 33

Appendix A Consistent exam names
Use the same name for the exam throughout
Unit name Year of study Date of exam e.g.: Sci 1 paper 1 220503 (meaning 22 May 2003)
Send items below to print services

Exam name in Multiquest (Task 4) Answer sheets

SCI 1 PAPER 1

22/05/03

Plus, similarly labelled:

2 candidate lists (name order/number order)
with absentees clearly marked.

Saving response files (Task 4.7) Order for scanning

SCI 1 PAPER 1 220503

Copying response files (Task 5) Labelled floppy disk

PAT BROWN
MEDICINE
PHYSIOLOGY
Tel: 9976
SCI 1 PAPER 1
220503

Multiquest Optical Mark Reader (omr-t1) A-1

 Job Number. Use the form to request answer sheets and scanning of those same answer sheets

0046
Appendix B

Multiquest Optical Mark Reader (omr-t1)

Request form

B-1
Appendix C Timetable of events
For example, the end of unit examination (May/June) would have this progression.

Prior to the examination To do this see: When?

1 Your department must register as an intending user www.bristol.ac.uk/omr/ As soon as
of the OMR Service. Registration will be Registration possible
acknowledged and your departments will be supplied
with Print Services Answer Sheet Request Forms
2 Ensure that the Multiquest software is installed on Task 1 on page 2
the PCs of everybody in your department who will PC Support Person
need it and that a secure Multiquest filing system is www.bristol.ac.uk/omr/
set up. Technical
3 Ensure that at least two key users from your www.bristol.ac.uk/omr/
department attend Multiquest training (mandatory). Training
4 Examination, agreed by internal and external March/ April
examiners, is passed to Examination Office.
5 Send an Answer Sheet Request Form with When the date
completed Part 1 (Request for Student Answer of the exam is
Sheet supply) to Print Services, stating: known.
the contact details of the exam contact It is essential
the exam details to carry out the
the number of answer sheets required (number of procedures in
students plus 10% for spoilage) this section
6 Print Services will book your scanning time and well in
send: advance of the
Student Answer Sheets exam as
Answer Sheet Request Form with the Job Number support in case
for the exam. of problems
7 Create a candidate list in Excel containing: Task 2 on page 4 cannot be
Candidate number guaranteed at
Candidate name (Surname Forename Middlename) short notice.
8 Export the candidate list as tab delimited text Task 3 on page 7
9 Set up a new exam in Multiquest using the New Task 4 on page 8
button and import the candidate list. (Sub exams:
(As required, set up sub-exams at this stage). Task 15 on page 32)
10 Copy the three resulting unpopulated response files Task 5 on page 15
(.RES .RST .RSX) to a floppy disk labelled thus:
Name of exam (same as filename) in the form
programme, year of study, date of examination
Person(s) responsible for exam/phone number
11 Use a blank answer sheet to create a paper master Task 6 on page 16
answer sheet that shows the correct answers. Unit
organiser must verify this is marked up correctly.
12 Keep the floppy disk and master answer sheet
securely in the department until after the exam.
13 Prepare instructions for students. Task 7 on page 18
14 Take answer sheets to the exam. Instruct invigilators. Task 7 on page 18 Day of exam

Multiquest Optical Mark Reader (omr-t1) C-1

 After the examination (scanning phase) To do this see: When?
15 Hand deliver the following to Print Services (in a box Task 8 on page 19 M
a
to avoid damage): y
Answer Sheet Request Form with the Job Number /
for the exam (as obtained in step 0 above) and J
u
completed Part 2 (Scanning of Answer Sheets). n
Use the checklist on this form to ensure that e
everything necessary is included in the box, namely:
Master Answer Sheet (created as in step 0 above)
Two paper listings of candidates, one in candidate
number order, the other in candidate name order
These can be a print off of your Excel file created in
step 0 above. Mark clearly those who were absent.
All completed Student Answer Sheets.
The floppy disk containing empty response files
(created and labelled as in step 0 above).
16 Print Services will scan the examination through the During your
OMR machine. booked slot
17 If any student answer sheets have unreadable Task 8 on page 19 Rescanning
Candidate Numbers or are flawed and have not clinic (as
scanned correctly (except for minor errors), the necessary)
registered contact person will receive an email asking
them to ring to make an appointment for an academic
to come in to Print Services to alter the candidate
numbers on the form. Print Services will advise on
the steps necessary to ensure successful scanning of
flawed answer sheets (which may involve
transcribing the student's responses onto a fresh
answer sheet).
18 When all answer sheets have been successfully Task 8 on page 19 When scanning
scanned (except for minor errors) you will receive is complete
back from Print Services:
Answer Sheet Request Form (one copy)
Master Answer Sheet
Two paper listings of candidates
Floppy disk containing the response files, now
populated with the results of the scanning.
All completed Student Answer Sheets.
in two piles:
1) marked OK
2) had minor errors.
19 Copy all three populated response files Task 9 on page 20
(.RES .RST .RSX) from the floppy disk to your
Multiquest filing system, overwriting the
unpopulated files of the same name.
NEVER OPEN THE FILES WHEN ON THE
DISKETTE AS THIS WILL CORRUPT THEM!
At this point it is advisable to make an archive www.bristol.ac.uk/omr/
(backup) copy of the populated response files. Technical

Multiquest Optical Mark Reader (omr-t1) C-2

 After the examination (analysis phase) To do this see: When?

20 If any student answer sheets were returned with minor Task 10 on page 21
errors (affected Question Numbers ringed in black),
members of academic staff must use informed
judgement to decide how treat these unscanned
responses and the Multiquest Resps facility used to
manually correct the candidate data.

21 Examine relevant exam reports using the Multiquest Task 11 on page 23

Print and Preview facilities. (Sub exams:
(and sub-exams if these were set up in step 0 above) Task 16 on page 33)
22 If necessary use the Multiquest Scores facility to Task 12 on page 26 Prior to
adjust the master marking scheme of the examination finalising the
(e.g., to adjust the weighting of scores, introduce exam results
negative marking, withdraw questions and correct any
incorrect master answers).
23 If required, export the finalised results (e.g., the Total Task 13 on page 28
Percentage scores) to Excel.
24 Make a secure archive copy of the finalised Task 14 on page 31 After the exam
examination response files (.RES .RST .RSX) and www.bristol.ac.uk/omr/ results have
Excel (.XLS) files. Technical been finalised
25 You may wish to tidy up the examination folder in Task 14 on page 31
your Multiquest filing system, deleting any transitional www.bristol.ac.uk/omr/
files (e.g., export/import files). Technical
Be aware that Windows may copy deleted files to
the recycle bin.

Multiquest Optical Mark Reader (omr-t1) C-3