Frequently asked questions about test processing
Q. Where can I order test forms?
A. At room 5416.0258, Landleven 1. For more information: phone: 3636605/3633640.
Q. What do test forms cost?
A. There are both Dutch and English answer forms. Both cost €0.15 each. The forms are sold in packages of 500.
Q. What are the costs involved in test processing?
A. We charge 37.50 for the processing of a standard test-homogenous, no different versions, a maximum of 100 students and a maximum of 71 questions. A re-analysis of the test costs 22.50 euro and grade calculation costs 37.50. We also calculate a surcharge for more time-consuming attributes of the test (e.g. different versions, more than 71 questions). A list of different surcharges can be requested at firstname.lastname@example.org.
Q. What are important considerations when making test questions?
A. It is important that there is only one correct answer per question and that there are no more than four alternatives per question. The questions should be representative of the subject matter and the formulation should be concise and clear.
The distracting alternatives should be realistic alternatives. When you cannot think of sufficient reasonable alternatives, make a question with fewer alternatives. It is a misunderstanding that all questions need to have the same number of alternatives; the number of alternatives may vary within an test.
The UCLT offers a course on multiple choice questions twice a year in which you will receive more information on making test questions. The book “Toetsen in het hoger onderwijs” (“Testing in Higher Education”) by W. Bender (Koninklijke Van Gorcum 2003, ISBN 90 232 3939 3) also gives much practical information on the construction of tests, but is available in Dutch only.
Q. What is the procedure when the test has different versions, i.e., the students receive the same questions but not in the same order?
A. If the test has multiple versions it is of the utmost importance that all students indicate the number of their version on the form (above the student number, in the English form this is called “test number”). When the test number has not been filled in, the form cannot be processed.
Moreover, the teacher has to indicate, when handing in the forms and the answer key, how the versions can be converted into version 1. For example: questions 1 to 16 in version 2 are questions 17 to 32 in version 1, etc. There is a maximum of eight blocks of questions that can be transposed in relation to each other. Questions cannot be randomly mixed.
Q. What if the test has been taken by several different groups of students?
A. If the test is not identical for the different groups, e.g. if some of the students dare allowed to skip a number of questions, these different groups cannot be processed simultaneously and the forms have to be delivered separately per group. When you want to keep the different groups of students separate for a different reason, for example due to a difference in branch of study or location of study, the forms also have to be delivered separately.
On request (this can be indicated on the answer key ) an aggregate test analysis for the different groups may be done afterwards.
Q. Where and when do I hand in the forms for processing?
A. At the UCLT desk on Landleven 1 (first floor). The desk is usually open from Monday to Friday from 8.30 am to 5 pm, and can be reached at 3632000.
Q. How do I hand in the filled-in test forms?
A. In an envelope or box, along with:
- the name of the course and the faculty
- the test date
- the name, email address, and telephone number of the corresponding teacher
- the answer key, a list of the correct answers. Particulars, such as when two alternatives are correct or a question needs to be excluded from analysis, have to be clearly indicated on the answer key.
- whether or not you would like to receive the results by email (as opposed to on a floppy disk).
- in case of different versions (also check the question on versions) please add the coding of the versions (in other words, where did question 1 in version 1 end up in version 2?, etc.)
- when groups of students need to be analysed separately, the forms also have to be handed in separately (also check the question on this matter)
- when students are informed that a question will be excluded from the test prior or during the test itself, please inform us, about this to prevent problems in scanning the test forms.
Q. How long does it take to process a test?
A. We guarantee that your test is processed in three workdays. Tests are always processed in order of delivery.
Q. What does the processing of an test entail?
A. The answers on the forms are scanned by an optical mark reader. The data files thus produced are combined with the answer key using special analysis software. This program yields the scores per student number and an item analysis of the test (statistical information for each question and on the test as a whole).
Q. How do I know that the test has been processed?
A. All people whose e-mail address were listed at drop-off of the filled-in test forms receive an email notification, either with the test results attached or with the message that the test has been processed and is ready to be picked up. In this case the test results can be found on a floppy with the answer forms.
Also, you can check the status of your test at the list of tests processed at our website. Tests are listed with the test number assigned at the drop-off of the answer forms.
Q. Is it possible to receive the results by email?
A. Yes. Results will be sent by email if you indicate your wish to that respect on the answer key. Ofcourse, you will still need to pick up the test forms at the UCLT (see below as well).
Q. What will happen with the forms?
A. Along with the email notification sent when your test has been processed, you will receive a collection notice with which you can collect your answer forms at the UCLT. Alternatively, you can ask the transport service (phone 3635522) to pick up the forms (costs of transport are not included in test processing). In that case, you will have to forward your collection notice to the transport service. We do not send test forms by internal mail for security reasons.
Q. Is it possible to calculate grades along with the scores?
A. Yes. We use two ‘standard’ formulas to calculate marks from scores, one on a linear basis and one on a ‘passing score’(the fail/pass threshold) approach. If you specify on the answer key which formula to use –one of ours, or one you formulated yourself- then we will also calculate the marks.
Q. What if I want to remove questions or alter the answer key post-hoc?
A. We can re-analyse your test using the new and improved answer key. We need a written request for re-analysis to avoid confusion over which question(s) need to be altered. Requests can be emailed at email@example.com
Q. I cannot open the files that contain the results. What should I do?
A. The files are in ASCII-text format, but Windows will most likely not recognise them as such. You can open them using Notepad, Wordpad, or any plain text viewer of your choice.
Q. I do not understand the item analysis.
A. To have the item analysis explained to you, you can call us at 3634834, 3633640 or 3633645 between 9 am and 2.30 am. You can also receive advice on mark calculation and the quality of the test.
Q. How can I reach you?
A. We are available every workday at the telephone numbers above. You can also reach us at our joint email address: firstname.lastname@example.org.
|Last modified:||21 November 2018 3.22 p.m.|