
Multiple-Choice (MC) items have many advantages that make them widely used and highly regarded. They also have disadvantages, some of which can be reduced by careful attention to good item-writing and item analysis practice.
Advantages of Multiple-Choice Items
Versatility -- MC items are adaptable to the measurement of a wide variety of learning outcomes including reasoning, making inferences, solving problems, exercising judgment and demonstrating knowledge of facts through interpretation and analysis of information.
Efficiency -- Because of the large number of items that can be posed in a given length of time, MC items permit wide sampling and broad coverage of the content domain.
Scoring accuracy and economy -- Expert agreement on the correct answer to MC items is easy to obtain, and machine or clerical assistants can economically apply scoring keys.
Reliability -- Consistency in scoring and wide sampling of content provide test results that can be generalized to the domain of interest. < /p>
Diagnosis -- Patterns of incorrect responses can provide diagnostic information about the learning of individual students or groups.
Control of difficulty -- The level of difficulty of a test can be increased or decreased by adjusting the degree of similarity among the options to the items.
Reduction of guessing -- In comparison with two-choice (e.g., true-false) tests, guessing is reduced with MC items.
Freedom from response sets -- MC items are relatively uninfluenced by response sets, such as a tendency to answer "true."
Amenable to item analysis -- Item analysis have means by which they can be improved.
Multiple-choice tests are difficult and time consuming to write. The construction of plausible distracters is especially difficult. The quality of the test is therefore dependent on the item-writing skill of the instructor.
There is a tendency to write items requiring only factual knowledge rather than higher-level skills and understandings.
Performance on MC items can be influenced by student characteristics unrelated to the subject of measurement, such as reading ability, deductive reasoning, the use of context clues and risk-taking.
MC items are subject to clueing.
MC items do not measure ability to organize and express ideas.
Write items that deal with significant facts or concepts, not trivial questions or overly specific details.
Write items that have a definite answer. Students may be asked to select either the correct answer or the best answer. The former instruction is usually more suitable for items dealing with factual knowledge, where the correct answer is a matter of record. For items dealing with interpretation, understanding, or inference, instruction to select the best answer is usually preferred.
Communicate clearly. The wording and presentation of the items should not present obstacles to the students' ability to demonstrate what they know. The item should be written in clear language with vocabulary, other than the vocabulary being tested, that is as simple and precise as possible.
Don't give away the answer by including irrelevant cues in the item.
Don't write items that require skills or knowledge irrelevant to what you are trying to measure.
Don't use language that may be offensive to some groups.
Have items reviewed by knowledgeable persons other than the composer of the question if possible.
Multiple-Choice items consist of two parts: the stem and the response options. The stem presents the question or problem. The options include the correct or best answer--the keyed response--and the distracters or foils.
Write an item as either a direct question (Who was the first President of the United States?) or an incomplete statement (The first President of the United States was ________). Often one form or the other will produce simpler and clearer wording. If not, the question form may be easier for the writer and more straightforward for the student.
Present a single, complete problem or question in the stem. Most of the reading should be in the stem.
Eliminate excess wording; include only what is necessary to present the problem or question.
Include in the stem all the information needed to arrive at an unambiguous answer to the item.
Include in the stem any words that would be repeated in each option.
Use an introductory sentence for the item if it seems useful. Two sentences may express the problem more clearly than one.
Write completion items with the blank at the end rather than the beginning or middle of the sentence.
Avoid the use of negative wording in items. If negatives are necessary, emphasize them with bolding, underlining or capitalization. Do not use negatives in either the stem or the response because double negatives can be confusing.
Do not write items that require a series of true-false answers, i.e., questions of the form: "Which of the following is true?"
Make sure that items are independent. The information in one item should not supply the answer to another.
To test understanding and interpretation rather than factual knowledge, ask the questions "How?" and "Why?" rather than "Who?" and "When".
Consider variations on the simple MC format:
Present material to be interpreted--such as a reading passage, a table, a graph, and a map--and base several items on it (being careful about guideline 10, above).
Use the same set of response options for several items, presenting the options first, in effect creating a small matching task.
Present items in analogy form: a is to b as 1 is to _____.
Be sure there is one best response to the item. Options must be mutually exclusive and not overlap.
Make the length of the options comparable. Avoid over qualifying the keyed response.
Make the options parallel in form.
Make all options grammatically consistent with the stem.
Don't use absolute language, such as "never" and "always" as a means of making options incorrect.
Don't repeat key words from the stem in the keyed option.
Don't use stereotyped language that may cue the keyed option.
Make the distracters plausible and equally attractive to students who do not know the correct response.
Use 3-5 options. Four or five options are desirable to reduce guessing, but a good item with three options can be useful. Do not discard an item with only three good options or add implausible options, but make the number of options consistent.
List the options in a logical order if there is one.
Present the options in a list format rather than in a paragraph with the stem.
Distribute the correct option randomly among the option positions.
Don't make the options overly wordy or confusing.
Don't use "All of the above" as an option. "None of the above" should not be used as an option with "best answer" items but can be used effectively with computational items.
Sometimes it may be easier to write correct than incorrect options for an item. It is legitimate to ask students to choose the option that is not correct, but heed the caveats regarding negatives in item stem guideline 8, above.
It can be helpful to define the class of things to which the correct answer belongs, and then write distracters based on members of that class.
Consider as distracters responses that are correct but do not answer the question posed by the stem.
Obtain distracters from responses of students to items administered in completion or short answer form.