True/false questions have been used within paper-based and digital assessments for longer than I can remember. As an instructional designer they are easy to design, a single question or statement, with a simple two-option answer structure (eg. True or False, Yes or No, Option 1 or Option 2). Digital assessments and automated marking have made this question type even more popular, as they have a simple predefined correct answer and they can be easily marked by a computer, freeing up the teacher/marker to work on other things. However, there are some downsides to the true/false question, which could impact the robustness of your assessment and the knowledge your learners retain.
While a multiple-choice question will on average have four or more options, a true/false question has only two. In an assessment this means, regardless of the learner’s knowledge of the topic, they have a fifty per cent chance of correctly answering this question. If you are using this question to assess a learner’s understanding of a particular learning outcome, how can you know for sure that they have truly achieved mastery and have not simply had a moment of luck?
Multiple-choice questions still allow for automated digital marking but the chance of guessing the correct answer are greatly reduced. Also, the format of a multiple-choice question allows for much more complex question design and the ability to create powerful answer options (when well-written of course).
What will your learners remember?
True/false questions are often framed as a statement, with the learner asked to decide whether the statement is true or false. What will your learners remember in the days, weeks, months following the completion of your learning content: the statement you provided or whether they selected true or false (and which option was correct)?
True or False –
The average winter temperature in Melbourne, Australia is 27 degrees Celsius.
Take the statement above. As a question, it is a simple (and incorrect) statement about the weather in Melbourne. Do you think if you were not familiar with the weather in this area that you would remember which option you selected, or would the number 27 be forever stuck in your long-term memory? Consider the impact this will potentially have on your learners; they may pass the assessment but in the long term retain the incorrect information. Imagine if this was related to critical safety or medical training, the impact of poorly retained information could be quite dangerous.
Different question types work best for different types of content and the desired learning outcomes. However, true/false questions are a question type best kept for self-assessments/knowledge checks, not formal assessments. When designing your next assessment, ask yourself this, are true/false questions the best way to assess knowledge and embed learning?
- Beware of the gap – Considering the digital literacy of your learners – 20th October 2020
- Is ‘All of the above’ an effective question option? – 20th September 2020
- Asking why? – Solution-focused learning design – 20th August 2020