Assessment Design

Question Writing

25 min

Simple Explanation

Question writing (item writing) is the craft of creating assessment tasks that validly and reliably elicit evidence of learner competence. Good items are clear, fair, appropriately demanding, and aligned to criteria.

Professional Definition

Item writing is the systematic process of creating assessment tasks that measure specific constructs, criteria, and AOs. It requires clarity of language, appropriate cognitive demand, freedom from bias, and alignment with mark schemes.

Explain It to a 10-Year-Old

Writing a good question is like setting a fair puzzle. The solver should be challenged by the puzzle itself, not by confusing instructions, trick wording, or irrelevant information.

Why It Matters

Poorly written items produce unreliable results. If a question is ambiguous, different learners interpret it differently. If it contains bias, some groups are unfairly disadvantaged. Both threaten validity.

Where It Fits in the Process

This topic belongs to Assessment Design in the assessment development journey.

Assessment Strategy Assessment Methods Blueprint Question Writing Validity Reliability

Step-by-Step Process

1
Understand the criterion

What construct and verb does it demand?

2
Draft the item

Write the question stem, context, and task

3
Draft the mark scheme

What would a good answer look like?

4
Self-review against checklist

Clarity, demand, accessibility, bias

5
Peer/SME review

Get feedback before items go live

Worked Example

Weak question: 'Discuss digital tools.' — Vague, no scope, no context.
Strong question: 'A small business is choosing between cloud-based and locally installed software for managing customer records. Evaluate the suitability of each approach, considering cost, accessibility, and security. Recommend one approach with justification. (12 marks)'
Clear context, specific verb, defined scope, known mark allocation.

Common Mistakes

MistakeProblemBetter Approach
Writing before blueprint approval Items may not match criteria or AOs Blueprint defines what items to write — do that first
Making items too wordy Excessive context obscures the actual task Keep context relevant and concise
Embedding clues in the question Accidental hints reduce validity Review for unintended clues

Checklist

of 4 complete

Related Tool

Apply what you learned with a practical tool.

Open Blueprint Builder

Interview Connection

You may be asked about this topic in assessment developer interviews.

Practice Interview Questions

Knowledge Check (3 Questions)

You scored %

Summary

  • Good items are clear, specific, and unambiguous
  • Items should test the construct, not reading comprehension
  • Context should support the question, not distract from it
  • Command verb must match the item type and mark allocation
  • Every item should have a draft mark scheme before review