A team claims its new dashboard "helps city officials make better decisions". Which evaluation provides the most relevant evidence?
Q2
What is the main purpose of a think-aloud usability test?
Q3
A participant gives SUS ratings 4, 2, 4, 2, 4, 2, 4, 2, 4, 2 (items 1–10). What is the SUS score?
Q4
Approximately what SUS score is considered average?
Q5
Why report the median task time rather than the mean in small usability tests?
Q6
In a within-subjects study comparing a table and a chart, what is counterbalancing?
Q7
What is the main advantage of a between-subjects design?
Q8
Eight participants were faster with a chart than a table by 10.6 s on average, 95 % CI [6.4, 14.9] s. What is the best reading?
Q9
A comparison yields a 95 % CI of [−6.7, 9.2] s for the time difference. What can you conclude?
Q10
Why should effect sizes and confidence intervals accompany p-values?
Q11
A study measures 20 different metrics and reports the one with p < 0.05 as the main result. What is the problem?
Q12
App routing beats manual routing on weekdays (93 % vs. 87 %) and on weekends (73 % vs. 69 %), but manual routing looks better overall (83 % vs. 78 %). What explains this?
Q13
Which title best follows the "titles state the message" rule?
Q14
In Segel and Heer's narrative visualization framework, a martini glass structure:
Q15
Which is not one of Segel and Heer's narrative visualization genres?
Q16
What makes a bootstrap confidence interval reproducible?
Q17
Which practice best ensures that a classmate can regenerate your figures six months later?
Q18
A notebook works only when cells are run in a particular non-linear order. What should you do before sharing it?
Q19
Which item is required ethically before running a usability study with students or city staff?
Q20
For a public article about air quality, which way of showing uncertainty is usually most understandable?
Q21
An AI tool drafted the narrative text of your data story. What does responsible disclosure include?
Q22
Formative usability testing is best described as:
Q23
Which evaluation method suits the claim "our encoding lets people compare values more accurately", tested with hundreds of participants quickly?
Q24
Insight-based evaluation measures:
Q25
An annotated chart highlights one district in colour and shows the other five in light grey. Which storytelling technique is this?
Q26
Why should evaluation analyses be planned before collecting data?
Q27
A result did not support your design (no reliable difference). What should the report do?
Q28Short answer
You compared two CityPulse dashboards with 6 participants (3 each) on three tasks. Results: A — 6/9 tasks completed, median time 55 s, 1.33 errors per attempt, SUS 71.7; B — 8/9, 42.5 s, 0.44 errors, SUS 87.5. "Locate" was the hardest task (50 % overall). Write the results paragraph for a report, including limitations and next steps.
Q29Short answer
A colleague's chart shows overall success rates (manual 82.6 %, app 78.0 %) with the title "Manual routing works better". The breakdown is: weekdays app 81/87, manual 234/270; weekends app 192/263, manual 55/80. Explain what is wrong, compute the group rates, and redesign the chart and title.
Q30Short answer
List what a reproducibility package for your CityPulse visualization project should contain, and explain for each item which failure it prevents.