THINK FIRST·CODE LATER

← Interactive Information Visualization
Chapter 14 · Week 14

Evaluation, Storytelling and Reproducibility

Answered 0/30 Correct 0
Sign in to save progress across devices
Q1

A team claims its new dashboard "helps city officials make better decisions". Which evaluation provides the most relevant evidence?

Q2

What is the main purpose of a think-aloud usability test?

Q3

A participant gives SUS ratings 4, 2, 4, 2, 4, 2, 4, 2, 4, 2 (items 1–10). What is the SUS score?

Q4

Approximately what SUS score is considered average?

Q5

Why report the median task time rather than the mean in small usability tests?

Q6

In a within-subjects study comparing a table and a chart, what is counterbalancing?

Q7

What is the main advantage of a between-subjects design?

Q8

Eight participants were faster with a chart than a table by 10.6 s on average, 95 % CI [6.4, 14.9] s. What is the best reading?

Q9

A comparison yields a 95 % CI of [−6.7, 9.2] s for the time difference. What can you conclude?

Q10

Why should effect sizes and confidence intervals accompany p-values?

Q11

A study measures 20 different metrics and reports the one with p < 0.05 as the main result. What is the problem?

Q12

App routing beats manual routing on weekdays (93 % vs. 87 %) and on weekends (73 % vs. 69 %), but manual routing looks better overall (83 % vs. 78 %). What explains this?

Q13

Which title best follows the "titles state the message" rule?

Q14

In Segel and Heer's narrative visualization framework, a martini glass structure:

Q15

Which is not one of Segel and Heer's narrative visualization genres?

Q16

What makes a bootstrap confidence interval reproducible?

Q17

Which practice best ensures that a classmate can regenerate your figures six months later?

Q18

A notebook works only when cells are run in a particular non-linear order. What should you do before sharing it?

Q19

Which item is required ethically before running a usability study with students or city staff?

Q20

For a public article about air quality, which way of showing uncertainty is usually most understandable?

Q21

An AI tool drafted the narrative text of your data story. What does responsible disclosure include?

Q22

Formative usability testing is best described as:

Q23

Which evaluation method suits the claim "our encoding lets people compare values more accurately", tested with hundreds of participants quickly?

Q24

Insight-based evaluation measures:

Q25

An annotated chart highlights one district in colour and shows the other five in light grey. Which storytelling technique is this?

Q26

Why should evaluation analyses be planned before collecting data?

Q27

A result did not support your design (no reliable difference). What should the report do?

Q28 Short answer

You compared two CityPulse dashboards with 6 participants (3 each) on three tasks. Results: A — 6/9 tasks completed, median time 55 s, 1.33 errors per attempt, SUS 71.7; B — 8/9, 42.5 s, 0.44 errors, SUS 87.5. "Locate" was the hardest task (50 % overall). Write the results paragraph for a report, including limitations and next steps.

Q29 Short answer

A colleague's chart shows overall success rates (manual 82.6 %, app 78.0 %) with the title "Manual routing works better". The breakdown is: weekdays app 81/87, manual 234/270; weekends app 192/263, manual 55/80. Explain what is wrong, compute the group rates, and redesign the chart and title.

Q30 Short answer

List what a reproducibility package for your CityPulse visualization project should contain, and explain for each item which failure it prevents.