Design (and, if you have access to an AI assistant, run on a small scale) an experiment comparing three ways of asking an AI tool for CityPulse charts: (P1) the question only; (P2) the question plus the data schema (columns, types, units, example values); (P3) P2 plus the task in visualization vocabulary ("compare distributions…").
- State the hypotheses.
- Define the question set (at least 20 questions of varying difficulty), the gold standard and the procedure (model, temperature, repetitions).
- Define the metrics (validity, schema errors, exact/component/execution accuracy, design-lint issues, human ratings).
- Describe how you will analyse the results and the threats to validity.
- If you ran it: report your results in a table and discuss them.