We applied DracoGPT using experimental data from Younghoon Kim et al. (EuroVis'18) that spans a variety of plots, data distributions, and tasks (comparing individual values vs. aggregate properties). The plots show chart "scores" from two GPT-4 Turbo prompting methods vs. human performance data.

People are now using LLMs to create charts and graphs. How might we assess the quality and consistency of the results? DracoGPT is a method that fits a visualization knowledge base (Draco) to LLM responses, enabling comparison across models, prompts, and results from human subjects experiments.