ACX complex compositionality

Comparison
5 prompts
·
42 models
Raters are asked: Select the image you prefer as a completion of the prompt: “{prompt}”
Completed

Add more comparisons

More comparisons tighten the confidence intervals on each model's Elo score.
Total
additional comparisons

Elo scores

Each bar spans a 95% credible interval; the dot marks the mean. Hover for exact values.

Cost vs. Elo score