first real crowdsourced eval

6 Prompts

11 models

Completed

Save this link to find your results later

Download results JSON

CSV: one row per individual rating. JSON: the full results — eval settings, Elo scores with confidence intervals, and every rating with image URLs. Images remain available for at least 5 years after creation.

Elo scores

Each bar spans a 95% credible interval; the dot marks the mean. Hover for exact values.

Cost vs. Elo score

Generated images

eggs with legs

a hog on a jog with his dog through a smoggy bog while a frog on a log looks on…

Corporate man, extra corporate

A diagram of the process of making this image

A keyboard for hieroglyphics

Japanese game show with three men fighting; one dressed as a rock, one as paper…

“eggs with legs”

${'text': 'eggs with legs', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'eggs with legs', 'image_s3_key': None} — Kling V3$

Kling V3

${'text': 'eggs with legs', 'image_s3_key': None} — Flux.2 Pro$

Flux.2 Pro

${'text': 'eggs with legs', 'image_s3_key': None} — GPT Image 1.5 (High Fidelity)$

GPT Image 1.5 (High Fidelity)

${'text': 'eggs with legs', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'eggs with legs', 'image_s3_key': None} — Gemini 3 Pro Image$

Gemini 3 Pro Image

${'text': 'eggs with legs', 'image_s3_key': None} — Nano Banana Pro (Gemini 3 Pro)$

Nano Banana Pro (Gemini 3 Pro)

${'text': 'eggs with legs', 'image_s3_key': None} — GPT-5 Image$

GPT-5 Image

${'text': 'eggs with legs', 'image_s3_key': None} — Grok Imagine Image$

Grok Imagine Image

${'text': 'eggs with legs', 'image_s3_key': None} — Seedream 4.5$

Seedream 4.5

${'text': 'eggs with legs', 'image_s3_key': None} — MiniMax Image$

MiniMax Image

Flux.2 Flex

Kling V3

Flux.2 Pro

GPT Image 1.5 (High Fidelity)

Flux.2 Max

Gemini 3 Pro Image

Nano Banana Pro (Gemini 3 Pro)

GPT-5 Image

Grok Imagine Image

Seedream 4.5

MiniMax Image

“a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog”

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Kling V3$

Kling V3

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Flux.2 Pro$

Flux.2 Pro

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — GPT Image 1.5 (High Fidelity)$

GPT Image 1.5 (High Fidelity)

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Gemini 3 Pro Image$

Gemini 3 Pro Image

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Nano Banana Pro (Gemini 3 Pro)$

Nano Banana Pro (Gemini 3 Pro)

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — GPT-5 Image$

GPT-5 Image

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Grok Imagine Image$

Grok Imagine Image

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — Seedream 4.5$

Seedream 4.5

${'text': 'a hog on a jog with his dog through a smoggy bog while a frog on a log looks on agog', 'image_s3_key': None} — MiniMax Image$

MiniMax Image