ACX complex compositionality eval

5 Prompts

10 models

Completed

Save this link to find your results later

Download results JSON

CSV: one row per individual rating. JSON: the full results — eval settings, Elo scores with confidence intervals, and every rating with image URLs. Images remain available for at least 5 years after creation.

Elo scores

Each bar spans a 95% credible interval; the dot marks the mean. Hover for exact values.

Cost vs. Elo score

Generated images

A 3D render of an astronaut in space holding a fox wearing lipstick

A digital art picture of a child riding a llama with a bell on its tail through…

A stained glass picture of a woman in a library with a raven on her shoulder wi…

An oil painting of a man in a factory looking at a cat wearing a top hat

pixel art of a farmer in a cathedral holding a red basketball

“A 3D render of an astronaut in space holding a fox wearing lipstick”

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Seedream 4.5$

Seedream 4.5

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Flux.1 Schnell$

Flux.1 Schnell

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Flux.2 Klein 4B$

Flux.2 Klein 4B

${'text': 'A 3D render of an astronaut in space holding a fox wearing lipstick', 'image_s3_key': None} — Bagel$

Bagel

“A digital art picture of a child riding a llama with a bell on its tail through the desert”

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Seedream 4.5$

Seedream 4.5

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Flux.1 Schnell$

Flux.1 Schnell

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Flux.2 Klein 4B$

Flux.2 Klein 4B

${'text': 'A digital art picture of a child riding a llama with a bell on its tail through the desert', 'image_s3_key': None} — Bagel$

Bagel

“A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth”

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Seedream 4.5$

Seedream 4.5

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — SD 3.5 Large$

SD 3.5 Large

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Flux.1 Schnell$

Flux.1 Schnell

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Flux.2 Klein 4B$

Flux.2 Klein 4B

${'text': 'A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth', 'image_s3_key': None} — Qwen Image$

Qwen Image

“An oil painting of a man in a factory looking at a cat wearing a top hat”

${'text': 'An oil painting of a man in a factory looking at a cat wearing a top hat', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

“pixel art of a farmer in a cathedral holding a red basketball”

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Flux.2 Max$

Flux.2 Max

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Flux.2 Flex$

Flux.2 Flex

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Flux.1 Schnell$

Flux.1 Schnell

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Flux.2 Klein 4B$

Flux.2 Klein 4B

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Qwen Image$

Qwen Image

${'text': 'pixel art of a farmer in a cathedral holding a red basketball', 'image_s3_key': None} — Bagel$

Bagel

Navigation

Legal

ACX complex compositionality eval

Elo scores

Cost vs. Elo score

Generated images