Navigation

How it works All evals My evals

Legal

Terms of Service Privacy Policy

Evaluate Image Models

Test and evaluate which models perform best for your prompts.
Unique name for this evaluation experiment. Save this to reference and share your eval results.
Upload a .txt (one prompt per line), or a .csv with optional image and question columns — select its .zip of reference images together with the CSV.

Custom Models

Select at least 2 models to compare.

model selected
Raters will be asked: Select the image you prefer as a completion of the prompt: “{prompt}” Raters will be asked: Select the image that more accurately and completely depicts the prompt: “{prompt}” Raters will be asked: Select the image with higher overall quality — sharper detail and fewer artifacts or distortions. Raters will be asked: Select the image you find more beautiful or visually appealing. Raters will be asked: Select the image that looks more like a real photograph or human-made artwork. Raters answer your question for every image pair.
Write {prompt} to insert the prompt text into your question.
Who judges the image comparisons — crowdsourced human raters or an AI vision model.
Number of images to generate for each model/prompt combination. More images yields a more accurate estimate of model performance.
How many head-to-head comparisons each model participates in. More comparisons yields higher confidence in the final ranking.

Prompts
·
models
·
Overall preference Prompt adherence Image quality Aesthetics Realism Custom question
Image generation
Images
Comparisons
Total