Model Overall Basic Following Advanced Following Designer
Avg Attribute Relation Reasoning Avg Attribute
+Relation
Attribute
+Reasoning
Relation
+Reasoning
Style Text Real World
short long short long short long short long short long short long short long short long short long short long short long short long
Diffusion based Models (GPT-4o Evaluation)
FLUX.1 dev 63.4767.32 70.0371.84 77.7578.80 78.0278.67 54.3158.04 62.6965.11 66.9569.74 60.9960.75 62.4764.66 63.3372.67 43.2558.91 64.1463.65
SD 3 66.8363.69 70.2369.73 80.0578.15 76.1474.83 54.5056.22 64.9664.62 72.8872.48 59.4461.39 62.1063.15 75.3377.00 58.2426.87 62.7863.15
SD 3.5 69.5964.96 71.7470.07 80.2578.35 78.6175.61 56.3856.24 66.9062.69 73.4168.33 60.7357.30 64.5162.95 78.3371.67 71.7949.76 62.2864.39
SANA 1.5 65.1762.17 70.1869.03 76.8575.25 78.7377.60 54.9754.23 65.7562.45 72.4268.66 63.8461.76 63.6960.66 93.0081.00 16.9114.13 66.1366.25
Playground v2 46.3054.63 53.1063.31 55.7567.00 63.4473.87 40.1149.06 44.9754.82 50.9063.34 39.4849.99 46.9554.37 69.3381.67 1.102.16 49.6350.25
Playground v2.5 46.3454.04 54.3363.04 57.7569.25 63.3274.07 41.9045.79 45.4154.31 53.1463.90 39.6949.52 46.4052.45 65.3380.00 1.485.08 48.0146.28
PixArt-delta 43.3248.92 50.6255.52 50.5554.90 62.8668.07 38.4443.60 42.0547.37 47.4551.38 37.4043.00 43.5048.74 66.3385.67 0.191.15 43.1843.80
PixArt-alpha 45.8351.12 52.2757.87 54.9558.75 63.0270.34 38.8344.53 45.1750.04 52.7956.62 39.7645.80 45.9149.27 66.0086.00 0.721.39 50.5047.39
PixArt-sigma 58.1758.80 64.8867.21 70.3075.00 71.5974.88 52.7551.75 58.8058.09 65.1365.74 56.0854.86 58.2856.80 89.3387.33 3.453.88 56.5858.93
LUMINA-Next 50.3749.83 57.3257.49 61.2060.85 64.9366.54 45.8345.08 50.2748.23 55.2554.13 45.8443.07 52.5549.70 77.0077.67 1.010.96 49.7550.50
Hunyuan-DiT 50.2253.63 61.9264.57 66.8571.35 70.9273.45 48.0048.92 52.8652.94 61.3759.52 49.9948.51 53.4153.71 55.6781.67 0.621.01 45.1644.54
AR based Models (GPT-4o Evaluation)
Llamagen 40.4039.85 48.4250.75 45.7054.15 60.9658.56 38.5839.55 39.7538.77 42.3438.69 37.4837.57 42.5843.87 53.0045.00 1.101.96 41.8139.33
LightGen 52.7746.31 61.4951.68 65.9058.80 69.2654.94 49.3041.31 54.0146.14 59.1648.93 52.3845.41 55.2947.55 67.0058.00 2.636.47 53.9755.33
Show-o 56.9458.17 66.2869.56 72.2078.30 74.0876.52 52.5653.85 59.4658.76 66.9266.38 56.0355.72 61.2959.31 68.6772.00 3.164.65 57.5756.82
Infinity 63.1160.83 69.5567.02 75.7076.15 78.1874.27 54.7750.63 64.5860.95 70.9868.94 62.2558.42 63.8758.33 81.0079.67 21.1719.54 60.0561.54
Janus-Pro 64.4162.19 70.9768.15 77.1076.55 76.8476.45 58.9851.45 64.9362.87 71.7671.59 61.8859.57 64.4860.46 71.0068.33 32.1433.19 65.5162.16