REVIEW 4 major objections 6 minor 1 cited by
Can Text-to-Image Generative Models Accurately Depict Age? A Comparative Study on Synthetic Portrait Generation and Age Estimation
T0 review · 4 major / 6 minor · reviewed 2026-08-09 · deepseek-v4-flash
Pith's one-line read The paper claims that text-to-image models can generate plausible faces with varied identities, but their depictions of a specified age are off by three to five years on average, so synthetic portraits are not yet reliable for high-stakes…
desk verdict A genuinely large synthetic-portrait benchmark whose headline MAE numbers are undercut by unvalidated age estimators, so the paper's central attribution of error to generators does not yet hold. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The measurement pipeline is the prompt-to-estimator loop. A fixed prompt template ('Photorealistic selfie photo of a [age]-year-old [nationality] [gender] person, centered, high-resolution') is used to generate 12,960 portraits with three text-to-image models; two age estimators, MiVOLO-D1 and JAM, then produce a predicted age for each face. The argument is carried by the comparison between those predicted ages and the prompted age, summarized as MAE, RMSE, Pearson correlation, per-age-bucket and per-demographic breakdowns, and regression diagnostics. The load-bearing assumption is that the prompted age is the ground truth, so every reported error measures how far the generated face is from the age it was asked to show.
What would settle it
Take a subset of the generated portraits to human raters and ask them to estimate each face's age: if human estimates match the prompt ages closely while MiVOLO-D1 and JAM still show MAEs of 3 to 5 years, the paper's conclusion that generators fail at age depiction would be weakened, because the estimators themselves would be the untested link.
Extended reading notes
Core claim
On its own terms, the paper shows that text-to-image generators can produce faces with varied identities, but the age those faces appear to be is only loosely controlled by the prompt. Across 12,960 prompts spanning 30 ages from 10 to 78, 212 nationalities, and both genders, the two age estimators give mean absolute errors between 2.99 and 5.26 years depending on the generator and estimator, with Epic Realism the most accurate and FLUX.1-dev the least. Older prompts (60+) show the largest errors and the most erratic correlations, and both estimators reveal gender and regional offsets in synthetic faces that the authors say are larger than what the same estimator shows on real faces. The conclusion the authors draw is that age fidelity, not identity fidelity, is the weak point of current text-to-image models for biometric use.
Load-bearing premise
The entire comparison treats the prompt age as ground truth and the two estimators' outputs as accurate measurements of the apparent age of synthetic faces, even though neither estimator was calibrated or validated on synthetic images.
Editorial extensions
If this is right
- Age-estimation practitioners should not use text-to-image portraits as ground-truth training data without per-image filtering or calibration.
- Teams choosing a generator for age-sensitive work should prefer Epic Realism over FLUX.1-dev based on these error ranges, and should treat 60+ prompts as unreliable.
- Age-verification systems that use synthetic data should only act on large age mismatches, since small-to-moderate errors are common.
- The reported pattern motivates post-hoc correction or targeted prompt engineering for the older-age range, where MAE and correlation degrade most.
- Synthetic portraits remain usable for exploratory tasks where approximate age distributions are enough.
Reading between the lines
- A direct extension the authors leave open is a human-rater study on a sample of the same portraits; it would separate generator error from estimator miscalibration on synthetic faces.
- The same prompt protocol could be rerun on newer text-to-image models to see whether age fidelity improves or whether the reported gender and regional offsets persist.
- If the pattern generalizes, prompt-age error could serve as a cheap, image-only proxy for demographic fairness auditing of generative models, since systematic MAE offsets by gender and region are measurable without real-image data.
- Adding known-age real portraits through the same estimators would provide a baseline the paper does not include, clarifying how much of the reported error is specific to synthetic faces.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper evaluates whether three text-to-image models (FLUX.1-dev, Stable Diffusion 3.5 Large, and SDXL Epic Realism) can generate portraits matching a specified age. The authors construct 12,960 prompts spanning 30 ages from 10 to 78, 212 nationalities, and both genders; generate one image per prompt; and score the resulting faces with two age estimators, MiVOLO-D1 and JAM. They report MAE, RMSE, and Pearson correlation for each estimator-generator pair, finding the best alignment for Epic Realism (MAE 2.99 with MiVOLO-D1, 3.52 with JAM) and the worst for Flux (MAE 5.26 and 4.68), with larger errors and low correlations at age extremes, demographic biases, and a small fraction of decade-level outliers. They conclude that current synthetic portraits are too unreliable for high-stakes age-related tasks without significant filtering and curation.
Significance. The study addresses a timely and practical question, and its breadth is a genuine strength: 30 ages, 212 nationalities, three generators, two estimators, and demographic subgroup analyses. The authors are appropriately cautious in their conclusion and provide useful diagnostics beyond global metrics, including age-bucket breakdowns, outlier counts, and regression slopes. However, the central claim depends on treating age-estimator outputs on synthetic faces as ground-truth apparent age; no human-rater validation, no calibration of the estimators on synthetic images, and no quantitative real-image baseline are provided. Because both estimators are trained predominantly on real photographs and one is proprietary and co-authored by the same team, the reported MAE range is best interpreted as a joint generator-estimator alignment score. If the estimator domain-shift concern is addressed with perceptual ratings or a real-image control, the paper would be a sound and useful cautionary benchmark for practitioners.
major comments (4)
- [Section III.B and Section IV.A] The paper's load-bearing assumption is stated in Section III.B: 'we treat the prompted age as the ground truth,' and then all MAE/RMSE/correlation values in Table IV are computed against the outputs of MiVOLO-D1 and JAM. This assumes both estimators are unbiased readers of apparent age on synthetic faces, but no evidence for that assumption is provided. Age estimators trained on real photographs are known to compress toward the training distribution on out-of-distribution inputs, which would produce exactly the pattern reported here: overestimated young prompts, underestimated old prompts, inflated MAE, and low correlation at age extremes. The authors themselves flag in Ethical Impact C that age estimation accuracy may decrease in older populations. The authors should add a synthetic-image calibration using human perceptual age ratings and/or a quantitative real-portrait baseline scored by the same estimators. Without such controls, the headline 2.99-5.26 year MAE range cannot be attributed to generator failure rather than evaluator domain shift.
- [Section III.B and reference [12]] JAM is a proprietary age estimator developed by members of the author team (reference [12]), and the paper provides no architecture, training data description, or reported performance on synthetic images. Section IV.A uses JAM as one of two judges for every generator ranking, yet an independent reader cannot reproduce or scrutinize its behavior. Section IV.B claims that JAM 'broadly tracks age variations' on real-life production data but gives no quantitative results for that claim. The authors should either disclose sufficient technical detail about JAM, base the main claims on publicly available estimators with published error characteristics, or add a table comparing JAM's real-image MAE/correlation by age bucket so that estimator bias can be separated from generator error. This is a transparency and reproducibility issue, not a novelty issue.
- [Section IV.A (Table IV) and Section IV.D] Table IV reports large differences between generator-estimator combinations (e.g., Epic Realism MAE 2.99 versus Flux MAE 5.26 for MiVOLO-D1), but no confidence intervals, standard errors, or sample-size information are given for these metrics. The t-tests mentioned in Section IV.D are not reported with test statistics, p-values, or multiple-comparison corrections. Since the relative ranking of generators is a central conclusion, the authors should provide bootstrap confidence intervals for MAE/RMSE/correlation and a table of the t-test results. In addition, the age-bucket correlations in Section IV.B are computed within narrow 10-year ranges, which mechanically restricts the achievable correlation; the interpretation that generators 'struggle to differentiate subtle changes' should be checked against the estimator's own consistency on real faces over the same age spans.
- [Abstract and Section V] The abstract and conclusion claim that text-to-image models 'can consistently generate faces reflecting different identities' and preserve 'identity-related cues,' but no identity-consistency metric appears in the methodology. The experiments vary age, nationality, and gender in prompts, yet there is no face-recognition embedding similarity measure, no repeated-generation test, and no controlled comparison linking the same identity across conditions. This positive claim is presented alongside the main negative result, so it should either be removed or supported with a concrete measurement; as written, it exceeds the evidence in the paper.
minor comments (6)
- [Section III.A] The text says '30 distinct ages from 10 to 78,' but 10 through 78 inclusive contains 69 integer ages; the authors should list the specific 30 ages or explain the sampling rule to remove ambiguity.
- [Section IV.B] The age-bucket narrative discusses 10-19, 20-29, 30-39, 40-49, 50-59, and 70-79 but skips 60-69; the authors should clarify whether the 60-69 bucket was omitted, merged, or simply not highlighted.
- [Section IV.C] The outlier definition uses a deviation threshold of 'more than 11 years' without justification; a brief rationale or a sensitivity analysis for thresholds such as 8, 10, and 12 years would strengthen the robustness of the outlier discussion.
- [Ethical Impact Statement, Section A] The sentence beginning 'One aspect to assess from a risk perspective is potential bias...' is duplicated verbatim in the same section; the duplicate should be removed.
- [Figure 2] The scatter plots would be easier to interpret if each panel included the MAE, sample size, and regression equation, and if the axis labels and point density (e.g., alpha or hex-bin) were specified.
- [General] No code or dataset is provided, and the dataset is only 'aimed' to be released in the future; given the paper's benchmarking character, releasing prompts, generation parameters, and per-image age estimates would materially improve reproducibility.
Circularity Check
No circular derivation: the MAE/RMSE comparisons are an external benchmark of T2I age fidelity, with only a minor self-citation (JAM) that is not load-bearing.
full rationale
The paper's quantitative claims are an empirical comparison between prompted ages and the outputs of two age-estimation models, MiVOLO-D1 (external) and JAM (the authors' proprietary model). No parameter is fitted from the reported test data and then renamed a prediction; no equation defines the conclusion in terms of itself; no uniqueness theorem or ansatz is imported from prior author work. The step 'we treat the prompted age as the ground truth' is a transparent operational convention rather than a hidden self-reference, because the prompted age is an independent input to the generation process, not an output of the estimator being evaluated. The only mild self-citation concern is that JAM, one of the two judges, is the authors' own model and is supported mainly by a statement about real-world and NIST performance rather than by a calibration study on synthetic faces. That is a measurement-validity threat for external validity, but it does not make the derivation circular because MiVOLO-D1 independently corroborates the headline pattern and the numerical results are not constructed to equal their own inputs. The authors' own caveat that age estimation accuracy may decrease in older populations reinforces the validity concern without establishing circularity. No circular step meets the evidentiary bar, so score 2 reflects the minor self-citation rather than a circular derivation.
Assumptions & free parameters
free parameters (1)
- Outlier deviation threshold =
11 years
assumptions (5)
- domain assumption Predicted ages from MiVOLO-D1 and JAM are valid measures of the apparent age of synthetic faces.
- domain assumption The prompt age is the correct target age for each synthetic portrait.
- domain assumption Nationality and gender labels in prompts are faithfully rendered in the generated faces.
- standard math The reported t-tests and linear regressions satisfy standard statistical assumptions.
- domain assumption The real-life production data used as a comparison is a fair baseline.
Cite this review
Pith. "Pith review of Can Text-to-Image Generative Models Accurately Depict Age? A Comparative Study on Synthetic Portrait Generation and Age Estimation." pith.science (2026). https://pith.science/paper/Z4QCS5CT
@misc{pith2026250203420,
author = {Pith},
title = {Pith review of: Can Text-to-Image Generative Models Accurately Depict Age? A Comparative Study on Synthetic Portrait Generation and Age Estimation},
year = {2026},
howpublished = {\url{https://pith.science/paper/Z4QCS5CT}},
note = {Machine review of arXiv:2502.03420}
}
read the original abstract
Text-to-image generative models have shown remarkable progress in producing diverse and photorealistic outputs. In this paper, we present a comprehensive analysis of their effectiveness in creating synthetic portraits that accurately represent various demographic attributes, with a special focus on age, nationality, and gender. Our evaluation employs prompts specifying detailed profiles (e.g., Photorealistic selfie photo of a 32-year-old Canadian male), covering a broad spectrum of 212 nationalities, 30 distinct ages from 10 to 78, and balanced gender representation. We compare the generated images against ground truth age estimates from two established age estimation models to assess how faithfully age is depicted. Our findings reveal that although text-to-image models can consistently generate faces reflecting different identities, the accuracy with which they capture specific ages and do so across diverse demographic backgrounds remains highly variable. These results suggest that current synthetic data may be insufficiently reliable for high-stakes age-related tasks requiring robust precision, unless practitioners are prepared to invest in significant filtering and curation. Nevertheless, they may still be useful in less sensitive or exploratory applications, where absolute age precision is not critical.
Figures
Forward citations
Cited by 1 Pith paper
-
FLUXSynID: A Framework for Identity-Controlled Synthetic Face Generation with Document and Live Images
FLUXSynID generates paired document-style and live synthetic face images with user-controllable identity attributes and releases a dataset of 14,889 identities.
Reference graph
Works this paper leans on
-
[12]
Novikov, Ruslan Parkhomenko, Artem V oronin, and Alix Melchy
Franc ¸ois David, Alexey A. Novikov, Ruslan Parkhomenko, Artem V oronin, and Alix Melchy. Jam: A comprehensive model for age estimation, verification, and comparability, 2024
work page 2024
-
[1]
Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial networks, 2014
2014
-
[2]
Face aging with identity-preserved conditional generative adversarial networks
Xu Tang, Zongwei Wang, Weixin Luo, and Shenghua Gao. Face aging with identity-preserved conditional generative adversarial networks. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7939–7947, 2018
work page 2018
-
[3]
Face aging via diffusion- based editing, 2023
Xiangyi Chen and St ´ephane Lathuili `ere. Face aging via diffusion- based editing, 2023
work page 2023
-
[4]
Diffage3d: Diffusion-based 3d-aware face aging, 2024
Junaid Wahid, Fangneng Zhan, Pramod Rao, and Christian Theobalt. Diffage3d: Diffusion-based 3d-aware face aging, 2024
work page 2024
-
[5]
Analyzing and improving the image quality of StyleGAN
Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. Analyzing and improving the image quality of StyleGAN. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages 8107–8116, 2019
work page 2020
-
[6]
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th Inter- national Conference on Machi...
work page 2021
-
[7]
Wang Yao, Muhammad Ali Farooq, Joseph Lemley, and Peter Cor- coran. Synthetic face ageing: Evaluation, analysis and facilitation of age-robust facial recognition algorithms, 2024
work page 2024
Show all 15 references
-
[8]
Flux.1: Redefining text-to-image ai with superior visual fidelity
Black Forest Labs. Flux.1: Redefining text-to-image ai with superior visual fidelity. 2024
2024
-
[9]
Stable diffusion 3.5 large - the most advanced sd model
Stability AI. Stable diffusion 3.5 large - the most advanced sd model. 2024
2024
-
[10]
Realism engine sdxl - v3.0 vae
Civitai Community. Realism engine sdxl - v3.0 vae. 2023
2023
-
[11]
Mivolo: Multi-input trans- former for age and gender estimation, 2023
Maksim Kuprashevich and Irina Tolstykh. Mivolo: Multi-input trans- former for age and gender estimation, 2023
2023
-
[13]
Age estimation evaluation report, 2024
National Institute of Standards and Technology. Age estimation evaluation report, 2024
2024
-
[14]
Tzvi Ganel, Carmel Sofer, and Melvyn A. Goodale. Biases in human perception of facial age are present and more exaggerated in current ai technology. 2022
2022
-
[15]
Chu, Simon Donato-Woodger, Shehroz S
Charlene H. Chu, Simon Donato-Woodger, Shehroz S. Khan, Rune Nyrup, Kathleen Leslie, Alexandra Lyn, Tianyu Shi, Andria Bianchi, Samira Abbasgholizadeh Rahimi, and Amanda Grenier. Age-related bias and artificial intelligence: A scoping review. 2023
2023
Reviewed August 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.