{"id":"c195a17a-bc2f-4fb4-8ff2-3d60538afab7","arxiv_id":"1908.02787","paper_version":2,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"Using the BlueTides simulation, the authors predict cosmic variance for z>7 galaxies: 3-10% for WFIRST's 10 deg^2 field, 20-50% for JWST medium/deep fields, and dominant over Poisson noise in most surveys.","lead":"This paper uses a large cosmological simulation, BlueTides, to predict how much galaxy counts in the early universe will vary from one patch of sky to another. It finds that for planned JWST and WFIRST surveys, this cosmic variance often dominates the measurement error and provides tools to correct for it.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Table 2 contradicts the paper's claim that cosmic variance dominates Poisson uncertainty except for N≲10: rows with N=168 and N=102 show Poisson uncertainties larger than cosmic-variance uncertainties.","rationale":"The paper's most consequential claim is not just that BlueTides predicts certain cosmic-variance amplitudes, but that cosmic variance dominates Poisson uncertainty across all current and upcoming surveys. That claim is directly load-bearing for survey planning and for the paper's stated conclusions. The reader identified an overstatement in the abstract and noted the N≲10 caveat, but did not point out that Table 2 itself contains multiple rows with N>10 where Poisson uncertainty is larger. This is stronger than a wording issue: it is an internal contradiction between the paper's quantitative results and its qualitative conclusion. A single arithmetic check settles it. The simulation-bias concern is real but would require external comparisons and is acknowledged qualitatively in Section 4; the Table 2 inconsistency is immediate and decisive. Recommending the same CONDITIONAL verdict as the reader, since the cosmic-variance estimates remain useful and the flaw is correctable by revising the dominance claim and its scope.","tokens_in":18479,"tokens_out":14948,"duration_ms":177119,"concrete_test":"Recompute δN_cosmic/δN_Poisson for every row in Table 2 and compare with the paper's stated N≲10 exception threshold. In particular, verify the entries (10 deg^2, z=11, M_UV<-20: 168±7±13) and (10 deg^2, z=14, M_UV<-18: 102±4±10). If these rows are correct, the abstract and Section 5 must be revised to specify the regime (volume, density, redshift, magnitude) where cosmic variance actually dominates; otherwise the dominance claim should be withdrawn or qualified.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central 'dominance' claim (Abstract; Section 5) is contradicted by the paper's own Table 2, independent of any simulation systematics. Table 2 lists, for 10 deg^2 WFIRST-like fields: z=11, M_UV<-20, ⟨N⟩=168, δN_cosmic=7, δN_poisson=13 (Poisson larger by ~1.9x); and z=14, M_UV<-18, ⟨N⟩=102, δN_cosmic=4, δN_poisson=10 (Poisson larger by ~2.5x). Also 1 deg^2 z=14 M_UV<-18 has N=10.6 with δN_cosmic=2.1 and δN_poisson=3.3. These rows have N>10, yet Poisson uncertainty exceeds cosmic variance. The text and abstract claim the only exceptions are samples with ≲10 galaxies. Thus the statement that 'cosmic variance is larger than Poisson variance and forms the dominant component of the overall uncertainty in all current and upcoming surveys' is false as written. The cosmic variance estimates themselves are not necessarily wrong; the unsupported part is the comparison to Poisson and the sweeping conclusion. This is an internal arithmetic inconsistency that must be fixed before the headline claim can stand.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper uses the BlueTides cosmological hydrodynamic simulation (400 Mpc/h box, WMAP9 cosmology) to estimate the cosmic variance of z>7 galaxies selected by rest-frame UV absolute magnitude thresholds M_UV ~ -16 to -22, over survey areas from ~0.1 arcmin^2 to 10 deg^2 and redshifts 7.5-14. The authors fit the simulated two-point correlation function with power laws, integrate it over model survey volumes to obtain sigma_g, validate against subvolume number-count distributions for small/medium fields, and package the results as fitting functions and a public online calculator. They apply the estimator to JWST medium/deep surveys, WFIRST 1 and 10 deg^2 fields, and lensed surveys, concluding that cosmic variance ranges from a few percent for large WFIRST fields to tens of percent for JWST fields and >=40% for lensed surveys, and that cosmic variance generally dominates the Poisson uncertainty for samples with more than about 10 galaxies.","tokens_in":18752,"tokens_out":7787,"duration_ms":74674,"significance":"If the underlying BlueTides galaxy-halo connection is representative, these are useful, directly usable predictions for interpreting and planning high-redshift surveys. The paper's strengths are the large simulation volume, the transparent pipeline from correlation function to sigma_g, the explicit fitting functions and public calculator, and the internal cross-check between the correlation-integral method and the subvolume number-count method. The main scientific conclusions are however currently overstated in two ways: the claim that cosmic variance dominates Poisson variance 'in all current and upcoming surveys' is contradicted by the paper's own Table 2, and the quantitative predictions are presented without an uncertainty budget despite acknowledged shot-noise and modeling limitations.","major_comments":[{"comment":"The claim that cosmic variance is larger than Poisson variance except for samples with N ≲ 10 is internally contradicted by Table 2. In the 10 deg^2 rows, z=11, M_UV<-20 has ⟨N⟩=168 with δN_cosmic=7 and δN_poisson=13, and z=14, M_UV<-18 has ⟨N⟩=102 with δN_cosmic=4 and δN_poisson=10; in both cases N>10 and the Poisson uncertainty exceeds the cosmic-variance uncertainty. The 1 deg^2 row at z=14, M_UV<-18 likewise has N=10.6 with δN_cosmic=2.1 and δN_poisson=3.3. These rows make the abstract sentence 'cosmic variance is larger than Poisson variance and forms the dominant component of the overall uncertainty in all current and upcoming surveys' false as written, and they also conflict with Section 5's statement that cosmic variance dominates except for bins with ≲10 objects. The authors should either restrict the dominance claim to the small-area/JWST-like geometries shown in Figure 5 or provide a corrected quantitative condition (e.g., involving both N and the amplitude of sigma_g); the 10 deg^2 WFIRST-like points should be added to Figure 5.","section":"Abstract; Section 5; Table 2"},{"comment":"The redshift-bin-width scaling sigma_g(Δz)/sigma_g(Δz_ref) = (Δz/Δz_ref)^{-0.32} is presented as universal, but the supporting Figure 3 shows only M_UV<-16 galaxies. The calculator CV_AT_COSMIC_DAWN then applies this exponent to every M_UV threshold and redshift in Table 1 via interpolation (§3.4). If the exponent depends on magnitude or redshift at z>7, the public estimates will be biased outside the single tested case. Please show the Δz dependence for at least a bright sample (e.g., M_UV<-20) and for a higher-redshift snapshot, or restrict Eq. (5) with appropriate caveats.","section":"§3.2.2, Eq. (5); §3.4"},{"comment":"The quantitative predictions are presented without an uncertainty budget. Table 1 lists power-law parameters r0 and gamma (and the derived Sigma, beta) with no error bars, and Figures 2 and 4 show no uncertainties on sigma_g; Section 4 provides only a qualitative discussion of systematic differences (e.g., 25-30% from cosmology) and does not propagate these or the fitting errors into the quoted values. This matters most at the bright end: Section 3.3.1 states that M_UV<-22 clustering 'could not be accurately probed due to excessive shot noise,' yet Table 1 still reports fits for M_UV=-22 at z=7.5-12 and the text quotes >10% cosmic variance for M_UV<-20 at z>10. Please provide uncertainties on the fitted parameters and sigma_g values, or explicitly flag the affected regimes as upper/lower limits.","section":"§3.1, Table 1; §4"}],"minor_comments":[{"comment":"Equation (4) defines the power law with exponent beta, but the text states 'where α is the power-law exponent'; the symbol should be beta.","section":"§3.2.1, Eq. (4)"},{"comment":"At z=9, M_UV=-18, the fitted value gamma=-2.98 is likely a typo and breaks the monotonic trend with luminosity and redshift; please check and correct.","section":"Table 1"},{"comment":"The caption states that squares correspond to a survey area of 10 arcsec^2, which is inconsistent with the stated range of BlueTides validity (~0.1 arcmin^2 and above); this should likely be 10 arcmin^2.","section":"Figure 3 caption"},{"comment":"Please state explicitly that deltaN_cosmic and deltaN_poisson are 1-sigma uncertainties, and clarify whether they are computed from the correlation-function integral or from the subvolume distribution, since both estimators are used in the paper.","section":"Table 2 caption"},{"comment":"The reference 'McCracken, H. J. et al., 2012' is formatted inconsistently with the other author-year references; it should be formatted in the same style.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"For the editor: the manuscript is within the scope of MNRAS and the core estimator is potentially useful. The main obstacle is the overclaimed dominance statement, which is internally contradicted by Table 2; this is fixable by rewriting the claim and adding the missing points to Figure 5. The lack of an uncertainty budget and the unsupported extrapolation of the redshift-width scaling also need attention. I did not independently verify the public repository."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The paper delivers exactly what the title promises: cosmic variance estimates for z>7 galaxies from BlueTides, with fitting functions, a public calculator, and full number-count distributions for JWST-scale fields. The methodology is not novel—Peebles 1980 integral of the correlation function, as used by Somerville et al. 2004 and Moster et al. 2011—but the application to a (400 Mpc/h)^3 hydrodynamic simulation at z=7.5–14 fills a real gap. The specific predictions for WFIRST (3–10%) and JWST medium/deep (20–50%) are the kind of numbers survey planners actually need. The paper also does something useful beyond the mean: the probability of detecting bright outliers like GN-z11 (~4–5% for JADES medium) is a genuinely new way to frame survey expectations.\n\nThe soft spots are real but mostly addressable. The headline claim in the abstract and Section 5—that cosmic variance dominates Poisson variance except for samples with N≲10—is not supported by the paper's own Table 2. For a 10 deg^2 field at z=11, M_UV<-20, N=168 with δN_cosmic=7 and δN_poisson=13; at z=14, M_UV<-18, N=102 with 4 vs 10. Those samples have N well above 10 and Poisson is the larger uncertainty. The statement is false as written, and it appears three times (abstract, Section 3.3, and Section 5). This is an internal arithmetic inconsistency, not a failure of the σ_g calculation. The authors need to correct the claim and, ideally, present the ratio more carefully for the regimes where cosmic variance does not dominate.\n\nBeyond that, the quantitative estimates inherit unquantified systematics from a single simulation. The paper acknowledges cosmology differences (~25–30% in σ_g between WMAP and Planck) and the sensitivity to star-formation physics, but does not propagate these into the numbers. Given that the clustering bias of the M_UV-limited samples is the core input, a more careful discussion of how subgrid physics and dust affect bias would strengthen the paper. The power-law fits also have no error bars, and shot noise at M_UV~-22 is a known weak spot.\n\nIn sum: the central calculation is standard and the numbers are probably in the right ballpark, but the domination claim needs fixing before publication. The paper deserves a serious referee—this is useful survey-planning material, and the full distributions are a genuine addition. I'd send it out, with a request to fix the overstatement and add caveats about systematic uncertainties.","headline":"Useful BlueTides-based cosmic variance numbers for JWST/WFIRST survey planning, but the claim that cosmic variance dominates Poisson except for N≲10 is contradicted by the paper's own Table 2.","tokens_in":19333,"tokens_out":2897,"would_cite":true,"duration_ms":29417,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"For galaxies at redshift 7 and beyond, field-to-field cosmic variance—not Poisson counting noise—dominates the error budget of every planned survey, according to the BlueTides simulation.","keywords":["cosmic variance","high-redshift galaxies","galaxy clustering","luminosity function","JWST surveys","WFIRST surveys","BlueTides simulation","UV luminosity function"],"falsifier":"Compare the observed number-count scatter across many independent JWST fields, for example repeated $100\\,\\mathrm{arcmin}^2$ pointings at fixed $M_{\\rm UV}<-16$ and $z\\approx9$–$11$; the sample variance of those counts should equal the predicted $\\sigma_g\\approx20$–$50\\%$, and a measured scatter outside this range after accounting for selection effects would falsify the BlueTides bias.","tokens_in":18290,"feed_emoji":"🔭","tokens_out":7424,"duration_ms":72187,"temperature":0.7,"pith_summary":"The paper argues that the dominant uncertainty in future JWST and WFIRST measurements of galaxies at redshift 7 and above is not the finite number of galaxies detected but the field-to-field scatter caused by strong clustering—cosmic variance. Using the large-volume BlueTides hydrodynamic simulation, the authors predict this variance for UV magnitudes $M_{\\rm UV}$ from $-16$ to $-22$ over survey areas from roughly $0.1\\,\\mathrm{arcmin}^2$ to $10\\,\\mathrm{deg}^2$, finding that it scales as a power law in survey area with exponents around $-0.25$ to $-0.45$. The forecast is $3\\text{--}10\\%$ cosmic variance for WFIRST's $10\\,\\mathrm{deg}^2$ field, $20\\text{--}50\\%$ for JWST medium/deep fields of about $100\\,\\mathrm{arcmin}^2$, and $\\gtrsim40\\%$ for lensed fields. Across essentially all current and upcoming surveys, cosmic variance exceeds Poisson variance; only samples with fewer than about ten galaxies are Poisson-limited. This matters because the luminosity functions and brightness distributions at $z>7$ will be interpreted against these same error budgets.","feed_headline":"Cosmic variance, not Poisson noise, sets JWST's z>7 error bars","feed_subtitle":"Simulation forecast: WFIRST keeps scatter at 3–10%, while JWST medium/deep fields reach 20–50%.","key_machinery":"The load-bearing object is the cosmic variance statistic $\\sigma_g^2 = (1/V^2)\\int_V \\int_V \\xi_{gg}(r_1,r_2)\\,d^3r_1\\,d^3r_2$, where $\\xi_{gg}$ is the two-point galaxy correlation function; it measures the excess field-to-field scatter in counts beyond Poisson noise. BlueTides supplies $\\xi_{gg}$ for a UV-magnitude-limited galaxy population, and the paper condenses it into power-law fits $\\xi(r)=(r/r_0)^\\gamma$ and $\\sigma_g=\\Sigma A^\\beta$, with a universal redshift-width scaling $(\\Delta z/\\Delta z_{\\rm ref})^{-0.32}$. For small surveys (JWST medium/deep and lensed fields), the paper also counts galaxies in many simulated sub-volumes to obtain the full probability distribution of overdensities, which yields rare-outlier detection probabilities.","core_discovery":"The central claim is that for $z>7$ galaxies, cosmic variance is substantial and is the dominant component of the total uncertainty in every planned survey except those with fewer than about ten expected galaxies. Specifically, the paper predicts $\\sigma_g\\sim3\\text{--}10\\%$ for WFIRST's $10\\,\\mathrm{deg}^2$ field, $\\sigma_g\\sim20\\text{--}50\\%$ for JWST medium/deep surveys up to $A\\sim100\\,\\mathrm{arcmin}^2$, and $\\sigma_g\\gtrsim40\\%$ for lensed surveys; to keep the variance below $100\\%$, effective volumes of $\\gtrsim(8\\,\\mathrm{Mpc}/h)^3$ at $z\\sim12$ and $\\gtrsim(12\\,\\mathrm{Mpc}/h)^3$ at $z\\sim14$ are required. The authors obtain these numbers from BlueTides, a $(400\\,\\mathrm{Mpc}/h)^3$ hydrodynamic simulation, by integrating the simulated two-point correlation function over mock survey volumes and, for small volumes, by building the full distribution of number counts across thousands of realizations.","pith_inferences":["If the simulation's galaxy–halo connection is representative, the predicted scatter can be tested directly: the field-to-field dispersion in number counts across independent JWST fields should match $\\sigma_g$, and a mismatch would localize where the galaxy–halo connection fails.","The shallow power-law scaling $\\sigma_g\\propto A^{-0.25\\ldots-0.45}$ means that enlarging a single field is an inefficient cure; several well-separated medium fields would reduce cosmic variance more effectively than one deep pencil beam.","Because BlueTides contains no regions underdense by more than $2\\sigma$, the predicted distribution of overdensities is asymmetric; survey teams can use this to decide whether a claimed 'void' field is physically plausible.","The same machinery could be extended to stellar-mass-selected samples or to $z\\sim6$–$7$ if the simulation's clustering is recalibrated, making the estimator useful beyond UV luminosity functions."],"forward_implications":["JWST's JADES-medium/deep and CEERS surveys should expect 20–50% field-to-field scatter in $M_{\\rm UV}<-16$ to $-20$ samples at $z\\sim7.5$–$11$; for example, roughly $2200\\pm450$ galaxies at $z\\sim7.5$ in a $100\\,\\mathrm{arcmin}^2$ field.","WFIRST's $10\\,\\mathrm{deg}^2$ survey keeps cosmic variance at 3–10% for most samples, making it the cleanest platform for luminosity-function shape measurements at $z>7$.","Lensed surveys probing the faint end have $\\sigma_g\\gtrsim40\\%$, so their luminosity-function constraints are meaningful only if effective volumes exceed roughly $(8\\text{--}12\\,\\mathrm{Mpc}/h)^3$, depending on redshift.","Cosmic variance rather than Poisson noise sets the error budget for essentially all upcoming surveys; published luminosity functions at $z>7$ should carry cosmic-variance terms or risk overstating constraints."],"supporting_citations":[{"why":"Provides the volume-integral definition of cosmic variance used in Eq. (2).","marker":"Peebles (1980)"},{"why":"Supplies the standard methodology for estimating cosmic variance from galaxy clustering that the paper follows.","marker":"Somerville et al. (2004)"},{"why":"Earlier high-redshift cosmic variance estimates using a halo-mass–luminosity relation that BlueTides improves upon.","marker":"Trenti & Stiavelli (2008)"},{"why":"Source for the geometry and aspect-ratio dependence of cosmic variance and the redshift-width scaling comparison.","marker":"Moster et al. (2011)"},{"why":"Presents the BlueTides simulation whose volume and resolution set the accessible $M_{\\rm UV}$ and area range.","marker":"Feng et al. (2016)"},{"why":"Provides the BlueTides clustering predictions for $z>7$ galaxies that feed the cosmic-variance integral.","marker":"Bhowmick et al. (2018a)"},{"why":"Supplies effective volumes for lensed fields used to set lensed-survey cosmic variance estimates.","marker":"Livermore et al. (2017)"},{"why":"Defines the GNz11-like bright galaxies whose detection probability is quantified in the paper.","marker":"Oesch et al. (2016)"}],"fun_headline_variants":["BlueTides: cosmic variance dominates JWST's z>7 error bars","Cosmic variance, not Poisson, drives JWST's z>7 error bars","For JWST and WFIRST, cosmic variance is the key uncertainty","z>7 surveys: cosmic variance exceeds Poisson noise"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The simulation's mapping between galaxy UV brightness and dark-matter halo mass—and hence the clustering bias of $M_{\\rm UV}$-limited samples—matches the real universe at $z=7.5$–$14$; if that mapping is wrong, every predicted cosmic variance shifts.","fun_headline_variants_meta":{"raw":{"variants":["BlueTides: cosmic variance dominates JWST's z>7 error bars","Cosmic variance, not Poisson, drives JWST's z>7 error bars","For JWST and WFIRST, cosmic variance is the key uncertainty","z>7 surveys: cosmic variance exceeds Poisson noise"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001019,"raw_usage":{"total_tokens":4440,"prompt_tokens":1222,"completion_tokens":3218,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":838,"completion_tokens_details":{"reasoning_tokens":3140}},"tokens_in":838,"tokens_out":3218,"duration_ms":22390,"temperature":1.0,"reasoning_tokens":3140,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T14:34:50.775952+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Compare the observed number-count scatter across many independent JWST fields, for example repeated $100\\,\\mathrm{arcmin}^2$ pointings at fixed $M_{\\rm UV}<-16$ and $z\\approx9$–$11$; the sample variance of those counts should equal the predicted $\\sigma_g\\approx20$–$50\\%$, and a measured scatter outside this range after accounting for selection effects would falsify the BlueTides bias.","supporting_citations":[],"review_version":1}