Animal Wildlife Population Estimation Using Social Media Images Collections

Guido Muscioni; Lorenzo Semeria; Matteo Foglio; Riccardo Pressiani; Tanya Berger-Wolf

REVIEW 4 major objections 5 minor 12 references

Animal Wildlife Population Estimation Using Social Media Images Collections

T0 review · 4 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper claims that social media sharing bias in wildlife images is learnable, and that correcting for it with machine learning can turn Flickr photo collections into wildlife population estimates.

desk verdict Interesting framing of shareability as a learnable bias-correction problem, but the central pipeline trains on full SD-card collections and applies to shared albums only, so the population estimates are unsupported. read the letter →

arxiv 1908.01875 v2 pith:ZANBDJS3 submitted 2019-08-05 cs.LG stat.ML

Matteo Foglio , Lorenzo Semeria , Guido Muscioni , Riccardo Pressiani , Tanya Berger-Wolf This is my paper · ORCID

classification cs.LGstat.ML

keywords populationsizeestimationsocialmediabiasshareabilitypredictionmachinelearningwildlifeconservationcapture-mark-recaptureGrevy'szebraFlickr

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that the gap between how many animals a photographer photographs and how many appear in the photos they share online is not random noise but a learnable pattern. It proposes a two-stage framework: a classifier predicts which images in a collection would be shared, and a regression predicts, from the shared collection, how many animals were originally photographed. The inverse of the predicted share percentage acts as a correction factor, and the corrected counts are fed into a capture–recapture estimator to produce population numbers. The authors report that shareability is learnable (0.82 accuracy on combined data) and that the regression beats naive baselines (R2 of 0.417). If the framework holds, it would give conservation biologists a cheap and scalable way to turn the vast, biased resource of social media wildlife images into usable population estimates.

What carries the argument

The load-bearing object is the collection-correction factor $k_i$, the inverse of the predicted fraction of photographed animals that a photographer would share. It is computed by a regression model that maps features of the shared image collection — individual-level animal counts, image quality and beauty features, and new features describing the structure of the source photo collection — to the share percentage. Multiplying the shared-animal count $n_i$ by $k_i$ recovers the estimated number of animals photographed. The same features feed a binary shareability classifier, and both models are trained on survey labels obtained by asking people whether they would share each citizen-science photo. The final population estimate comes from plugging the corrected per-photographer counts into the Jolly–Seber capture–recapture estimator.

What would settle it

Collect ground-truth sharing behavior for a set of Flickr users who post Grevy's zebra images — for example, by obtaining their full camera rolls or having them label their own upload decisions — and compare the actual photographed-to-shared ratio with the $k_i$ the model predicts from their uploaded albums. If the predicted correction factors are systematically off, the framework's population estimates would not survive the test.

Watch

Extended reading notes

Core claim

The central claim is that social media bias in wildlife photography is a solvable, learnable problem: given the images a user shared, a machine-learning model can predict how many animals the user actually photographed. The paper defines two linked problems — the estimate problem, predicting the total photographed animals $N_i$ from the shared collection's features, and the shareability problem, predicting which individual images get shared. Using survey respondents labeling citizen-science photos from two Great Grevy's Rally events, a gradient-boosted tree model achieves 0.82 accuracy on the shareability task and an $R^2$ of 0.417 on the estimate problem, while the mean and mode baselines score negative $R^2$. Applying the learned correction factors to Flickr albums and feeding the corrected counts into the Jolly–Seber estimator yields Grevy's zebra population estimates for 2011–2017, with an RMSE of 1194 against official counts compared to 1612 for the uncorrected estimator. The paper's point is that the remaining deviation is not irreducible: the structure of the original photo collection carries predictive signal about what gets shared.

Load-bearing premise

The paper's estimates rest on the assumption that survey respondents' shareability labels on citizen-science SD-card photos predict how real Flickr users decide which wildlife photos to post online.

Editorial extensions

If this is right

If the framework generalizes, conservation programs could estimate population sizes for data-poor species directly from existing social media images, without mounting new field surveys or citizen-science rallies.
The finding that collection structure helps predict shareability implies that sharing bias cannot be corrected image-by-image; any model of social media wildlife data must account for the whole photo set taken at an event.
Because the corrected per-photographer counts feed a standard capture–recapture estimator, the framework acts as a bias-correction layer that can be inserted into existing population-monitoring pipelines.
The reported accuracy of 0.82 on shareability and R2 of 0.417 on the estimate problem indicate the correction is learnable with modest data, and the authors expect additional species- and platform-specific features to improve the estimates.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The survey-based labels could be replaced by observing what photographers actually post versus what they capture on their cameras, which would give a direct, non-hypothetical training signal for the shareability model.
A direct transfer test would recruit Great Grevy's Rally participants who also post to Flickr or Instagram, so the model's predicted correction factor could be checked against their real photographed-to-shared ratio.
The sizeable year-to-year deviations in the corrected population estimates suggest the framework is best read as a demonstration that the bias is learnable rather than as a production census tool in its current form.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The core idea here is genuinely worth a look: treat the gap between photographed and shared animals as a learnable per-user correction factor, and use collection-level features rather than single-image features. The paper also shows the shareability sub-problem is learnable to a modest degree (F1 0.62 on the combined data, 0.77 on GGR1 alone), which is a real, reproducible signal. It uses actual citizen-science GGR data and Wildbook identifications, and the authors are honest about limitations. Credit where due: this is a legitimate step beyond the group's prior single-image shareability work [7,8].

The soft spot is load-bearing, not cosmetic. The regression model in Section 4 is trained on GGR SD cards, where the full set of photos taken is known and the survey labels give the fraction of animals the respondent would share. The features explicitly model the structure of the source collection, accounting for all pictures taken. At inference, the model is applied to Flickr albums C_i, which are only the shared subset; the full SD card is unobserved. So either the training-time features are not computable, or the authors silently substituted features from the shared album, which changes the input distribution and makes the denominator (total animals photographed) unidentifiable. The stress-test note is correct, and the Table 1 results bear it out: the 2017 estimate of 67 vs. official 1627, and RMSE 1194. There is also no uncertainty propagation, the Jolly-Seber step is under-specified, and the symmetry recapture multiplier is introduced ad hoc without estimation. These are not minor quibbles; they break the central claim of producing usable population estimates.

The paper is not incoherent on every level. The shareability classification is a legitimate contribution, and the framing of the bias-correction problem is useful for the conservation-tech community. But the estimation pipeline, as written, does not work. The transfer from survey respondents to Flickr users is unvalidated, and the train/inference mismatch is a basic methodological error. That said, the problem matters and the authors have real data, so I would not desk-reject. A serious referee could push them to redesign the inference to use observable features (e.g., shared-album statistics alone) or to collect validation data where full SD cards are known for the same users. With major revision, this could become a useful study. As submitted, it is not citeable for its population estimates, but the shareability finding is worth a look in a reading group as a cautionary example.

If it crosses your desk, send it to review with the train/inference mismatch flagged as the primary issue. It deserves referee time, not because the estimates are convincing, but because the idea is promising and the flaws are fixable in principle.

Referee Report

4 major / 5 minor

Summary. The paper proposes a framework for estimating wildlife population sizes from Flickr image collections by correcting for the bias that users share only a subset of the animal photos they take. The authors collect survey labels from Great Grevy's Rally citizen-science SD-card images, train a regression model to predict the percentage of photographed animals a survey respondent would share, and use the inverse of this percentage as a correction coefficient k_i that multiplies the number of distinct animals seen in a Flickr album. They then apply Jolly-Seber capture-recapture to year-grouped Flickr collections and multiply the result by an ad hoc ``symmetry recapture multiplier'' motivated by the asymmetry of Grevy's zebra stripes. Table 1 reports population estimates for 2011-2017, with large deviations from official censuses (e.g., 67 versus 1,627 for 2017, overall RMSE 1,194).

Significance. If the proposed approach worked, it would be a valuable new direction for low-cost wildlife monitoring: the paper correctly identifies collection-level sharing bias as an important obstacle, and the shareability classification experiments do show that some signal is learnable (accuracy 0.82, F1 0.62 on the combined GGR dataset). The use of collection-structure features is a sensible and nontrivial idea. However, the central population estimates are not validated: the estimate-problem model achieves only R^2 = 0.417, the final numbers deviate strongly from official counts, no uncertainty intervals are provided, and the method rests on a training-inference mismatch in the shareability model. The paper does not provide code or data, and it depends heavily on unpublished prior work for feature definitions. The contribution is therefore currently a plausible research direction rather than a demonstrated method.

major comments (4)

[Section 4, estimate problem] The regression model is trained on full GGR SD-card collections to predict "the percentage of animals that the interviewee would share", and the feature vector includes "features modeling the structure of the source collection, in order to account for all the pictures that were taken". At Flickr inference, only the shared album C_i is available; the full SD card SD_i is unobserved. The paper does not describe how the source-collection features are computed in that setting, and if they are computed from C_i alone, the input distribution differs from training while the target denominator (all photographed animals) is not identifiable from the album. Since k_i = 1 / predicted sharing percentage is the only mechanism correcting the social-media bias, this mismatch undermines the central estimates in Table 1.
[Section 4 and Table 1, Jolly-Seber application] The paper does not specify the capture occasions, the definition of a "capture" in the Flickr data, or how individual animals are matched across years. Jolly-Seber requires at least two sampling occasions with known numbers of marked and unmarked animals, and no such capture histories are provided. Without this specification, the "Jolly-Seber" column in Table 1 cannot be reproduced or interpreted, and the per-year estimates are not connected to the multi-year method described in the text.
[Section 4, last paragraph] The final population estimate is multiplied by a "coefficient to take into account the recaptures which cannot be detected ... due to the lack of symmetry in Grevy's zebra stripes on either side". This multiplier is introduced without estimation, calibration, or sensitivity analysis, and it is a free parameter whose value changes all final estimates. The paper should either estimate it from data or show that the conclusions are robust to a range of plausible values; as written, the final numbers depend on an ad hoc assumption.
[Section 6, Table 1] The model's estimates deviate from official censuses by a large margin: 67 versus 1,627 for 2017, with an overall RMSE of 1,194, and no uncertainty intervals or error propagation are reported. The estimate-problem model achieves only R^2 = 0.417, and no evidence is given that the model transfers from citizen-science SD cards to Flickr collections. These results do not support the abstract's claim that the social-media-bias correction is "a learnable and potentially solvable problem" at the level of population estimates.

minor comments (5)

[Table 1] The meaning of the "+" in the official counts for 2012 and 2017 (1,897+ and 1,627+) is not explained; if these are minimum counts, the comparison should state this explicitly.
[Section 4, survey procedure] The survey procedure is under-described: the number of respondents per SD card, the aggregation rule for multiple responses, and inter-annotator agreement are not reported, although the regression target is a personal sharing preference.
[Sections 4-5] The feature set F_i is not listed. A table of feature names would be necessary to understand the estimate-problem model and the ``source collection structure'' features, and to assess the training-inference mismatch.
[Conclusions] Calling the framework "species-independent" overstates the evidence, because all experiments concern Grevy's zebra; the text should say that the framework is intended to be general and has been tested on one species.
[References [7,8]] The feature definitions and the earlier approach are load-bearing for this paper but appear only as an unpublished thesis and report; the authors should summarize the relevant definitions so that the current method is self-contained.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the shareability model is supervised on external survey labels, and the population estimate is an extrapolation with correctness risks, not a tautology.

full rationale

The paper's derivation chain is not circular. The shareability regression is trained on survey labels collected from human respondents on GGR SD-card images (Section 4), and the k_i correction factor is the inverse of the model's predicted share percentage. The final population estimate is obtained by applying this fitted model to Flickr collections and feeding the resulting k_i values into the Jolly-Seber capture-recapture formula (Section 4). This is an external supervised-learning pipeline: the target Ni is not defined in terms of the output, and the model is not fitted to the quantity it is used to predict on Flickr. The citations to prior work [7,8] are contextual and reuse features, but the paper's own cross-validation results (Section 6) provide the evidence for learnability, so the self-citations are not load-bearing. The main weaknesses are correctness risks rather than circularity: the survey shareability labels may not transfer to real Flickr users, and the feature vector computed from a full SD card at training time is not computable from the shared Flickr album at inference time. These are assumptions about external validity and identifiability, not cases where an output reduces to an input by construction. No circular step requiring a specific equation-to-equation reduction was found.

Assumptions & free parameters 1 free parameters · 4 assumptions · 0 invented entities

The central claim rests on the assumption that survey-based shareability labels transfer to Flickr users, which is untested and load-bearing. The symmetry recapture multiplier is a free parameter introduced without estimation. No new physical entities are introduced.

free parameters (1)

Symmetry recapture multiplier
Introduced in Section 4 to adjust for recaptures missed by computer vision due to asymmetric Grevy's zebra stripes. No value, estimation procedure, or source is provided; it directly scales the final population estimate and is a hand-chosen correction.

assumptions (4)

domain assumption Survey respondents' sharing preferences represent the sharing behavior of Flickr users who post wildlife images.
The shareability model is trained on GGR event SD cards labeled by interviewees (Section 4) and applied to Flickr collections without any validation that the two sharing behaviors match.
domain assumption Flickr keyword search for 'grevy's zebra' returns collections that are representative of all photos taken by those users, with albums treated as complete collections.
The paper assumes downloaded albums correspond to the user's full set of photos from an event, but users may organize, delete, or upload photos selectively.
domain assumption The Jolly-Seber capture-recapture assumptions hold for the estimated annual totals derived from Flickr data.
Section 4 invokes Jolly-Seber [5,11] without stating how captures, recaptures, and time intervals are defined using the coefficient-derived N_i estimates.
ad hoc to paper Grevy's zebra stripe asymmetry prevents computer vision recapture detection, requiring a correction multiplier.
The paper postulates this in Section 4 to justify an unnamed multiplier, but provides no data or estimation to support it.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Animal Wildlife Population Estimation Using Social Media Images Collections." pith.science (2026). https://pith.science/paper/ZANBDJS3

@misc{pith2026190801875,
  author       = {Pith},
  title        = {Pith review of: Animal Wildlife Population Estimation Using Social Media Images Collections},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZANBDJS3}},
  note         = {Machine review of arXiv:1908.01875}
}

read the original abstract

We are losing biodiversity at an unprecedented scale and in many cases, we do not even know the basic data for the species. Traditional methods for wildlife monitoring are inadequate. Development of new computer vision tools enables the use of images as the source of information about wildlife. Social media is the rich source of wildlife images, which come with a huge bias, thus thwarting traditional population size estimate approaches. Here, we present a new framework to take into account the social media bias when using this data source to provide wildlife population size estimates. We show that, surprisingly, this is a learnable and potentially solvable problem.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

12 extracted references · 11 canonical work pages

[1]

Berger-Wolf, J

T. Berger-Wolf, J. Crall, J. Holberg, J. Parham, C. Stewa rt, B. L. Mackey, P. Kahumbu, and D. Rubenstein. The great grevyâĂŹs rally: Th e need, meth- ods, ﬁndings, implications and next steps. Technical repor t, Technical Report, GrevyâĂŹs Zebra Trust, Nairobi, Kenya, 2016

work page 2016
[2]

T. Y. Berger-Wolf, D. I. Rubenstein, C. V. Stewart, J. A. H olmberg, J. Parham, S. Menon, J. Crall, J. Van Oast, E. Kiciman, and L. Joppa. Wild book: Crowd- sourcing, computer vision, and data science for conservati on. arXiv preprint arXiv:1710.08880, 2017

arXiv
[3]

Chen and C

T. Chen and C. Guestrin. Xgboost: A scalable tree boostin g system. In Proceed- ings of the 22nd acm sigkdd international conference on know ledge discovery and data mining, pages 785–794. ACM, 2016

work page 2016
[4]

S. Díaz, J. Settele, and E. Brondízio et al. Summary for policymakers of the global assessment report on biodiversity and ecosystem ser vices of the inter- governmental science-policy platform on biodiversity and ecosystem services. https://www.ipbes.net/system/tdf/spm_global_unedited_advance.pdf?ﬁle=1&type=node&id=35245 , May 6, 2019

work page 2019
[5]

G. M. Jolly. Explicit estimates from capture-recapture data with both death and immigration-stochastic model. Biometrika, 52(1/2):225–247, 1965

work page 1965
[6]

R. A. Lancia, W. L. Kendall, K. H. Pollock, and J. D. Nichol s. Estimating the number of animals in wildlife populations. 2005

work page 2005
[7]

S. Menon. Animal Wildlife Population Estimation Using Social Media Images. PhD thesis, 2017

work page 2017
[8]

Menon, T

S. Menon, T. Berger-Wolf, E. Kiciman, L. Joppa, C. V. Stew art, J. Parham, J. Crall, J. Holmberg, and J. Van Oast. Animal population estimation u sing ﬂickr images. 2016

work page 2016

Show all 12 references

[9]

Olteanu, C

A. Olteanu, C. Castillo, F. Diaz, and E. Kiciman. Social d ata: Biases, methodolog- ical pitfalls, and ethical boundaries. 2016

2016
[10]

Rubenstein, B

D. Rubenstein, B. Low Mackey, Z. Davidson, F. Kebede, and S. King. Equus grevyi. the iucn red list of threatened species 2016: e. t7950a89624 491, 2016

2016
[11]

G. A. Seber. A note on the multiple-recapture census. Biometrika, 52(1/2):249– 259, 1965

1965
[12]

G. W. Witmer. Wildlife population monitoring: some pra ctical considerations. Wildlife Research, 32(3):259–263, 2005

2005

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.

[1] [1]

Berger-Wolf, J

T. Berger-Wolf, J. Crall, J. Holberg, J. Parham, C. Stewa rt, B. L. Mackey, P. Kahumbu, and D. Rubenstein. The great grevyâĂŹs rally: Th e need, meth- ods, ﬁndings, implications and next steps. Technical repor t, Technical Report, GrevyâĂŹs Zebra Trust, Nairobi, Kenya, 2016

work page 2016

[2] [2]

T. Y. Berger-Wolf, D. I. Rubenstein, C. V. Stewart, J. A. H olmberg, J. Parham, S. Menon, J. Crall, J. Van Oast, E. Kiciman, and L. Joppa. Wild book: Crowd- sourcing, computer vision, and data science for conservati on. arXiv preprint arXiv:1710.08880, 2017

arXiv

[3] [3]

Chen and C

T. Chen and C. Guestrin. Xgboost: A scalable tree boostin g system. In Proceed- ings of the 22nd acm sigkdd international conference on know ledge discovery and data mining, pages 785–794. ACM, 2016

work page 2016

[4] [4]

S. Díaz, J. Settele, and E. Brondízio et al. Summary for policymakers of the global assessment report on biodiversity and ecosystem ser vices of the inter- governmental science-policy platform on biodiversity and ecosystem services. https://www.ipbes.net/system/tdf/spm_global_unedited_advance.pdf?ﬁle=1&type=node&id=35245 , May 6, 2019

work page 2019

[5] [5]

G. M. Jolly. Explicit estimates from capture-recapture data with both death and immigration-stochastic model. Biometrika, 52(1/2):225–247, 1965

work page 1965

[6] [6]

R. A. Lancia, W. L. Kendall, K. H. Pollock, and J. D. Nichol s. Estimating the number of animals in wildlife populations. 2005

work page 2005

[7] [7]

S. Menon. Animal Wildlife Population Estimation Using Social Media Images. PhD thesis, 2017

work page 2017

[8] [8]

Menon, T

S. Menon, T. Berger-Wolf, E. Kiciman, L. Joppa, C. V. Stew art, J. Parham, J. Crall, J. Holmberg, and J. Van Oast. Animal population estimation u sing ﬂickr images. 2016

work page 2016