Pith. sign in

REVIEW 4 major objections 6 minor 6 references

Producers of Popular Science Web Videos. Between New Professionalism and Old Gender Issues

T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A quantitative survey of 190 popular science web videos argues that professionalism on YouTube is best measured by production quality, frequency, and monetization, and that women remain a 24% minority among visible producers.

desk verdict A useful descriptive corpus and a sensible redefinition of professionalism, but the two-video-per-channel sampling makes the headline percentages, especially the gender gap, more fragile than the paper acknowledges. read the letter →

arxiv 1908.05572 v1 pith:WO4CXWQJ submitted 2019-08-15 cs.CY

Jesus Munoz Morcillo , Klemens Czurda , Andrea Geipel , Caroline Y. Robertson-von Trotha This is my paper · ORCID
classification cs.CY
keywords popularsciencewebvideocommunicationYouTubeprofessionalismgendergapcommunitybuildingcommodificationuser-generatedcontent
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper aims to replace the tired distinction between user-generated and professionally generated content with a production-based measure of professionalism for popular science web videos. Analysing 190 videos from 95 channels, it reports that most popular science videos are made by organizations, that 69 percent of channels run advertising, and that high audiovisual quality plus regular weekly output coincide in only 14 percent of the sample. It also documents a gender gap of 26 percentage points: 24 percent of the 370 visible producers are women, and women are almost absent from individual productions. These findings matter because they shift the debate from who uploads to how the platform's attention economy shapes science communication.

What carries the argument

The central instrument is a coding scheme applied to 190 videos from 95 channels selected from YouTube's 'Science & Education' category lists in March 2015 and from recommendations on 63 science blogs. Professionalism is operationalized on three axes: audiovisual quality (high-definition video and good sound), production frequency (more than one video per week), and commodification (advertising activated). These are crossed with producer type, estimated gender and age of visible producers, and the position and type of organic links in the video's intro, body, outro, and description. The coding's reliability is checked through Cronbach's alpha and inter-coder agreement on 20 videos.

What would settle it

Take a new random sample of popular science channels—for example, all channels with at least 500,000 subscribers that post science-tagged videos in a given year—and code the same variables: if the female share of visible producers approaches parity, or if the share of monetized channels drops below half, the paper's headline percentages are artifacts of the 2015 channel lists rather than stable features of the genre.

Watch

Extended reading notes

Core claim

The central claim is that professionalism on YouTube's popular science scene is a matter of audiovisual quality, production frequency, and commodification, not of the producer's status as amateur or professional. Under that definition the paper finds a professional scene in which 69% of channels are profit-oriented, 72% are run by organizations, and all identified non-profit channels belong to large institutions; meanwhile only about one in seven videos combines high quality with a weekly or faster release rate. The same data set shows a systematic gender imbalance—24% of visible presenters and actors are women, a 26-point gap—present in nearly every age group and sharper among individual producers, where only 4% of visible producers are women. The paper argues that community-building practices, such as placing subscription invitations and links in the outro and description, are part of an economic strategy rather than purely participatory culture.

Load-bearing premise

The headline percentages assume that YouTube's 2015 'Science & Education' channel lists and 63 science blogs cover the full population of popular science web videos, and that each channel's most recent and most popular video represents its output.

Editorial extensions

If this is right

  • The UGC/PGC dichotomy should be retired in favor of production indicators; researchers who keep it will misclassify professional amateurs and amateur institutions.
  • Popularity on YouTube science is less a spontaneous amateur phenomenon than the product of organized, monetized production: 72% of channels are organizations and 69% run advertising.
  • Science communicators' community-building is an economic strategy; link placement in outro and description follows platform best practice rather than pure participatory culture.
  • Any explanation of the gender gap must account for its uneven distribution: women appear more in organizational than in individual productions.
  • Single-video quality alone is a poor proxy for professionalism; evaluating channels requires combining production rate and business model.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the 2015 sample frame is representative, the findings describe a platform before later algorithm and policy changes; a replication on current data would test whether the gender gap and monetization rates have shifted.
  • The authors' coding links professionalism to success, but not to content accuracy; a natural extension is to test whether the channels identified as professional by production indicators also score higher on scientific reliability or trustworthiness.
  • The gender-gap explanation via sexist comments could be tested directly by comparing comment sentiment on channels with female versus male presenters matched for popularity and topic.
  • The paper's notion of non-PGC suggests a spectrum rather than a binary; future work could build a professionalism index that weights quality, frequency, and commodification and validates it against channel revenue or career outcomes.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper reports a content analysis of 190 YouTube videos drawn from 95 popular science channels, coding audiovisual quality, production frequency, advertising activation, type of producer, gender and age of visible presenters, and the placement and type of organic links. It argues that professionalism in science web videos is better captured by production frequency, commodification, and audiovisual quality than by the old UGC/PGC distinction, and it reports a 24% female share among visible producers, interpreted as a gender gap in almost every age group. The authors compare their descriptive percentages with qualitative studies and practical YouTube advice.

Significance. If the descriptive patterns hold, the paper provides a useful mapping of an understudied production context and a reusable coding scheme. The reliability checks are a genuine strength: inter-rater accuracy above 80% and Cronbach's alpha values of 0.7-0.8 for age coding are appropriate for exploratory content analysis. The conceptual proposal to replace UGC/PGC with a multidimensional professionalism construct is plausible, and the paper makes concrete, falsifiable descriptive claims. However, the evidence base is a non-random, popularity-based sample with only two videos per channel, and several headline percentages rest on small subgroups, so the broader conclusions should be framed as exploratory rather than as a definitive global picture.

major comments (4)
  1. [Methodology: Selection of YouTube Channels]
  2. [Defining Professionalism and Results]
  3. [Results: Gender and Age of the Producers]
  4. [Methodology: Selection of YouTube Channels and Conclusions]
minor comments (6)
  1. [Abstract and Introduction] The phrases 'general picture' and 'global scale' overstate what a non-random 95-channel, 190-video corpus can support; consider using 'exploratory descriptive study'.
  2. [References] The reference list contains 'Ervity and Stengler, 2016' and the text alternates between 'Stengel' and 'Stengler'; the spelling should be unified.
  3. [Results, Figure 6] The title 'As Perceived Non-Profit Producers (95 Channels) Producers, i.e., without ads (46 channels)' appears garbled and should be rewritten for clarity.
  4. [Results, Gender and Age] The 'gender gap of 26%' should be defined explicitly as the difference from parity (50% minus the 24% female share), since a reader could otherwise read it as the 76%-versus-24% difference.
  5. [References] The citation 'ITC, 2016' in the text should be 'ITU, 2016' to match the International Telecommunication Union reference.
  6. [Global] Minor typos appear throughout, including 'previews research' for 'previous research,' 'intension' for 'intention,' and 'superfluous' misspelled as 'superfl uous'; a careful proofread is needed.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the article reports direct codings of a 190-video corpus and does not fit parameters that later reappear as predictions.

full rationale

The paper's central claims are descriptive statistics computed directly from coding 190 videos (two per channel): 57% non-HQ video, 69% ad activation, 24% female visible producers, and link-placement patterns. These are tabulations, not outputs of fitted parameters or equations, so there is no reduction of a 'prediction' to its inputs by construction. The 'new professionalism' concept is introduced as an explicit operational definition combining technical quality, production frequency, and commodification ('we opted to focus on the degree of technical expertise, production frequency and commodification, with a view to defining a new concept of professionalism'); a stipulated definition is not circular merely because it is applied to the same sample. The authors also transparently flag sample limitations, e.g., footnote 5 on choosing advertising activation as an indicator 'for the sake of simplicity and methodological consistency,' and the conclusion that 'for any future analysis on the distinction between professional and non-professional science web videos we would need a broader sample of videos.' The self-citation to Muñoz Morcillo et al. (2016) supplies coding criteria for storytelling and amateurism from a separate earlier study; it is not a uniqueness theorem and does not force the empirical gender or community-building findings. No circular step can be exhibited by quoting an equation or a fitted parameter renamed as a prediction, so the appropriate finding is no significant circularity.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

The paper's conclusions rest on the sampling frame, the coding proxies (ad activation for profit, estimated age), and the chosen thresholds for quality and production rate. These are domain assumptions rather than mathematically fitted parameters.

free parameters (2)
  • Production-rate professionalism threshold = >1 video per week
    Used to classify channels as nascent-professional or professional in Figures 3 and 4; chosen by the authors, not derived from the data.
  • High-quality (HQ) video threshold = at least 720p vertical resolution and good sound quality
    Defines HQ vs non-HQ in Figure 1; selected by the authors, not derived from the data.
assumptions (4)
  • domain assumption YouTube's Science & Education channel category site, as it existed in March 2015, lists the most popular science channels globally and per country.
    The sample frame relies on this deprecated algorithmic list and blog recommendations; no external validation of the list's completeness is provided (Methodology, 'Selection of YouTube Channels').
  • domain assumption Activation of advertising is a valid indicator of profit orientation.
    The authors acknowledge in footnote 5 that institutions can pursue long-term profit without advertising; they use ad activation 'for the sake of simplicity and methodological consistency.'
  • domain assumption Age can be reliably estimated from facial and voice features into 10-year brackets.
    Age is based on subjective visual and auditory assessment with reported Cronbach's alpha; no ground truth is available (Methodology, 'Design of Coding Categories').
  • domain assumption The most recent and the most popular video from each channel represent that channel's production practices.
    The corpus is two videos per channel, which may overrepresent flagship content and miss typical production (Methodology, 'Selection of YouTube Channels').

how reviews work

0 comments
Cite this review

Pith. "Pith review of Producers of Popular Science Web Videos. Between New Professionalism and Old Gender Issues." pith.science (2026). https://pith.science/paper/WO4CXWQJ

@misc{pith2026190805572,
  author       = {Pith},
  title        = {Pith review of: Producers of Popular Science Web Videos. Between New Professionalism and Old Gender Issues},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WO4CXWQJ}},
  note         = {Machine review of arXiv:1908.05572}
}
read the original abstract

This article provides an overview of the web video production context related to science communication, based on a quantitative analysis of 190 YouTube videos. The authors explore the main characteristics and ongoing strategies of producers, focusing on three topics: professionalism, producer's gender and age profile, and community building. In the discussion, the authors compare the quantitative results with recently published qualitative research on producers of popular science web videos. This complementary approach gives further evidence on the main characteristics of most popular science communicators on YouTube, it shows a new type of professionalism that surpasses the hitherto existing distinction between User Generated Content (UGC) and Professional Generated Content (PGC), raises gender issues, and questions the participatory culture of science communicators on YouTube.

Figures

Figures reproduced from arXiv: 1908.05572 by the authors.

Figure 3
Figure 3. Video Production per Week (95 Channels) [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figure 2
Figure 2. Audio Quality (190 Videos) [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 5
Figure 5. Profit versus non-Profit [PITH_FULL_IMAGE:figures/full_fig_p007_5.png] view at source ↗
Figures from the paper (4 more)
Figure 8
Figure 8. Figure 8: Producers’ Gender (370 Producers, Absolute Figures and Percentage) [PITH_FULL_IMAGE:figures/full_fig_p009_8.png]
Figure 9
Figure 9. Figure 9: Producers’ Gender According to Type of Production (370 Producers) Absolute Figures and Percentage [PITH_FULL_IMAGE:figures/full_fig_p010_9.png]
Figure 10
Figure 10. Figure 10: Average Age of All Producers (142 Producers, i.e., Only Actors and Presenters/Producers) [PITH_FULL_IMAGE:figures/full_fig_p010_10.png]
Figure 11
Figure 11. Figure 11: Average Age of Female Producers (30 Producers, i.e. Only Female Actors and Presenters/Producers) [PITH_FULL_IMAGE:figures/full_fig_p011_11.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

6 extracted references · 5 canonical work pages

  1. [1]

    Understanding the Characteristics of Internet Short Video Sharing: YouTube as a Case Study

    Amarasekara I, Grant WJ (2019) Exploring the YouTube science communication gender gap: A sentiment analysis. Public Understanding of Science 28(1). Benevenuto F, Rodrigues T, Almeida V, Almeida J, and Ross K (2009) Video interactions in online video social networks. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 5(4). Bo...

    work page Pith review arXiv 2019

  2. [4]

    Merleau Ponty M (2012) Phenomenology of Perception

    Available at: https://broadly.vice.com/de/article/8x4dwv/die-deutsche-youtube-szene-ist- sexistischer-als-jede-mario-barth-show (accessed on 20 November 2017). Merleau Ponty M (2012) Phenomenology of Perception. New York: Routledge. Molyneaux H, O’Donnell S, Gibson K, Singer J (2008) Exploring the Gender Divide on YouTube: An Analysis of the Creation and ...

    2012

  3. [5]

    Welbourne D and Grant WJ (2015) Science communication on YouTube: Factors that affect channel and video popularity

    Available at: https://de.statista.com/statistik/daten/studie/691565/umfrage/anteil-der-nutzer- von-youtube-nach-alter-in-deutschland/ (accessed on 20 November 2017). Welbourne D and Grant WJ (2015) Science communication on YouTube: Factors that affect channel and video popularity. Public Understanding of Science 25(6): pp. 1-14. Welzer H (2016) Die smarte...

    work page 2015

  4. [6]

    T-Rex 156 SmithsonianChannel Secrets of the Third Reich: This Video Exposes Hitler's Secret Illness 157 ScienceChannel Jumping Jack Ants vs

    ~ Source Energy 105 ScienceBob Science Bob's Crazy Foam Experiment 106 ScienceBob Exploding Pumpkins on Jimmy Kimmel Live 107 ouLEarn Shakespeare: Original Pronunciation 108 ouLEarn Maryam Bibi – Unlikely Leaders (2/5) 109 Euronews Knowledge World's smallest atomic clock 110 Euronews Knowledge Can Earthquakes Bring Life? Do You Know? 111 Naked Scientists ...

    work page 1994

  5. [125]

    How Today's Internet is Killing Our Culture and Assaulting Our Economy

    Keen A (2007) The Cult of the Amateur. How Today's Internet is Killing Our Culture and Assaulting Our Economy. London: Nicholas Brealey. Klicksafe (2017) Zahlen und Fakten – YouTube-Nutzung in Deutschland. Available at: http://www.klicksafe.de/themen/kommunizieren/youtube/zahlen-und-fakten- youtube-nutzung-in-deutschland/ (accessed on 17 October 2017). Ko...

    work page 2007

  6. [2016]

    Jenna Redfield Designs (2017) Why You need an Intro and Outro in your YouTube Videos

    Available at: http://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2016.pdf (accessed on 20 November 2017). Jenna Redfield Designs (2017) Why You need an Intro and Outro in your YouTube Videos. Available at: http://www.jennaredfielddesigns.com/blog/2017/1/12/why-you-need-an-intro- and-and-outro-in-your-youtube-videos (accessed on 20 Novem...

    work page 2017

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.