Pith. sign in

REVIEW 4 major objections 5 minor 30 references

From Fads to Classics -- Analyzing Video Game Trend Evolutions through Steam Tags

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read Steam tag data indicates a typical video-game feature trend rises for about four years before fading.

desk verdict The four-year trend duration claim rests on a null model that removes the metric's own autocorrelation; the paper itself is a solid descriptive study that needs major revision. read the letter →

arxiv 2506.08881 v1 pith:GBAXPDWP submitted 2025-06-10 cs.HC

classification cs.HC
keywords videogametrendsSteamtagsfad-fashion-classictrenddurationCohen'shsparsePCAanalytics
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper aims to establish that trends in video-game features can be read from user-assigned Steam tags, and that a typical feature trend rises for about four years before declining. The authors measure each tag's yearly share of released games, build four related scores, and combine them into a combined recent trend score; comparing the longest positive runs of this score with a null built from independent samples yields the four-year figure. They also sort tags into short-lived fads, medium-lived fashions, and stable classics, and report that industry experts found the resulting curves and examples consistent with their market experience. The stakes are practical: with development cycles often spanning three to five years, a studio that chases a trend may ship after the trend has already peaked.

What carries the argument

The central mechanism is the combined recent trend score, $f_c(T,Y_i)=0.82f_r(T,Y_i)+0.57f^h_r(T,Y_i)$, built as a weighted sum after a sparse PCA on four related curves. Each ingredient is a Cohen's h comparison of a yearly proportion with a benchmark: for two proportions $p_1$ and $p_2$, Cohen's h is $\phi(p_1)-\phi(p_2)$ with $\phi(p)=2\arcsin(\sqrt{p})$, so a difference only counts as a trend if the current proportion is itself large. The recent scores compare the current year with the average of the previous five years; the high-priority variant uses only games where the tag is essential. Trend-increase periods are consecutive years in which this combined score stays positive, and the four-year claim comes from comparing the histogram of the longest such periods with an independent-sampling null.

What would settle it

Build a null distribution for the longest positive-run histogram by resampling the combined recent trend score with a method that preserves its year-to-year dependence (for example, fitting a simple autoregressive model or using block bootstrap); if the second mode at four years still appears in that null, the paper's inference that the mode reflects real four-year trend cycles would not be supported.

Watch

Extended reading notes

Core claim

The paper's central discovery is that the rise phase of a video-game tag trend typically lasts about four years. This is inferred from the histogram of the longest consecutive runs in which the combined recent trend score remains positive: the observed histogram shows a mode at two years and a second mode at four years, while the histogram built from independently sampled score values shows only the first mode. The paper attributes this extra four-year mode to genuine trend effects. It also claims that the same measurements reproduce the conceptual division of trends into fads, fashions, and classics, and it presents expert-validated examples: Experimental as a fad, Free to Play as a fashion, and Battle Royale as a classic. The analysis is explicitly a supply-side view, tracking the features of released games rather than player purchases or playtime.

Load-bearing premise

The four-year claim stands on the assumption that the extra mode in the duration histogram comes from real trend effects rather than from the way the score is built, specifically from comparing each year with the average of the previous five years, which makes consecutive yearly values depend on one another.

Editorial extensions

If this is right

  • If the four-year rise is typical, a development cycle of three to five years means a project started at a trend's onset can release at or after its peak, so trend-following is a risky strategy.
  • The fad/fashion/classic split gives a vocabulary and a visual method for separating short spikes from durable genre shifts, useful to publishers and investors.
  • Proportion-based scores protect the analysis from the steady growth in total yearly releases, so a tag's rise is measured relative to the market rather than in raw counts.
  • Because the pipeline is published with source code, other researchers can apply the same score construction to any Steam tag or to other tagged media catalogs.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The authors leave implicit that their null model may be too lenient: because the combined score compares each year with a trailing five-year average, consecutive values are dependent by construction, and an independent-sampling null removes that dependence rather than 'trend effects.'
  • We infer that a demand-side replication, tracking playtime or sales instead of releases, could produce trend lifespans that differ from four years, since supply follows investment cycles while demand reacts to player behavior.
  • A calibration experiment the paper does not run is to generate synthetic tag series with known trend durations and pass them through the same pipeline; the share of the four-year mode that survives in synthetic data would reveal how much of the estimate is metric-driven.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes a data-driven framework for analyzing the evolution of Steam game tags as a proxy for video game trends. It defines four trend scores (general, recent, high-priority, high-priority recent), combines the two recent scores via sparse PCA into a combined recent trend score, and uses these to classify trends as fads, fashions, or classics following Bae et al. The central quantitative claim, addressing RQ3, is that the surge of a trend typically lasts about four years, based on a comparison of observed maximum positive-run lengths of the combined recent trend score against a null model of independent sampling. The paper also includes qualitative interpretations of selected tag curves by two industry experts and provides open-source code.

Significance. If the four-year trend-increase duration held up, it would be a practically useful quantitative benchmark for game developers and publishers, and the paper would provide a credible supply-side replication of the fad/fashion/classic taxonomy. The paper is also commendable for releasing its analysis code and for grounding its interpretations in concrete, domain-specific examples. However, the central quantitative result is not supported by the analysis as presented: the null model destroys the autocorrelation that the metric itself builds in, and the abstract overstates what the histogram shows. The qualitative evaluation, while rich, cannot substitute for a valid statistical inference.

major comments (4)
  1. [Section IV-D, Definitions 2 and 4] The independent-sampling null model is inappropriate for the metric it is meant to test. The recent trend score f_r(T,Y_i) compares p_i to a trailing five-year average p_r(i) that includes p_i, so even if the underlying proportions p_i were white noise, the signs of f_r(T,Y_i) (and therefore of f_c = 0.82 f_r + 0.57 f_hr) are autocorrelated by construction. The stated rationale, that in the absence of trend effects the f_c values would be independently distributed, is false. Therefore the second mode at four years in the blue histogram of Figure 3 cannot be attributed to 'trend effects' unless the null model reproduces the overlapping-window dependence of the metric. This invalidates the main RQ3 conclusion as stated.
  2. [Abstract and Section IV-D / Section VII] The abstract claims that 'the surge of a trend averages at about four years,' and the conclusion says trends 'typically last about four years,' but Section IV-D identifies a second mode at four years in a histogram of maximum positive runs, not an average duration. Moreover, the histogram is over only 9 years per tag (K=13 with f_c defined for i=5,...,13), so a mode at four years is not evidence about a typical trend duration. The claims in the abstract and conclusion should be rephrased to match exactly what the analysis shows, or the analysis should be extended to estimate a duration distribution.
  3. [Section V] The 'industrial experts' who validate the findings are the third and fourth authors of the paper, and the selection of example tags was made by the authors themselves. This is not an independent external validation, and the abstract's phrasing 'After using industrial experts to validate our findings' overstates the evidentiary value. Please either recruit independent experts or clearly present this as authors' domain-expert interpretation rather than validation.
  4. [Sections IV-A, IV-B, IV-E] The four-year result depends on several hand-tuned choices with no sensitivity analysis: the five-year recent window (Definition 2), the 0.6 high-priority threshold, the sparse PCA weights (0.82 and 0.57), the start year 2012, and the use of 'at least four years trend increase' as the inclusion criterion for the fad/fashion/classic classification. Because the combined recent trend score f_c is the basis for the duration analysis, the paper should demonstrate that the four-year mode is robust to these choices, or at least discuss how each parameter affects the result.
minor comments (5)
  1. [Abstract] The phrase 'short-livedfads' is missing a space and should read 'short-lived fads.'
  2. [Section IV-E] The sentence 'we still intent on following' should be 'we still intend to follow.'
  3. [Section V] The phrase 'last four approximately four years' has a word-order error and should read 'last approximately four years.'
  4. [Section IV-D] The parenthetical 'which may be zero if the recent trend score is negative for all years' should refer to the combined recent trend score f_c, not the recent trend score f_r.
  5. [Figure 1] The line styles in Figure 1 are denoted only by dashes; please add a legend or explicit labels so the curves corresponding to general, recent, high-priority, and high-priority recent trend scores can be distinguished.

Circularity Check

1 steps flagged · score 6.0 of 10

The four-year trend-duration claim is generated by a null model that discards the autocorrelation built into f_c; the attributed 'trend effect' is a construction artifact.

  1. self definitional [Section IV-D (with Definition 2 and Section IV-B combined recent trend score)]
    "We define trend increase periods as consecutive years in which the combined recent trend score remains positive. ... Conversely, in the absence of trend effects, the values f_c(T, Yi) for a given tag across different years would be independently distributed. ... only the histogram derived from actual data, shown in blue, displays a second peak at four years. As discussed above, this second mode results from trend effects, supporting our claim that trends typically last around four years."

    The 'no trend effects' baseline is defined as independent draws of f_c, but f_c is built as 0.82 f_r + 0.57 f_hr, where f_r(T,Y_i) is Cohen's h of p_i against p_r(i), the average of p_{i-5} through p_i. Therefore f_r(i) and f_r(i+1) share five of six underlying proportions, making consecutive f_c values autocorrelated by construction even if tag proportions were white noise. The paper labels this built-in dependency 'trend effects' and attributes the extra four-year mode to it, but the separation between the blue histogram and the independent-sampling null is exactly the dependency already inserted by the moving-window definition. The four-year duration claim thus reduces to the metric's own construction rather than to an independently established trend cycle.

full rationale

The central quantitative claim, that 'the surge of a trend averages at about four years,' rests entirely on Section IV-D's comparison between the observed distribution of longest positive runs of f_c and an independent-sampling null. That null is not a valid no-trend baseline: because f_r and f_hr compare each p_i to a trailing five-year average that includes p_i, consecutive f_c values are necessarily autocorrelated by construction. The independent-sampling null removes exactly this autocorrelation, so the observed second mode at four years cannot be attributed to 'trend effects' without a null that reproduces the overlapping-window dependence. The paper itself acknowledges the dependency and calls it 'trend effects,' which makes the reasoning circular: the effect being 'discovered' is already present in the definition of the score. Other elements, such as the priority notion cited from the authors' prior work, the hand-chosen 5-year window, the 0.6 priority threshold, and the PCA weights fitted to the same data, weaken the claim's independence but are not themselves the main circular step. Because the paper's headline prediction is an artifact of the metric's own moving-window construction, the circularity score is 6.

Assumptions & free parameters 6 free parameters · 6 assumptions · 0 invented entities

The central 'four-year' result rests on several hand-chosen parameters and domain assumptions: the 5-year recent window, the 0.6 high-priority threshold, the sparse PCA weights, and the filters that reduce tags from 450 to 66. The duration inference also depends on a questionable independent-sampling null model and on author-provided expert validation. No new physical or conceptual entities are introduced.

free parameters (6)
  • Recent window size = 5 years
    Used in Definitions 2 and 4 to compute the recent trend score. Chosen based on AAA development time and is parameterizable; the four-year duration result is likely sensitive to this window.
  • High-priority threshold = 0.6
    Empirically chosen at the elbow of the cumulative histogram of tag priorities. Affects the high-priority trend scores and therefore the classification and duration measures.
  • Sparse PCA weights for combined recent trend score = 0.82 and 0.57
    Fitted by sparse PCA to the same data used for the duration analysis. These weights define the combined recent trend score used to identify trend increase periods.
  • Start year = 2012
    Chosen because the metrics are noisy before 2012. This excludes earlier data and may affect the estimated proportions and duration patterns.
  • Minimum trend increase length for classification = 4 years
    Tags must have at least four years of trend increase to be included in the classification step, reducing the set from 450 to 194 tags. This threshold overlaps with the claimed typical trend duration.
  • Peak cutoff year = 2021
    Only tags that peaked before 2021 are kept for classification so that decrease speed can be observed. This further filters the set down to 66 tags and introduces selection bias.
assumptions (6)
  • domain assumption Steam tags are user-assigned but reliably describe important game features and genres
    The paper cites prior work [12], [13] for this, but also acknowledges mislabeling and inconsistency as limitations in Section VI.
  • domain assumption The proportion of released games carrying a tag is a meaningful supply-side measure of trends
    Stated in Section III as a deliberate alternative to demand-side playtime data. The choice is reasonable for developers but is not validated against demand measurements.
  • domain assumption Retroactive tagging does not systematically distort historical trend curves
    Tags were introduced in 2014 and retroactively assigned, and the analysis starts in 2012. The paper acknowledges in Section VI that user perceptions of older games may affect tag assignments.
  • domain assumption A game either has a tag or does not, and live-service or DLC updates do not change its tag status
    Used in Section IV-E to map games onto the Bae et al. adoption model. The limitations section notes that live-service games and DLCs can change a game's identity after release.
  • ad hoc to paper Independent sampling of the combined recent trend score is a valid null model for the absence of trend effects
    Section IV-D compares the observed duration histogram to one from independently sampled values. This null removes the autocorrelation created by the 5-year moving window, so the comparison is not a valid test for trend effects.
  • ad hoc to paper Qualitative judgments by two industry experts are valid external validation
    Section V states the experts are the third and fourth authors of the paper, so the validation is not independent of the research team.

how reviews work

0 comments
Cite this review

Pith. "Pith review of From Fads to Classics -- Analyzing Video Game Trend Evolutions through Steam Tags." pith.science (2026). https://pith.science/paper/GBAXPDWP

@misc{pith2026250608881,
  author       = {Pith},
  title        = {Pith review of: From Fads to Classics -- Analyzing Video Game Trend Evolutions through Steam Tags},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GBAXPDWP}},
  note         = {Machine review of arXiv:2506.08881}
}
read the original abstract

The video game industry deals with a fast-paced, competitive and almost unpredictable market. Trends of genres, settings and modalities change on a perpetual basis, studios are often one big hit or miss away from surviving or perishing, and hitting the pulse of the time has become one of the greatest challenges for industrials, investors and other stakeholders. In this work, we aim to support the understanding of video game trends over time based on data-driven analysis, visualization and interpretation of Steam tag evolutions. We confirm underlying groundwork that trends can be categorized in short-lived fads, contemporary fashions, or stable classics, and derived that the surge of a trend averages at about four years in the realm of video games. After using industrial experts to validate our findings, we deliver visualizations, insights and an open approach of deciphering shifts in video game trends.

Figures

Figures reproduced from arXiv: 2506.08881 by the authors.

Figure 1
Figure 1. Trend evolution for the tag PvE, as measured with dif￾ferent considerations regarding priority and future-dependency (see Sections III and IV-A). III. METHODOLOGY Towards developing an analysis suitable for answering RQ1, we first compute four curves that show the evolution of a tag through the years (see [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 3
Figure 3. Histograms of maximum duration of trend increases in [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figure 4
Figure 4. The general trend scores of Experimental (fad), Free to Play (fashion) and Battle Royale (classic). Regarding RQ2, we presented general trend score curves for three different tags that are conceptually well-defined, which showed a clear trend evolution as indicated by the metric in Section IV-E, and for which justified elaborations could be derived from industrial knowledge. As depicted in [PITH_FULL_IMAGE:figures/… view at source ↗
Figures from the paper (1 more)
Figure 5
Figure 5. Figure 5: The trend curves of Souls-like and Exploration, two tags that are currently trending. a classic trend. Even when excluding the main genre titles with maintained player bases, “Battle Royale mechanics (shrinking maps, last player standing. . . )” were introduced to more…

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

30 extracted references · 28 canonical work pages

  1. [1]

    Mathematical modeling of trend cycle: Fad, fashion and classic,

    H.-O. Bae, S. Y . Cho, J. Yoo, and S.-B. Yun, “Mathematical modeling of trend cycle: Fad, fashion and classic,”Physica D: Nonlinear Phenomena, vol. 472, p. 134500, 2025

  2. [2]

    Video game genre, evolution and innovation,

    D. Arsenault, “Video game genre, evolution and innovation,”Eludamos: Journal for computer game culture, vol. 3, no. 2, pp. 149–176, 2009

  3. [3]

    Recent trends in the por- tuguese video game industry: 2016–2020,

    F. Nunes, P. Santos, P. Romeiro, and C. Pinto, “Recent trends in the por- tuguese video game industry: 2016–2020,” inInternational Conference on Videogame Sciences and Arts. Springer, 2020, pp. 15–32

  4. [4]

    Our princess is in another castle: A review of trends in serious gaming for education,

    M. F. Young, S. Slota, A. B. Cutter, G. Jalette, G. Mullin, B. Lai, Z. Simeoni, M. Tran, and M. Yukhymenko, “Our princess is in another castle: A review of trends in serious gaming for education,”Review of educational research, vol. 82, no. 1, pp. 61–89, 2012

  5. [5]

    Is this the end of the (fantasy) world as we know it? multiplayer online battle arenas (mobas) versus massively multiplayer online role playing games (mmorpgs)

    B. Stetina, A. Klaps, Z. Kovacovsky, and J. Aden, “Is this the end of the (fantasy) world as we know it? multiplayer online battle arenas (mobas) versus massively multiplayer online role playing games (mmorpgs).” 11 2016

  6. [6]

    Electric retrospective – playtime’s over: The rise and fall of toys to life,

    WGEcho, “Electric retrospective – playtime’s over: The rise and fall of toys to life,” 2017, accessed: 2025-03-06. [Online]. Available: https://wgecho.org/2017/10/25/ electric-retrospective-playtimes-over-the-rise-and-fall-of-toys-to-life/

  7. [7]

    Why we hate (some) video game motion controls,

    J. Harris, “Why we hate (some) video game motion controls,” Psychology Today, 2015, accessed: 2025-03-06. [Online]. Avail- able: https://www.psychologytoday.com/us/blog/mind-games/201506/ why-we-hate-some-video-game-motion-controls

  8. [8]

    The case for dynamic difficulty adjustment in games,

    R. Hunicke, “The case for dynamic difficulty adjustment in games,” inProceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, 2005, pp. 429–433

Show all 30 references
  1. [9]

    Squire,Open-ended video games: A model for developing learning for the interactive age

    K. Squire,Open-ended video games: A model for developing learning for the interactive age. MacArthur Foundation Digital Media and Learning Initiative, 2007

  2. [10]

    Designing for disability: Evaluating the state of accessibility design in video games,

    M. Brown and S. L. Anderson, “Designing for disability: Evaluating the state of accessibility design in video games,”Games and Culture, vol. 16, no. 6, pp. 702–718, 2021

  3. [11]

    Is it a sense of autonomy, control, or attachment? exploring the effects of in-game customization on game enjoyment,

    K. Kim, M. G. Schmierbach, M.-Y . Chung, J. D. Fraustino, F. Dardis, L. Ahernet al., “Is it a sense of autonomy, control, or attachment? exploring the effects of in-game customization on game enjoyment,” Computers in Human Behavior, vol. 48, pp. 695–705, 2015

  4. [12]

    Full steam ahead: A conceptual analysis of user-supplied tags on steam,

    T. W. Windleharth, J. Jett, M. Schmalz, and J. H. Lee, “Full steam ahead: A conceptual analysis of user-supplied tags on steam,”Cataloging & Classification Quarterly, vol. 54, no. 7, pp. 418–441, 2016

  5. [13]

    A preliminary network analysis on steam game tags: another way of understanding game genres,

    X. Li and B. Zhang, “A preliminary network analysis on steam game tags: another way of understanding game genres,” inProceedings of the 23rd International Conference on Academic Mindtrek, 2020, pp. 65–73

  6. [14]

    A data-driven classification of video game vocabulary,

    N. Grelier and S. Kaufmann, “A data-driven classification of video game vocabulary,” inInternational Conference on Entertainment Computing. Springer, 2023, pp. 17–30

  7. [15]

    (2025) Steam game releases by year

    SteamDB. (2025) Steam game releases by year. [Online]. Available: https://steamdb.info/stats/releases/

  8. [16]

    PC & console gaming report 2024,

    Newzoo, “PC & console gaming report 2024,” Tech. Rep., 2024

  9. [17]

    An empirical study of early access games on the steam platform,

    D. Lin, C.-P. Bezemer, and A. E. Hassan, “An empirical study of early access games on the steam platform,”Empirical Software Engineering, vol. 23, pp. 771–799, 2018

  10. [18]

    The panorama of steam multiplayer games (2018-2020): A player reviews analysis,

    S. Petrosino, E. Loria, A. Kainz, and J. Pirker, “The panorama of steam multiplayer games (2018-2020): A player reviews analysis,” in Proceedings of the 17th International Conference on the Foundations of Digital Games, 2022, pp. 1–7

  11. [19]

    Virtual reality and education–the steam panorama,

    J. Pirker, E. Loria, A. Kainz, J. Kopf, and A. Dengel, “Virtual reality and education–the steam panorama,” inProceedings of the 17th International Conference on the Foundations of Digital Games, 2022, pp. 1–11

  12. [20]

    Towards factor-oriented understanding of video game genres using exploratory factor analysis on steam game tags,

    X. Li, “Towards factor-oriented understanding of video game genres using exploratory factor analysis on steam game tags,” in2020 IEEE international conference on Progress in informatics and computing (PIC). IEEE, 2020, pp. 207–213

  13. [21]

    Automated clustering of video games into groups with distinctive names,

    N. Grelier and S. Kaufmann, “Automated clustering of video games into groups with distinctive names,” inInternational Conference on Entertainment Computing. Springer, 2024, pp. 223–231

  14. [22]

    Success factors of game products by using a diffusion model and cluster analysis,

    S. Song, N.-W. Cho, and T. Kim, “Success factors of game products by using a diffusion model and cluster analysis,”Journal of Korean Institute of Industrial Engineers, vol. 42, no. 3, pp. 222–230, 2016

  15. [23]

    Predicting success factors of video game titles and companies,

    J. Pfau, M. Debus, J. Juul, E. Lundedal Hammar, A. Canossa, and M. Seif El-Nasr, “Predicting success factors of video game titles and companies,” inInternational Conference on Entertainment Computing. Springer, 2022, pp. 269–282

  16. [24]

    From teams to games: Connecting game development to game characteristics,

    E. Lundedal Hammar, A. Canossa, M. S. Debus, J. Pfau, M. Seif El- Nasr, J. Juul, and A. Azadvar, “From teams to games: Connecting game development to game characteristics,” inInternational Conference on Human-Computer Interaction. Springer, 2023, pp. 336–340

  17. [25]

    Flawless victory! investi- gating search and experience qualities as antecedent predictors of video game success,

    S. Heidenreich, F. Handrich, and T. Kraemer, “Flawless victory! investi- gating search and experience qualities as antecedent predictors of video game success,”Electronic Markets, vol. 33, no. 1, p. 20, 2023

  18. [26]

    Sparse principal component analysis,

    H. Zou, T. Hastie, and R. Tibshirani, “Sparse principal component analysis,”Journal of computational and graphical statistics, vol. 15, no. 2, pp. 265–286, 2006

  19. [27]

    Cohen,Statistical power analysis for the behavioral sciences

    J. Cohen,Statistical power analysis for the behavioral sciences. rout- ledge, 2013

  20. [28]

    Schell,The Art of Game Design: A Book of Lenses, 2nd ed

    J. Schell,The Art of Game Design: A Book of Lenses, 2nd ed. Boca Raton, FL: CRC Press, 2014

  21. [29]

    Dix and P

    J. Dix and P. Wright,Game Development Essentials: An Introduction. Boston, MA: Delmar Cengage Learning, 2007

  22. [30]

    Principal component analysis: a review and recent developments,

    I. T. Jolliffe and J. Cadima, “Principal component analysis: a review and recent developments,”Philosophical transactions of the royal society A: Mathematical, Physical and Engineering Sciences, vol. 374, no. 2065, p. 20150202, 2016

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.