{"id":"9e61e2a1-698b-4f2b-b47d-8e9ede8c1081","arxiv_id":"2412.04236","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"Dynamic topic modeling of Ideas y Valores finds value theory, epistemology, and German philosophy as dominant themes, with no significant decline in historical articles.","lead":"We analyzed 816 Spanish-language articles from the Colombian philosophy journal Ideas y Valores with dynamic topic modeling to trace how philosophical topics evolved from 1951 to 2022. The results show steady emphasis on value theory, epistemology, and German philosophy, and no statistical evidence that historical scholarship declined.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The no-decline result depends on unvalidated manual #historical topic tags and an admitted ad-hoc 50% assignment cutoff, so r(38)=0.20, p=0.8885 is not yet a stable estimate.","rationale":"The reader's weakest assumption names exactly the two construction choices I also see as load-bearing: the manual #historical tags and the 50% cutoff. The paper's own text concedes both are open to discussion, and the regression outcome is computed on a variable whose numerator and denominator both depend on these choices. The stronger descriptive claims (dominance of value theory and epistemology/philosophy of science) are less threatened by this concern because they are aggregate and likely robust to moderate threshold changes; the non-decline null result, however, is precisely the kind of finding that can flip if the dependent variable is redefined. I therefore agree with the CONDITIONAL verdict: the substantive qualitative findings are plausible, but the historical-decline result needs sensitivity analysis and inter-annotator validation before it can be taken as established. No further adjustment is needed beyond what the reader already recommended.","tokens_in":19077,"tokens_out":3966,"duration_ms":43230,"concrete_test":"Use the released GitHub code to recompute the Sec. 4.3 ratio and regression under: (a) cumulative-likelihood thresholds of 25%, 75%, and 90%; (b) two independent annotators relabeling all 90 topics as #historical using the paper's stated PhilPapers-based criterion, with disagreements adjudicated by a third; report the range of r and one-sided p across all combinations. If every combination yields p > 0.05 with no negative slope, the no-decline conclusion survives; if a plausible threshold/tag combination gives p < 0.05 with negative slope, the null result is an artifact of the measurement.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central non-decline claim in Sec. 4.3 depends entirely on a dependent variable built from two unvalidated researcher choices: (1) the authors' manual '#historical' tag assigned at topic level (Sec. 3.3), and (2) the 50% cumulative-likelihood document-assignment threshold (Sec. 3.4). The threshold is admitted to be ad hoc ('There are two ad-hoc choices in this process...'), and the tags are admitted to be contestable ('tags may be open to discussion', Sec. 5). The tag is global to a topic: every document assigned to a tagged topic counts as historical, even though dynamic topics evolve and a topic like Kant-in-value-theory could be interpretive in one era and systematic in another. Because documents can be assigned to several topics, the yearly historical ratio is a non-linear function of these choices. A small change in which topics get the tag, or in the 50% cutoff, can change numerator and denominator differently, so r(38)=0.20, p=0.8885 is not a stable estimate of the historical-engagement trend. No inter-annotator or threshold-sensitivity evidence is provided.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper applies Dynamic Topic Models to 816 Spanish-language articles from the Colombian journal Ideas y Valores (1951-2022), labels the 90 learned topics using the PhilPapers taxonomy, assigns documents to topics via a 50% cumulative-likelihood cutoff, and reports descriptive trends: value theory, epistemology, and philosophy of science are the most prominent areas, German philosophers such as Kant, Hegel, and Husserl are strongly represented, and the ratio of articles in manually tagged \"#historical\" topics shows no significant decline (r(38)=0.20, p=0.8885). An appendix provides a tutorial-level derivation of LDA and DTM.","tokens_in":19343,"tokens_out":4691,"duration_ms":47686,"significance":"This is a valuable and unusually transparent contribution to the computational history of Latin American philosophy. It ships code and data, documents the Spanish preprocessing pipeline, uses an external public taxonomy to guide topic labeling, and is candid about several limitations. If the descriptive findings are robust, they provide a useful baseline for future journal-level studies in non-English philosophy. However, the main inferential claim about historical decline rests on the least validated part of the pipeline, namely the authors' manual #historical tags and an admitted ad-hoc document-assignment threshold, so the central conclusion is currently weaker than the descriptive results.","major_comments":[{"comment":"The central non-decline result in Figure 6 is a regression of the yearly ratio of \"historical\" documents, a variable constructed from (i) the authors' manual \"#historical\" topic tags (§3.3) and (ii) the 50% cumulative-likelihood document-assignment cutoff (§3.4). The authors explicitly call both choices ad hoc and concede that the tags \"may be open to discussion\" (§5). Because a document can be assigned to several topics and the ratio is therefore a nonlinear function of these choices, the reported r(38)=0.20, p=0.8885 is not a stable estimate without inter-annotator reliability or a sensitivity analysis. I ask for sensitivity analyses at other cutoffs (e.g., 25% and 75%), an examination of leave-one-out removal of contested tags, and, if possible, a small validation study with an independent rater for the #historical labels.","section":"§4.3 with §3.3 and §3.4"},{"comment":"The methods state that the corpus consists of 875 full-text articles, but after preprocessing \"we obtained a corpus of 816 documents\" with no explanation for the 59-document drop. Notes 4 and 5 later refer to 875 as the corpus size. Since all proportions in §4.1–§4.3 use document counts, the manuscript must specify whether the 875 or 816 base is used, why some documents were excluded, and whether the exclusions could affect the historical ratio.","section":"§3.1 and Table 1"},{"comment":"The choice K=90 is made using quantitative metrics combined with manual inspection, and no robustness check with respect to K is reported. Topic granularity directly determines which topics receive a \"#historical\" tag and hence the ratio in Figure 6; the main descriptive percentages and the non-decline finding could change at other values of K. I request that the central claims be rechecked at adjacent choices of K (e.g., 60 and 120), or that a stability analysis of the historical ratio across K be reported.","section":"§3.2"},{"comment":"The one-sided test H1:r<0 returns p=0.8885, which only fails to reject the null; it does not establish that the historical ratio is constant, especially with 40 yearly observations and a 95% confidence interval that includes both negative and positive slopes. The sentence \"it appears more likely that the ratio is constant\" is stronger than the evidence justifies. I recommend reporting the slope and confidence interval, and an explicit equivalence test or power analysis if the claim is that there was no meaningful decline.","section":"§4.3 and Figure 6"}],"minor_comments":[{"comment":"The text after Table 4 contains the typo \"Riceour\"; it should be \"Ricoeur\".","section":"§4.3"},{"comment":"The heading-like phrase \"Metaphyics and Epistemology\" contains a typo; it should be \"Metaphysics and Epistemology\".","section":"§4.1"},{"comment":"The y-axis label \"Historical Docs. / T otal Docs.\" has an unnecessary space in \"T otal\".","section":"Figure 6"},{"comment":"The note that two subareas have exactly the same number of items and most probable words is ambiguous; if this arises from one single topic tagged with multiple subarea labels, the table should state that directly rather than presenting them as separate aggregated subareas.","section":"Table 3 note"},{"comment":"The assignment procedure would be clearer if the manuscript stated how documents assigned to more than one #historical topic are counted in the numerator of the yearly historical ratio; the current description leaves this ambiguity.","section":"§3.4"}],"recommendation":"major_revision","confidential_remarks":"The manuscript is honest and reproducible, and the descriptive contribution is real. The main issue is not circularity but the lack of robustness evidence for the historical-decline test; the authors should be asked to add sensitivity analyses and to clarify the corpus-size discrepancy before publication."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"You should know this paper before citing it for the \"no decline in historical philosophy\" claim: that specific result is not yet stable. It rests on the authors' manual #historical topic tags and an admitted 50% document-assignment cutoff, neither of which gets inter-annotator or threshold-sensitivity testing. The paper itself is transparent about both choices, but the regression r(38)=0.20, p=0.8885 is essentially a restatement of those choices, not a robust finding on its own.\n\nThat said, the paper is genuinely useful for its descriptive core. It is the first topic-modeling study of Ideas y Valores, a major Latin American philosophy journal, and it ships code and data. The preprocessing for a Spanish-language corpus is careful, including OCR correction and lemmatization, and the main findings—value theory dominance, a strong German philosophy presence (Kant, Hegel, Husserl), and shifts in epistemology after 1990—are plausible and supported by the topic-word tables. The authors do not oversell; they explicitly flag the ad-hoc nature of several modeling decisions and call for independent raters in future work.\n\nWhere are the real soft spots? The 875-to-816 document drop is never explained, which is minor but should be fixed. K=90 is chosen partly by manual inspection, which is normal for topic modeling but means the topic set is one of many possible. The bigger issue is the historical-tagging pipeline: a topic is tagged globally as #historical, even though dynamic topics evolve, and then every document assigned to that topic counts as historical. Combined with the 50% likelihood cutoff, the yearly historical ratio can shift with small changes in either choice. The authors acknowledge this, but they do not test it. A sensitivity analysis across cutoffs (say 40-60%) and a second annotator tagging a sample of topics would either confirm or kill the no-decline result.\n\nWho gets value from this paper? Digital humanists studying non-English philosophy corpora, historians of Latin American philosophy, and anyone building NLP workflows for Spanish. The descriptive map is worth having, and the code is reusable. The historical-decline claim should be read as a hypothesis, not a conclusion.\n\nMy recommendation: send it to peer review, but with a clear request for sensitivity analysis on the cutoff and at least a small inter-annotator check on the historical tags. If that comes back clean, the paper is a solid contribution. If not, the descriptive half still stands, but the headline result should be softened.","headline":"A useful first topic-modeling map of a Colombian philosophy journal, with a solid descriptive core and a historically-focused claim that needs sensitivity work before it can be trusted.","tokens_in":19788,"tokens_out":1260,"would_cite":true,"duration_ms":15438,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Value theory and epistemology dominate Colombia's philosophy journal, with no decline in historical articles since 1951.","keywords":["topic modelling","dynamic topic models","Ideas y Valores","Colombian philosophy","value theory","history of philosophy","Spanish natural language processing","digital humanities"],"falsifier":"Re-run the analysis with independent raters assigning '#historical' tags to the same 90 topics, or with cutoff values of 30% and 70%; a statistically significant negative correlation between the historical-article ratio and year under any of those replications would show that the reported non-decline is an artifact of the tagging and cutoff choices.","tokens_in":18876,"feed_emoji":"📚","tokens_out":4436,"duration_ms":42597,"temperature":0.7,"pith_summary":"This paper tries to show what a data-driven history of philosophy looks like outside the Anglophone mainstream by topic-modelling every Spanish-language article published in Ideas y Valores, Colombia's leading philosophy journal, between 1951 and 2022. Its central empirical claims are that value theory (ethics, political philosophy, aesthetics) and epistemology and philosophy of science dominate the journal's output, that German thinkers such as Kant, Husserl, and Hegel are constant reference points, and that historically focused articles did not significantly decline despite an editorial turn toward 'original' work. A sympathetic reader would take these findings as evidence that the journal's history is one of stable engagement with the history of philosophy and a lasting ethical-political orientation, and as a demonstration that the tools of computational text analysis transfer to a Spanish-language corpus.","feed_headline":"Value theory dominates Colombia's top philosophy journal since 1951","feed_subtitle":"A topic model of 875 Spanish articles finds ethics and political philosophy lead, with no drop in historical work.","key_machinery":"The central object is the Dynamic Topic Model, a temporal extension of Latent Dirichlet Allocation in which topic-word distributions evolve by small Gaussian steps from one time slice to the next. The paper fits K=90 topics to 875 Spanish-language articles, labels each topic with a PhilPapers main-area and subarea tag plus an optional '#historical' tag, and assigns documents to topics by taking the top documents that cumulatively cover 50% of the likelihood sum for each topic. This machinery produces the area shares and the yearly historical-ratio series that are then tested by linear regression.","core_discovery":"Across Ideas y Valores from 1951 to January 2022, the journal's most prominent philosophical areas are value theory (571 documents, led by ethics and political philosophy) and metaphysics and epistemology (240 documents), with a stable emphasis on German philosophers, especially Kant, Hegel, Husserl, and Heidegger. Against the expectation raised by editorial debates, the share of documents assigned to historically focused topics shows no significant decline (r(38)=0.20, p=0.8885 on a one-sided test), and the fitted slope is slightly positive (0.0020). The authors conclude that editorial pressure toward original work did not measurably reduce historical scholarship.","pith_inferences":["Because the 50% likelihood cutoff for assigning documents to topics is admitted to be arbitrary, the absolute document counts per main area are less robust than the qualitative topic patterns, and small changes in that cutoff could shift the area shares.","The '#historical' tag groups author-focused topics (Kant, Hegel, Husserl) together with exegetical method, so a finer distinction between 'about a historical figure' and 'using historical interpretation' could reveal a decline that the current binary tag hides.","If other Latin American journals show the same value-theory dominance, this would suggest a regional pattern in philosophy publication rather than a peculiarity of Ideas y Valores.","The stable ratio of historical articles may be tied to the persistent presence of German philosophy in the journal; testing author affiliations and reference networks could show whether the apparent stability is driven by a specific scholarly community."],"forward_implications":["If the flat historical ratio holds, the journal's 1980s policy shift toward 'original' work did not crowd out interpretive and historical scholarship.","The concentration in value theory suggests that Colombian philosophy's public identity is tied to ethics, political philosophy, and aesthetics more than to other areas.","German idealism and phenomenology, centered on Kant, Hegel, Husserl, and Heidegger, remain stable reference points across many topics throughout the journal's lifetime.","The same Dynamic Topic Model pipeline can be applied to other Latin American journals, allowing comparable regional histories of philosophy to be constructed.","The Spanish-language preprocessing workflow, including custom OCR correction and expanded stopword lists, is a necessary part of making topic modelling work on non-English philosophical corpora."],"supporting_citations":[{"why":"Supplies the Dynamic Topic Model method that tracks how topic-word distributions evolve across time slices.","marker":"[Blei and Lafferty, 2006]"},{"why":"Provides the Latent Dirichlet Allocation foundation that the Dynamic Topic Model extends.","marker":"[Blei et al., 2003]"},{"why":"Serves as the template application of topic modelling to a philosophy journal, which this paper adapts to a Spanish-language corpus.","marker":"[Malaterre et al., 2019a]"},{"why":"Provides the multi-journal comparison and model-selection practices, such as coherence and perplexity, used to choose the number of topics.","marker":"[Malaterre et al., 2021]"},{"why":"Supplies the PhilPapers taxonomy used to label topics by main area and subarea.","marker":"[Bourget and Chalmers]"},{"why":"Documents the journal's early universalist policy and the editorial debates that motivate the historical-decline hypothesis.","marker":"[Betancur Gómez, 2021]"},{"why":"Proposes human-interpretability validation methods that the authors cite for refining topic labeling in future work.","marker":"[Chang et al., 2009]"}],"fun_headline_variants":["Value theory tops Colombia's Ideas y Valores for 70 years","No decline in historical philosophy in top Colombian journal","Ethics, political philosophy lead Colombian journal's topics","German philosophers persist in Colombia's philosophy journal","Topic modeling reveals Colombian philosophy's stable historical core"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The claim that historical articles never declined rests on the authors' manually assigned '#historical' topic labels and their 50% likelihood cutoff for assigning documents to topics; if either misclassifies documents, the flat trend could vanish.","fun_headline_variants_meta":{"raw":{"variants":["Value theory tops Colombia's Ideas y Valores for 70 years","No decline in historical philosophy in top Colombian journal","Ethics, political philosophy lead Colombian journal's topics","German philosophers persist in Colombia's philosophy journal","Topic modeling reveals Colombian philosophy's stable historical core"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000289,"raw_usage":{"total_tokens":1670,"prompt_tokens":900,"completion_tokens":770,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":516,"completion_tokens_details":{"reasoning_tokens":695}},"tokens_in":516,"tokens_out":770,"duration_ms":7968,"temperature":1.0,"reasoning_tokens":695,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-11T21:36:48.345288+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the analysis with independent raters assigning '#historical' tags to the same 90 topics, or with cutoff values of 30% and 70%; a statistically significant negative correlation between the historical-article ratio and year under any of those replications would show that the reported non-decline is an artifact of the tagging and cutoff choices.","supporting_citations":[],"review_version":1}