Pith. sign in

REVIEW 4 major objections 6 minor 102 references

Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias

T0 review · 4 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash

Pith's one-line read This paper proposes a scalable, comparison-based pipeline that detects media bias in event selection and labeling and word choice by measuring each news outlet's deviation from the cross-outlet average, using topic modeling, sentiment…

desk verdict Integration-level novelty with a real validation gap: the entity-level spectrum uses raw counts and the abstract overclaims what the case studies actually show. read the letter →

arxiv 2505.01754 v1 pith:R732KO6M submitted 2025-05-03 cs.AI cs.CLcs.IRcs.LGcs.MA

classification cs.AIcs.CLcs.IRcs.LGcs.MA
keywords mediabiaslargelanguagemodelstopicmodelingsentimentanalysisontologylearningeventselectionlabelingandwordchoicespectrum
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that media bias can be studied without any zero-bias baseline: instead, bias is defined relationally, as a news outlet's deviation from the average behavior of the other outlets covering the same topic in the same period. The authors build a pipeline that groups articles with hierarchical topic modeling, scores sentiment in titles, text bodies, and toward named entities, and extracts article-level ontologies with a large language model. Three case studies on the October 2023 Hamas attack, the 2023 Belt and Road Forum, and the full dataset demonstrate that event selection bias and labeling/word choice bias show up as measurable, visualizable differences across outlets. The paper claims the method succeeds for those two bias forms, while commission and omission analysis through ontologies works in the smaller case study but degrades as topic size grows.

What carries the argument

The carrying object is the media bias spectrum, a two-axis scatter plot in which the x-axis is an outlet's sentiment deviation from the cross-outlet mean and the y-axis is its coverage-share deviation from the same mean, with point size encoding the underlying article or mention count. This spectrum is fed by a hierarchy of topic clusters from BERTopic, target-dependent sentiment scores from a RoBERTa news model, and GPT-4-generated ontologies with automatic consistency checks. The spectrum makes the paper's relational definition of bias operational: the mean is always zero, and every outlet is plotted as a departure from that zero.

What would settle it

Take one newspaper's articles on a single event, compute its sentiment and coverage deviations against two different sets of peer outlets from the same dates, and check whether its bias scores move substantially; if they do, the measured bias is a property of the outlet pool rather than of the reporting.

Watch

Extended reading notes

Core claim

The central claim is that comparing outlets against the mean of all outlets—rather than against an external truth or ideological label—yields a scalable, minimally biased way to surface media bias. Concretely, the coverage share per outlet per topic, compared with the cross-outlet mean, exposes event selection bias, while the mean sentiment per outlet, also compared with the cross-outlet mean at title, body, and entity levels, exposes labeling and word choice bias. The paper further claims that comparing the objects and relations in each outlet's ontology can expose commission and omission, and that this worked in one small topic but did not hold up when the corpus grew larger.

Load-bearing premise

The load-bearing premise is that a newspaper's systematic difference from the average of the other included newspapers is media bias, not sampling noise, editorial style, or model error, since the paper explicitly rejects any zero-bias reference point and supplies no external ground truth.

Editorial extensions

If this is right

  • Event selection bias becomes measurable without labels: an outlet that consistently sits above the mean on coverage of a topic is giving that topic disproportionate space relative to its peers.
  • Labeling and word choice bias is captured by title sentiment and entity-level sentiment, while whole-text sentiment is found to be uninformative in the paper's tests.
  • The same pipeline works at any level of the topic hierarchy, from a single small event to a cross-topic corpus, without extra adaptation steps.
  • For commission and omission, the method's usefulness is currently limited by unresolved semantic duplicates in the ontology nodes, so its reliable reach is smaller topics.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct consequence of the relational definition is that an outlet's measured bias depends on the chosen pool of comparison outlets: swap the pool and the same articles can show a different deviation, a corollary the paper does not draw out.
  • A testable extension would be to merge ontology nodes by embedding similarity before comparing graphs, which would likely let commission and omission analysis scale to the large topics where the paper reports failure.
  • Adding a time axis to the media bias spectrum could turn the method from a static snapshot into a detector of sentiment shifts around single events, an extension the paper lists as future work.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. Jähde, Weber, and Buchkremer present a modular NLP pipeline for comparative media-bias analysis. The pipeline combines BERTopic-based hierarchical topic modeling with RoBERTa and spaCy sentiment analysis at the title, body-text, and entity levels, and GPT-4-based ontology learning with automatic consistency checks. Outlets are compared through a 'media bias spectrum' showing each newspaper's deviation from the cross-outlet mean for coverage share and sentiment. The method is applied to 40,308 English RSS articles from 37 outlets in three case studies: the Supernova festival attack (t138), the 2023 Belt and Road Forum and Putin's visit (t751), and a cross-topic study. The paper reports success for event-selection bias and for labeling/word-choice bias measured through title and entity sentiment; it concedes that spaCy body-text sentiment was not informative and that ontology-based commission/omission analysis worked in the first case study but not in the second.

Significance. The paper has several genuine strengths. The comparative, deviation-from-mean design is transparent and reproducible in principle; Eqs. (1)–(5) are definitions rather than fitted quantities, so the bias scores do not smuggle in a fitted target. The ontology-consistency checks (object-class, object-object, object-relation) provide a concrete quality gate for LLM outputs, and the case studies include manual spot-checks that give the reader a sense of where the method works. If the effectiveness claim were fully supported, the 'media bias spectrum' would be a practical, scalable tool for comparing outlets. However, the evidence as presented does not yet support the generalized claim: entity-level count deviations are unnormalized, small-sample sentiment differences are reported without uncertainty, and the methodology's own results in Section 5.1 limit the validated scope to title/entity sentiment and some event-selection comparisons. The central claim is therefore defensible only after the measurement and validation gaps are addressed.

major comments (4)
  1. [Section 3.5, entity-axis definition; Tables A3–A4, B7–B8, C10] The y-axis for the entity-level media bias spectrum is the deviation of the raw number of entity mentions from the mean raw count, with no normalization by outlet size. Because per-outlet article counts range from 91 (CommonWealth Beacon) to 10,230 (The Hindu) in Section 4.1, raw mention counts largely reflect outlet output rather than bias. In Table C10, for example, Jerusalem Post (+2,468) and NDTV (+2,422) have the largest positive count deviations partly because they are the highest-output outlets in the dataset. The claim in Section 5.2 that the methodology 'successfully analyze[s]' event-selection bias depends on this axis. Please re-compute entity-level spectra with rates (e.g., mentions per 1,000 articles, or a regression controlling for outlet article volume) and report whether the qualitative conclusions change.
  2. [Section 4.3, Table A1; Section 4.4, Table B5] Many sentiment deviations are computed from a single article (e.g., CBC, Mothership, France24, Al Jazeera, El Pais, Straits Times, Japan Times, and BBC in t138; Bangkokpost, Mothership, El Pais, Journal, and Korea Herald in t751), and the paper reports no confidence intervals or significance tests. A deviation of -0.59 from one article cannot be distinguished from sampling noise. Please add uncertainty quantification, such as bootstrap intervals or a minimum-count threshold with suppressed or flagged points, and re-state the corresponding conclusions in Sections 5.1–5.2.
  3. [Abstract and Section 5.2] The generalized effectiveness claim is broader than the evidence in the paper itself. Section 5.1 states that the spaCy body-text sentiment analysis 'was found to hold no valuable result' and that for t751 'the proposed methodology failed to provide insights into omission and commission bias'; Section 5.2 concedes that commission and omission 'could not be consistently and successfully analyzed.' The abstract nonetheless says the methodology 'examines ... commission and omission biases' and 'demonstrate[s] the methodology's effectiveness in identifying biases across news sources.' Please narrow the abstract and conclusion to the components that survived the case studies (title and entity-level sentiment; event-selection comparisons), and present ontology-based commission/omission analysis as preliminary.
  4. [Section 2.1 and Eqs. (2), (5)] The bias scores are deviations from the mean of the included newspapers, and the paper explicitly rejects a zero-bias baseline. This is a defensible design choice, but the central claim that the scores identify media bias requires some evidence that the cross-outlet mean is a meaningful reference. As it stands, the method is calibrated to the selected corpus; the same scores would change if a different set of outlets were included. A concrete validation would be to compare a small set of computed deviations against independent bias judgments (e.g., human annotation or established outlet ratings such as AllSides or Ad Fontes) for the same topics, and to report agreement. Without such a check, the wording 'successfully analyze the potential media bias' in Section 5.2 remains an assumption about the reference distribution rather than a demonstrated result.
minor comments (6)
  1. [Section 3.3] There is a stray '].' immediately following the sentence that ends with '[60].' Please remove it.
  2. [Section 3.5 and Sections 4.3–4.4] 'Statistical interference' should be 'statistical inference,' and 'assorted communities' in Section 4.4 should be 'assortative communities.'
  3. [Section 4.2] The phrase '150 characters suitable of the target' is ungrammatical; it should read 'to the right of the target' or 'after the target.'
  4. [Section 3.5, Eq. (3)] The summation notation \sum_{i=0}^{|a(N_t)|} does not define the indexing variable; please write the average more explicitly or define i and the bounds.
  5. [Appendix B] The appendix heading 'Thirt Beld and Road Forum' contains a typo; it should be 'Third Belt and Road Forum.'
  6. [Section 4.4] 'Mispresented' should be 'misrepresented' in the discussion of the Moscow Times title.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper's quantitative outputs are transparent descriptive statistics, and its only author-overlap citation is a parameter-free formula that is not load-bearing.

full rationale

I walked the derivation chain from Eqs. (1) through (5). Equation (1) defines the per-newspaper coverage share p(Nt) = |a(Nt)|/|a(N)|; Eq. (2) defines the deviation d(Nt) = p(Nt) - pbar_t; Eqs. (3)-(5) define mean sentiment and sentiment deviations in the same way. These are direct descriptive summaries of article counts and model sentiment scores, not fitted parameters that are later renamed as predictions. The central claim in Section 5.2, that the methodology 'allows us to successfully analyze the potential media bias in event selection within news,' is an interpretive statement about cross-outlet deviations, and the paper explicitly frames the approach as comparative rather than absolute ('Instead of pinpointing a zero-bias baseline, we compare the presentation of the same political topic across different newspapers over the same timeframe'). The entity-level y-axis in Section 3.5 is based on raw mention counts rather than rates, and some sentiment deviations rest on one or two articles, but these are measurement-validity weaknesses, not reductions of the output to the input by construction. The only self-citation with author overlap is [59], used for the simplified sentiment score defined as positive probability minus negative probability; that formula is parameter-free, transparent, and independently checkable, so this citation is not load-bearing. The paper also candidly reports failures (spaCy text-body sentiment yielded no valuable insights; commission/omission analysis via ontologies was not consistently successful), which further undercuts any suggestion that the central claims are forced by a hidden self-referential definition. Overall, no circular step is exhibited, so the appropriate score is 0.

Assumptions & free parameters 3 free parameters · 6 assumptions · 0 invented entities

The formulas in Section 3.5 are descriptive definitions, not fitted derivations, so there are no fitted constants. The real load is carried by interpretive assumptions: deviations from the corpus mean equal bias; model scores represent labeling; GPT-4 ontology consistency implies content fidelity; RSS feeds represent outlets; and the chosen context window and top-entity truncation do not distort signals.

free parameters (3)
  • 150-character context window = 150 characters each side of target
    Adopted in Section 4.2 because full sentence context was too long for the dataset; affects every entity-level sentiment score in all case studies.
  • Top entities per topic = 10
    Section 4.2: only the ten most frequent entities per base topic received target-dependent sentiment analysis, so entity-level comparisons are incomplete and biased toward frequent entities.
  • Acceptable noise-topic proportion = 39.9%
    Section 4.2: the noise cluster was accepted although it is 3.9 points above the 36% recommendation cited from [46]; the authors judged the distribution acceptable by inspection.
assumptions (6)
  • domain assumption News bias can be operationalized as deviation from the cross-newspaper mean of article shares and sentiment scores, with no zero-bias baseline required.
    Section 2.1 states the 'bias relative to what?' problem, and Section 3.5 defines all bias signals through Eqs. (1) to (5) relative to the included newspapers' mean.
  • domain assumption Sentiment scores from RoBERTa and spaCy measure labeling and word choice bias.
    Section 3.2; the case studies rely on these model scores, despite the paper itself concluding that spaCy text sentiment yielded no valuable insights.
  • domain assumption GPT-4-generated ontologies, after consistency checks, faithfully represent article content for omission and commission analysis.
    Section 3.4: consistency checks only verify internal coherence, not semantic correctness, and no external validation of ontology content is provided.
  • domain assumption Topic clusters from BERTopic correspond to meaningful news topics after human review and merging single-newspaper topics into the noise cluster.
    Section 3.1; the t138 case study shows one misplaced article, and the noise cluster contains 39.9% of all articles.
  • ad hoc to paper The 150-character context window captures the sentiment context of each entity mention.
    Section 4.2: long sentences forced this window, and Section 4.4 notes that even one sentence of context is sometimes insufficient to judge sentiment toward an entity.
  • domain assumption RSS feeds and the selected 37 outlets are representative enough for cross-newspaper comparisons.
    Section 4.1 and Section 5.4 note that RSS feeds include only a fraction of all articles and that findings are specific to the given dataset.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias." pith.science (2026). https://pith.science/paper/R732KO6M

@misc{pith2026250501754,
  author       = {Pith},
  title        = {Pith review of: Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/R732KO6M}},
  note         = {Machine review of arXiv:2505.01754}
}
read the original abstract

Biased news reporting poses a significant threat to informed decision-making and the functioning of democracies. This study introduces a novel methodology for scalable, minimally biased analysis of media bias in political news. The proposed approach examines event selection, labeling, word choice, and commission and omission biases across news sources by leveraging natural language processing techniques, including hierarchical topic modeling, sentiment analysis, and ontology learning with large language models. Through three case studies related to current political events, we demonstrate the methodology's effectiveness in identifying biases across news sources at various levels of granularity. This work represents a significant step towards scalable, minimally biased media bias analysis, laying the groundwork for tools to help news consumers navigate an increasingly complex media landscape.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

102 extracted references · 30 canonical work pages

  1. [1]

    International Journal on Digital Libraries 20(4), 391–415 (2019) https://doi.org/10.1007/ s00799-018-0261-y

    Hamborg, F., Donnay, K., Gipp, B.: Automated identification of media bias in news articles: an interdisciplinary literature review. International Journal on Digital Libraries 20(4), 391–415 (2019) https://doi.org/10.1007/ s00799-018-0261-y

  2. [2]

    Refugee Crisis

    Kroon, A.C., Meer, T.G.L.A.: Who’s to Fear? Implicit Sexual Threat Pre and Post the “Refugee Crisis”. Journalism Practice 17(2), 319–335 (2023) https: //doi.org/10.1080/17512786.2021.1916401

  3. [3]

    Opperhuizen, A.E., Schouten, K., Klijn, E.H.: Framing a Conflict! How Media Report on Earthquake Risks Caused by Gas Drilling: A Longitudinal Analy- sis Using Machine Learning Techniques of Media Reporting on Gas Drilling from 1990 to 2015.Journalism Studies 20(5), 714–734 (2019) https://doi.org/ 10.1080/1461670X.2017.1418672

  4. [4]

    Galgoczy, M.C., Phatak, A., Vinson, D., Mago, V.K., Giabbanelli, P.J.: (Re)shaping online narratives: when bots promote the message of President Trump during his first impeachment.PeerJ Computer Science 8, 1–26 (2022) https://doi.org/10.7717/peerj-cs.947

  5. [5]

    Bernhardt, D., Krasa, S., Polborn, M.: Political polarization and the electoral effects of media bias.Journal of Public Economics 92(5-6), 1092–1104 (2008) https://doi.org/10.1016/j.jpubeco.2008.01.006

  6. [6]

    Wilson, A.E., Parker, V., Feinberg, M.: Polarization in the contemporary politi- cal and media landscape.Current Opinion in Behavioral Sciences34(October), 223–228 (2020) https://doi.org/10.1016/j.cobeha.2020.07.005

  7. [7]

    Baron, D.P.: Persistent media bias.Journal of Public Economics90(1-2), 1–36 (2006) https://doi.org/10.1016/j.jpubeco.2004.10.006

  8. [8]

    Machine-Learning media bias

    D’Alonzo, S., Tegmark, M.: Machine-learning media bias. PLoS ONE 17(8 August), 1–24 (2022) https://doi.org/10.1371/journal.pone.0271947 arXiv:2109.00024

Show all 102 references
  1. [9]

    Conference on Human Factors in Comput- ing Systems - Proceedings, 443–452 (2009) https://doi.org/10.1145/1518701

    Park, S., Kang, S., Chung, S., Song, J.: NewsCube: Delivering multiple aspects of news to mitigate media bias. Conference on Human Factors in Comput- ing Systems - Proceedings, 443–452 (2009) https://doi.org/10.1145/1518701. 1518772

  2. [10]

    2022.100064 47

    Naredla, N.R., Adedoyin, F.F.: Detection of hyperpartisan news articles us- ing natural language processing technique.International Journal of Information Management Data Insights2(1),100064(2022)https://doi.org/10.1016/j.jjimei. 2022.100064 47

  3. [11]

    Shultziner, D., Stukalin, Y.: Distorting the News? The Mechanisms of Partisan Media Bias and Its Effects on News Production.Political Behavior 43(1), 201– 222 (2021) https://doi.org/10.1007/s11109-019-09551-y

  4. [12]

    Journal of Computational Social Science 6(1), 289–313 (2022) https://doi.org/10.1007/ s42001-022-00196-2

    Németh, R.: A scoping review on the use of natural language processing in research on political polarization: trends and research prospects. Journal of Computational Social Science 6(1), 289–313 (2022) https://doi.org/10.1007/ s42001-022-00196-2

  5. [13]

    In: Handbook of Media Economics , pp

    Puglisi, R., Snyder, J.M.: Empirical Studies of Me- dia Bias. In: Handbook of Media Economics , pp. 647–667 (2015). https://doi.org/10.1016/B978-0-444-63685-0.00015-2 . https://linkinghub.elsevier.com/retrieve/pii/B9780444636850000152

  6. [14]

    Communications of the ACM 60(9), 65–71 (2017) https://doi.org/10

    Brandtzaeg, P.B., Følstad, A.: Trust and distrust in online fact-checking ser- vices. Communications of the ACM 60(9), 65–71 (2017) https://doi.org/10. 1145/3122803

  7. [15]

    Kang, H., Yang, J.: Quantifying Perceived Political Bias of Newspapers through a Document Classification Technique.Journal of Quantitative Linguistics29(2), 127–150 (2022) https://doi.org/10.1080/09296174.2020.1771136

  8. [16]

    Journal of Communication 50(4), 133–156 (2000) https://doi.org/10.1111/j

    D’Alessio, D., Allen, M.: Media Bias in Presidential Elections: A Meta-Analysis. Journal of Communication 50(4), 133–156 (2000) https://doi.org/10.1111/j. 1460-2466.2000.tb02866.x

  9. [17]

    Technical report, National Bureau of Economic Research, Cambridge, MA (oct 2002)

    Mullainathan, S., Shleifer, A.: Media Bias. Technical report, National Bureau of Economic Research, Cambridge, MA (oct 2002). https://doi.org/10.3386/w9295 . http://www.nber.org/papers/w9295.pdf

  10. [18]

    Rodrigo-Ginés, F.-J., Carrillo-de-Albornoz, J., Plaza, L.: A systematic review on media bias detection: What is media bias, how it is expressed, and how to detect it.Expert Systems with Applications237, 121641 (2024) https://doi.org/ 10.1016/j.eswa.2023.121641

  11. [19]

    Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention Is All You Need.arXiv: 1706.03762 (2017) arXiv:1706.03762

  12. [20]

    In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp

    Baly, R., Da San Martino, G., Glass, J., Nakov, P.: We Can Detect Your Bias: Predicting the Political Ideology of News Articles. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 4982–4991. Association for Computational Lin...

  13. [21]

    Quijote, T.A., Zamoras, A.D., Ceniza, A.: Bias detection in Philippine political 48 news articles using SentiWordNet and inverse reinforcement model.IOP Con- ference Series: Materials Science and Engineering 482, 012036 (2019) https: //doi.org/10.1088/1757-899X/482/1/012036

  14. [22]

    In: Proceedings of the 60th An- nual Meeting of the Association for Computational Linguistics: Student Re- search Workshop, pp

    Agrawal, S., Gupta, K., Gautam, D., Mamidi, R.: Towards Detecting Political Bias in Hindi News Articles. In: Proceedings of the 60th An- nual Meeting of the Association for Computational Linguistics: Student Re- search Workshop, pp. 239–244. Association for Computational Lingu...

  15. [23]

    In:Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp

    Sinha, M., Dasgupta, T.: Determining Subjective Bias in Text through Linguis- tically Informed Transformer based Multi-Task Network. In:Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3418–3422. ACM, New York, NY, USA (2021). htt...

  16. [24]

    In:Proceedings of the 11th International Conference on Natural Language Generation, pp

    Chen, W.-F., Wachsmuth, H., Al-Khatib, K., Stein, B.: Learning to Flip the Bias of News Headlines. In:Proceedings of the 11th International Conference on Natural Language Generation, pp. 79–88. Association for Computational Lin- guistics, Stroudsburg, PA, USA (2018). https://d...

  17. [25]

    Fan, L., White, M., Sharma, E., Su, R., Choubey, P.K., Huang, R., Wang, L.: In Plain Sight: Media Bias Through the Lens of Factual Reporting. In:Proceedings of the 2019 Conference on Empirical Methods in Natural Language Process- ing and the 9th International Joint Conference ...

  18. [26]

    1007/978-3-030-96957-8_20 arXiv:2211.03491

    Spinde, T., Krieger, J.-D., Ruas, T., Mitrović, J., Götz-Hahn, F., Aizawa, A., Gipp, B.: Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles.arXiv: 2211.03491 (2022) https://doi.org/10. 1007/978-3-030-96957-8_20 arXiv:2211.03491

  19. [27]

    3188724 arXiv:1904.07536

    Bourgeois, D., Rappaz, J., Aberer, K.: Selection Bias in News Coverage: Learn- ing it, Fighting it.The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018,535–543(2018)https://doi.org/10.1145/3184558. 3188724 arXiv:1904.07536

  20. [28]

    Saez-Trumper, D., Castillo, C., Lalmas, M.: Social media news communities: Gatekeeping, coverage, and statement bias.International Conference on Infor- mation and Knowledge Management, Proceedings(June2014),1679–1684(2013) https://doi.org/10.1145/2505515.2505623

  21. [29]

    Ehrhardt, J., Spinde, T., Vardasbi, A., Hamborg, F.: Omission of information 49 : Identifying political slant via an analysis of co-occurring entities.Information between Data and Knowledge,80–93(2021)https://doi.org/10.5283/epub.44931

  22. [30]

    Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., Hussain, A.: Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions.Information Fusion 91, 424–444 (2023) https://doi.org/10.1016/J.INF...

  23. [31]

    Molenaar, I., Mooij, S., Azevedo, R., Bannert, M., Järvelä, S., Gašević, D.: Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data.Computers in Human Behavior139(September

  24. [32]

    IEEE Transactions on Pattern Analysis and Machine In- telligence 45(10), 12113–12132 (2023) https://doi.org/10.1109/TPAMI.2023

    Xu, P., Zhu, X., Clifton, D.A.: Multimodal Learning With Transform- ers: A Survey. IEEE Transactions on Pattern Analysis and Machine In- telligence 45(10), 12113–12132 (2023) https://doi.org/10.1109/TPAMI.2023. 3275156 arXiv:2206.06488

  25. [33]

    Alexandropoulos, S.A.N., Kotsiantis, S.B., Vrahatis, M.N.: Data preprocessing in predictive data mining.Knowledge Engineering Review34(April 2020) (2019) https://doi.org/10.1017/S026988891800036X

  26. [34]

    Siino, M., Tinnirello, I., La Cascia, M.: Is text preprocessing still worth the time? A comparative survey on the influence of popular preprocessing methods on Transformers and traditional classifiers.Information Systems 121(March 2023), 102342 (2024) https://doi.org/10.1016/j...

  27. [35]

    Expert Systems with Applications110, 298–310 (2018) https://doi.org/10.1016/ j.eswa.2018.06.022

    Symeonidis, S., Effrosynidis, D., Arampatzis, A.: A comparative evaluation of pre-processing techniques and their interactions for twitter sentiment analysis. Expert Systems with Applications110, 298–310 (2018) https://doi.org/10.1016/ j.eswa.2018.06.022

  28. [36]

    Hickman, L., Thapa, S., Tay, L., Cao, M., Srinivasan, P.: Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations.Or- ganizational Research Methods25(1), 114–146 (2022) https://doi.org/10.1177/ 1094428120971683

  29. [37]

    In:RepL4NLP 2021 - 6th Workshop on Representation Learning for NLP, Proceedings of the Workshop (2021)

    Goyal, N., Du, J., Ott, M., Anantharaman, G., Conneau, A.: Larger-Scale Trans- formers for Multilingual Masked Language Modeling. In:RepL4NLP 2021 - 6th Workshop on Representation Learning for NLP, Proceedings of the Workshop (2021). https://doi.org/10.18653/v1/2021.repl4nlp-1.4

  30. [38]

    https://pypi.org/ project/spacy-language-detection/ Accessed 2024-02-17

    Beauchemin, D.: spacy-language-detection 0.2.1 (2021). https://pypi.org/ project/spacy-language-detection/ Accessed 2024-02-17

  31. [39]

    IEEE Access7, 65263–65276 (2019) https://doi.org/10.1109/ACCESS

    Buchkremer, R., Demund, A., Ebener, S., Gampfer, F., Jägering, D., Jürgens, A., Klenke, S., Krimpmann, D., Schmank, J., Spiekermann, M., Wahlers, M., 50 Wiepke, M.: The application of artificial intelligence technologies as a substi- tute for reading and to support and enhance...

  32. [40]

    arXiv preprint arXiv:2203.05794(2020) arXiv:2203.05794v1

    Grootendorst, M.: BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794(2020) arXiv:2203.05794v1

  33. [41]

    https://maartengr.github.io/ BERTopic/algorithm/algorithm.html Accessed 2024-01-19

    Grootendorst, M.: The Algorithm (2024). https://maartengr.github.io/ BERTopic/algorithm/algorithm.html Accessed 2024-01-19

  34. [42]

    Reimers, N., Gurevych, I.: Sentence-BERT: Sentence embeddings using siamese BERT-networks.EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Meth- ods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Confere...

  35. [43]

    arXiv:1802.03426 (2020) arXiv:1802.03426v3

    Mcinnes, L., Healy, J., Melville, J.: UMAP : Uniform Manifold Approxi- mation and Projection for Dimension Reduction. arXiv:1802.03426 (2020) arXiv:1802.03426v3

  36. [44]

    Campello, R.J.G.B., Moulavi, D., Sander, J.: Density-Based Clustering Based on Hierarchical Density Estimates.Advances in Knowledge Discovery and Data Mining, 160–172 (2013) https://doi.org/10.1007/978-3-642-37456-2_14

  37. [45]

    https:// scikit-learn.org/stable/modules/generated/sklearn.feature{_}extraction.text

    sklearn.feature_extraction.text.CountVectorizer (2023). https:// scikit-learn.org/stable/modules/generated/sklearn.feature{_}extraction.text. CountVectorizer.html Accessed 2024-01-18

  38. [46]

    Schubert, E., Sander, J., Ester, M., Kriegel, H.P., Xu, X.: DBSCAN revisited, revisited: Why and how you should (still) use DBSCAN.ACM Transactions on Database Systems 42(3) (2017) https://doi.org/10.1145/3068335

  39. [47]

    Mckinney, W.: pandas: a Foundational Python Library for Data Analysis and Statistics (2011)

  40. [48]

    https://maartengr.github.io/BERTopic/ api/bertopic.html Accessed 2024-01-18

    Grootendorst, M.: BERTopic (2024). https://maartengr.github.io/BERTopic/ api/bertopic.html Accessed 2024-01-18

  41. [49]

    Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: RoBERTa: A Robustly Optimized BERT Pretraining Approach.arXiv: 1907.11692 (1) (2019) arXiv:1907.11692

  42. [50]

    https://spacy.io/universe/project/ spacy-textblob Accessed 2024-02-17

    Edwardes, S.: spacytextblob (2024). https://spacy.io/universe/project/ spacy-textblob Accessed 2024-02-17

  43. [51]

    https://spacy.io/models/ 51 en{#}en{_}core{_}web{_}sm Accessed 2024-02-17

    Explosion: en_core_web_sm (2023). https://spacy.io/models/ 51 en{#}en{_}core{_}web{_}sm Accessed 2024-02-17

  44. [52]

    Linguistic Data Consortium (2013)

    Weischedel, R., Palmer, M., Marcus, M., Hovy, E., Pradhan, S., Ramshaw, L., Xue, N., Taylor, A., Kaufman, J., Franchini, M., Others: Ontonotes release 5.0. Linguistic Data Consortium (2013). https://doi.org/10.35111/xmhb-2b84 . https://catalog.ldc.upenn.edu/LDC2013T19

  45. [53]

    https://github.com/explosion/spacy-models/releases/ tag/en{_}core{_}web{_}sm-3.7.1

    SpaCy: English (2023). https://github.com/explosion/spacy-models/releases/ tag/en{_}core{_}web{_}sm-3.7.1

  46. [54]

    arXiv: 2002.11402 (2020) arXiv:2002.11402

    Jadhav, S.A.: Detecting Potential Topics In News Using BERT, CRF and Wikipedia. arXiv: 2002.11402 (2020) arXiv:2002.11402

  47. [55]

    2019.00017

    Vychegzhanin, S., Kotelnikov, E.: Comparison of named entity recognition tools applied to news articles.Proceedings - 2019 Ivannikov Ispras Open Conference, ISPRAS 2019(February), 72–77 (2019) https://doi.org/10.1109/ISPRAS47671. 2019.00017

  48. [56]

    Kamel, M., Siuky, F.N., Yazdi, H.S.: Robust sentiment fusion on distribution of news.Multimedia Tools and Applications78(15), 21917–21942 (2019) https: //doi.org/10.1007/s11042-019-7505-8

  49. [57]

    Advanced Data Mining and Applications

    Mandalapu, A.C., Gunabalan, S., Sadineni, A., Cai, T., Al Hasan Haldar, N., Li, J.: Correlate Influential News Article Events to Stock Quote Movement. Advanced Data Mining and Applications. ADMA 2019. Lecture Notes in Com- puter Science 11888 LNAI (November), 331–342 (2019) ht...

  50. [58]

    In:EACL 2021 - 16th Confer- ence of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, pp

    Hamborg, F., Donnay, K.: NewsMTSC: A dataset for (multi-)target-dependent sentiment classification in political news articles. In:EACL 2021 - 16th Confer- ence of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, pp. 1663–167...

  51. [59]

    Algorithms 16(9), 403 (2023) https://doi.org/10.3390/a16090403

    Harth, P., Jähde, O., Schneider, S., Horn, N., Buchkremer, R.: From Data to Human-Readable Requirements: Advancing Requirements Elicitation through Language-Transformer-Enhanced Opportunity Mining. Algorithms 16(9), 403 (2023) https://doi.org/10.3390/a16090403

  52. [60]

    Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of deep bidirectionaltransformersforlanguageunderstanding. NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceed...

  53. [61]

    https://pypi.org/project/ transformers/ Accessed 2024-02-17 52

    Huggingface: transformers 4.37.2 (2024). https://pypi.org/project/ transformers/ Accessed 2024-02-17 52

  54. [62]

    In:Proceedings of the Sev- enth Conference on Natural Language Learning at HLT-NAACL 2003, pp

    Sang, E.F.T.K., De Meulder, F.: Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition. In:Proceedings of the Sev- enth Conference on Natural Language Learning at HLT-NAACL 2003, pp. 142–147 (2003).https://aclanthology.org/W03-0419

  55. [63]

    In: Findings of the Association for Computational Linguistics: NAACL 2022 - Findings, pp

    Tedeschi, S., Navigli, R.: MultiNERD: A Multilingual, Multi-Genre and Fine- Grained Dataset for Named Entity Recognition (and Disambiguation). In: Findings of the Association for Computational Linguistics: NAACL 2022 - Findings, pp. 801–812 (2022). https://doi.org/10.18653/v1/...

  56. [64]

    In:ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, pp

    Ringland, N., Dai, X., Hachey, B., Karimi, S., Paris, C., Curran, J.R.: NNE: A dataset for nested named entity recognition in English newswire. In:ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, pp. 5176–5181 (202...

  57. [65]

    acl-long.459 arXiv:2212.09747

    Liu, S., Ritter, A.: Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? arXiv: 2212.09747, 8254–8271 (2023) https://doi.org/10.18653/v1/2023. acl-long.459 arXiv:2212.09747

  58. [66]

    Hu, X., Zhou, Z., Li, H., Hu, Y., Gu, F., Kersten, J., Fan, H., Klan, F.: Location Reference Recognition from Texts: A Survey and Comparison.ACM Computing Surveys 56(5), 1–37 (2024) https://doi.org/10.1145/3625819 arXiv:2207.01683

  59. [67]

    Polignano, M., Gemmis, M., Semeraro, G.: Comparing transformer-based NER approaches for analysing textual medical diagnoses.CEUR Workshop Proceed- ings 2936, 818–833 (2021)

  60. [68]

    IEEE Transactions on Knowledge and Data Engineering35(11), 11019–11038 (2023) https://doi.org/ 10.1109/TKDE.2022.3230975

    Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges. IEEE Transactions on Knowledge and Data Engineering35(11), 11019–11038 (2023) https://doi.org/ 10.1109/TKDE.2022.3230975

  61. [69]

    Wu, H., Zhang, Z., Shi, S., Wu, Q., Song, H.: Phrase dependency relational graph attention network for Aspect-based Sentiment Analysis.Knowledge-Based Systems 236, 107736 (2022) https://doi.org/10.1016/j.knosys.2021.107736

  62. [70]

    Bird, S.: NLTK: The natural language toolkit.COLING/ACL 2006 - 21st In- ternational Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Interactive Presentation Sessions, 69–72 (2006) arXiv:0205028 [cs]

  63. [71]

    Biemann, C.: Ontology Learning from Text: A Survey of Methods.Journal for Language Technology and Computational Linguistics20(2), 75–93 (2005) https: //doi.org/10.21248/jlcl.20.2005.76 53

  64. [72]

    International Journal of Information Management Data Insights 2(2) (2022) https://doi.org/10.1016/j.jjimei.2022.100131

    Antunes, A.L., Cardoso, E., Barateiro, J.: Incorporation of Ontologies in Data Warehouse/Business Intelligence Systems - A Systematic Literature Review. International Journal of Information Management Data Insights 2(2) (2022) https://doi.org/10.1016/j.jjimei.2022.100131

  65. [73]

    Future Generation Computer Systems 153(July 2023), 442–456 (2024) https://doi.org/10.1016/j.future.2023.12.013 arXiv:2308.15168

    Karabulut, E., Pileggi, S.F., Groth, P., Degeler, V.: Ontologies in digital twins: A systematic literature review. Future Generation Computer Systems 153(July 2023), 442–456 (2024) https://doi.org/10.1016/j.future.2023.12.013 arXiv:2308.15168

  66. [74]

    Procedia Computer Science 176, 3356–3368 (2020) https:// doi.org/10.1016/j.procs.2020.09.061

    Wątróbski, J.: Ontology learning methods from text - an extensive knowledge- based approach. Procedia Computer Science 176, 3356–3368 (2020) https:// doi.org/10.1016/j.procs.2020.09.061 . Knowledge-Based and Intelligent Informa- tion & Engineering Systems: Proceedings of the 2...

  67. [75]

    IEEE Intelligent Systems 16(2), 72–79 (2001) https://doi.org/10.1109/5254.920602

    Maedche, A., Staab, S.: Ontology learning for the Semantic Web. IEEE Intelligent Systems 16(2), 72–79 (2001) https://doi.org/10.1109/5254.920602

  68. [76]

    In: Research in Computing Science, vol

    Reyes-Peña, C., Tovar-Vidal, M.: Ontology: Components and Evaluation, a Review. In: Research in Computing Science, vol. 148, pp. 257–265 (2019). https://doi.org/10.13053/rcs-148-3-21

  69. [77]

    Knowl- edge Acquisition 5(2), 199–220 (1993) https://doi.org/10.1006/knac.1993.1008

    Gruber,T.R.:Atranslationapproachtoportableontologyspecifications. Knowl- edge Acquisition 5(2), 199–220 (1993) https://doi.org/10.1006/knac.1993.1008

  70. [78]

    In: Ontologies in Urban Development Projects, pp

    Roussey, C., Pinet, F., Kang, M.A., Corcho, O.: An Introduction to On- tologies and Ontology Engineering. In: Ontologies in Urban Development Projects, pp. 9–38 (2011). https://doi.org/10.1007/978-0-85729-724-2_2 . http://link.springer.com/10.1007/978-0-85729-724-2_2

  71. [79]

    In:Semantic Web Services, pp

    Stephan, G., Pascal, H., Andreas, A.: Knowledge Representation and Ontolo- gies. In:Semantic Web Services, pp. 51–105. Springer, Berlin, Heidelberg (2009). https://doi.org/10.1007/3-540-70894-4_3 . http://link.springer.com/10.1007/3- 540-70894-4_3

  72. [80]

    : The Rise and Potential of Large Language Model Based Agents: A Survey.arXiv: 2309.07864 (2023) arXiv:2309.07864

    Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, T. ...: The Rise and Potential of Large Language Model Based Agents: A Survey.arXiv: 2309.07864 (2023) arXiv:2309.07864

  73. [81]

    : GPT-4 Technical Report.arXiv: 2303.08774 (2023) arXiv:2303.08774

    OpenAI, :, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Ale- man, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, B. ...: GPT-4 Technical Report.arXiv: 2303.08774 (2023) arXiv:2303.08774

  74. [82]

    : Gemini: A Family of Highly Capable Multimodal Models.arXiv: 2312.11805 (2023) arXiv:2312.11805 54

    Gemini Team, Anil, R., Borgeaud, S., Wu, Y., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A.M., Hauth, O. ...: Gemini: A Family of Highly Capable Multimodal Models.arXiv: 2312.11805 (2023) arXiv:2312.11805 54

  75. [83]

    Giglou, H.B., D’Souza, J., Auer, S.: LLMs4OL: Large Language Models for Ontology Learning.arXiv: 2307.16648 (Dcmi) (2023) arXiv:2307.16648

  76. [84]

    Konys, A.: Knowledge systematization for ontology learning methods.Procedia Computer Science 126, 2194–2207 (2018) https://doi.org/10.1016/j.procs.2018. 07.229

  77. [85]

    In:Findings of the Association for Computa- tional Linguistics: EMNLP 2023, pp

    Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., Fung, P.: Towards Mitigating LLM Hallucination via Self Reflection. In:Findings of the Association for Computa- tional Linguistics: EMNLP 2023, pp. 1827–1843. Association for Computational Linguistics, Stroudsburg, PA, USA (2023). ht...

  78. [86]

    Martino, A., Iannelli, M., Truong, C.: Knowledge Injection to Counter Large Language Model (LLM) Hallucination.The Semantic Web: ESWC 2023 Satellite Events, 182–185 (2023) https://doi.org/10.1007/978-3-031-43458-7_34

  79. [87]

    arXiv:2309.05922 (2023) arXiv:2309.05922

    Rawte, V., Sheth, A., Das, A.: A Survey of Hallucination in Large Foundation Models. arXiv:2309.05922 (2023) arXiv:2309.05922

  80. [88]

    Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Chen, Y., Wang, L., Luu, A.T., Bi, W., Shi, F., Shi, S.: Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models.arXiv: 2309.01219 (2023) arXiv:2309.01219

  81. [89]

    arXiv: 2306.13781 (Figure 4) (2023) arXiv:2306.13781

    Huo, S., Arabzadeh, N., Clarke, C.L.A.: Retrieving Supporting Evi- dence for LLMs Generated Answers. arXiv: 2306.13781 (Figure 4) (2023) arXiv:2306.13781

  82. [90]

    Artificial Intelligence Review56(4), 3005–3054 (2023) https://doi.org/10.1007/ s10462-022-10246-w

    Mosqueira-Rey, E., Hernández-Pereira, E., Alonso-Ríos, D., Bobes-Bascarán, J., Fernández-Leal, Á.: Human-in-the-loop machine learning: a state of the art. Artificial Intelligence Review56(4), 3005–3054 (2023) https://doi.org/10.1007/ s10462-022-10246-w

  83. [91]

    1145/3387939.3391592

    Li, N., Adepu, S., Kang, E., Garlan, D.: Explanations for human-on-the- loop: A probabilistic model checking approach.Proceedings - 2020 IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self- Managing Systems, SEAMS 2020 (April), 181–187 (2020) ht...

  84. [92]

    IEEE Systems, Man, and Cybernetics Magazine 3(1), 10–17 (2017) https://doi.org/10.1109/ MSMC.2016.2623867

    Nahavandi, S.: Trusted Autonomy Between Humans and Robots: Toward Human-on-the-Loop in Robotics and Autonomous Systems. IEEE Systems, Man, and Cybernetics Magazine 3(1), 10–17 (2017) https://doi.org/10.1109/ MSMC.2016.2623867

  85. [93]

    1609/icwsm.v3i1.13937

    Bastian, M., Heymann, S., Jacomy, M.: Gephi: An Open Source Software for Exploring and Manipulating Networks.Proceedings of the International AAAI 55 Conference on Web and Social Media3(1), 361–362 (2009) https://doi.org/10. 1609/icwsm.v3i1.13937

  86. [94]

    Physical Review Research 2(4), 043271 (2020) https://doi.org/10.1103/ PhysRevResearch.2.043271

    Zhang, L., Peixoto, T.P.: Statistical inference of assortative community struc- tures. Physical Review Research 2(4), 043271 (2020) https://doi.org/10.1103/ PhysRevResearch.2.043271

  87. [95]

    Spinde, T., Rudnitckaia, L., Mitrović, J., Hamborg, F., Granitzer, M., Gipp, B., Donnay, K.: Automated identification of bias inducing words in news arti- cles using linguistic and context-oriented features.Information Processing and Management 58(3), 102505 (2021) https://doi...

  88. [96]

    Hamborg, F., Zhukova, A., Gipp, B.: Automated identification of media bias by word choice and labeling in news articles.Proceedings of the ACM/IEEE Joint Conference on Digital Libraries2019-June(1), 196–205 (2019) https://doi.org/ 10.1109/JCDL.2019.00036

  89. [97]

    In:The History and Politics of Public Radio, pp

    Bennett, J.T.: Left, Right, or Always Establishment? The Bias Issue. In:The History and Politics of Public Radio, pp. 85–97 (2021). https://doi.org/10.1007/ 978-3-030-80019-2_6 . https://link.springer.com/10.1007/978-3-030-80019-2_6

  90. [98]

    Technical report (2023)

    Newman, N., Fletcher, R., Eddy, K., Robertson, C.T., Nielsen, R.K.: Digital News Report 2023. Technical report (2023)

  91. [99]

    Gan, L., Yang, T., Huang, Y., Yang, B., Luo, Y.Y., Richard, L.W.C., Guo, D.: Experimental Comparison of Three Topic Modeling Methods with LDA, Top2Vec and BERTopic.Artificial Intelligence and Robotics, 376–391 (2024) https://doi.org/10.1007/978-981-99-9109-9_37

  92. [100]

    Hamborg, F., Meuschke, N., Gipp, B.: Bias-aware news analysis using matrix- based news aggregation.International Journal on Digital Libraries21(2), 129– 147 (2020) https://doi.org/10.1007/s00799-018-0239-9

  93. [101]

    In: 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL), pp

    Hamborg, F., Meuschke, N., Gipp, B.: Matrix-based news aggregation: Ex- ploring different news perspectives. In: 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL), pp. 1–10 (2017). https://doi.org/10.1109/JCDL.2017. 7991561 56

  94. [2022]

    (2023) https://doi.org/10.1016/j.chb.2022.107540

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.