REVIEW 4 major objections 6 minor 102 references
Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias
T0 review · 4 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read This paper proposes a scalable, comparison-based pipeline that detects media bias in event selection and labeling and word choice by measuring each news outlet's deviation from the cross-outlet average, using topic modeling, sentiment…
desk verdict Integration-level novelty with a real validation gap: the entity-level spectrum uses raw counts and the abstract overclaims what the case studies actually show. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying object is the media bias spectrum, a two-axis scatter plot in which the x-axis is an outlet's sentiment deviation from the cross-outlet mean and the y-axis is its coverage-share deviation from the same mean, with point size encoding the underlying article or mention count. This spectrum is fed by a hierarchy of topic clusters from BERTopic, target-dependent sentiment scores from a RoBERTa news model, and GPT-4-generated ontologies with automatic consistency checks. The spectrum makes the paper's relational definition of bias operational: the mean is always zero, and every outlet is plotted as a departure from that zero.
What would settle it
Take one newspaper's articles on a single event, compute its sentiment and coverage deviations against two different sets of peer outlets from the same dates, and check whether its bias scores move substantially; if they do, the measured bias is a property of the outlet pool rather than of the reporting.
Extended reading notes
Core claim
The central claim is that comparing outlets against the mean of all outlets—rather than against an external truth or ideological label—yields a scalable, minimally biased way to surface media bias. Concretely, the coverage share per outlet per topic, compared with the cross-outlet mean, exposes event selection bias, while the mean sentiment per outlet, also compared with the cross-outlet mean at title, body, and entity levels, exposes labeling and word choice bias. The paper further claims that comparing the objects and relations in each outlet's ontology can expose commission and omission, and that this worked in one small topic but did not hold up when the corpus grew larger.
Load-bearing premise
The load-bearing premise is that a newspaper's systematic difference from the average of the other included newspapers is media bias, not sampling noise, editorial style, or model error, since the paper explicitly rejects any zero-bias reference point and supplies no external ground truth.
Editorial extensions
If this is right
- Event selection bias becomes measurable without labels: an outlet that consistently sits above the mean on coverage of a topic is giving that topic disproportionate space relative to its peers.
- Labeling and word choice bias is captured by title sentiment and entity-level sentiment, while whole-text sentiment is found to be uninformative in the paper's tests.
- The same pipeline works at any level of the topic hierarchy, from a single small event to a cross-topic corpus, without extra adaptation steps.
- For commission and omission, the method's usefulness is currently limited by unresolved semantic duplicates in the ontology nodes, so its reliable reach is smaller topics.
Reading between the lines
- A direct consequence of the relational definition is that an outlet's measured bias depends on the chosen pool of comparison outlets: swap the pool and the same articles can show a different deviation, a corollary the paper does not draw out.
- A testable extension would be to merge ontology nodes by embedding similarity before comparing graphs, which would likely let commission and omission analysis scale to the large topics where the paper reports failure.
- Adding a time axis to the media bias spectrum could turn the method from a static snapshot into a detector of sentiment shifts around single events, an extension the paper lists as future work.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. Jähde, Weber, and Buchkremer present a modular NLP pipeline for comparative media-bias analysis. The pipeline combines BERTopic-based hierarchical topic modeling with RoBERTa and spaCy sentiment analysis at the title, body-text, and entity levels, and GPT-4-based ontology learning with automatic consistency checks. Outlets are compared through a 'media bias spectrum' showing each newspaper's deviation from the cross-outlet mean for coverage share and sentiment. The method is applied to 40,308 English RSS articles from 37 outlets in three case studies: the Supernova festival attack (t138), the 2023 Belt and Road Forum and Putin's visit (t751), and a cross-topic study. The paper reports success for event-selection bias and for labeling/word-choice bias measured through title and entity sentiment; it concedes that spaCy body-text sentiment was not informative and that ontology-based commission/omission analysis worked in the first case study but not in the second.
Significance. The paper has several genuine strengths. The comparative, deviation-from-mean design is transparent and reproducible in principle; Eqs. (1)–(5) are definitions rather than fitted quantities, so the bias scores do not smuggle in a fitted target. The ontology-consistency checks (object-class, object-object, object-relation) provide a concrete quality gate for LLM outputs, and the case studies include manual spot-checks that give the reader a sense of where the method works. If the effectiveness claim were fully supported, the 'media bias spectrum' would be a practical, scalable tool for comparing outlets. However, the evidence as presented does not yet support the generalized claim: entity-level count deviations are unnormalized, small-sample sentiment differences are reported without uncertainty, and the methodology's own results in Section 5.1 limit the validated scope to title/entity sentiment and some event-selection comparisons. The central claim is therefore defensible only after the measurement and validation gaps are addressed.
major comments (4)
- [Section 3.5, entity-axis definition; Tables A3–A4, B7–B8, C10] The y-axis for the entity-level media bias spectrum is the deviation of the raw number of entity mentions from the mean raw count, with no normalization by outlet size. Because per-outlet article counts range from 91 (CommonWealth Beacon) to 10,230 (The Hindu) in Section 4.1, raw mention counts largely reflect outlet output rather than bias. In Table C10, for example, Jerusalem Post (+2,468) and NDTV (+2,422) have the largest positive count deviations partly because they are the highest-output outlets in the dataset. The claim in Section 5.2 that the methodology 'successfully analyze[s]' event-selection bias depends on this axis. Please re-compute entity-level spectra with rates (e.g., mentions per 1,000 articles, or a regression controlling for outlet article volume) and report whether the qualitative conclusions change.
- [Section 4.3, Table A1; Section 4.4, Table B5] Many sentiment deviations are computed from a single article (e.g., CBC, Mothership, France24, Al Jazeera, El Pais, Straits Times, Japan Times, and BBC in t138; Bangkokpost, Mothership, El Pais, Journal, and Korea Herald in t751), and the paper reports no confidence intervals or significance tests. A deviation of -0.59 from one article cannot be distinguished from sampling noise. Please add uncertainty quantification, such as bootstrap intervals or a minimum-count threshold with suppressed or flagged points, and re-state the corresponding conclusions in Sections 5.1–5.2.
- [Abstract and Section 5.2] The generalized effectiveness claim is broader than the evidence in the paper itself. Section 5.1 states that the spaCy body-text sentiment analysis 'was found to hold no valuable result' and that for t751 'the proposed methodology failed to provide insights into omission and commission bias'; Section 5.2 concedes that commission and omission 'could not be consistently and successfully analyzed.' The abstract nonetheless says the methodology 'examines ... commission and omission biases' and 'demonstrate[s] the methodology's effectiveness in identifying biases across news sources.' Please narrow the abstract and conclusion to the components that survived the case studies (title and entity-level sentiment; event-selection comparisons), and present ontology-based commission/omission analysis as preliminary.
- [Section 2.1 and Eqs. (2), (5)] The bias scores are deviations from the mean of the included newspapers, and the paper explicitly rejects a zero-bias baseline. This is a defensible design choice, but the central claim that the scores identify media bias requires some evidence that the cross-outlet mean is a meaningful reference. As it stands, the method is calibrated to the selected corpus; the same scores would change if a different set of outlets were included. A concrete validation would be to compare a small set of computed deviations against independent bias judgments (e.g., human annotation or established outlet ratings such as AllSides or Ad Fontes) for the same topics, and to report agreement. Without such a check, the wording 'successfully analyze the potential media bias' in Section 5.2 remains an assumption about the reference distribution rather than a demonstrated result.
minor comments (6)
- [Section 3.3] There is a stray '].' immediately following the sentence that ends with '[60].' Please remove it.
- [Section 3.5 and Sections 4.3–4.4] 'Statistical interference' should be 'statistical inference,' and 'assorted communities' in Section 4.4 should be 'assortative communities.'
- [Section 4.2] The phrase '150 characters suitable of the target' is ungrammatical; it should read 'to the right of the target' or 'after the target.'
- [Section 3.5, Eq. (3)] The summation notation \sum_{i=0}^{|a(N_t)|} does not define the indexing variable; please write the average more explicitly or define i and the bounds.
- [Appendix B] The appendix heading 'Thirt Beld and Road Forum' contains a typo; it should be 'Third Belt and Road Forum.'
- [Section 4.4] 'Mispresented' should be 'misrepresented' in the discussion of the Moscow Times title.
Circularity Check
No significant circularity: the paper's quantitative outputs are transparent descriptive statistics, and its only author-overlap citation is a parameter-free formula that is not load-bearing.
full rationale
I walked the derivation chain from Eqs. (1) through (5). Equation (1) defines the per-newspaper coverage share p(Nt) = |a(Nt)|/|a(N)|; Eq. (2) defines the deviation d(Nt) = p(Nt) - pbar_t; Eqs. (3)-(5) define mean sentiment and sentiment deviations in the same way. These are direct descriptive summaries of article counts and model sentiment scores, not fitted parameters that are later renamed as predictions. The central claim in Section 5.2, that the methodology 'allows us to successfully analyze the potential media bias in event selection within news,' is an interpretive statement about cross-outlet deviations, and the paper explicitly frames the approach as comparative rather than absolute ('Instead of pinpointing a zero-bias baseline, we compare the presentation of the same political topic across different newspapers over the same timeframe'). The entity-level y-axis in Section 3.5 is based on raw mention counts rather than rates, and some sentiment deviations rest on one or two articles, but these are measurement-validity weaknesses, not reductions of the output to the input by construction. The only self-citation with author overlap is [59], used for the simplified sentiment score defined as positive probability minus negative probability; that formula is parameter-free, transparent, and independently checkable, so this citation is not load-bearing. The paper also candidly reports failures (spaCy text-body sentiment yielded no valuable insights; commission/omission analysis via ontologies was not consistently successful), which further undercuts any suggestion that the central claims are forced by a hidden self-referential definition. Overall, no circular step is exhibited, so the appropriate score is 0.
Assumptions & free parameters
free parameters (3)
- 150-character context window =
150 characters each side of target
- Top entities per topic =
10
- Acceptable noise-topic proportion =
39.9%
assumptions (6)
- domain assumption News bias can be operationalized as deviation from the cross-newspaper mean of article shares and sentiment scores, with no zero-bias baseline required.
- domain assumption Sentiment scores from RoBERTa and spaCy measure labeling and word choice bias.
- domain assumption GPT-4-generated ontologies, after consistency checks, faithfully represent article content for omission and commission analysis.
- domain assumption Topic clusters from BERTopic correspond to meaningful news topics after human review and merging single-newspaper topics into the noise cluster.
- ad hoc to paper The 150-character context window captures the sentiment context of each entity mention.
- domain assumption RSS feeds and the selected 37 outlets are representative enough for cross-newspaper comparisons.
Cite this review
Pith. "Pith review of Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias." pith.science (2026). https://pith.science/paper/R732KO6M
@misc{pith2026250501754,
author = {Pith},
title = {Pith review of: Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias},
year = {2026},
howpublished = {\url{https://pith.science/paper/R732KO6M}},
note = {Machine review of arXiv:2505.01754}
}
read the original abstract
Biased news reporting poses a significant threat to informed decision-making and the functioning of democracies. This study introduces a novel methodology for scalable, minimally biased analysis of media bias in political news. The proposed approach examines event selection, labeling, word choice, and commission and omission biases across news sources by leveraging natural language processing techniques, including hierarchical topic modeling, sentiment analysis, and ontology learning with large language models. Through three case studies related to current political events, we demonstrate the methodology's effectiveness in identifying biases across news sources at various levels of granularity. This work represents a significant step towards scalable, minimally biased media bias analysis, laying the groundwork for tools to help news consumers navigate an increasingly complex media landscape.
Reference graph
Works this paper leans on
-
[1]
International Journal on Digital Libraries 20(4), 391–415 (2019) https://doi.org/10.1007/ s00799-018-0261-y
Hamborg, F., Donnay, K., Gipp, B.: Automated identification of media bias in news articles: an interdisciplinary literature review. International Journal on Digital Libraries 20(4), 391–415 (2019) https://doi.org/10.1007/ s00799-018-0261-y
2019
-
[2]
Kroon, A.C., Meer, T.G.L.A.: Who’s to Fear? Implicit Sexual Threat Pre and Post the “Refugee Crisis”. Journalism Practice 17(2), 319–335 (2023) https: //doi.org/10.1080/17512786.2021.1916401
arXiv 2023
-
[3]
Opperhuizen, A.E., Schouten, K., Klijn, E.H.: Framing a Conflict! How Media Report on Earthquake Risks Caused by Gas Drilling: A Longitudinal Analy- sis Using Machine Learning Techniques of Media Reporting on Gas Drilling from 1990 to 2015.Journalism Studies 20(5), 714–734 (2019) https://doi.org/ 10.1080/1461670X.2017.1418672
-
[4]
Galgoczy, M.C., Phatak, A., Vinson, D., Mago, V.K., Giabbanelli, P.J.: (Re)shaping online narratives: when bots promote the message of President Trump during his first impeachment.PeerJ Computer Science 8, 1–26 (2022) https://doi.org/10.7717/peerj-cs.947
-
[5]
Bernhardt, D., Krasa, S., Polborn, M.: Political polarization and the electoral effects of media bias.Journal of Public Economics 92(5-6), 1092–1104 (2008) https://doi.org/10.1016/j.jpubeco.2008.01.006
-
[6]
Wilson, A.E., Parker, V., Feinberg, M.: Polarization in the contemporary politi- cal and media landscape.Current Opinion in Behavioral Sciences34(October), 223–228 (2020) https://doi.org/10.1016/j.cobeha.2020.07.005
-
[7]
Baron, D.P.: Persistent media bias.Journal of Public Economics90(1-2), 1–36 (2006) https://doi.org/10.1016/j.jpubeco.2004.10.006
-
[8]
D’Alonzo, S., Tegmark, M.: Machine-learning media bias. PLoS ONE 17(8 August), 1–24 (2022) https://doi.org/10.1371/journal.pone.0271947 arXiv:2109.00024
work page Pith review arXiv 2022
Show all 102 references
-
[9]
Conference on Human Factors in Comput- ing Systems - Proceedings, 443–452 (2009) https://doi.org/10.1145/1518701
Park, S., Kang, S., Chung, S., Song, J.: NewsCube: Delivering multiple aspects of news to mitigate media bias. Conference on Human Factors in Comput- ing Systems - Proceedings, 443–452 (2009) https://doi.org/10.1145/1518701. 1518772
2009 doi
-
[10]
2022.100064 47
Naredla, N.R., Adedoyin, F.F.: Detection of hyperpartisan news articles us- ing natural language processing technique.International Journal of Information Management Data Insights2(1),100064(2022)https://doi.org/10.1016/j.jjimei. 2022.100064 47
2022
-
[11]
Shultziner, D., Stukalin, Y.: Distorting the News? The Mechanisms of Partisan Media Bias and Its Effects on News Production.Political Behavior 43(1), 201– 222 (2021) https://doi.org/10.1007/s11109-019-09551-y
2021 doi
-
[12]
Journal of Computational Social Science 6(1), 289–313 (2022) https://doi.org/10.1007/ s42001-022-00196-2
Németh, R.: A scoping review on the use of natural language processing in research on political polarization: trends and research prospects. Journal of Computational Social Science 6(1), 289–313 (2022) https://doi.org/10.1007/ s42001-022-00196-2
2022
-
[13]
In: Handbook of Media Economics , pp
Puglisi, R., Snyder, J.M.: Empirical Studies of Me- dia Bias. In: Handbook of Media Economics , pp. 647–667 (2015). https://doi.org/10.1016/B978-0-444-63685-0.00015-2 . https://linkinghub.elsevier.com/retrieve/pii/B9780444636850000152
2015 doi
-
[14]
Communications of the ACM 60(9), 65–71 (2017) https://doi.org/10
Brandtzaeg, P.B., Følstad, A.: Trust and distrust in online fact-checking ser- vices. Communications of the ACM 60(9), 65–71 (2017) https://doi.org/10. 1145/3122803
2017
-
[15]
Kang, H., Yang, J.: Quantifying Perceived Political Bias of Newspapers through a Document Classification Technique.Journal of Quantitative Linguistics29(2), 127–150 (2022) https://doi.org/10.1080/09296174.2020.1771136
2022
-
[16]
Journal of Communication 50(4), 133–156 (2000) https://doi.org/10.1111/j
D’Alessio, D., Allen, M.: Media Bias in Presidential Elections: A Meta-Analysis. Journal of Communication 50(4), 133–156 (2000) https://doi.org/10.1111/j. 1460-2466.2000.tb02866.x
2000
-
[17]
Technical report, National Bureau of Economic Research, Cambridge, MA (oct 2002)
Mullainathan, S., Shleifer, A.: Media Bias. Technical report, National Bureau of Economic Research, Cambridge, MA (oct 2002). https://doi.org/10.3386/w9295 . http://www.nber.org/papers/w9295.pdf
2002 doi
-
[18]
Rodrigo-Ginés, F.-J., Carrillo-de-Albornoz, J., Plaza, L.: A systematic review on media bias detection: What is media bias, how it is expressed, and how to detect it.Expert Systems with Applications237, 121641 (2024) https://doi.org/ 10.1016/j.eswa.2023.121641
2024
-
[19]
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention Is All You Need.arXiv: 1706.03762 (2017) arXiv:1706.03762
2017 arXiv
-
[20]
In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp
Baly, R., Da San Martino, G., Glass, J., Nakov, P.: We Can Detect Your Bias: Predicting the Political Ideology of News Articles. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 4982–4991. Association for Computational Lin...
2020 doi
-
[21]
Quijote, T.A., Zamoras, A.D., Ceniza, A.: Bias detection in Philippine political 48 news articles using SentiWordNet and inverse reinforcement model.IOP Con- ference Series: Materials Science and Engineering 482, 012036 (2019) https: //doi.org/10.1088/1757-899X/482/1/012036
2019 doi
-
[22]
In: Proceedings of the 60th An- nual Meeting of the Association for Computational Linguistics: Student Re- search Workshop, pp
Agrawal, S., Gupta, K., Gautam, D., Mamidi, R.: Towards Detecting Political Bias in Hindi News Articles. In: Proceedings of the 60th An- nual Meeting of the Association for Computational Linguistics: Student Re- search Workshop, pp. 239–244. Association for Computational Lingu...
2022 doi
-
[23]
In:Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp
Sinha, M., Dasgupta, T.: Determining Subjective Bias in Text through Linguis- tically Informed Transformer based Multi-Task Network. In:Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3418–3422. ACM, New York, NY, USA (2021). htt...
2021
-
[24]
In:Proceedings of the 11th International Conference on Natural Language Generation, pp
Chen, W.-F., Wachsmuth, H., Al-Khatib, K., Stein, B.: Learning to Flip the Bias of News Headlines. In:Proceedings of the 11th International Conference on Natural Language Generation, pp. 79–88. Association for Computational Lin- guistics, Stroudsburg, PA, USA (2018). https://d...
2018 doi
-
[25]
Fan, L., White, M., Sharma, E., Su, R., Choubey, P.K., Huang, R., Wang, L.: In Plain Sight: Media Bias Through the Lens of Factual Reporting. In:Proceedings of the 2019 Conference on Empirical Methods in Natural Language Process- ing and the 9th International Joint Conference ...
2019 doi
-
[26]
1007/978-3-030-96957-8_20 arXiv:2211.03491
Spinde, T., Krieger, J.-D., Ruas, T., Mitrović, J., Götz-Hahn, F., Aizawa, A., Gipp, B.: Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles.arXiv: 2211.03491 (2022) https://doi.org/10. 1007/978-3-030-96957-8_20 arXiv:2211.03491
2022 arXiv
-
[27]
3188724 arXiv:1904.07536
Bourgeois, D., Rappaz, J., Aberer, K.: Selection Bias in News Coverage: Learn- ing it, Fighting it.The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018,535–543(2018)https://doi.org/10.1145/3184558. 3188724 arXiv:1904.07536
2018 arXiv
-
[28]
Saez-Trumper, D., Castillo, C., Lalmas, M.: Social media news communities: Gatekeeping, coverage, and statement bias.International Conference on Infor- mation and Knowledge Management, Proceedings(June2014),1679–1684(2013) https://doi.org/10.1145/2505515.2505623
2013
-
[29]
Ehrhardt, J., Spinde, T., Vardasbi, A., Hamborg, F.: Omission of information 49 : Identifying political slant via an analysis of co-occurring entities.Information between Data and Knowledge,80–93(2021)https://doi.org/10.5283/epub.44931
2021 doi
-
[30]
Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., Hussain, A.: Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions.Information Fusion 91, 424–444 (2023) https://doi.org/10.1016/J.INF...
2023 doi
-
[31]
Molenaar, I., Mooij, S., Azevedo, R., Bannert, M., Järvelä, S., Gašević, D.: Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data.Computers in Human Behavior139(September
-
[32]
IEEE Transactions on Pattern Analysis and Machine In- telligence 45(10), 12113–12132 (2023) https://doi.org/10.1109/TPAMI.2023
Xu, P., Zhu, X., Clifton, D.A.: Multimodal Learning With Transform- ers: A Survey. IEEE Transactions on Pattern Analysis and Machine In- telligence 45(10), 12113–12132 (2023) https://doi.org/10.1109/TPAMI.2023. 3275156 arXiv:2206.06488
2023 arXiv
-
[33]
Alexandropoulos, S.A.N., Kotsiantis, S.B., Vrahatis, M.N.: Data preprocessing in predictive data mining.Knowledge Engineering Review34(April 2020) (2019) https://doi.org/10.1017/S026988891800036X
2019 doi
-
[34]
Siino, M., Tinnirello, I., La Cascia, M.: Is text preprocessing still worth the time? A comparative survey on the influence of popular preprocessing methods on Transformers and traditional classifiers.Information Systems 121(March 2023), 102342 (2024) https://doi.org/10.1016/j...
2024
-
[35]
Expert Systems with Applications110, 298–310 (2018) https://doi.org/10.1016/ j.eswa.2018.06.022
Symeonidis, S., Effrosynidis, D., Arampatzis, A.: A comparative evaluation of pre-processing techniques and their interactions for twitter sentiment analysis. Expert Systems with Applications110, 298–310 (2018) https://doi.org/10.1016/ j.eswa.2018.06.022
2018
-
[36]
Hickman, L., Thapa, S., Tay, L., Cao, M., Srinivasan, P.: Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations.Or- ganizational Research Methods25(1), 114–146 (2022) https://doi.org/10.1177/ 1094428120971683
2022
-
[37]
In:RepL4NLP 2021 - 6th Workshop on Representation Learning for NLP, Proceedings of the Workshop (2021)
Goyal, N., Du, J., Ott, M., Anantharaman, G., Conneau, A.: Larger-Scale Trans- formers for Multilingual Masked Language Modeling. In:RepL4NLP 2021 - 6th Workshop on Representation Learning for NLP, Proceedings of the Workshop (2021). https://doi.org/10.18653/v1/2021.repl4nlp-1.4
2021 doi
-
[38]
https://pypi.org/ project/spacy-language-detection/ Accessed 2024-02-17
Beauchemin, D.: spacy-language-detection 0.2.1 (2021). https://pypi.org/ project/spacy-language-detection/ Accessed 2024-02-17
2021
-
[39]
IEEE Access7, 65263–65276 (2019) https://doi.org/10.1109/ACCESS
Buchkremer, R., Demund, A., Ebener, S., Gampfer, F., Jägering, D., Jürgens, A., Klenke, S., Krimpmann, D., Schmank, J., Spiekermann, M., Wahlers, M., 50 Wiepke, M.: The application of artificial intelligence technologies as a substi- tute for reading and to support and enhance...
2019
-
[40]
arXiv preprint arXiv:2203.05794(2020) arXiv:2203.05794v1
Grootendorst, M.: BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794(2020) arXiv:2203.05794v1
2020 arXiv
-
[41]
https://maartengr.github.io/ BERTopic/algorithm/algorithm.html Accessed 2024-01-19
Grootendorst, M.: The Algorithm (2024). https://maartengr.github.io/ BERTopic/algorithm/algorithm.html Accessed 2024-01-19
2024
-
[42]
Reimers, N., Gurevych, I.: Sentence-BERT: Sentence embeddings using siamese BERT-networks.EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Meth- ods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Confere...
2019 arXiv
-
[43]
arXiv:1802.03426 (2020) arXiv:1802.03426v3
Mcinnes, L., Healy, J., Melville, J.: UMAP : Uniform Manifold Approxi- mation and Projection for Dimension Reduction. arXiv:1802.03426 (2020) arXiv:1802.03426v3
2020 arXiv
-
[44]
Campello, R.J.G.B., Moulavi, D., Sander, J.: Density-Based Clustering Based on Hierarchical Density Estimates.Advances in Knowledge Discovery and Data Mining, 160–172 (2013) https://doi.org/10.1007/978-3-642-37456-2_14
2013 doi
-
[45]
https:// scikit-learn.org/stable/modules/generated/sklearn.feature{_}extraction.text
sklearn.feature_extraction.text.CountVectorizer (2023). https:// scikit-learn.org/stable/modules/generated/sklearn.feature{_}extraction.text. CountVectorizer.html Accessed 2024-01-18
2023
-
[46]
Schubert, E., Sander, J., Ester, M., Kriegel, H.P., Xu, X.: DBSCAN revisited, revisited: Why and how you should (still) use DBSCAN.ACM Transactions on Database Systems 42(3) (2017) https://doi.org/10.1145/3068335
2017 doi
-
[47]
Mckinney, W.: pandas: a Foundational Python Library for Data Analysis and Statistics (2011)
2011
-
[48]
https://maartengr.github.io/BERTopic/ api/bertopic.html Accessed 2024-01-18
Grootendorst, M.: BERTopic (2024). https://maartengr.github.io/BERTopic/ api/bertopic.html Accessed 2024-01-18
2024
-
[49]
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: RoBERTa: A Robustly Optimized BERT Pretraining Approach.arXiv: 1907.11692 (1) (2019) arXiv:1907.11692
2019 arXiv
-
[50]
https://spacy.io/universe/project/ spacy-textblob Accessed 2024-02-17
Edwardes, S.: spacytextblob (2024). https://spacy.io/universe/project/ spacy-textblob Accessed 2024-02-17
2024
-
[51]
https://spacy.io/models/ 51 en{#}en{_}core{_}web{_}sm Accessed 2024-02-17
Explosion: en_core_web_sm (2023). https://spacy.io/models/ 51 en{#}en{_}core{_}web{_}sm Accessed 2024-02-17
2023
-
[52]
Linguistic Data Consortium (2013)
Weischedel, R., Palmer, M., Marcus, M., Hovy, E., Pradhan, S., Ramshaw, L., Xue, N., Taylor, A., Kaufman, J., Franchini, M., Others: Ontonotes release 5.0. Linguistic Data Consortium (2013). https://doi.org/10.35111/xmhb-2b84 . https://catalog.ldc.upenn.edu/LDC2013T19
2013 doi
-
[53]
https://github.com/explosion/spacy-models/releases/ tag/en{_}core{_}web{_}sm-3.7.1
SpaCy: English (2023). https://github.com/explosion/spacy-models/releases/ tag/en{_}core{_}web{_}sm-3.7.1
2023
-
[54]
arXiv: 2002.11402 (2020) arXiv:2002.11402
Jadhav, S.A.: Detecting Potential Topics In News Using BERT, CRF and Wikipedia. arXiv: 2002.11402 (2020) arXiv:2002.11402
2020 arXiv
-
[55]
2019.00017
Vychegzhanin, S., Kotelnikov, E.: Comparison of named entity recognition tools applied to news articles.Proceedings - 2019 Ivannikov Ispras Open Conference, ISPRAS 2019(February), 72–77 (2019) https://doi.org/10.1109/ISPRAS47671. 2019.00017
2019
-
[56]
Kamel, M., Siuky, F.N., Yazdi, H.S.: Robust sentiment fusion on distribution of news.Multimedia Tools and Applications78(15), 21917–21942 (2019) https: //doi.org/10.1007/s11042-019-7505-8
2019 doi
-
[57]
Advanced Data Mining and Applications
Mandalapu, A.C., Gunabalan, S., Sadineni, A., Cai, T., Al Hasan Haldar, N., Li, J.: Correlate Influential News Article Events to Stock Quote Movement. Advanced Data Mining and Applications. ADMA 2019. Lecture Notes in Com- puter Science 11888 LNAI (November), 331–342 (2019) ht...
2019
-
[58]
In:EACL 2021 - 16th Confer- ence of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, pp
Hamborg, F., Donnay, K.: NewsMTSC: A dataset for (multi-)target-dependent sentiment classification in political news articles. In:EACL 2021 - 16th Confer- ence of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, pp. 1663–167...
2021
-
[59]
Algorithms 16(9), 403 (2023) https://doi.org/10.3390/a16090403
Harth, P., Jähde, O., Schneider, S., Horn, N., Buchkremer, R.: From Data to Human-Readable Requirements: Advancing Requirements Elicitation through Language-Transformer-Enhanced Opportunity Mining. Algorithms 16(9), 403 (2023) https://doi.org/10.3390/a16090403
2023 doi
-
[60]
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of deep bidirectionaltransformersforlanguageunderstanding. NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceed...
2019 arXiv
-
[61]
https://pypi.org/project/ transformers/ Accessed 2024-02-17 52
Huggingface: transformers 4.37.2 (2024). https://pypi.org/project/ transformers/ Accessed 2024-02-17 52
2024
-
[62]
In:Proceedings of the Sev- enth Conference on Natural Language Learning at HLT-NAACL 2003, pp
Sang, E.F.T.K., De Meulder, F.: Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition. In:Proceedings of the Sev- enth Conference on Natural Language Learning at HLT-NAACL 2003, pp. 142–147 (2003).https://aclanthology.org/W03-0419
2003
-
[63]
In: Findings of the Association for Computational Linguistics: NAACL 2022 - Findings, pp
Tedeschi, S., Navigli, R.: MultiNERD: A Multilingual, Multi-Genre and Fine- Grained Dataset for Named Entity Recognition (and Disambiguation). In: Findings of the Association for Computational Linguistics: NAACL 2022 - Findings, pp. 801–812 (2022). https://doi.org/10.18653/v1/...
2022 doi
-
[64]
In:ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, pp
Ringland, N., Dai, X., Hachey, B., Karimi, S., Paris, C., Curran, J.R.: NNE: A dataset for nested named entity recognition in English newswire. In:ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, pp. 5176–5181 (202...
2020
-
[65]
acl-long.459 arXiv:2212.09747
Liu, S., Ritter, A.: Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? arXiv: 2212.09747, 8254–8271 (2023) https://doi.org/10.18653/v1/2023. acl-long.459 arXiv:2212.09747
2023 arXiv
-
[66]
Hu, X., Zhou, Z., Li, H., Hu, Y., Gu, F., Kersten, J., Fan, H., Klan, F.: Location Reference Recognition from Texts: A Survey and Comparison.ACM Computing Surveys 56(5), 1–37 (2024) https://doi.org/10.1145/3625819 arXiv:2207.01683
2024 arXiv
-
[67]
Polignano, M., Gemmis, M., Semeraro, G.: Comparing transformer-based NER approaches for analysing textual medical diagnoses.CEUR Workshop Proceed- ings 2936, 818–833 (2021)
2021
-
[68]
IEEE Transactions on Knowledge and Data Engineering35(11), 11019–11038 (2023) https://doi.org/ 10.1109/TKDE.2022.3230975
Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges. IEEE Transactions on Knowledge and Data Engineering35(11), 11019–11038 (2023) https://doi.org/ 10.1109/TKDE.2022.3230975
2023
-
[69]
Wu, H., Zhang, Z., Shi, S., Wu, Q., Song, H.: Phrase dependency relational graph attention network for Aspect-based Sentiment Analysis.Knowledge-Based Systems 236, 107736 (2022) https://doi.org/10.1016/j.knosys.2021.107736
2022
-
[70]
Bird, S.: NLTK: The natural language toolkit.COLING/ACL 2006 - 21st In- ternational Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Interactive Presentation Sessions, 69–72 (2006) arXiv:0205028 [cs]
2006
-
[71]
Biemann, C.: Ontology Learning from Text: A Survey of Methods.Journal for Language Technology and Computational Linguistics20(2), 75–93 (2005) https: //doi.org/10.21248/jlcl.20.2005.76 53
2005 doi
-
[72]
International Journal of Information Management Data Insights 2(2) (2022) https://doi.org/10.1016/j.jjimei.2022.100131
Antunes, A.L., Cardoso, E., Barateiro, J.: Incorporation of Ontologies in Data Warehouse/Business Intelligence Systems - A Systematic Literature Review. International Journal of Information Management Data Insights 2(2) (2022) https://doi.org/10.1016/j.jjimei.2022.100131
2022
-
[73]
Future Generation Computer Systems 153(July 2023), 442–456 (2024) https://doi.org/10.1016/j.future.2023.12.013 arXiv:2308.15168
Karabulut, E., Pileggi, S.F., Groth, P., Degeler, V.: Ontologies in digital twins: A systematic literature review. Future Generation Computer Systems 153(July 2023), 442–456 (2024) https://doi.org/10.1016/j.future.2023.12.013 arXiv:2308.15168
2024 arXiv
-
[74]
Procedia Computer Science 176, 3356–3368 (2020) https:// doi.org/10.1016/j.procs.2020.09.061
Wątróbski, J.: Ontology learning methods from text - an extensive knowledge- based approach. Procedia Computer Science 176, 3356–3368 (2020) https:// doi.org/10.1016/j.procs.2020.09.061 . Knowledge-Based and Intelligent Informa- tion & Engineering Systems: Proceedings of the 2...
2020 doi
-
[75]
IEEE Intelligent Systems 16(2), 72–79 (2001) https://doi.org/10.1109/5254.920602
Maedche, A., Staab, S.: Ontology learning for the Semantic Web. IEEE Intelligent Systems 16(2), 72–79 (2001) https://doi.org/10.1109/5254.920602
2001
-
[76]
In: Research in Computing Science, vol
Reyes-Peña, C., Tovar-Vidal, M.: Ontology: Components and Evaluation, a Review. In: Research in Computing Science, vol. 148, pp. 257–265 (2019). https://doi.org/10.13053/rcs-148-3-21
2019 doi
-
[77]
Knowl- edge Acquisition 5(2), 199–220 (1993) https://doi.org/10.1006/knac.1993.1008
Gruber,T.R.:Atranslationapproachtoportableontologyspecifications. Knowl- edge Acquisition 5(2), 199–220 (1993) https://doi.org/10.1006/knac.1993.1008
1993
-
[78]
In: Ontologies in Urban Development Projects, pp
Roussey, C., Pinet, F., Kang, M.A., Corcho, O.: An Introduction to On- tologies and Ontology Engineering. In: Ontologies in Urban Development Projects, pp. 9–38 (2011). https://doi.org/10.1007/978-0-85729-724-2_2 . http://link.springer.com/10.1007/978-0-85729-724-2_2
2011 doi
-
[79]
In:Semantic Web Services, pp
Stephan, G., Pascal, H., Andreas, A.: Knowledge Representation and Ontolo- gies. In:Semantic Web Services, pp. 51–105. Springer, Berlin, Heidelberg (2009). https://doi.org/10.1007/3-540-70894-4_3 . http://link.springer.com/10.1007/3- 540-70894-4_3
2009 doi
-
[80]
: The Rise and Potential of Large Language Model Based Agents: A Survey.arXiv: 2309.07864 (2023) arXiv:2309.07864
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, T. ...: The Rise and Potential of Large Language Model Based Agents: A Survey.arXiv: 2309.07864 (2023) arXiv:2309.07864
2023 arXiv
-
[81]
: GPT-4 Technical Report.arXiv: 2303.08774 (2023) arXiv:2303.08774
OpenAI, :, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Ale- man, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, B. ...: GPT-4 Technical Report.arXiv: 2303.08774 (2023) arXiv:2303.08774
2023 arXiv
-
[82]
: Gemini: A Family of Highly Capable Multimodal Models.arXiv: 2312.11805 (2023) arXiv:2312.11805 54
Gemini Team, Anil, R., Borgeaud, S., Wu, Y., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A.M., Hauth, O. ...: Gemini: A Family of Highly Capable Multimodal Models.arXiv: 2312.11805 (2023) arXiv:2312.11805 54
2023 arXiv
-
[83]
Giglou, H.B., D’Souza, J., Auer, S.: LLMs4OL: Large Language Models for Ontology Learning.arXiv: 2307.16648 (Dcmi) (2023) arXiv:2307.16648
2023 arXiv
-
[84]
Konys, A.: Knowledge systematization for ontology learning methods.Procedia Computer Science 126, 2194–2207 (2018) https://doi.org/10.1016/j.procs.2018. 07.229
2018 doi
-
[85]
In:Findings of the Association for Computa- tional Linguistics: EMNLP 2023, pp
Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., Fung, P.: Towards Mitigating LLM Hallucination via Self Reflection. In:Findings of the Association for Computa- tional Linguistics: EMNLP 2023, pp. 1827–1843. Association for Computational Linguistics, Stroudsburg, PA, USA (2023). ht...
2023 doi
-
[86]
Martino, A., Iannelli, M., Truong, C.: Knowledge Injection to Counter Large Language Model (LLM) Hallucination.The Semantic Web: ESWC 2023 Satellite Events, 182–185 (2023) https://doi.org/10.1007/978-3-031-43458-7_34
2023 doi
-
[87]
arXiv:2309.05922 (2023) arXiv:2309.05922
Rawte, V., Sheth, A., Das, A.: A Survey of Hallucination in Large Foundation Models. arXiv:2309.05922 (2023) arXiv:2309.05922
2023 arXiv
-
[88]
Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., Chen, Y., Wang, L., Luu, A.T., Bi, W., Shi, F., Shi, S.: Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models.arXiv: 2309.01219 (2023) arXiv:2309.01219
2023 arXiv
-
[89]
arXiv: 2306.13781 (Figure 4) (2023) arXiv:2306.13781
Huo, S., Arabzadeh, N., Clarke, C.L.A.: Retrieving Supporting Evi- dence for LLMs Generated Answers. arXiv: 2306.13781 (Figure 4) (2023) arXiv:2306.13781
2023 arXiv
-
[90]
Artificial Intelligence Review56(4), 3005–3054 (2023) https://doi.org/10.1007/ s10462-022-10246-w
Mosqueira-Rey, E., Hernández-Pereira, E., Alonso-Ríos, D., Bobes-Bascarán, J., Fernández-Leal, Á.: Human-in-the-loop machine learning: a state of the art. Artificial Intelligence Review56(4), 3005–3054 (2023) https://doi.org/10.1007/ s10462-022-10246-w
2023
-
[91]
1145/3387939.3391592
Li, N., Adepu, S., Kang, E., Garlan, D.: Explanations for human-on-the- loop: A probabilistic model checking approach.Proceedings - 2020 IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self- Managing Systems, SEAMS 2020 (April), 181–187 (2020) ht...
2020
-
[92]
IEEE Systems, Man, and Cybernetics Magazine 3(1), 10–17 (2017) https://doi.org/10.1109/ MSMC.2016.2623867
Nahavandi, S.: Trusted Autonomy Between Humans and Robots: Toward Human-on-the-Loop in Robotics and Autonomous Systems. IEEE Systems, Man, and Cybernetics Magazine 3(1), 10–17 (2017) https://doi.org/10.1109/ MSMC.2016.2623867
2017
-
[93]
1609/icwsm.v3i1.13937
Bastian, M., Heymann, S., Jacomy, M.: Gephi: An Open Source Software for Exploring and Manipulating Networks.Proceedings of the International AAAI 55 Conference on Web and Social Media3(1), 361–362 (2009) https://doi.org/10. 1609/icwsm.v3i1.13937
2009
-
[94]
Physical Review Research 2(4), 043271 (2020) https://doi.org/10.1103/ PhysRevResearch.2.043271
Zhang, L., Peixoto, T.P.: Statistical inference of assortative community struc- tures. Physical Review Research 2(4), 043271 (2020) https://doi.org/10.1103/ PhysRevResearch.2.043271
2020
-
[95]
Spinde, T., Rudnitckaia, L., Mitrović, J., Hamborg, F., Granitzer, M., Gipp, B., Donnay, K.: Automated identification of bias inducing words in news arti- cles using linguistic and context-oriented features.Information Processing and Management 58(3), 102505 (2021) https://doi...
2021
-
[96]
Hamborg, F., Zhukova, A., Gipp, B.: Automated identification of media bias by word choice and labeling in news articles.Proceedings of the ACM/IEEE Joint Conference on Digital Libraries2019-June(1), 196–205 (2019) https://doi.org/ 10.1109/JCDL.2019.00036
2019
-
[97]
In:The History and Politics of Public Radio, pp
Bennett, J.T.: Left, Right, or Always Establishment? The Bias Issue. In:The History and Politics of Public Radio, pp. 85–97 (2021). https://doi.org/10.1007/ 978-3-030-80019-2_6 . https://link.springer.com/10.1007/978-3-030-80019-2_6
2021 doi
-
[98]
Technical report (2023)
Newman, N., Fletcher, R., Eddy, K., Robertson, C.T., Nielsen, R.K.: Digital News Report 2023. Technical report (2023)
2023
-
[99]
Gan, L., Yang, T., Huang, Y., Yang, B., Luo, Y.Y., Richard, L.W.C., Guo, D.: Experimental Comparison of Three Topic Modeling Methods with LDA, Top2Vec and BERTopic.Artificial Intelligence and Robotics, 376–391 (2024) https://doi.org/10.1007/978-981-99-9109-9_37
2024 doi
-
[100]
Hamborg, F., Meuschke, N., Gipp, B.: Bias-aware news analysis using matrix- based news aggregation.International Journal on Digital Libraries21(2), 129– 147 (2020) https://doi.org/10.1007/s00799-018-0239-9
2020 doi
-
[101]
In: 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL), pp
Hamborg, F., Meuschke, N., Gipp, B.: Matrix-based news aggregation: Ex- ploring different news perspectives. In: 2017 ACM/IEEE Joint Conference on Digital Libraries (JCDL), pp. 1–10 (2017). https://doi.org/10.1109/JCDL.2017. 7991561 56
2017 doi
-
[2022]
(2023) https://doi.org/10.1016/j.chb.2022.107540
2023
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.