{"id":"346ef6f3-cdac-4051-bf29-577844474c6c","arxiv_id":"2508.16453","paper_version":2,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":4.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"Computational labeling shows anti-establishment sentiment is prevalent in TikTok conspiracy content but uncommon in finance and wellness, with varying engagement suggesting possible platform incentives.","lead":"This paper uses computational methods to label TikTok posts for anti-establishment sentiment across finance, wellness, and conspiracy topics. It reports the sentiment is common in conspiracy content but rare in the others, with topic-specific engagement patterns that may create platform incentives for such posts.","discovery_kind":"unclear","skeptic_critique":{"model":"grok-4.3","headline":"AES labeling method lacks reported domain-specific validation metrics","rationale":"The reader's weakest assumption matches the load-bearing step exactly. Full-text access does not resolve it because validation details remain the critical missing piece for trusting cross-domain comparisons; this is an internal methodological gap rather than an external consensus issue.","tokens_in":1784,"tokens_out":266,"duration_ms":22721,"concrete_test":"Annotate a fresh random sample of 300 posts (100 per domain) by two independent coders using the paper's AES definition; compute per-domain F1 against the model's labels. If F1 drops below 0.70 in finance or wellness, the 'relatively rare' prevalence result is unreliable.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The prevalence finding (AES common in conspiracy, rare in finance/wellness) rests on the computational classifier correctly identifying AES without domain bias or high error rates. Even with full text, the methods section does not appear to include per-domain human validation, inter-annotator agreement, or performance metrics (precision/recall/F1) on held-out samples from each topic; a single model trained primarily on conspiracy-style text could systematically under- or over-label AES in wellness/finance posts, directly undermining the comparative claim.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The paper examines anti-establishment sentiment (AES) on TikTok in finance, wellness, and conspiracy theory domains. Using a computational labeling method, it reports that AES is most prevalent in conspiracy content and relatively rare in finance and wellness posts, while engagement patterns vary by topic and may reflect platform incentives for AES content.","tokens_in":1878,"tokens_out":284,"duration_ms":17390,"significance":"If the AES labeling is shown to be accurate and unbiased across domains, the findings would help explain how social media environments contribute to institutional distrust by documenting prevalence and engagement differences, with implications for influencer strategies and platform moderation.","major_comments":[{"comment":"Methods section: The computational approach for labeling posts as AES or not is described without per-domain human validation, inter-annotator agreement scores, or performance metrics (precision/recall/F1) on held-out samples from finance, wellness, and conspiracy topics. This directly affects the validity of the comparative prevalence claim, as domain-specific bias or misclassification could alter the reported differences.","section":null}],"minor_comments":[{"comment":"Abstract: The headline findings on prevalence and engagement are stated without any reference to sample sizes, statistical tests, or controls, making it difficult to evaluate the strength of the evidence from the outset.","section":null}],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for their constructive feedback on our manuscript. We address the major comment below and will revise the paper to strengthen the methodological validation of our computational labeling approach.","responses":[{"response":"We agree that domain-specific validation is necessary to support the comparative prevalence claims across topics. Our computational labeling method was applied uniformly using the same procedure for consistency, but we acknowledge that this does not substitute for per-domain human evaluation. In the revised manuscript, we will expand the Methods section to include human annotation of held-out samples from each domain (finance, wellness, and conspiracy). We will report inter-annotator agreement scores and performance metrics (precision, recall, and F1) against human judgments for each domain separately. This addition will allow us to quantify and discuss any domain-specific biases or misclassification rates.","revision_made":"yes","referee_comment":"Methods section: The computational approach for labeling posts as AES or not is described without per-domain human validation, inter-annotator agreement scores, or performance metrics (precision/recall/F1) on held-out samples from finance, wellness, and conspiracy topics. This directly affects the validity of the comparative prevalence claim, as domain-specific bias or misclassification could alter the reported differences."}],"tokens_in":1282,"tokens_out":277,"duration_ms":37055,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"The main takeaway is that anti-establishment sentiment shows up heavily in conspiracy content on TikTok but stays low in finance and wellness posts, while engagement patterns differ enough to suggest platform incentives for that kind of framing. The work is mostly descriptive and stays within the bounds of what the data can support on its face.","headline":"The paper reports AES is common in conspiracy TikToks but rare in finance and wellness, with topic-varying engagement, yet the labeling step lacks the validation needed to back the comparisons.","tokens_in":2389,"tokens_out":144,"would_cite":false,"duration_ms":28887,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":{"model":"grok-4.3","evidence":[{"relation":"unclear","rs_module":"IndisputableMonolith/Foundation/RealityFromDistinction.lean","rs_theorem":"reality_from_one_distinction","paper_passage":"We employ a computational approach to label TikTok posts as containing AES or not... train supervised learning models... RoBERTa with the inclusion of category-specific information."},{"relation":"unclear","rs_module":"IndisputableMonolith/Cost/FunctionalEquation.lean","rs_theorem":"washburn_uniqueness_aczel","paper_passage":"We find that AES is most prevalent in conspiracy theory content, and relatively rare in content related to the other two topics."}],"headline":"Social-media AES classifier has no overlap with RS cost or distinction forcing","alignment":"orthogonal","rationale":"The paper's core machinery is a RoBERTa-based supervised classifier (with category embeddings) trained on human-annotated TikTok transcripts to detect anti-establishment sentiment across conspiracy/finance/wellness domains. This empirical labeling pipeline, engagement analysis, and LIWC linguistic cues bear no structural resemblance to the RS recognition cost J(x), phi-ladder, 8-tick periodicity, or the forcing chain from a single distinction. The domain (computational social science) lies outside the scope of the RS theorems.","tokens_in":56793,"confidence":"high","tokens_out":309,"duration_ms":12001,"cache_read_input_tokens":38528,"cache_creation_input_tokens":0},"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"Anti-establishment sentiment is common in TikTok conspiracy content but rare in finance and wellness videos.","keywords":["anti-establishment sentiment","TikTok","social media","conspiracy theories","wellness","finance","engagement patterns","influencers"],"falsifier":"A hand-coded sample of posts from the finance and wellness sets showing frequent mislabeling as anti-establishment when they are not.","tokens_in":2672,"feed_emoji":"📱","tokens_out":555,"duration_ms":40768,"temperature":0.7,"pith_summary":"The paper examines the prevalence of anti-establishment sentiment on TikTok in three areas where creators often claim expertise. It applies a computational method to detect distrust of institutions in posts about finance, wellness, and conspiracy theories. The analysis shows this sentiment appears most often in conspiracy videos and infrequently in the other two topics. Engagement with such posts differs across areas, which points to possible platform incentives that reward distrustful framing. Understanding these patterns matters for seeing how social media shapes attitudes toward public institutions.","feed_headline":"Anti-establishment views rare on TikTok finance and wellness posts","feed_subtitle":"They appear often in conspiracy content, with engagement varying by topic and possible incentives for distrustful framing.","key_machinery":"Computational labeling of TikTok posts for the presence or absence of anti-establishment sentiment, applied across finance, wellness, and conspiracy domains.","core_discovery":"Anti-establishment sentiment is most prevalent in conspiracy theory content on TikTok and relatively rare in content related to finance and wellness. Engagement patterns with such content vary by area, and there may be platform incentives for users to post content that expresses anti-establishment sentiment.","pith_inferences":["This pattern could affect how users evaluate health or money advice from non-institutional sources.","Similar labeling could be tested on other short-video platforms to check if incentives appear elsewhere.","The findings leave open whether repeated exposure to rare anti-establishment posts still shapes broader distrust over time."],"forward_implications":["Creators positioning themselves as experts in finance or wellness rarely use anti-establishment framing to gain attention.","Conspiracy content relies more heavily on distrust of institutions to attract viewers.","Differences in engagement suggest that anti-establishment posts can receive different levels of interaction depending on the topic.","Platform design choices may encourage certain types of content that question institutional authority."],"fun_headline_variants":["Anti-establishment sentiment rare in TikTok finance wellness posts","Anti-establishment sentiment common in TikTok conspiracy content","Engagement patterns vary for anti-establishment TikTok content","TikTok may offer incentives for anti-establishment posts"],"cache_read_input_tokens":64,"weakest_assumption_plain":"The computational method correctly identifies anti-establishment sentiment in posts without major errors or topic-specific biases.","fun_headline_variants_meta":{"raw":{"variants":["Anti-establishment sentiment rare in TikTok finance wellness posts","Anti-establishment sentiment common in TikTok conspiracy content","Engagement patterns vary for anti-establishment TikTok content","TikTok may offer incentives for anti-establishment posts"]},"model":"grok-4.3","cost_usd":0.013104,"raw_usage":{"total_tokens":5611,"prompt_tokens":685,"num_sources_used":0,"completion_tokens":63,"cost_in_usd_ticks":131040500,"prompt_tokens_details":{"text_tokens":685,"audio_tokens":0,"image_tokens":0,"cached_tokens":64},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":4863,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":685,"tokens_out":63,"duration_ms":50139,"temperature":1.0,"reasoning_tokens":4863,"cache_read_input_tokens":64,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-05-21T22:51:57.981872+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"A hand-coded sample of posts from the finance and wellness sets showing frequent mislabeling as anti-establishment when they are not.","supporting_citations":[],"review_version":1}