{"id":"10fc8580-fc2f-4adf-81bd-e8f822e6f3b2","arxiv_id":"2412.20068","paper_version":1,"verdict":"REJECT","confidence":"HIGH","novelty_score":5.0,"correctness_risk":"high","formal_verification":"none","parameter_count":6,"one_line_summary":"A fine-tuned LLM chatbot that classifies emotions and generates empathetic replies can also produce emotional profiles that the authors use to screen Reddit posts for suicide risk.","lead":"This paper presents RACLETTE, a chatbot fine-tuned from Mistral 7B that predicts a user's emotion and responds empathetically, then builds a running emotional profile of the user. The authors argue these profiles can be compared to emotion histograms extracted from mental-health subreddits to screen for suicide risk.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The screening claim rests on an undocumented independence between reference profiles and test posts; unless the test split is disjoint from the prototype computation, the 0.95 recall could be an artifact of self-similarity.","rationale":"The reader's REJECT is well-founded. I considered whether the more basic issue is that the 'emotion embeddings' are just the fine-tuned LLM's predicted label distribution and may be confounded by topic, but the immediate experiment that makes or breaks the central screening claim is the suicide-risk discrimination in §6, and that experiment has a clear, testable validity threat: the reference and test samples may not be independent. The paper says 'We select 5% of the initial samples at random as a test set' but never says the remaining samples or the Section 5 reference posts are excluded from prototype construction. Even if the positive SuicideWatch prototype comes from Low et al. and the test from Kaggle, the negative CasualConversation control is described as being from the same collection, so at least one side of the comparison is suspect. This concern is not about disagreement with consensus; it is about the internal validity of the reported recall 0.95. The 'unsupervised' framing and OR-combination further complicate interpretation, but the missing disjointness is the most load-bearing single flaw. A strict split would settle it. Thus I keep the reader's verdict unchanged.","tokens_in":19926,"tokens_out":7558,"duration_ms":84379,"concrete_test":"Re-run the §6 experiment with a strict and pre-registered split: partition the Kaggle SuicideWatch/CasualConversation pool into reference (e.g., 80%) and test (20%) before computing any prototype; exclude the test posts from both the positive and negative reference embeddings; then recompute Table 4. Independently hash post IDs to check overlap between the Low et al. reference set and the test set. If recall drops toward the RoBERTa baseline (0.84) or accuracy falls below 0.70, the reported 0.95 is contamination. Report results with stratified bootstrap confidence intervals.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim depends on the §6 evaluation, and the paper never shows that the reference embeddings used as class prototypes are disjoint from the test posts. §5 builds reference profiles from 1,000 posts per subreddit; §6 samples a test set from a SuicideWatch/CasualConversation pool and uses a CasualConversation embedding as the negative control, but never states whether the leftover pool or the Low et al. reference set contains test posts. If the negative prototype comes from the same pool as the test negatives, a 'normal' post is compared to a centroid of its own population, inflating accuracy; if the positive prototype overlaps positive tests, the recalled 0.95 may reflect self-similarity rather than a diagnostic marker. The 'unsupervised' label also hides that subreddit labels define prototypes, and the 'Combined' rule is an OR-ensemble chosen to maximize recall, so Table 4's comparison with BERT/RoBERTa k-means is not a like-for-like operating point. The load-bearing issue is independence: absent a documented split, the screening result cannot be interpreted.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper introduces RACLETTE, a Mistral-7B model fine-tuned on Empathetic Dialogues with a three-turn prompt/emotion/response format, and evaluates it on emotion recognition and empathetic response generation. The authors then define \"emotion embeddings\" by sampling top-k emotion tokens and aggregating them over sentences, construct reference embeddings from Reddit mental-health subreddits and DailyDialog, and use these reference embeddings to classify SuicideWatch versus CasualConversation posts in a binary suicide-risk task. The central claim is that emotional profiles built from LLM predictions can serve as interpretable markers for preliminary mental-health screening. The empirical support for this claim rests on Section 6's classification experiment, which reports recall up to 0.95.","tokens_in":20121,"tokens_out":6623,"duration_ms":72482,"significance":"If the screening claim were validated, the idea of using generative LLM emotion distributions as explainable, low-cost markers would be of practical interest for preliminary triage, especially because the approach avoids requiring labeled clinical text. The paper has real strengths: it gives concrete fine-tuning details, uses public datasets, and includes useful qualitative examples of coexisting emotions and model uncertainty. However, the current evaluation does not establish the screening claim: the Section 6 experiment does not document that the reference prototypes and test posts are disjoint, and the decision rule is essentially a nearest-centroid classifier over subreddit-derived prototypes. The emotion-classification comparison in Section 4 is also a single run compared against literature numbers under unspecified protocols. The paper's contribution is therefore better viewed as an unvalidated proof-of-concept than as a demonstrated screening tool.","major_comments":[{"comment":"The load-bearing issue is independence between the reference embeddings and the test set. Section 5 states that reference embeddings for each disorder are computed by processing 1,000 posts from each subreddit, while Section 6 states that a 5% random test set (about 10,585 samples) is taken from a Kaggle collection of SuicideWatch and CasualConversation posts. The paper never states that the test posts are excluded from the 1,000-post reference computations or from the CasualConversation negative prototype. If the test posts overlap with the reference set, then a SuicideWatch post is compared against a centroid that includes its own source population, and the reported recall of 0.95 in Table 4 may reflect self-similarity rather than any diagnostic signal. The authors must document and enforce a strict disjoint split, ideally at the user level, and report results on that split.","section":"Sections 5–6, Table 4"},{"comment":"The method is described as unsupervised, but the positive and negative label sets are manually defined from subreddit membership, and the prototypes are centroids of those labeled sets. The \"Combined\" rule is an OR-ensemble over three similarity metrics that is explicitly chosen to maximize recall, so the comparison with the BERT/RoBERTa k-means systems in Table 4 is not at a like-for-like operating point. Moreover, the positive label set includes seven disorder subreddits, which makes high recall easy to obtain by construction: any post whose nearest prototype is one of those seven is labeled positive. The 0.95 recall therefore cannot be interpreted as evidence that the emotion markers outperform the stated baselines.","section":"Section 6.1, positive/negative label definitions"},{"comment":"The claim of \"superior emotional accuracy\" is based on a single run of RACLETTE (0.59) compared with accuracy values taken directly from other papers, with no error bars and no statement about whether those values use the same evaluation protocol (prompt-level vs. conversation-level, exact test split, model selection). This makes the comparison unverifiable. Please provide variance estimates over multiple seeds and, if possible, re-run the baselines under the identical protocol, or report all numbers with explicit protocol caveats.","section":"Section 4, Table 2"},{"comment":"The reference \"disorder embeddings\" are derived from self-selected subreddit communities rather than clinically assessed populations. The paper itself acknowledges in Section 8 that self-reported information and social-media expression are noisy proxies for mental disorders. As a result, the Section 6 experiment demonstrates, at most, that emotion profiles can distinguish two subreddit communities; it does not demonstrate discrimination between clinical conditions. The abstract's conclusion that the method provides \"a novel approach to preliminary screening\" goes beyond what the data can support. A revision should either add a clinical or validated-label evaluation, or carefully re-frame the contribution as a study of subreddit-community discrimination.","section":"Sections 5–6 and 8"}],"minor_comments":[{"comment":"The word \"intrinsecaly\" is a typo and should be \"intrinsically\".","section":"Abstract"},{"comment":"The caption contains \"coversation\", which should be \"conversation\".","section":"Figure 1 caption"},{"comment":"Several KL divergence values are reported as infinite (anxiety, lonely, healthAnxiety); please explain how zero probabilities are handled, or use a smoothed divergence so that all values are finite and comparable.","section":"Table 3"},{"comment":"The conversation-level evaluation seems to append the target response, not the model's predicted response, to the context during evaluation; this is stated implicitly in Appendix D.1 but should be stated explicitly in the main text because it affects the interpretation of the conversation-level accuracy gain.","section":"Section 4 / Appendix D.1"},{"comment":"The text says \"establishing 'exited' as the prominent emotion\"; this should be \"excited\".","section":"Appendix D.1"},{"comment":"t-SNE is stochastic; please report the perplexity, learning rate, and random seed for reproducibility.","section":"Figure 4(A)"},{"comment":"The use of green shading to indicate better performance is not accessible in grayscale print; please add boldface or symbols to mark the best values.","section":"Tables 2 and 4"}],"recommendation":"major_revision","confidential_remarks":"The Section 6 screening result is the main support for the paper's central claim, and the missing disjoint split between reference prototypes and test posts is a serious, load-bearing flaw. I would be willing to look at a revised version that (a) enforces and documents a strict split, (b) reports multiple runs with error bars, and (c) re-frames the contribution as subreddit-community discrimination unless clinical labels are added. If the authors cannot provide a valid evaluation, the appropriate decision would be rejection rather than acceptance."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The part of this paper worth taking seriously is the RACLETTE system itself: fine-tuning Mistral 7B on Empathetic Dialogues with a 3-turn prompt format and using top-k sampling to produce emotion distributions is a plausible way to get both classification and generation from one decoder model, and the accumulated emotional profile is an interesting idea. The paper is transparent about hyperparameters, includes per-class error analysis, and gives qualitative examples including out-of-label emotion predictions. The limitations section is also honest about social-media noise and ethical concerns.\n\nThe screening claim is a different story. Section 5 builds reference embeddings from 1,000 posts per subreddit; Section 6 samples 5% of what looks like the same Kaggle collection for the test set. The paper never states that the test posts are excluded from the reference computation. Without that disjoint split, the suicide-risk classifier is comparing a post to a centroid of its own population, so the 0.95 recall is an artifact of self-similarity, not evidence of a diagnostic marker. The method is also called unsupervised while using subreddit labels to construct the prototypes, and the Combined rule is a post-hoc OR-ensemble of three metrics chosen to maximize recall, so Table 4 is not a like-for-like comparison with the k-means baselines. These are load-bearing flaws because the paper's headline contribution is precisely the interpretable-marker-for-screening claim.\n\nThe emotion-recognition results have softer but real issues: the 0.59 accuracy is compared to numbers lifted from other papers that may use different evaluation protocols, there are no error bars or significance tests, and no code or data is released. The empathy evaluation is only BERTScore against target responses, with no baseline or human judgment. These would be fixable in revision; the independence problem is not a patch.\n\nWho gets value from this? Someone working on LLM-based empathetic dialogue could learn from the 3-turn mechanism and the profile-accumulation idea, but should treat the screening experiment as illustrative at best. This paper deserves a serious referee because the topic is important and the engineering work is real, but I would expect major revision or rejection of the screening claims as currently validated. A clean experiment with a documented disjoint split and matched operating points would change my read substantially.","headline":"The RACLETTE emotion-classification and empathetic-response system is real engineering, but the screening claim rests on an undocumented split between reference and test subreddit posts, so the 0.95 recall is likely self-similarity.","tokens_in":20690,"tokens_out":2338,"would_cite":false,"duration_ms":26067,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A single fine-tuned LLM can chat empathetically and simultaneously emit interpretable emotion distributions that flag suicide-risk text with 0.95 recall.","keywords":["empathetic conversational AI","emotion embeddings","emotional profiles","mental health screening","suicide risk detection","large language models","explainable markers","mental health support"],"falsifier":"Rebuild the reference embeddings from one randomly chosen half of the SuicideWatch and CasualConversation posts and re-run the 0.95-recall experiment on the other half; if recall on the held-out half falls far below the reported combined score, then part of the signal is the test posts' own contribution to the reference profiles rather than their emotional content. A second probe: swap the reference source, building the 'suicide' profile from a clinically validated corpus of suicide notes, and check whether recall on the same test set survives the swap.","tokens_in":19696,"feed_emoji":"🧠","tokens_out":7047,"duration_ms":64454,"temperature":0.7,"pith_summary":"The paper argues that one LLM can do both halves of mental-health support — talk empathetically and screen for risk — using a single shared representation: the user's emotional profile. It introduces RACLETTE, a fine-tuned 7-billion-parameter language model that predicts which of 32 emotions a speaker is feeling as a next-token generation task, replies empathetically, and accumulates the sampled emotion distributions into an explainable profile. The paper then claims these profiles are interpretable markers: comparing a profile to pre-computed emotion distributions from subreddits such as SuicideWatch and r/depression separates suicidal from ordinary text, with the combined detector reaching 0.95 recall. If correct, the approach offers preliminary screening without clinical labels or sensitive therapy data, since the signals are built from public text and from the emotions the model itself reads.","feed_headline":"LLM chatbot reads emotions and flags suicide risk at 0.95 recall","feed_subtitle":"A single model answers empathetically while building emotion profiles that separate suicidal from ordinary text.","key_machinery":"The load-bearing object is the emotion embedding: a probability vector over 32 emotion classes built by repeated Top-K sampling from the fine-tuned decoder. For each prompt the model predicts an emotion as a next token; sampling ten times produces an empirical distribution over emotions, and averaging those distributions across the turns of a conversation gives the user's emotional profile. The same procedure applied to subreddit posts produces reference disorder profiles, so the profile is simultaneously the input to the empathetic response (the predicted emotion is inserted into the three-turn prompt) and the marker compared against reference embeddings for screening. Because the embedding is a weighted sum of named emotions, every prediction can be inspected as a list of named emotions with weights rather than an opaque score.","core_discovery":"Mental states can be represented as mixtures of discrete emotions. By fine-tuning a generative decoder model on the Empathetic Dialogues dataset with a three-turn prompt–emotion–response structure, the paper obtains a conversational agent that predicts a speaker's emotion as autoregressive next-token generation, samples top-10 emotions ten times per prompt, and aggregates these empirical distributions over a conversation into an emotion embedding. Applying the same sampling procedure to 1,000 posts from each of 15 mental-health subreddits yields characteristic disorder profiles, and comparing a user profile against the suicide profile with KL or JS divergence or cosine similarity labels the text at risk. On a binary test set of SuicideWatch versus CasualConversation posts, the method reaches recall 0.95 for suicide risk in its combined variant, while the reference distributions remain visually and mathematically interpretable: depression sits closest to suicide, the depression-plus-schizophrenia embedding lands near bipolar, and control-group profiles from DailyDialog are dominated by positive emotions.","pith_inferences":["Implicit extension: the emotional profile is built cumulatively over conversation turns, so the same comparison could track whether a user's distribution drifts toward the suicide reference over time; the paper reports one-shot classification, not trajectories, so a longitudinal study is a natural next step.","The near-arithmetic relation in the reduced space (depression + schizophrenia near bipolar) suggests emotional profiles might predict profiles for conditions with no dedicated community; testing this by synthesizing a profile and checking it against a held-out subreddit would confirm whether the arithmetic is semantically meaningful.","The 32-emotion simplex is coarse for clinical use; converting the profile into a small set of named dominant emotions (e.g., 'devastated, lonely, ashamed' for the suicide reference) could produce a plain-language summary a non-specialist can read, which is the direction the authors gesture at but do not implement."],"forward_implications":["A single fine-tuned LLM can handle both empathetic response generation and emotion classification, and conversation-level context improves emotion accuracy from 56% to 59% on the Empathetic Dialogues test set, beating the 51% of the CAiRE baseline.","Emotional profiles of mental disorders are separable and psychologically coherent: suicide overlaps with depression, addiction with alcoholism, schizophrenia with PTSD, and summing the depression and schizophrenia embeddings places the result near bipolar in t-SNE space.","Suicide-risk screening can be done without supervised clinical labels: comparing a post's emotion embedding to reference embeddings, with the combined KL/JS/cosine rule, achieves 0.95 recall for identifying suicidal text, at precision 0.63.","Because the marker is a distribution over 32 named emotions, a clinician or user can inspect why a text was flagged, addressing the explainability gap of black-box classifiers.","The approach avoids requiring sensitive real-world therapy conversations for training, using only public empathetic dialogues and public subreddit text."],"supporting_citations":[{"why":"Supplies the Empathetic Dialogues training data that teaches the model both emotion prediction and empathetic response generation.","marker":"Rashkin et al., 2018"},{"why":"The CAiRE chatbot architecture this work builds on and the main accuracy benchmark (0.51) that RACLETTE surpasses at 0.59.","marker":"Lin et al., 2020"},{"why":"Source of the Reddit mental-health subreddit posts used to compute each disorder's reference emotion profile.","marker":"Low et al., 2020"},{"why":"DailyDialog dataset providing the control ('normal') embedding and the healthy class in the screening experiment.","marker":"Li et al., 2017"},{"why":"The Mistral 7B base model that is fine-tuned into RACLETTE.","marker":"Jiang et al., 2023"},{"why":"Top-K sampling method used to produce the 10 emotion predictions per prompt that form the empirical distribution.","marker":"Holtzman et al., 2019"},{"why":"BDI-II, the psychometric inventory used as the conceptual template for treating mental state as a profile of emotion item scores.","marker":"Beck et al., 1996"},{"why":"Empirical basis for which disorders carry elevated suicide risk, fixing the positive-label set in the screening experiment.","marker":"Song et al., 2020"}],"fun_headline_variants":["LLM builds emotion profiles to detect suicide risk","Chatbot with empathy reads emotional states for mental health screening","Emotion embedding from LLM chats flags mental health risk","Interpretable emotion profiles aid mental health triage"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The screening results assume that the posts used to measure suicide risk were not also used to build the reference emotional profiles; the paper draws both from the same set of subreddit posts and never states that the test posts were set aside.","fun_headline_variants_meta":{"raw":{"variants":["LLM builds emotion profiles to detect suicide risk","Chatbot with empathy reads emotional states for mental health screening","Emotion embedding from LLM chats flags mental health risk","Interpretable emotion profiles aid mental health triage"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000262,"raw_usage":{"total_tokens":1584,"prompt_tokens":922,"completion_tokens":662,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":538,"completion_tokens_details":{"reasoning_tokens":599}},"tokens_in":538,"tokens_out":662,"duration_ms":7373,"temperature":1.0,"reasoning_tokens":599,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-10T23:35:54.320478+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Rebuild the reference embeddings from one randomly chosen half of the SuicideWatch and CasualConversation posts and re-run the 0.95-recall experiment on the other half; if recall on the held-out half falls far below the reported combined score, then part of the signal is the test posts' own contribution to the reference profiles rather than their emotional content. A second probe: swap the reference source, building the 'suicide' profile from a clinically validated corpus of suicide notes, and check whether recall on the same test set survives the swap.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The CAiRE chatbot architecture this work builds on and the main accuracy benchmark (0.51) that RACLETTE surpasses at 0.59."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Source of the Reddit mental-health subreddit posts used to compute each disorder's reference emotion profile."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"BDI-II, the psychometric inventory used as the conceptual template for treating mental state as a profile of emotion item scores."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Empirical basis for which disorders carry elevated suicide risk, fixing the positive-label set in the screening experiment."}],"review_version":1}