{"id":"8b10929d-07c9-4305-9dfd-903911eabb55","arxiv_id":"2504.19767","paper_version":1,"verdict":"ACCEPT","confidence":"MODERATE","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A journaling ecosystem of materials, personal context, and community shapes how analog journaling practices form and change over time.","lead":"Researchers studied how people develop personal analog journaling routines by analyzing public journaling videos and Instagram posts and interviewing 11 journalers. They found that journaling practice is shaped by materials, personal context, and community, and propose design directions for future journaling tools.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Framework's completeness is not established: no saturation check or negative-case analysis reported, and most results come from 11 student interviews.","rationale":"I reviewed the full text. The paper is a well-structured qualitative HCI study; the interview protocol, thematic analysis, and design implications are clearly described, and the authors appropriately limit some claims. The central concern is not that the study is sloppy but that the phrase 'the journaling ecosystem' implies a complete mapping, whereas the reported analysis cannot support completeness. The paper's own move—acknowledging the student sample in Section 6—strengthens trust but does not fix the absence of a saturation check. This is not a fatal flaw for the paper's design-implication value, but it is a load-bearing uncertainty for the generalized framework. The proposed saturation analysis can be run on the data the authors already have, so the condition is inexpensive. I also note that the 'Shouzhang et al.' citation in Section 2.1 appears to point to reference [54] (Yan Yuan), which should be corrected, though it does not affect the main argument.","tokens_in":19046,"tokens_out":7344,"duration_ms":71417,"concrete_test":"Run a saturation analysis on the existing 11 interview transcripts: order them chronologically, plot cumulative counts of codes and top-level themes per transcript, and check whether the last two transcripts introduce any new themes. Then have two independent coders apply the consolidated codebook plus an explicit 'other/unclassified' code to the final two transcripts; if any meaning units fall outside Materials, Personal Context, Community, or new top-level themes emerge, the framework's completeness claim should be revised to a provisional account.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The central claim presents 'the journaling ecosystem' as the set of factors shaping journaling practice, but the evidence does not establish that the three identified components are complete or correctly weighted. Section 4.1 explicitly states that the bulk of our results stemmed from the interviews rather than the initial social media analysis; those interviews are 11 self-selected students from one New York City research university (Section 3.5). The consolidation procedure (Section 3.4) describes open coding and a second coding pass but reports no saturation analysis, no stopping criterion, and no negative-case analysis. If later interviews were still generating new top-level themes, the three-component model would be an artifact of a small homogeneous sample rather than a complete ecosystem. The Limitations section (Section 6) acknowledges that students may differ from other journalers, but it does not address internal completeness of the codebook, so the gap remains.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents a qualitative study of analog journaling practices, based on thematic analysis of 29 YouTube stationery-focused videos, 50 Instagram journaling-spread posts, and semi-structured interviews with 11 university-student journalers. The authors derive a 'journaling ecosystem' framework in which journaling practice is shaped by materials, personal context, and community, and use the framework to propose design opportunities for future journaling tools, such as accommodating evolving practices, providing helpful constraints, and supporting selective sharing with close confidants rather than public audiences.","tokens_in":19213,"tokens_out":4565,"duration_ms":45306,"significance":"If the framework holds, it contributes a useful holistic account of how analog journaling practices develop over time, complementing prior HCI work on bullet journaling and quantified-self documentation. The paper's strengths include the triangulation of three data sources, a full appendix listing all analyzed videos and posts, and rich grounding of claims in participant quotes and visual examples. The qualitative methods are standard and described in detail, and the design opportunities follow directly from the empirical themes. The main risk is the completeness and generalizability of the ecosystem framework, given the small, homogeneous interview sample and the absence of explicit saturation or negative-case analysis.","major_comments":[{"comment":"The paper states in Section 4.1 that 'the bulk of our results stemmed from our interviews rather than our initial social media analysis,' yet Section 3.4 reports no saturation analysis, no stopping criterion, and no negative-case analysis for the interview coding. Without such evidence, the three-component ecosystem cannot be distinguished from an artifact of a small, homogeneous interview sample. Please add a codebook-stability analysis (e.g., plotting new themes against interview order) or explicitly reframe the contribution as a first-order framework whose completeness remains open.","section":"Section 4.1 / Section 3.4"},{"comment":"The generalizability of the ecosystem claim is constrained by the interview sample: all 11 participants are students at one New York City research university, aged 18-25, and nine are female. Section 6 acknowledges that students may differ from journalers more broadly, but it does not identify which specific ecosystem components might be missing or misweighted in non-student populations (e.g., working adults, older journalers, non-English-speaking communities). Please either broaden the recruitment strategy or qualify the scope of the framework to the studied populations, and discuss the implications of the sample for each of the three ecosystem components.","section":"Section 3.5 / Section 6"}],"minor_comments":[{"comment":"The in-text citation 'Shouzhang et al.' does not correspond to reference [54], which is Yan Yuan. Please correct the attribution or the reference list.","section":"Section 2.1"},{"comment":"The system 'list.it' is described without an explicit citation; if it refers to Van Kleek et al. [50], please insert the citation at that point, otherwise add the missing reference.","section":"Section 2.2"},{"comment":"The ecosystem diagram omits labels on the arrows connecting the components, so the causal directions (e.g., personal context influencing both materials and practice) are not legible from the figure alone; consider adding arrow labels or a more detailed caption.","section":"Figure 4"},{"comment":"The selection criteria for YouTube videos and Instagram posts ('diversity of content', 'diversity of visual styles') are not operationalized; please state the specific dimensions considered (e.g., format, materials, aesthetic style, geography, creator demographics) and any inclusion thresholds used.","section":"Sections 3.1 and 3.2"},{"comment":"The manuscript would benefit from a brief positionality statement; since the coding is qualitative and interpretive, information about the researchers' disciplinary backgrounds and prior assumptions about journaling would help readers interpret the coding choices.","section":"Section 3.3"}],"recommendation":"major_revision","confidential_remarks":"The paper fits the scope of C&C and the data collection is transparent for a qualitative study. My main concern is that the central claim—the completeness of the three-component ecosystem—is under-supported without saturation or negative-case analysis, and the homogeneous interview sample further limits confidence in the framework's generalizability. I would ask for a revised version that either provides such evidence or carefully qualifies the claim. The citation mismatch in Section 2.1 should also be fixed."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Lin and colleagues have written a clean, readable qualitative study with a genuinely useful framing. They treat analog journaling as a moving target, shaped over time by materials, personal context, and community, rather than as a static preference. That three-part ecosystem is the real contribution. Prior work has examined bullet journals, self-tracking, and reflective writing, but usually in isolation; putting them together and showing how they interact over time is new enough to be worth publishing.\n\nThe methods are standard for the subfield: 29 YouTube videos and 50 Instagram posts selected for diversity, 11 semi-structured interviews with students, thematic analysis with affinity diagramming and a second coding pass. The writeup is unusually honest; the authors say the bulk of results came from interviews, not the social media data, and they acknowledge the sample is young, student, and New York–centric. The design implications (bounded writing space, adaptable templates, selective sharing) follow from the quotes and don't overreach.\n\nThe main soft spot is the one the stress-test flags: the paper never establishes that the three-component ecosystem is complete. There is no saturation check, no negative-case analysis, and the consolidation pass is described only as 'identification of common themes plus addition of new themes.' Since the interviews are the main engine and there are only eleven of them, the framework could miss material factors a broader sample would surface. This is a real limitation, but not fatal. As a formative framework for design work, the three themes are plausible and well-illustrated. The paper would be stronger if the framework were framed as 'dimensions observed in this population' rather than 'the journaling ecosystem.'\n\nMinor issues: the Section 2.1 citation that attributes the slow/fast media distinction to 'Shouzhang et al.' but actually cites Yan Yuan should be fixed. No inter-coder reliability is reported; acceptable in qualitative work, but one sentence on how disagreements were resolved would help.\n\nWho is this for? HCI researchers and designers working on journaling, personal informatics, or reflective tools. It is a solid contribution at the level of a workshop paper or short paper, not a landmark. I would send it to peer review.","headline":"Useful ecosystem framing for analog journaling, but the completeness of that ecosystem rests on a thin interview sample with no demonstrated saturation.","tokens_in":19672,"tokens_out":3590,"would_cite":true,"duration_ms":34512,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper's central claim is that analog journaling practice emerges from a dynamic negotiation among materials, personal context, and community.","keywords":["journaling","documentation","analog journaling","journaling ecosystem","material affordances","personal context","community influence","design opportunities"],"falsifier":"A two-year longitudinal study of journalers that logs material purchases, major life events, and community interactions, and then compares these logs with changes in journal entries and layouts, would test the framework; if many journalers change their practice with no corresponding change in any of the three components, the ecosystem model would need revision.","tokens_in":18885,"feed_emoji":"📔","tokens_out":14278,"duration_ms":112287,"temperature":0.7,"pith_summary":"This paper argues that a person's analog journaling practice is not a fixed preference but a living, negotiated outcome of three interacting forces: the materials they use (stationery, notebooks, and digital tools), their personal context (life stage, identity, and mental-health goals), and their communities (close friends and online journaling circles). Based on interviews with 11 journalers and qualitative analysis of 29 YouTube videos and 50 Instagram posts, the paper shows how these forces continually reshape what people write, how they lay out their pages, and whether they sustain the habit. Understanding this ecosystem matters because journaling is linked to mental health and identity development, and the paper uses the framework to suggest design opportunities for future tools, such as adapting templates over time, providing helpful physical constraints, and supporting selective sharing with confidants. The central claim is that the ecosystem model explains both the diversity and the evolution of journaling practice better than individual taste alone.","feed_headline":"Journaling practice is an ecosystem, not a preference","feed_subtitle":"Journalers' routines change as materials, life context, and community shift; tools should adapt.","key_machinery":"The central object is the 'journaling ecosystem' framework, a model that depicts a journaler's practice as the output of ongoing negotiation among three mutually influential components: materials, personal context, and community. The framework functions as the paper's analytical lens, organizing all observed themes into these three categories and explaining changes in practice over time as rebalancing among them. It also directly generates design opportunities by highlighting the ecosystem aspects that current tools overlook, such as evolving templates, helpful physical constraints, and private, selective sharing.","core_discovery":"The paper's core discovery is the identification of a 'journaling ecosystem' in which journaling practice is the product of continuous negotiation among three components: materials (both physical stationery and digital tools like note-taking apps), personal context (the journaler's life circumstances, identity, aspirations, and mental-health goals), and community (immediate social relationships and broader online journaling communities). The paper demonstrates this through examples: page size and pen smoothness shape thought and reduce friction; moving to college alters access to materials and time, shifting routines; and exposure to 'aesthetic journaling' on social media first inspires then is rejected as inauthentic. The framework explains how practices develop over time, and the paper derives design implications from it, including bounded writing spaces, de-emphasized undo functions, and sharing features aimed at small groups of close contacts rather than public audiences.","pith_inferences":["The ecosystem framework likely extends beyond paper journals to other personal documentation practices, such as scrapbooking, art journals, and digital diaries, since materials, context, and community plausibly operate there too, though the balance among the three may differ.","The finding that journalers deliberately filter out negative content to protect their mental health suggests a testable design hypothesis: journaling tools that encourage complete or objective capture may be rejected by users, whereas tools that let users curate a selectively positive record may sustain engagement.","Because the interview sample was all university students, the framework's emphasis on personal context may be amplified by a life stage of rapid transition, such as leaving home and starting college, and older or more settled journalers might show a different weighting of the three components, which is an empirical question the paper does not address."],"forward_implications":["Journaling tools should let users adapt templates and structures over time, since practices evolve as personal context changes, and fixed prompts or rigid layouts can become stale or feel prescriptive.","Designers should embrace helpful constraints such as bounded page space and de-emphasized undo, because small spaces reduce fear of the blank page and permanent ink encourages freeform, unedited reflection.","Sharing features should support selective sharing with small groups of confidants rather than public audiences, since many journalers share with close friends or use entries to work through interpersonal conflicts.","Digital capture tools such as calendars, photo libraries, and note apps already alter journaling routines by replacing planning and serving as staging grounds, so future tools should integrate these streams thoughtfully rather than replace analog practice."],"supporting_citations":[{"why":"This reference supplies the baseline finding that paper bullet journals support flexible and mindful self-tracking, grounding the material and personal-context components of the ecosystem.","marker":"[4]"},{"why":"This reference documents how manual self-tracking on paper combines with digital tools, supporting the materials and digital-tools facet of the framework.","marker":"[1]"},{"why":"This reference describes bullet journaling as a craft of personal information management, reinforcing the idea that practices are individually crafted and evolve over time.","marker":"[49]"},{"why":"This reference introduces the slow media and fast media distinction used to frame analog journaling versus social media sharing, underpinning the community component.","marker":"[54]"},{"why":"This reference is used in the discussion of how physical wear and tear carries meaning, informing the material affordances and helpful-constraints design implications.","marker":"[23]"},{"why":"This reference supplies the thematic analysis procedure used to code the YouTube, Instagram, and interview data.","marker":"[9]"}],"fun_headline_variants":["Journaling is a negotiation among tools, life, and community","Journaling practices evolve as materials, context, and community shift","The journaling ecosystem: materials, personal context, and community","Journaling tools, life changes, and community shape your practice","Why journaling routines shift: materials, life context, and community"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The ecosystem framework's generalizability rests on a sample of 11 university students in New York City and 79 social media posts selected by hashtags and diversity criteria, so the framework may not capture the experiences of older, non-student, or non-English-speaking journalers.","fun_headline_variants_meta":{"raw":{"variants":["Journaling is a negotiation among tools, life, and community","Journaling practices evolve as materials, context, and community shift","The journaling ecosystem: materials, personal context, and community","Journaling tools, life changes, and community shape your practice","Why journaling routines shift: materials, life context, and community"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000378,"raw_usage":{"total_tokens":1988,"prompt_tokens":901,"completion_tokens":1087,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":517,"completion_tokens_details":{"reasoning_tokens":1000}},"tokens_in":517,"tokens_out":1087,"duration_ms":7617,"temperature":1.0,"reasoning_tokens":1000,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-16T05:43:28.608708+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A two-year longitudinal study of journalers that logs material purchases, major life events, and community interactions, and then compares these logs with changes in journal entries and layouts, would test the framework; if many journalers change their practice with no corresponding change in any of the three components, the ecosystem model would need revision.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"This reference supplies the baseline finding that paper bullet journals support flexible and mindful self-tracking, grounding the material and personal-context components of the ecosystem."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"This reference documents how manual self-tracking on paper combines with digital tools, supporting the materials and digital-tools facet of the framework."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"This reference describes bullet journaling as a craft of personal information management, reinforcing the idea that practices are individually crafted and evolve over time."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"This reference introduces the slow media and fast media distinction used to frame analog journaling versus social media sharing, underpinning the community component."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"This reference is used in the discussion of how physical wear and tear carries meaning, informing the material affordances and helpful-constraints design implications."}],"review_version":1}