{"id":"8ca93aa8-bc4a-443a-9820-d5ce41441348","arxiv_id":"2506.13466","paper_version":1,"verdict":"ACCEPT","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"In a hypothetical earthquake scenario with local-only cellular connectivity, adult smartphone users in major German cities report favoring general-purpose apps such as messengers and news over crisis-specific apps, leading the authors to propose a five-tier service prioritization typology.","lead":"This paper surveys 857 smartphone users from German cities about which apps they would want during a crisis when the internet is down but a local cellular network inside the city still works. It finds people prefer messengers and news apps over dedicated crisis apps for several tasks, and proposes a priority ranking for which services should stay available.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The RQ2 demand-shift claim conflates crisis effects with island-connectivity effects, since Q13 is compared only to normal-operation Q11 without a crisis-with-full-Internet control condition.","rationale":"The paper is careful and its released dataset is a real contribution; I am not disputing that citizens report preferring messengers/news/crisis apps and deprioritizing shopping/travel in a hypothetical earthquake with local-only connectivity. The issue is what this report licenses. Section 5.2 frames the results as 'App Demand on Islands,' and the abstract and typology translate them into island-ready prioritization. But the Q11-versus-Q13 comparison varies crisis and connectivity jointly. Since RQ1 shows that the crisis alone alters app preferences, the observed shifts are compatible with a pure crisis effect. The paper's robustness measures (SRSI, IRI, comics, video) address attention and comprehension of the materials, not the absence of a baseline condition that isolates the island factor. The reader's weakest_assumption (hypothetical self-report) is related but broader; my concern is the internal contrast used to isolate the island factor. The proposed 2x2 experiment would settle it. If the test shows a significant interaction, the paper's claims stand; if not, the authors should reframe RQ2 as 'preferences in a crisis with local-only connectivity' and weaken the island-specific wording. The typology itself mixes normative and technical reasoning and can survive a reframing, but its empirical anchor needs the control condition. Hence CONDITIONAL rather than REJECT: the paper is publishable, but the headline claim needs either new data or a scoped rewrite.","tokens_in":35161,"tokens_out":5236,"duration_ms":55087,"concrete_test":"Conduct a between-subjects 2x2 replication of Q13 (N about 200 per cell): (a) normal operation, (b) same earthquake scenario with full Internet restored, (c) same earthquake scenario with island connectivity, (d) island connectivity without an earthquake. Compute Borda ranks for the 23 categories in each cell. The central claim requires a significant interaction: for messengers, news, crisis, shopping, and travel, the rank difference between (c) and (b) must exceed the rank difference between (b) and (a) in the direction claimed in Table 2. If 95% bootstrap CIs for the (c) minus (b) differences include zero, or are much smaller than the (b) minus (a) differences, then the Section 5.2 shifts are crisis effects rather than island-connectivity effects, and the RQ2 conclusions and Tier 1-4 ordering must be reframed as crisis-scenario preferences instead of island-specific preferences.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The load-bearing weakness is in the inference from the Q11/Q13 comparison (Section 4.2, Table 2). RQ2's headline result — messengers, news, and crisis apps rise; shopping and travel apps fall — is obtained by comparing positional voting in Q13 (hypothetical earthquake, several days in, with island connectivity) against Q11 (everyday normal operation). These conditions differ in two ways at once: the participant is in a crisis, and the participant has local-only connectivity. RQ1's own results (Section 5.1) show that the crisis context alone changes app choice: crisis apps dominate for warnings/safety tips, messengers for communication, news for information. Consequently, the Q11-to-Q13 shifts cannot be uniquely attributed to island connectivity; they could be a generic crisis response. The survey has no control cell with the same earthquake but with normal Internet access, and no comprehension check on the island concept. The paper's own Section 5.4 records a participant (P69) rejecting the scenario ('The described scenario is wrong because the Internet does not work locally'), and the authors classify such responses as inattention, but without a comprehension measure they cannot rule out systematic misunderstanding of the local-only constraint. Since the demand shifts are the empirical basis for the five-tier typology (RQ3) and for the design implications in Section 6.2, this confound is load-bearing: the island-specific contribution is not yet separated from crisis-general behavior.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This manuscript introduces the concept of \"island connectivity\" for 6G networks to the HCI community and reports a large survey (N=857) of adult smartphone users in major German cities. The survey measures (RQ1) which app categories citizens prefer for crisis-specific use cases, (RQ2) how app demand changes when the participants are asked to imagine a crisis scenario with local-only cellular connectivity, and (RQ3) builds a five-tier smartphone service typology to guide operator prioritization. The headline findings are that general-purpose apps (messengers, news) are preferred for several crisis use cases over dedicated crisis apps, and that in the island scenario demand for messengers, news, and crisis apps rises while demand for shopping and travel apps falls. The typology is then derived by combining these survey results with German regulatory documents and 3GPP standards. The paper includes a replication package with data, analysis scripts, and survey structure.","tokens_in":35350,"tokens_out":5483,"duration_ms":59905,"significance":"If taken as descriptive of user preferences in the combined crisis-plus-island scenario, the study is valuable: it is the first large-sample empirical view of a novel 6G service model, with implications for operators, app developers, and authorities. The methodology is a strength: a pilot study, valid attention checks (SRSI UseMe, IRI), very high inter-coder reliability, Bonferroni corrections, and a public replication package. The findings also support a concrete, actionable prioritization framework that goes beyond prior crisis-informatics studies. However, the load-bearing inference that the observed demand shifts are specifically attributable to island connectivity (rather than to the crisis context alone) is not supported by the design, as discussed in the major comments.","major_comments":[{"comment":"The Q11-to-Q13 comparison conflates two factors: the crisis scenario and the local-only connectivity. Q13 asks participants to imagine an ongoing earthquake with island connectivity, while Q11 asks about everyday normal operation, so these conditions differ in both crisis presence and connectivity mode. The paper itself shows in §5.1 that crisis context alone changes app choices (crisis apps dominate warnings, messengers dominate communication, news dominates information). Therefore, the demand increases for messengers, news, and crisis apps and the decreases for shopping and travel apps cannot be uniquely attributed to island connectivity. This matters because the RQ2 results are the empirical basis for the RQ3 typology and the design implications in §6.2 that specifically target island-ready 6G. The manuscript should either explicitly reframe RQ2 as a descriptive study of the combined scenario (which is arguably the real deployment context) and add a corresponding limitation, or add a crisis-without-island control condition in a future study. As written, the causal-sounding language in §5.2 (\"increased demand in island operation\") and the design advice derived from it overstate the evidence for island-specific effects.","section":"§4.2"},{"comment":"There is no comprehension check for the island connectivity concept beyond the video and comic materials. The paper reports six participants doubting the island scenario, including P69, who said \"The described scenario is wrong because the Internet does not work locally,\" and the authors classify these as inattention or misunderstanding. Without a direct measure of comprehension (e.g., a post-video fact-check question), it is difficult to know how many participants actually understood that local cellular connectivity would be available while global Internet connectivity would not. This is particularly relevant given the abstract and hypothetical nature of the scenario. The paper already has strong attention checks, so adding one or two comprehension items about the island model would have strengthened validity. In the current version, the authors should at minimum analyze the open comments to estimate how prevalent misunderstanding of the connectivity model was, and report this as a limitation.","section":"§4.2/§4.5/§5.4"}],"minor_comments":[{"comment":"The sentence \"We warned participants that the survey’s subject included crises, which might be a sensible topic for them\" appears to use \"sensible\" where \"sensitive\" is intended.","section":"§4.6"},{"comment":"Reference [33] contains a typo: \"Turkye\" should be \"Turkey\".","section":"References"},{"comment":"The description of Table 2 refers to arrows (\"Dotted arrows indicate trends...\") but the manuscript text as provided does not show the arrows in the table; please ensure the published version includes the arrow symbols or reword the description to match the actual table rendering.","section":"§5.2"}],"recommendation":"major_revision","confidential_remarks":"The paper is well-executed as a descriptive survey of a plausible combined crisis-and-island scenario, and I would be happy to accept after the authors clarify that the Q11/Q13 comparison is not causal and after they explicitly acknowledge the absence of a crisis-without-island control. The typology itself is useful and would stand even if the demand shifts are crisis-general, but the manuscript currently risks overclaiming the island-specific contribution. The lack of a comprehension check is a secondary concern that is addressable through careful rewording and transparent reporting."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"You should know this paper is a well-run survey (N=857) of German city smartphone users on a novel 6G scenario: local-only cellular connectivity in a crisis-struck city, which they call island connectivity. It is the first HCI study of app preferences in that scenario, and the five-tier service typology is a practical artifact. The methodology is careful: attention checks, inter-coder reliability with very high alpha, Bonferroni corrections, and a public replication package. I would send it to review.\n\nWhat is genuinely new and good: the comic-board scenario design, the concrete ranking data for 23 app categories, and the finding that messengers and news apps outrank dedicated crisis apps for several crisis-specific use cases. The typology combines survey results with standards and resilience guidelines, making it directly usable for operators and regulators. The data and scripts are public, so anyone can re-analyze.\n\nThe main soft spot is the comparison behind RQ2. Q11 measures everyday normal operation; Q13 measures an earthquake scenario several days in with island connectivity. These differ in two ways at once: the participant is in a crisis, and connectivity is local-only. So the reported demand shifts (messengers/news/crisis up, shopping/travel down) could largely reflect a generic crisis response rather than anything specific to island connectivity. The paper has no control cell with the same earthquake but normal Internet access, so the island-specific effect is not cleanly separated. That is not fatal—RQ2 can be read as describing the combined crisis-plus-island scenario, which is the actual use case—but the authors should either add a crisis-with-full-Internet control or temper the causal language about island operation driving demand changes.\n\nA second, minor concern: there is no comprehension check on the island concept. One participant (P69) commented that the scenario is wrong because the Internet does not work locally, which the authors dismiss as inattention. That dismissal is plausible but not verified. Given the overall data-quality filters, this is a small issue.\n\nWho is this for? Researchers in crisis informatics, 6G user-centric design, and local-first communication. It deserves a serious referee; the empirical base is solid and the typology is a useful design tool. I would cite it. Recommendation: accept with minor revisions, specifically addressing the confound and adding a note about the absent comprehension check.","headline":"A well-run, first-of-its-kind survey of user preferences in a local-only 6G crisis scenario; the main demand-shift claim partly conflates crisis effects with island-connectivity effects, but the paper remains a solid contribution and deserves serious review.","tokens_in":35945,"tokens_out":2711,"would_cite":true,"duration_ms":29129,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Citizens in crisis-hit 6G 'islands' prefer general-purpose apps over dedicated crisis apps for most crisis use cases, a survey of 857 German urban smartphone users finds.","keywords":["island connectivity","6G","crisis communication","smartphone app preferences","service prioritization","general-purpose apps","local cellular networks","survey study"],"falsifier":"Run a field trial in which a city district is put into island operation during a live exercise or a real outage, log actual app usage from the local core network, and compare the observed app ranks with the survey's stated ranks; a clear divergence would falsify the central demand-shift claim.","tokens_in":34908,"feed_emoji":"📱","tokens_out":4672,"duration_ms":45444,"temperature":0.7,"pith_summary":"The paper tries to establish what ordinary smartphone users would want from a 6G network that keeps working locally when a crisis cuts a city off from the Internet. Based on 857 survey responses from adults in major German cities, it argues that users would not rely mainly on dedicated crisis apps: for communication, information, navigation, and distraction they would reach for messengers, news, and navigation apps instead. It also claims that island connectivity would reshape demand upward for messengers, news, and crisis apps and downward for shopping and travel apps. On that basis it constructs a five-tier typology that tells operators, developers, and authorities which smartphone services to prioritize when capacity is limited.","feed_headline":"Messengers beat crisis apps in island-outage survey","feed_subtitle":"857 urban Germans ranked apps for local-only 6G; a five-tier priority list follows.","key_machinery":"The machinery is a two-stage survey instrument plus a classification scheme. Stage one uses comic boards and a short video to make the abstract idea of island connectivity concrete: an earthquake strikes the participant's city, the Internet goes down, and the mobile operator restores only local connectivity. Stage two uses positional voting, in which participants rank app categories, and the rankings are analyzed with the Borda count to compare normal-operation and island-operation demand. The output feeds a five-tier smartphone service typology (Tier 0: crisis-critical cellular services; Tier 1: immediate crisis response apps; Tier 2: critical-purpose services; Tier 3: crisis routine; Tier 4: crisis well-being) that translates demand ranks into prioritization guidance.","core_discovery":"On the paper's own terms, the discovery is that citizens' crisis smartphone behavior is general-purpose first: asked which apps they would use in seven crisis-specific situations, respondents chose crisis apps for warnings, safety tips, and emergency contact, but messengers for communicating with others and for distraction, news apps for information, and navigation apps for moving around the city. When the same participants ranked app categories under a scenario in which only local cellular connectivity remains, messengers stayed at rank 1, news rose to rank 2, and crisis apps jumped from rank 21 to rank 3, while shopping fell from rank 6 to rank 19 and travel from 16 to 21. These shifts are the empirical basis for the paper's smartphone service typology for island connectivity, ordered from Tier 0 (emergency calls and cell broadcasts) through Tier 4 (well-being apps like music and games).","pith_inferences":["If stated preferences carry over to real crises, crisis-app designers may need to interoperate with messengers and news rather than compete with them; a natural test is integrating official warnings into messenger and news feeds.","The German urban sample and earthquake scenario mean the ranking might shift for rural users, different risk cultures, or hazards like flooding, which the paper itself notes participants suggested.","The typology could be operationalized as technical quality-of-service classes in 6G network slicing, with each tier mapped to a guaranteed capacity and latency profile.","A local-only connectivity model creates a new design space for island-aware app features, such as showing which contacts are reachable locally, which the survey's demand data does not by itself specify."],"forward_implications":["If island connectivity is built into 6G, operators should plan for messengers, news, and crisis apps as the highest-demand data services, not assume that dedicated crisis apps alone will suffice.","Capacity-limited island networks can use the five-tier typology as a prioritization ladder, keeping emergency calls and cell broadcasts above telephony and entertainment when capacity is scarce.","App developers should prepare general-purpose apps for local operation, including local edge servers and local identity and authentication, so users do not need a separate crisis version.","Authorities gain a concrete checklist for regulating 6G resilience, including distributed app stores and geographically adapted crisis content.","Demand decreases for shopping, travel, and sports suggest these services can be deprioritized first when edge capacity is limited."],"supporting_citations":[{"why":"Supplies the positional-voting procedure that produced the everyday and island app rankings.","marker":"[99]"},{"why":"Supplies the Borda count used to convert raw rankings into consensus ranks shown in the comparison table.","marker":"[76]"},{"why":"Supplies the comicboarding technique used to convey the earthquake and island scenarios to lay participants.","marker":"[80]"},{"why":"Supplies the federal resilience framework whose emergency-call and cell-broadcast requirements anchor Tier 0 of the typology.","marker":"[12]"},{"why":"Supplies the 5G system-architecture specification that grounds the technical model of core network, edge servers, and island operation.","marker":"[1]"},{"why":"Provides representative trend data on crisis-app and social-media perceptions that the paper aligns with its RQ1 results.","marker":"[93]"},{"why":"Supplies the hurricane technology use-and-non-use study that motivated the navigation and distraction use cases U6 and U7.","marker":"[101]"}],"fun_headline_variants":["Messengers, news top app rankings for island-mode 6G","Survey: users favor messengers over crisis apps in cut-off zones","For local-only 6G, users pick news and chats over crisis apps","Crisis apps fall behind messengers in island-connectivity survey","German users rank messengers first for offline-6G crisis mode"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The paper assumes that what participants said they would do in a scripted, hypothetical earthquake with local-only connectivity matches what they would actually do on their phones during a real crisis.","fun_headline_variants_meta":{"raw":{"variants":["Messengers, news top app rankings for island-mode 6G","Survey: users favor messengers over crisis apps in cut-off zones","For local-only 6G, users pick news and chats over crisis apps","Crisis apps fall behind messengers in island-connectivity survey","German users rank messengers first for offline-6G crisis mode"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000613,"raw_usage":{"total_tokens":2824,"prompt_tokens":892,"completion_tokens":1932,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":508,"completion_tokens_details":{"reasoning_tokens":1842}},"tokens_in":508,"tokens_out":1932,"duration_ms":15297,"temperature":1.0,"reasoning_tokens":1842,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-15T19:59:34.803940+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run a field trial in which a city district is put into island operation during a live exercise or a real outage, log actual app usage from the local core network, and compare the observed app ranks with the survey's stated ranks; a clear divergence would falsify the central demand-shift claim.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the positional-voting procedure that produced the everyday and island app rankings."},{"cited_title":"Urken, and Fiona Hewitt","cited_arxiv_id":null,"evidence_quote":"Supplies the Borda count used to convert raw rankings into consensus ranks shown in the comparison table."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the comicboarding technique used to convey the earthquake and island scenarios to lay participants."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the hurricane technology use-and-non-use study that motivated the navigation and distraction use cases U6 and U7."}],"review_version":2}