{"id":"ee0e05c6-f1ff-477d-862f-6d83efb7182e","arxiv_id":"1908.02430","paper_version":1,"verdict":"REJECT","confidence":"LOW","novelty_score":2.0,"correctness_risk":"high","formal_verification":"none","parameter_count":0,"one_line_summary":"A qualitative case study asserts that staff at an Indonesian language school believe Big Data analytics will improve e-marketing and CRM operations, without providing supporting evidence.","lead":"This paper reviews a plan to combine Big Data analytics with electronic marketing and customer relationship management at an English language school in Indonesia, based on interviews with nine staff members. The paper reports that interviewees expect the integration to make marketing and customer relations more effective, but it presents no data, transcripts, or measurements to support that expectation.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The conclusion rests on circular confirmation: the same informants who generated the Section VI propositions are reported in Section VII as agreeing with them, with no quotes, counts, or outcome data to show that agreement tracks actual effectiveness.","rationale":"The reader correctly identifies the load-bearing weakness: the unshown agreement of nine purposively selected internal staff is asserted, not demonstrated, and the propositions were built from and then 'confirmed' by the same informant pool. I agree with that characterization and add specificity: the paper contains no raw interview data, no coding table, no counts, and no negative cases; the only apparent 'results' are thematic summaries that could have been generated directly from the leading questions in the interview guide. The study design also makes actual effectiveness untestable because no system is implemented and no outcome metric is collected. This is not merely a missing robustness check; it is the absence of any evidence that could distinguish the central claim from a research proposal. The paper's framework and interview guide are useful teaching material, but they do not support the empirical conclusion. Therefore, the reader's REJECT verdict should stand, with the confidence remaining low because the failure is evidentiary rather than a demonstrated falsehood.","tokens_in":7258,"tokens_out":4808,"duration_ms":50641,"concrete_test":"Obtain the full interview transcripts and build a respondent-by-proposition matrix: for each of the nine informants listed in Table 1, code the verbatim response to Q5.1 (and Q5.2/Q5.3) as agree, disagree, or qualified, and verify whether the Section VIII statement 'All respondents agreed' is literally true. Then trace every coded excerpt used in Section VII back to its source interview; if any result excerpt comes from the same pre-research statements that generated the Section VI propositions, the confirmation loop is exposed. If the transcripts are not available or the matrix cannot be produced, the conclusion must be downgraded to a proposal rather than a demonstrated finding.","verdict_should_be":"REJECT","load_bearing_attack":"The conclusion that 'All respondents agreed ... can increasing effectivity operational of Marketing and CRM department' depends on Section VII being independent confirmation of the propositions. It is not. The propositions in Section VI ('PREPOSITION') were derived from pre-research interviews with the same purposively selected informants, and Section VII reports only three thematic clusters — 'Quality of Big Data Integration Services', 'Electronic Marketing and CRM Features', and 'Analysis of Other Data' — with no quotes, counts, coding table, or negative cases. The structured interview's key item, Q5.1, is leading ('Do you think our draft system integration system will help Marketing and Customer Relation in the daily work and operational tasks?'), and no verbatim responses are shown. Section VIII then asserts unanimous agreement and that the result 'fully supports the research proposition.' This is circular confirmation: the same people who supplied the proposition content are later reported as validating it, so the observed agreement does not test the proposition. Additionally, the study is only a plan; no Hadoop system is deployed and no operational effectiveness metric (e.g., response time, conversion, retention) is measured before or after. The link between informant expectations and actual operational improvement is never observed. Without independent outcome data, the central claim collapses regardless of whether the informants were sincere.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper reports a qualitative case study at an international language education service in Surabaya, with the stated aim of planning an integration of the Apache Hadoop big data analytics program with the institution's electronic marketing and customer relationship management (CRM) systems. The study uses purposive sampling of nine internal staff members, structured interviews, observation, and documentation. Section VI presents research propositions derived from pre-research interviews, Section VII reports three thematic clusters of results, and Section VIII concludes that all respondents agreed that a big-data-enabled electronic marketing and CRM system can improve the operational effectiveness of the Marketing and CRM department. The manuscript also states that further qualitative research is needed to measure the actual effectiveness of such a system.","tokens_in":7442,"tokens_out":2332,"duration_ms":27882,"significance":"If the central effectiveness claim were established, the paper would offer a practically useful, low-cost integration path for small educational institutions considering open-source big data tools. The paper has a clear research framework, explicitly describes triangulation and Miles and Huberman data analysis, and addresses a relevant managerial problem. However, the significance is conditional: the manuscript provides no quotes, counts, coding tables, negative cases, or before/after outcome measures. The evidence actually presented consists of thematic assertions attributed to informants, with the conclusion acknowledging that effectiveness was not measured. As presented, the contribution is a plan with informant expectations rather than an evaluation of effectiveness.","major_comments":[{"comment":"The central conclusion that all respondents agreed that the integration 'can increasing effectivity operational of Marketing and CRM department' is not supported by the evidence reported. Section VII lists only three thematic clusters, without any interview quotes, frequency counts, coding table, or negative cases. The reader cannot verify whether the agreement was unanimous, whether dissenting views were discarded, or how the themes were derived from the raw interviews. This is load-bearing because the paper's main claim rests entirely on this unshown agreement.","section":"Section VII and Section VIII"},{"comment":"The validation is circular. Section VI states that the propositions were formulated in accordance with the results of pre-research interviews, and Section VIII states that the findings 'fully support' those propositions. The same informants who supplied the proposition content are then reported as validating it in Section VII. This is self-confirmation, not independent testing. The manuscript needs either independent data or an explicit argument for why the later interviews go beyond the pre-research interviews rather than simply repeating them.","section":"Section IV, Section VI, and Section VIII"},{"comment":"The key interview item is leading: Q5.1 asks 'Do you think that our draft system integration system will help Marketing and Customer Relation in the daily work and operational tasks?' No verbatim responses are shown, and the conclusion converts these expectations into a factual claim about effectiveness. Informant expectations are not a substitute for operational outcome data. Since no Hadoop system was deployed, and no metric such as response time, conversion rate, or retention was measured before and after, the paper cannot support the causal or predictive claim it makes in Section VIII.","section":"Section IV, Q5.1, and Section VIII"},{"comment":"The data analysis section describes data reduction, display, and conclusion drawing, but Section VII does not show the output of the reduction process. There is no display of codes, themes, or a data matrix, so the reader cannot assess the credibility or trustworthiness of the three reported themes. The manuscript needs to present at least a coding table, representative quotes, and a description of how disagreements or exceptions were handled.","section":"Section V and Section VII"}],"minor_comments":[{"comment":"The heading 'PREPOSITION' should read 'Proposition'; the same typo appears in the conclusion in the phrase 'fully supporting the research preposition.'","section":"Section VI"},{"comment":"The text '4S = Product, Price, Promotion, Place' should be '4P', since the four items are the traditional marketing mix; this appears to be a typographical error rather than a substantive claim.","section":"Section II"},{"comment":"The phrase 'with a unix customer segmentation and demography' should be 'with a unique customer segmentation and demography'.","section":"Section VIII"},{"comment":"The reference list contains typographical errors: 'trauss J.' should be 'Strauss J.', and 'alyanam, K.' should be 'Kalyanam, K.'; also several entries lack page numbers.","section":"References"},{"comment":"The grammar of the key sentence 'can increasing effectivity operational of Marketing and CRM department' needs correction; this appears verbatim in the abstract and conclusion and should be revised for clarity.","section":"Abstract and Section VIII"}],"recommendation":"reject","confidential_remarks":"The manuscript's central claim is not recoverable by minor revision: the effectiveness conclusion rests on non-independent informant testimony, the validation is circular as described in the text itself, and the paper concedes that effectiveness has not actually been measured. The present evidence base would require substantial new data collection and analysis before the claim could be supported."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Read this one as a thesis plan, not a completed study. The genuinely useful part is early: the author identifies a real adoption gap—small Indonesian education institutions can't afford the SAP-style big-data stacks that large firms use—and proposes a low-cost Apache Hadoop-based integration with e-marketing and CRM. The literature synthesis (Kalyanam/McIntyre, Buttle, Kotler/Armstrong) is accurate enough, and the qualitative design (purposive sampling, triangulation, Miles and Huberman) is a standard, credible template. That's the value: a concrete, context-specific blueprint someone could actually implement. Nothing here is new at the level of theory; the contribution is the plan itself, and that is fine for a niche practitioner audience.\n\nWhat is not there is the evidence. The results section has three theme clusters and no quotes, counts, coding tables, or negative cases. All we get is 'All respondents agreed' that integration can increase operational effectiveness. Those respondents are the same nine internal staff who helped generate the propositions in Section VI, and Q5.1 is leading. The conclusion then claims the result 'fully supports' the proposition. That is circular confirmation, and the paper itself admits, in the last line, that qualitative research still needs to be done to find out how effective the system is. The central claim collapses. The stress-test note is right; I don't think it overstates the problem.\n\nSmaller issues: references have typos, the '4Ps + P2C2S3' formula is garbled in places, and the paper is explicitly about a plan, so reporting unanimous expectations as a finding overreaches. The citation pattern is otherwise fine—mostly standard textbooks and relevant papers, no self-citation problem.\n\nFor whom: a thesis supervisor or a practitioner at a similar small education organization would get something from the framework and the practical questions in the interview guide. A journal reader expecting a completed case study won't.\n\nRecommendation: desk reject for this version, with an invitation to resubmit if the author actually implements the integration and reports before/after operational metrics (response times, conversion, retention) plus coded interview evidence. It doesn't deserve referee time as an empirical claim, and sending it out would just produce reviews saying what is obvious from reading.","headline":"This is a competent student research plan whose empirical payoff never arrives: the one substantive claim—that all respondents agreed integration would increase effectiveness—is circular and unsupported.","tokens_in":7977,"tokens_out":2886,"would_cite":false,"duration_ms":32917,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Big-data analytics integration will improve a language school's e-marketing and CRM operations, this case study concludes.","keywords":["big data analytics","Apache Hadoop","electronic marketing","customer relationship management","qualitative case study","customer journey","customer engagement","Surabaya"],"falsifier":"Run the proposed Hadoop-based integration at XYZ Institution for one or two academic terms and compare inquiry-to-registration conversion, student retention, customer-response times, and staff workload against the same metrics from before the integration; if those measures do not improve, the claim that integration increases operational effectiveness is falsified. A simpler check would be a quantitative survey of students and parents about whether service quality changed after implementation.","tokens_in":7018,"feed_emoji":"📊","tokens_out":7356,"duration_ms":73211,"temperature":0.7,"pith_summary":"The paper tries to establish that at XYZ Institution, a language-education service in Surabaya, adding a Big Data Analytics program built on Apache Hadoop to the existing electronic marketing and CRM systems will make the Marketing and Customer Relation departments more effective. The proposed integration combines structured internal records with unstructured data from social media, web analytics, online chat, and e-mail, and turns those inputs into trend analysis, customer profiles, and personalized communication. The study is a planning review grounded in qualitative interviews with purposively selected staff, and it reports that all respondents agreed the integration can increase operational effectiveness. If the claim holds, small or medium-sized institutions with stagnant growth could pursue a low-cost, open-source route to data-informed marketing and customer relations instead of expensive licensed enterprise software.","feed_headline":"Big data plus CRM will improve school marketing, case study finds","feed_subtitle":"Staff at a Surabaya language school unanimously agreed the analysis software would make e-marketing and CRM work faster.","key_machinery":"The load-bearing mechanism is the planned Big Data Analytics program built on Apache Hadoop, which ingests structured internal data (registration records, student status, demographics) and unstructured data from social media, web analytics, chat, and e-mail, and outputs trend data and customer profiles. That output feeds an electronic marketing mix of content, channels, and promotions, and an analytical CRM that personalizes communication through e-mail, SMS, and messaging apps. The argument also relies on a qualitative research process using purposive sampling and a data-analysis flow model of data reduction, data display, and conclusion drawing, together with the IDIC model (identify, differentiate, interact, customize) for one-to-one customer relationships.","core_discovery":"On its own terms, the paper's central discovery is that the effectiveness of electronic marketing and CRM at XYZ Institution depends on integrating a Big Data Analytics layer that analyzes both structured internal data and unstructured digital data, and that the school's staff unanimously support this integration as a way to improve daily marketing and customer-relations operations. The study identifies three groups of findings: quality of big data integration services, electronic marketing and CRM features, and analysis of additional data such as customer engagement and customer journey creation. It concludes that all respondents agreed that an electronic marketing system and CRM enabled by big data can increase the operational effectiveness of the Marketing and CRM department.","pith_inferences":["The paper reports staff agreement, not measured outcomes; a real pilot with before-and-after metrics on conversion, retention, and response times would be the natural next test.","If the integration is implemented, the assumption that open-source tools are sufficient for this school's data volume and staff skills will itself need checking, since the paper does not size the data or workload.","The same integration logic could plausibly transfer to other service businesses with comparable customer-journey structures, but that transfer would need its own evidence."],"forward_implications":["The case-study school can adopt a lower-cost integration path using open-source tools rather than expensive licensed ERP systems.","Marketing content can be matched to current trends and customer participation, which the paper links to creating a stronger customer journey.","CRM communication can become more personalized through customer profiling by age, sex, student status, and course history.","Staff can expect faster access to data and more responsive systems in their daily marketing and customer-relation tasks.","Other institutions with similar stagnant-growth problems could use the plan as a starting point for integrating big-data analytics with their own e-marketing and CRM systems."],"supporting_citations":[{"why":"Supplies the premise that data is important in strategic decision making and that big data adoption in Indonesia is still limited.","marker":"[1]"},{"why":"Supports the argument that digital data analysis can improve marketing strategies and reveal potential markets.","marker":"[2]"},{"why":"Provides variables linking online marketing and customer engagement to outcomes such as new customers and reduced churn.","marker":"[3]"},{"why":"Supports the role of customer and student participation in CRM success and retention.","marker":"[4]"},{"why":"Defines electronic marketing as the use of information technology in marketing activities.","marker":"[6]"},{"why":"Provides the e-marketing mix framework used to map marketing tools and functions.","marker":"[7]"},{"why":"Defines CRM as an integrated business strategy and distinguishes strategic, operational, and analytical CRM.","marker":"[10]"}],"fun_headline_variants":["Big data integration boosts school e-marketing and CRM, case study","Staff at Surabaya language school back big data CRM integration","Integrating big data with e-marketing and CRM speeds school operations","Big data layer key to better e-marketing and CRM for language school","Surabaya school staff back big data CRM integration for effectiveness"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that the unanimous agreement of a small, purposively selected group of the school's own staff that the integration will improve operations is enough evidence that it actually will.","fun_headline_variants_meta":{"raw":{"variants":["Big data integration boosts school e-marketing and CRM, case study","Staff at Surabaya language school back big data CRM integration","Integrating big data with e-marketing and CRM speeds school operations","Big data layer key to better e-marketing and CRM for language school","Surabaya school staff back big data CRM integration for effectiveness"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001137,"raw_usage":{"total_tokens":4667,"prompt_tokens":838,"completion_tokens":3829,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":454,"completion_tokens_details":{"reasoning_tokens":3738}},"tokens_in":454,"tokens_out":3829,"duration_ms":26183,"temperature":1.0,"reasoning_tokens":3738,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T14:43:53.312262+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run the proposed Hadoop-based integration at XYZ Institution for one or two academic terms and compare inquiry-to-registration conversion, student retention, customer-response times, and staff workload against the same metrics from before the integration; if those measures do not improve, the claim that integration increases operational effectiveness is falsified. A simpler check would be a quantitative survey of students and parents about whether service quality changed after implementation.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the premise that data is important in strategic decision making and that big data adoption in Indonesia is still limited."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supports the argument that digital data analysis can improve marketing strategies and reveal potential markets."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides variables linking online marketing and customer engagement to outcomes such as new customers and reduced churn."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supports the role of customer and student participation in CRM success and retention."},{"cited_title":"dan Frost Raymond, 2014","cited_arxiv_id":null,"evidence_quote":"Defines electronic marketing as the use of information technology in marketing activities."},{"cited_title":"dan McIntyre, S","cited_arxiv_id":null,"evidence_quote":"Provides the e-marketing mix framework used to map marketing tools and functions."},{"cited_title":"dan Maklan Stan, 2015","cited_arxiv_id":null,"evidence_quote":"Defines CRM as an integrated business strategy and distinguishes strategic, operational, and analytical CRM."}],"review_version":1}