Pith. sign in

REVIEW 4 major objections 5 minor 15 references

Automated Data Integration, Cleaning and Analysis Using Data Mining and SPSS Tool For Technical School in Malaysia

T0 review · 4 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read The paper claims that an automated SPSS-syntax pipeline can integrate, clean, and analyze school examination data with the same results as manual processing.

desk verdict A thin technical report whose central equivalence claim is unverified and whose shown SPSS merge logic probably cannot yield the reported 691-case dataset. read the letter →

arxiv 1909.01086 v1 pith:I254WIUU submitted 2019-08-15 cs.CY

classification cs.CY
keywords dataintegrationcleaninganalysisSPSSsyntaxeducationalminingstudentperformancedecisionsupporttechnicalschoolsMalaysia
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that a school's routine data work—merging student background records with exam results, cleaning the combined file, and producing descriptive statistics—can be automated with SPSS syntax and still give the same results as doing it by hand. If that holds, school management gets faster, more efficient decision support: frequency tables, crosstabulations, and charts appear automatically from a central dataset, without teachers keying in and analyzing marks manually. The study builds this pipeline for exam and family-background data from seven technical schools in Malaysia, using SPM grades as the target variable, and reports descriptive analysis as the evidence. The paper's conclusion extends the claim to future planning: the automated outputs can guide teaching approaches and can later be joined by other data-mining techniques such as association rules.

What carries the argument

The mechanism is the SPSS Syntax editor: a scripted, repeatable command file that replaces point-and-click operations. It imports Excel files with GET, merges them with MATCH FILES and variable renaming, selects and recodes attributes, and runs FREQUENCIES, CROSSTABS, and GGRAPH to produce tables and charts automatically. This syntax is what the paper relies on to guarantee that the automated pipeline gives the same results as manual integration and analysis.

What would settle it

Run the documented SPSS syntax on the seven original Excel datasets, then repeat the same integration, cleaning, frequencies, and crosstabulations manually or through point-and-click SPSS; any difference in the cleaned records, counts, or tables would refute the paper's equivalence claim. The paper includes no such comparison.

Watch

Extended reading notes

Core claim

The central claim is that an automated system built on SPSS 16.0 Syntax reproduces the outcome of manual integration and analysis exactly: the same cleaned dataset and the same descriptive statistics. Seven school-level Excel files are imported by syntax code, merged into one SPSS dataset of 691 records, converted to numeric form, and analyzed through automated FREQUENCIES, CROSSTABS, and GGRAPH commands. The paper treats this as proof that data mining provides a viable way to turn raw school records into meaningful information, and that management can rely on the automated output for faster decisions about teaching plans.

Load-bearing premise

The load-bearing premise is that the SPSS syntax performs integration, cleaning, and analysis correctly and equivalently to manual work; the paper asserts this without showing a side-by-side comparison.

Editorial extensions

If this is right

  • If the equivalence claim holds, schools can replace manual merging and reporting with a rerunnable script, cutting the time from raw marks to decision-ready tables.
  • The seven-school data, combined into a single 691-record dataset, becomes a centralized resource for comparing student backgrounds and exam performance across schools.
  • Management can use the automatically generated frequencies and crosstabulations to plan teaching approaches without waiting for hand-built reports.
  • The same syntax pattern could be applied to other schools' data whenever the source files follow a consistent Excel format.
  • Additional mining methods, such as association rules, can be layered onto the cleaned and integrated dataset to measure relationships between attributes.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the claimed equivalence holds, the syntax-based approach could be packaged as a web service that accepts school Excel files and returns a cleaned, merged dataset plus frequency and crosstab reports on demand.
  • Because the merge step depends on exact column names and codes, the approach becomes portable across schools once a shared data-entry template is used; without that, each new school would need its own rename list.
  • The same cleaned dataset could support inferential follow-ups, such as regression or association-rule mining, to test whether the descriptive patterns reported here persist when other variables are taken into account.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper reports a prototype workflow for automating the integration, cleaning, and descriptive analysis of student records from seven Malaysian technical schools using SPSS syntax. The authors claim that their automated SPSS-syntax pipeline produces the same results as manual integration and analysis and could support faster management decisions. The paper presents screenshots of SPSS import and integration, a syntax fragment using MATCH FILES, frequency and crosstab outputs for one attribute (number of family members), and a brief conclusion asserting strong relationships among the studied factors.

Significance. If substantiated, the claimed contribution would be a practical demonstration that routine school-data integration and analysis can be automated with a standard statistical tool, reducing teacher workload and decision latency. The paper ships reproducible-looking syntax fragments and clearly describes the data source and target variable, which is a useful starting point. However, the central equivalence claim is not demonstrated, and the one concrete integration step shown appears technically incorrect. As presented, the paper does not establish a validated contribution beyond showing that SPSS can run frequencies and crosstabs.

major comments (4)
  1. [§5.1, Fig. 11] The displayed MATCH FILES command has no BY variable, so in SPSS it performs a one-to-one side-by-side merge by case position, not a concatenation of cases. Since the seven school files contain 91, 92, 100, 97, 94, 118, and 99 rows respectively (Table 2), this command would yield at most 118 rows, not the reported 691. If the actual integration used ADD FILES or another concatenation step, that code is not shown; as written, the automated integration cannot produce the dataset analyzed in Section 5.4.
  2. [Abstract and §6 (Conclusion)] The central claim that the automated system 'will give the same result compare with manual system of integration and analysis' is never validated. No manual analysis was performed, no criterion for equivalence is defined (which outputs must match: case counts, frequency tables, crosstab cells, or derived data files), and no comparison table or error metric is reported. This assertion is load-bearing for the paper's contribution and rests on no evidence.
  3. [§5.3, §5.4, and §6] The conclusion states that 'these all factors show strong relationship between each other,' but the analyses presented are only frequency tables and count-only crosstabs. No chi-square test, Cramer's V, correlation, or any other association measure is computed, so the strong-relationship claim is unsupported. In addition, Section 5.2 announces that the analysis involves 'descriptive and predictive analysis,' yet no predictive analysis appears anywhere in the results.
  4. [§4.5 and §5] The paper describes a data cleaning phase and states that data selection was carried out, but it never reports what cleaning operations were performed, how many records were affected, or what the final cleaned dataset contained beyond the claimed 691 cases. Without this, the cleaning step cannot be assessed or reproduced.
minor comments (5)
  1. [§5.1, Fig. 11] The syntax shown is truncated, and the text explicitly says 'Fig 11 above not include all the source code,' so the automated integration process cannot be reproduced from the paper.
  2. [Tables 4 and 5] The domain for family income changes from 'RM 500, RM 1200, RM 1900' to 'Total Income 1, 2, 3, 4, 5, 6' with no mapping, and SPBT changes from 'YA, TIDAK' to '1, 2' without explaining the recoding scheme.
  3. [§4.4, Table 3] The target variable SPM grade is ordinal (1A through 9G) but is converted to numeric classes 1 through 5 without discussion of whether it is treated as interval or ordinal; this matters for any later predictive modeling.
  4. [References] Reference [7] is incomplete, listing authors and title but no publication venue, year, or page range.
  5. [General] The paper contains numerous grammatical errors and inconsistent terminology (e.g., 'integrate, clean and analysis'), and several figures are low-resolution screenshots that do not clearly convey the underlying data or output.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the integration and analysis pipeline is presented as a direct SPSS-syntax workflow; the 'same as manual' claim is unvalidated but not derived from its own inputs.

full rationale

The paper does not derive any predicted quantity from fitted parameters or from an ansatz. Its contribution is a procedural demonstration: importing seven Excel datasets into SPSS via syntax, integrating them (described with MATCH FILES code in §5.1), cleaning/converting attributes (§4.5), and running descriptive frequencies and crosstabs (§5.3–5.4). The outputs shown (frequencies, crosstabs, charts) are direct SPSS outputs, not quantities that were pre-defined in terms of the outputs. The abstract's claim that 'automated system will give the same result compare with manual system of integration and analysis' is an empirical assertion and is indeed missing support: no manual baseline, comparison metric, or error analysis is reported. That is a correctness/validation deficiency, not circularity, because the claim is not made true by construction or by self-citation. No equation or fitted parameter is reused as a 'prediction,' and no load-bearing argument reduces to a citation from the authors' prior work. Additional technical concerns, such as the MATCH FILES syntax appearing to merge by case position rather than concatenate cases, are also correctness issues rather than circularity. Therefore the circularity score is 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The paper introduces no free parameters or invented entities. It relies on unrealized assumptions about data representativeness, grade grouping, and software correctness.

assumptions (3)
  • domain assumption The convenience sample of 691 students from seven technical schools is representative of the population
    The paper treats the seven selected schools as the study sample without discussing the population or generalizability.
  • domain assumption The SPM grade categorization into five classes preserves meaningful information
    The authors collapse SPM grades into classes in Table 3 without justification.
  • domain assumption SPSS 16.0 syntax produces error-free integration and analysis
    The paper assumes the software operates correctly and that the displayed syntax is complete and functional, without testing against manual results.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Automated Data Integration, Cleaning and Analysis Using Data Mining and SPSS Tool For Technical School in Malaysia." pith.science (2026). https://pith.science/paper/I254WIUU

@misc{pith2026190901086,
  author       = {Pith},
  title        = {Pith review of: Automated Data Integration, Cleaning and Analysis Using Data Mining and SPSS Tool For Technical School in Malaysia},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/I254WIUU}},
  note         = {Machine review of arXiv:1909.01086}
}
read the original abstract

This study aims to integrate, clean and analysis through automated data mining techniques. Using data mining (DM) techniques is one of the processes of transferring raw data from current educational system to meaningful information that can be used to help the school community to make a right decision to achieve much better results. This proved DM provides means to assist both educators and students, and improve the quality of education. The result and findings in the study show that automated system will give the same result compare with manual system of integration and analysis and also could be used by the management to make faster and more efficient decision in order to map or plan efficient teaching approach for students in the future.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

15 extracted references · 15 canonical work pages

  1. [1]

    INTRODUCTION Examinations serve many purposes, which are to make a ssessment on the effectiveness of our education process, and subsequently facilitate improveme nt on the process. Examinations also serve the function of differentiations among studen ts so that different groups of student with unique level learning ability can be grouped together for diff...

  2. [2]

    The system gathered information including their names, birth certificate numbers, gender, age, parent’s name, parent’s job, parent’s income, guidance status and sib ilings

    PROBLEM STATEMENTS Currently, most schools in Malaysia use Sistem Maklumat Murid (SMM) to collect their information related to family background, income and ot hers as shown in Fig 1. The system gathered information including their names, birth certificate numbers, gender, age, parent’s name, parent’s job, parent’s income, guidance status and sib ilings. ...

  3. [3]

    The specific objectives are listed as: i

    OBJECTIVE OF STUDY Generally, the main objectives of this study are to pe rform integration, cleaning and automated analysis on school data management by using data minin g approaches. The specific objectives are listed as: i. To integrate databases from different sources. ii. To preprocess data prior to mining process. iii. To design and implement the pr...

  4. [4]

    2 that consists of stage Integration, Extract, Cleaning

    METHODOLOGY The process flow of the study is illustrated as shown in Fig. 2 that consists of stage Integration, Extract, Cleaning. FIGURE 2 : Process Flow of the study 4.1 Data Integration The initial phase is concerned with collection of data in Microsoft Excel format that integrate seven technical schools in Malaysia. These technical schools include SMK...

  5. [5]

    graphdataset

    RESULT AND FINDING This section will illustrate the analysis and result g ained from the data collected. The descriptive analysis has been carried out to get some information from the outcomes of each prediction variable aligned with the targeted output. 5.1 Data Integration This study has illustrate how the process of data inte gration on data set has be...

  6. [6]

    These all factors show str ong relationship between each other

    CONCLUSION This study summarized the examination factors such as exam results and other factors such as SPM’s subject, number of family members, number of fa mily member still learning, number of family member receive SPBT, family income and SPBT that contribute to students’ academic achievement in the future. These all factors show str ong relationship b...

  7. [7]

    ACKNOWLEDGMENT This presented study is supported by the Jabatan Pelajaran Negeri Pulau Pinang for their support direct and indirect in order to complete this research

  8. [8]

    Is The Achievement Gap in Indiana Narrowi ng

    Terry E, Spradlin, Kirk R, Walcott C, Kloosterman P, Zaman K, McNabb S, Zapf J & associates, “Is The Achievement Gap in Indiana Narrowi ng”, Education Resources Information Center Journal, September 2005

Show all 15 references
  1. [9]

    Using Artificial Neural Nets to Predict Academic Perfo rmance,

    Cripps A, “ Using Artificial Neural Nets to Predict Academic Perfo rmance,” American Psychological Association Journal , pp. 33 – 37, Feb.1996

  2. [10]

    Beal, C. R. & Cohen, P. R. (2006). Temporal Dat a Mining for Educational Applications. Chapman, A. D. 2005. Principles and Methods of Data Cleaning – Primary Specie s and Species-Occurrence Data , version 1.0. Report for the Global Biodiversity In formation Facility, Copenhagen

  3. [11]

    College Activities and Environmental Factors Associated with The Development of Life Long Learning Competencies of College Seniors

    Hayek, John C, Kuh, George D, “College Activities and Environmental Factors Associated with The Development of Life Long Learning Competencies of College Seniors” Education Resources Information Center Journal, November 1999

  4. [12]

    Schools That Make A Difference : Final Report. Twelve Canadian Secondary Schools in Low Income Settings

    Henchey, Norman, “Schools That Make A Difference : Final Report. Twelve Canadian Secondary Schools in Low Income Settings” Education Resources Information Center Journal, November 2001

  5. [13]

    Improving Graduation Outco mes for Migrant Students

    Gibson, Margaret A, “Improving Graduation Outco mes for Migrant Students”, Education Resources Information Center Journal, July 2003

  6. [14]

    K., Yu, P

    Ma, Y., Liu, B., Wong, C. K., Yu, P. S. & Lee, S. M. (2000). Targeting the Right Students Using Data Mining

  7. [15]

    R., & Bruce, P

    Shmueli, G., Patel, N. R., & Bruce, P. C. (2007) . Data mining for business intelligence : concepts, techniques, and applications in Microsoft Office Excel with XLMiner . Hoboken, NJ: John Wiley & Sons

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.