{"id":"263c2386-b5bd-4fb7-97c0-47eafc7bd646","arxiv_id":"1908.06484","paper_version":1,"verdict":"REJECT","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"high","formal_verification":"none","parameter_count":6,"one_line_summary":"A new software suite, GeoMind, computes OCEAN personality, OCC emotion, and Hofstede cultural scores from pedestrian tracking data, but with no validation against any psychological ground truth.","lead":"This paper presents GeoMind, a video analysis tool that maps pedestrian motion features onto personality, emotion, and cultural dimension scores. A generalist might read it to see how far crowd-behavior analysis has come in inferring psychological traits from surveillance-style video.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"GeoMind's central claim rests on an unvalidated mapping from tracked motion features to personality, emotion, and culture; the equations in Sec. 2.2 are hand-authored with no external criterion, so the outputs are not yet shown to measure the constructs.","rationale":"The reader's verdict is REJECT with high correctness risk, grounded in the absence of validation for the feature-to-construct mapping. My stress-test confirms that this is the load-bearing point: the paper's scientific claim depends entirely on the assumption that speed, angular variation, proximity, and grouping observations are valid indicators of OCEAN, OCC, and Hofstede constructs. Section 2.2 makes this dependence explicit with equations such as Q1 = s_i + 1/α_i, but no external criterion, baseline, or convergent-validity evidence is provided. The reported ANN accuracy (96%) concerns the intermediate socialization classifier, not the psychological constructs, and does not validate the personality/emotion/culture mappings. The software and viewer appear functional as engineering artifacts, so a software-demonstration framing would be appropriate, but the central detection claim is unsupported. The proposed controlled validation would test exactly the missing construct validity; unless such evidence is supplied, the REJECT verdict should stand.","tokens_in":9467,"tokens_out":3270,"duration_ms":35255,"concrete_test":"Run a controlled validation study: recruit at least 50 participants, administer the NEO PI-R, then record each participant walking a standardized route (alone and in a small group) in the same tracking format GeoMind expects. Use GeoMind to compute OCEAN scores from the trajectories and compare them to the questionnaire scores (per trait, using Pearson or Spearman correlation, plus a directional check on the 25 item equations). If correlations are near zero or negative for the traits the equations claim to measure, the Sec. 2.2 mapping is not measuring personality and the detection claim fails. A secondary check: compare GeoMind's Hofstede outputs on known-country videos against published Hofstede country scores; at minimum the rank order should match before 'detection' is claimed.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim is that GeoMind 'detects' OCEAN personality, OCC emotions, and Hofstede cultural dimensions from pedestrian trajectories. For that claim to hold, the numerical features extracted in Sec. 2.1 (speed, angular variation, collectivity, socialization, isolation) must be valid observable indicators of latent psychological and cultural constructs. The paper supplies no evidence for this bridge. Section 2.2 selects 25 of 240 NEO PI-R items and states 'we propose equations that could represent each one of the 25 items with features extracted from videos'; the example Q1 = s_i + 1/α_i is an arbitrary functional form (and is undefined when α_i = 0). No item-level or factor-level validation against actual NEO PI-R responses is reported. Section 2.3 then maps OCEAN values to OCC emotions using a hand-assigned sign table (Table 1), and Section 2.4 maps group statistics to Hofstede dimensions via equations with empirically chosen weights (σ1 = 0.5, ρ1 = 0.5). Because every downstream output is a deterministic function of these hand-authored formulas, the software's agreement with its own definitions is circular and cannot support the detection claim. Section 3.2 and Section 5 report that results are 'very satisfactory' but provide no ground truth, no baseline, no comparison to questionnaire scores, and no statistical test. The strongest load-bearing assumption is therefore the construct validity of the Sec. 2.2 mappings; if it fails, all OCC emotions and Hofstede dimensions inherit the failure.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents GeoMind, a Matlab-based software application that takes pedestrian tracking data from video sequences, extracts features such as speed, angular variation, collectivity, socialization, and isolation, and then maps those features to Big-Five (OCEAN) personality scores, OCC emotion scores, and Hofstede cultural dimensions. A Unity3D viewer is also described for visualizing the extracted features and computed attributes. The authors claim that the software 'detects' personality, emotion, and cultural aspects of pedestrians, based on the hypothesis that intrinsic human variables are related to how people behave in space and time. The paper describes the pipeline, the input/output formats, the graphical interface, and several qualitative example results, but it does not report any quantitative validation against external ground truth.","tokens_in":9793,"tokens_out":3544,"duration_ms":36528,"significance":"If the central claim were established, GeoMind would be a notable tool for crowd analysis, with potential applications in surveillance, serious games, and social-science research. The paper's strengths are the public availability of the software, the concrete description of a complete pipeline from tracking files to visualizations, and the integration of three psychological/cultural frameworks in one system. However, the significance is conditional: the manuscript provides no evidence that the computed OCEAN, OCC, and Hofstede values correspond to the actual psychological or cultural states of the filmed pedestrians. As submitted, the paper is a software description with illustrative outputs rather than a validated detection method.","major_comments":[{"comment":"The personality module is the load-bearing part of the pipeline, but its core equations are asserted without validation. For example, Q1 = s_i + 1/alpha_i combines quantities with different units without normalization and is undefined when alpha_i = 0. More importantly, no evidence is presented that any of the 25 equations correspond to NEO PI-R item responses: there is no item-level or factor-level comparison to questionnaire scores, no correlation analysis, and no inter-rater agreement measure. The resulting OCEAN scores are therefore not established as measurements of the Big-Five constructs; they are computed features relabeled as personality dimensions.","section":"Section 2.2"},{"comment":"The OCC emotion scores are deterministic functions of the OCEAN scores through a hand-assigned sign table (with OCEAN values thresholded at 0.5). Because the OCEAN scores themselves lack external validation, and because no emotion ground truth (self-report, facial expression annotation, or behavioral criterion) is used anywhere in the paper, the emotion labels produced by GeoMind cannot be considered detections of anger, fear, happiness, or sadness.","section":"Section 2.3, Table 1"},{"comment":"The Hofstede dimension equations reduce to the authors' own definitions: collectivism is defined as the percentage of grouped pedestrians, individualism as the percentage of lonely pedestrians, and MAS and IND are weighted combinations with hand-chosen weights sigma1 = 0.5 and rho1 = 0.5. The paper reports no comparison to Hofstede's published country-level scores or any other external criterion. The statement in Section 5 that results are 'very satisfactory' is not supported by any quantitative evaluation, so the cultural-detection claim is unsupported.","section":"Section 2.4"},{"comment":"The evaluation section consists of screenshots, descriptive comments about the graphical interface, and the assertion that results are very satisfactory. There are no error bars, no baselines, no statistical tests, no cross-validation, and no comparison against ground-truth labels for personality, emotion, or culture. Given that the central contribution is the detection of latent psychological constructs, the absence of any quantitative validation is a load-bearing gap, not a presentation issue.","section":"Sections 3.2 and 5"}],"minor_comments":[{"comment":"The constants beta = 0.3 and w1 = w2 = 1 are described as empirically defined, but no empirical procedure is reported. Since these constants directly control the collectivity values, a sensitivity analysis or at least a justification of the chosen values is needed.","section":"Section 2.1, Eq. (1)"},{"comment":"The description of the socialization ANN is incomplete: the paper reports 10 hidden layers and 96% accuracy on 16,000 samples with a 70/30 split, but does not specify the number of neurons per layer, whether the 96% is on the training or validation portion, or how the ground-truth labels for socialization were obtained. This prevents reproduction of the socialization module.","section":"Section 2.1"},{"comment":"The equation Q1 = s_i + 1/alpha_i is undefined when alpha_i = 0, which can occur when a pedestrian moves in a perfectly straight line. The paper should specify how zero angular variation is handled, and should also clarify how s_i and 1/alpha_i are normalized before summation.","section":"Section 2.2, Eq. for Q1"},{"comment":"The caption says 'From (g) to (f)' where it should say '(g) to (j)'. There are also several typographical errors elsewhere, such as 'App Desinger' instead of 'App Designer' in Section 3.","section":"Figure 6 caption"},{"comment":"The paper states that supporting data are available on request and that the software is downloadable from a personal website. For reproducibility, the dataset and code should be deposited in a permanent archival repository with versioning.","section":"Section 6 and website references"}],"recommendation":"reject","confidential_remarks":"The software pipeline appears functional and the authors have made a real engineering effort, but the manuscript's central claim—that the software detects personality, emotion, and cultural dimensions—is unsupported by any external validation. The equations in Section 2.2 are hand-authored, the emotion mapping is a thresholded sign table, and the Hofstede outputs are essentially relabeled group statistics. Adding rigorous validation would require new data collection with psychological instruments and statistical analysis, which is beyond a normal revision. If the authors resubmit a substantially revised version with such validation, the tool might still be of interest to the computer-vision and crowd-analysis community."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Colleague — quick read of 1908.06484. The headline: this is a software paper, not a science paper. The actual new artifact is GeoMind, a Matlab app plus Unity viewer that extracts pedestrian features from tracking data and renders OCEAN personality scores, OCC emotions, and Hofstede dimensions. What is genuinely new is the integration — taking the earlier hand-built mappings from the authors' own papers and [32] and packaging them into one runnable pipeline with a clean input format and a visualizer. The description of input/output files and the viewer is detailed and reproducible, and the software is linked for download.\n\nWhere it falls apart is the central claim that the software 'detects' psychological and cultural traits. The bridge from speed/angular variation/collectivity to personality, emotion, and culture is asserted, not validated. No ground truth, no comparison against NEO PI-R scores, no baseline, no error bars. The equations in Sec. 2.2 are called 'empirically defined' but they are hand-chosen functional forms — Q1 = s_i + 1/alpha_i, for instance, which is undefined when alpha_i = 0. Sec. 2.4 weights sigma1=rho1=0.5 are arbitrary. Because every output is a deterministic function of these hand-authored formulas, the 'agreement' with the authors' own definitions is circular and cannot support a detection claim. The paper itself acknowledges the hypothesis but provides no test of it.\n\nThe soft spots are proportionate: if the paper were reframed as a software tool for visualization and exploratory feature extraction, most of these problems would shrink to an honest limitations section. The authors do cite their own earlier work for the mappings; the issue is not citation practice but missing evidence that the mappings mean anything.\n\nWho benefits: readers interested in crowd-analysis software infrastructure or in using the authors' prior models in a tool. A researcher looking for validated measurement of personality/culture from video will not find it here.\n\nRecommendation: I would desk reject this at a scientific CV venue, but if you have a demo/tool or software track, it deserves a serious referee — the artifact is real and the documentation is enough to reproduce. The required revision would be to disclaim the 'detect' wording and add a clear statement that the psychological values are illustrative, not validated measurements.","headline":"A functional feature-extraction and visualization tool, but the 'detection' of personality, emotion, and culture is unvalidated hand-crafted mapping.","tokens_in":10365,"tokens_out":3643,"would_cite":false,"duration_ms":35924,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper claims that the GeoMind software can estimate pedestrian Big-Five personality, OCC emotions, and Hofstede cultural dimensions from motion and grouping features in video.","keywords":["crowd analysis","personality detection","Big-Five OCEAN","OCC emotion model","Hofstede cultural dimensions","pedestrian tracking","video analysis","GeoMind"],"falsifier":"Record crowd videos in several countries with known published Hofstede scores, run GeoMind on them, and compare the predicted country-level dimensions with the published indices; if the predicted ordering does not match the published ordering across countries, the cultural mapping is not detecting culture.","tokens_in":9263,"feed_emoji":"🧠","tokens_out":5747,"duration_ms":55317,"temperature":0.7,"pith_summary":"GeoMind is a software application that takes pedestrian tracking data from video and converts movement patterns into three layers of psychological description: Big-Five personality traits, OCC emotions, and Hofstede cultural dimensions. The authors' central hypothesis is that intrinsic human variables show up in how people move, cluster, and keep distance in space and time. To test this, they hand-built equations linking physical and social features such as speed, angular variation, collectivity, and isolation to selected NEO PI-R items, then used an existing mapping from personality to emotions and a group-based mapping to cultural dimensions. They report promising results on videos from different countries and provide a viewer for inspecting the estimated traits. If the premise holds, the software offers a way to read psychological and cultural information from ordinary crowd footage without questionnaires.","feed_headline":"Software reads personality, emotion, culture from crowd videos","feed_subtitle":"GeoMind maps pedestrian speed, spacing, and grouping to Big-Five traits, OCC emotions, and Hofstede dimensions.","key_machinery":"The central mechanism is a multi-stage mapping. Low-level features per pedestrian are speed, angular variation, isolation, socialization, and collectivity; collectivity is computed as a decaying Gaussian sum over pairwise differences in speed and orientation. A neural network trained with proxemics inputs turns these into a socialization score. Personality is obtained by hand-built equations linking 25 NEO PI-R items to the features, emotion follows from a fixed OCEAN-to-OCC table, and cultural dimensions are computed from group size, mean group distance, group angular variation, cohesion, collectivity, and speed. Each stage is deterministic once the tracking file is supplied, so the whole pipeline is a software tool that turns trajectories into trait estimates.","core_discovery":"The paper's central claim is that observable pedestrian dynamics carry enough information to reconstruct OCEAN personality, OCC emotions, and Hofstede cultural dimensions. For each tracked person the software averages per-frame features into a vector, maps selected NEO PI-R items to these features through empirically defined equations, converts the resulting personality scores into OCC emotion scores through a fixed OCEAN-to-OCC table, and aggregates group-level statistics into Hofstede dimensions such as individualism/collectivism, power distance, long-term orientation, masculinity, and indulgence. The authors present this as a complete detection pipeline, not just a visualization, and they report that tests on the Cultural Crowds dataset give very satisfactory results.","pith_inferences":["A direct test the authors do not run: compare GeoMind's country-level Hofstede outputs to Hofstede's published national scores; a strong positive correlation would be independent evidence that the cultural equations capture real cultural variation.","Because the emotion stage is a fixed table applied to estimated personality, errors in the personality equations propagate into every emotion; an ablation that bypasses personality and predicts emotions directly from features could show how much of the emotion signal is real.","The hand-built NEO PI-R equations could be replaced by a supervised regressor trained on questionnaire scores paired with tracking data, turning the claimed detection into a measurable predictive model.","The authors treat all five OCEAN traits as individually estimable per pedestrian, but the underlying features are mostly about movement and grouping; a skeptical extension would test whether the five estimated dimensions are statistically distinguishable or collapse into one or two motion factors."],"forward_implications":["With only tracking files as input, the tool produces per-pedestrian Big-Five scores, OCC emotions, and per-video Hofstede dimensions, making psychological profiling possible on existing surveillance or public footage.","The cultural mapping gives a video-based route to cross-cultural comparison: two crowd videos from different countries can be compared on the same Hofstede scales without running questionnaires.","The outputs can feed crowd simulations and games, giving virtual characters personalities, emotions, and cultural traits derived from real pedestrian behavior.","The viewer lets researchers inspect the estimated traits per agent over time, which supports qualitative checking of whether the detections make sense in context."],"supporting_citations":[{"why":"Supplies the empirically defined equations that map pedestrian features to OCEAN personality scores.","marker":"[15]"},{"why":"Supplies the OCEAN-to-OCC emotion mapping used in Section 2.3.","marker":"[17]"},{"why":"Supplies the group-based mapping to Hofstede cultural dimensions.","marker":"[14]"},{"why":"Provides the table connecting OCEAN factors to OCC emotions.","marker":"[32]"},{"why":"Defines the five-factor Big-Five model that the personality module targets.","marker":"[28]"},{"why":"Defines the OCC emotion model used for the emotion output.","marker":"[31]"},{"why":"Provides the NEO PI-R item inventory from which 25 crowd-related items are selected.","marker":"[9]"},{"why":"Establishes the social-space distance used as an input to the socialization network and grouping analysis.","marker":"[4]"},{"why":"Motivates the hypothesis that culture alters pedestrian flow parameters such as speed and density.","marker":"[8]"}],"fun_headline_variants":["Crowd videos reveal personality, emotion, culture","Software maps pedestrian motion to OCEAN, OCC, Hofstede","Detect Big-Five, OCC emotion, Hofstede from footage","Pedestrian behavior decoded into traits and cultural values","Video analysis infers emotion, personality, culture"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that measurable motion cues like speed, spacing, and grouping actually reflect inner personality, emotion, and cultural traits, so the hand-built equations are measuring something real.","fun_headline_variants_meta":{"raw":{"variants":["Crowd videos reveal personality, emotion, culture","Software maps pedestrian motion to OCEAN, OCC, Hofstede","Detect Big-Five, OCC emotion, Hofstede from footage","Pedestrian behavior decoded into traits and cultural values","Video analysis infers emotion, personality, culture"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00016,"raw_usage":{"total_tokens":1183,"prompt_tokens":849,"completion_tokens":334,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":465,"completion_tokens_details":{"reasoning_tokens":251}},"tokens_in":465,"tokens_out":334,"duration_ms":3544,"temperature":1.0,"reasoning_tokens":251,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T12:43:45.022420+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Record crowd videos in several countries with known published Hofstede scores, run GeoMind on them, and compare the predicted country-level dimensions with the published indices; if the predicted ordering does not match the published ordering across countries, the cultural mapping is not detecting culture.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the empirically defined equations that map pedestrian features to OCEAN personality scores."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the OCEAN-to-OCC emotion mapping used in Section 2.3."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the group-based mapping to Hofstede cultural dimensions."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides the table connecting OCEAN factors to OCC emotions."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Defines the five-factor Big-Five model that the personality module targets."},{"cited_title":"Ortony, G","cited_arxiv_id":null,"evidence_quote":"Defines the OCC emotion model used for the emotion output."},{"cited_title":"Costa and R","cited_arxiv_id":null,"evidence_quote":"Provides the NEO PI-R item inventory from which 25 crowd-related items are selected."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Establishes the social-space distance used as an input to the socialization network and grouping analysis."},{"cited_title":"Chattaraj, A","cited_arxiv_id":null,"evidence_quote":"Motivates the hypothesis that culture alters pedestrian flow parameters such as speed and density."}],"review_version":1}