REVIEW 4 major objections 6 minor 40 references
Can I do it
T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read The paper claims that a robot can answer 'Can I do it?' by combining an ontology of its components and configurations with deductive inference rules and inductive performance predictions from past experience.
desk verdict A solid ontology-and-reasoning core is buried in an unfinished draft whose central claim rests on an unvalidated SOM lookup and an empty results section. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrier of the argument is a hypergraph-based ontology whose core concepts are Entity, Relation, and Attribute, connected by 'has' and 'Role' links, with a set-theoretic notation that turns ontology statements into second-order logic expressions. On top of that structure, two automatically inferred relations do the deductive work: 'realizing' matches a requested creation's properties (format, rate, units, ranges) to those of an available creation, and 'processing' declares a component fully operational when its functional, non-functional, and environmental requirements are all realized, with transitivity chaining components into configurations. The inductive half is a set of self-organizing maps, one per behavior, trained on 25 experiments, which groups past conditions and component-quality readings into clusters and assigns each cluster an average detection-success probability; the current readings are matched to the best-matching unit, and that cluster average becomes the prediction of overall performance.
What would settle it
Run many search trials in conditions that fall inside a single trained cluster, and compare the cluster's average success probability to the observed frequency of correct detections; a large and systematic gap between the two, or a gap that changes with room characteristics the cluster ignores, would show that the inductive performance map does not generalize.
Extended reading notes
Core claim
The central claim is that a robot's engineering knowledge can be structured so that the robot itself can reason about its own capabilities at runtime. The ontology defines components (sensors, actuators, functional units, appliances), the creations they produce (data, resources, physical phenomena), and three kinds of requirement (functional, non-functional, environmental). Deductive rules instantiate 'realizing' relations when an available creation satisfies a component's requirement, and 'processing' relations when all requirements of a component are met; transitivity of processing lets the knowledge base assemble larger configurations from connected components. A behavior is then linked to the configurations that can execute it, and the expected quality of a behavior's output is derived from online measurements of component quality plus an inductive map learned from past experiments. On this basis the robot can answer whether a task is feasible and with what performance, and can select among configurations.
Load-bearing premise
The load-bearing premise is that the average success rate of past trials in a cluster of similar-looking conditions, computed from only 25 experiments, carries over to the current room; if the recorded lighting, noise, and room-size readings do not actually determine detection success, the predicted answer to 'Can I do it?' can be wrong even when the ontology and its inference rules are correct.
Editorial extensions
If this is right
- A robot can choose among alternative configurations for the same task by querying which configurations satisfy current conditions and which meet the task's required performance.
- Configuration validity does not have to be hard-coded: realizing and processing relations are inferred automatically and updated as components, data links, and environmental states change.
- Because the knowledge base is online and updatable, component degradation or failure can change the answer to 'Can I do it?' without re-engineering the system.
- The same ontology can later be interfaced with engineering languages such as SysML, so engineering-time models and runtime self-assessment share one structure.
- Performance predictions are behavior-specific: thorough search, fast search, and acoustic search each have their own self-organizing map, so the robot can compare expected success across qualitatively different ways of doing a task.
Reading between the lines
- The paper leaves implicit that the same ontology could support calibrated confidence rather than a single point estimate: replacing the cluster average with a probabilistic model over the same feature space would let the robot report 'I am 70 percent sure I can do it' and update that number as data accumulate.
- The separation of functional, non-functional, and environmental requirements suggests a natural extension to fleet learning, where one robot's experience with a configuration updates a shared capability knowledge base used by other robots.
- A testable extension would be to isolate the ontology's contribution from the inductive predictor's by running the system in simulation with a known ground-truth performance model; if the ontology and inference rules alone produce the correct configuration rankings, the remaining error is attributable to the clustering step.
- The paper's remark that quality will later enter equations rather than constraints points toward analytic propagation of component quality through processing chains, which could make performance prediction less dependent on the 25-experiment clusters.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Self-X, a knowledge representation intended to let a robot assess whether it can perform a task with a desired performance. It models system components, their requirements and outputs, configurations, and behaviors in a hypergraph-based ontology implemented in GRAKN; deductive inference rules generate realizing and processing relations between components; and an inductive stage uses a self-organizing map trained on 25 experiments to predict the probability of detecting a human (P(human)) from current quality readings and environmental conditions. The central claim is that this combination lets a robot answer 'can I do it' questions. The manuscript, however, provides no experimental evidence for that claim: Section 6 contains only fragments and missing figures, and the SOM-based predictor is not validated.
Significance. If the approach were fully supported, it would be a useful step toward runtime self-assessment in autonomous robots, combining the structure of engineering ontologies with quantitative, data-driven performance prediction, and the hardware implementation on a SPOT robot with ROS2/GRAKN is a concrete asset. The novel combination of deductive configuration logic and inductive performance learning is worth exploring. However, because the experimental results and validation for the inductive predictor are absent, the contribution cannot be assessed beyond the conceptual design; the paper does not, in its current form, substantiate the claimed real-life functionality.
major comments (4)
- [Section 6] The 'Experimental results' section contains no actual results. It consists of sentence fragments about deductive and inductive reasoning and captions for Figures 22–24, but the figures themselves are not present in the manuscript. There are no tables, plots, measurement summaries, or numerical outcomes, so the abstract's statement that 'our real-life implementation shows a robot' is unsupported. This is the central evidence for the paper's main claim and must be supplied.
- [Section 5.3] The prediction of P(human) is a nearest-cluster average of Boolean detection labels over a self-organizing map trained on only 25 experiments. No details are given on the number of clusters, the number of samples per cluster, the SOM hyperparameters, or any out-of-sample evaluation. With inputs comprising brightness, contrast, 16–20 Brisque features, noise, and room diagonal, a 25-sample training set is too small to establish generalization; the predicted 'expected performance' may be an artifact of the training data rather than a reliable estimate for a new room. Since this mapping is what converts component-quality readings into a task-level capability answer, the central claim depends on it and it is currently unvalidated.
- [Section 4.3.1] The realizing and processing inference rules are not well-formed formulas. For example, the realizing rule uses 'X⊂ (x∈ creation|x.hasProperty : p1)' and then 'Y∈ X' and 'p1∈ p2' without defining whether X, Y, p1, and p2 denote sets, individuals, or properties. The processing rule similarly defines a set of sets '{I, Y, F, R, O, C}⊂{{{ i∈ creation},...}}' whose type is unclear. Because these rules are the deductive engine that derives configurations from component requirements, the formalization must be corrected before the deductive reasoning can be considered sound.
- [Sections 4.3.2 and 5.3] The manuscript does not specify how the ontology and the predicted P(human) combine to answer the question 'can I do it with a desired performance.' Section 4.3.2 states that the system 'would choose' the acoustic behavior when visual accuracy is low without giving a selection rule, and Section 5.3 defines the prediction but not a threshold or query procedure that maps predicted performance to a configuration decision. The claimed ability to answer capability questions therefore lacks a formal decision step.
minor comments (6)
- [Throughout] There are numerous typographical errors, including 'Boulean' (Section 5.3), 'indcutive' and 'dedcutive' (Section 6), 'recieved' (Section 2), 'autonmous' (Section 2), 'envrionment' (Section 3.2.1), and 'visibability' (Section 4.3.2). The text needs a careful proofreading pass.
- [Section 2.3] The link names '.....Role' and '....has' appear with leading dots, which is likely a formatting artifact and should be corrected to 'Role' and 'has'.
- [Section 4.2] The sentence 'Discussions on what is a task or a behavior are not yet settled, see [ref]' contains an unresolved reference placeholder; a citation should be supplied.
- [Section 5.3] The self-organizing map citation is given as '[ref]', and the phrase 'insert figure' appears immediately after the description of the prediction procedure; both need to be completed.
- [Section 5.2] The text references 'figure XXX' twice and 'Figure 24' in a context where the figure is not present; all figure references should be resolved to actual figures.
- [Section 7] The Conclusions section contains only Elsevier bibliography style instructions and does not summarize the contribution, limitations, or future work. A proper conclusion is needed.
Circularity Check
No significant circularity: the SOM-based P(human) predictor is an explicit empirical fit, not a derivation equivalent to its inputs, and the ontology/deductive rules are self-contained.
full rationale
The only fitted component is the inductive performance predictor in Section 5.3, and the paper explicitly labels it as data-driven: 'This prediction is done with a data-driven approach, i.e., learned from experimental data.' The predicted P(human) is a nearest-cluster average of binary success labels over a self-organizing map trained on 25 experiments. That is supervised learning from recorded outcomes, not circularity: the query-time prediction uses current conditions and quality readings to select a cluster, and the binary outcome labels are not fed back into the ontology or inference rules as premises. The deductive realizing/processing rules check data format, rate, resource, and environmental requirements, which are independent of the fitted performance values. Citations to the authors' prior work, e.g. [11], [30], and [39], are used as related work or for floor-plan modeling, not as a load-bearing proof of the central claim, and no uniqueness theorem is imported from prior work. The paper's main weakness is evidentiary rather than circular: Section 6 contains placeholder text and references missing figures, and the SOM predictor is not validated with out-of-sample results. These are correctness and completeness concerns, not instances of the derivation reducing to its own inputs.
Assumptions & free parameters
free parameters (4)
- Robot position accuracy delta =
0.25 m
- Human voice intensity S =
70 dB
- SOM cluster parameters =
not reported
- Position inaccuracy D for acoustic and NLP search =
half of the room diagonal
assumptions (4)
- domain assumption An ontology with Entity, Relation, Attribute and Role/has links can capture runtime-relevant system engineering knowledge.
- domain assumption Component viability can be decided by checking Format, Rate, Capacity, Unit, and Range constraints in realizing rules.
- domain assumption The transitive closure of Processing relations faithfully represents a complete system configuration.
- ad hoc to paper Performance of a behavior can be predicted by nearest-cluster averaging of past success labels in a trained SOM.
invented entities (3)
-
Processing relation
-
ProcessingRequirement
-
Behavior-linked MeasureOfPerformance
Cite this review
Pith. "Pith review of Can I do it." pith.science (2026). https://pith.science/paper/624Q3AVL
@misc{pith2026241202569,
author = {Pith},
title = {Pith review of: Can I do it},
year = {2026},
howpublished = {\url{https://pith.science/paper/624Q3AVL}},
note = {Machine review of arXiv:2412.02569}
}
read the original abstract
Knowledge about how well a robot can perform a specific task is currently present only in engineering reports which are inaccessible to the robot. Artificial Intelligence techniques, such as hypergraphs and automated reasoning, can provide such engineering knowledge online while enabling updates in the knowledge with new experiences. This requires a sound knowledge structure and maintenance routines for keeping this knowledge-base about the robot's capabilities truthful. A robot with such up-to-date information can reason about if and how well it can accomplish a task. This article introduces a knowledge representation that combines an ontology on system engineering, a deductive reasoning on the connections between system components, and an inductive reasoning on the performance of these components in the current system configuration. This representation is further used to derive the expected performance for the overall system based on a continuous evaluation of the actual performance per component. Our real-life implementation shows a robot that can answer questions on whether it can do a specific task with the desired performance.
Figures
Figures from the paper (23 more)
Reference graph
Works this paper leans on
-
[1]
A. Huizing, C. Veenman, M. Neerincx, J. Dijk, Hybrid ai: The way forward in ai by developing four dimensions, in: F. Heintz, M. Mi- lano, B. O’Sullivan (Eds.), Trustworthy AI – Integrating Learning, Op- timization and Reasoning, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformat...
work page 2021
-
[2]
Russel, Human compatibale: AI and the problem of control, 1st Edi- tion, Viking, 2019
S. Russel, Human compatibale: AI and the problem of control, 1st Edi- tion, Viking, 2019
work page 2019
-
[3]
Pickery, The cybernetic brain: sketches of another future, The name of the publisher, 2010
A. Pickery, The cybernetic brain: sketches of another future, The name of the publisher, 2010
work page 2010
-
[4]
F. Heylighen, From Human Computation to the Global Brain: The Self- Organization of Distributed Intelligence, In: Michelucci P. (eds) Hand- book of Human Computation. Springer, New York, NY , 2013
work page 2013
-
[5]
W. L. Chapman, A. T. Bahill, A. W. Wymore, Engineering modeling and design, CRC Press, 2018
work page 2018
-
[6]
J. A. Estefan, et al., Survey of model-based systems engineering (mbse) methodologies, Incose MBSE Focus Group 25 (8) (2007) 1–12
work page 2007
-
[7]
Dori, et al., Model-based systems engineering with OPM and SysML, V ol
D. Dori, et al., Model-based systems engineering with OPM and SysML, V ol. 15, Springer, 2016
work page 2016
-
[8]
S. Friedenthal, A. Moore, R. Steiner, A practical guide to SysML: the systems modeling language, Morgan Kaufmann, 2014
work page 2014
Show all 40 references
-
[9]
Hochgeschwender, L
N. Hochgeschwender, L. Gherardi, A. Shakhirmardanov, G. K. Kraet- zschmar, D. Brugali, H. Bruyninckx, A model-based approach to soft- ware deployment in robotics, in: 2013 IEEE /RSJ International Confer- ence on Intelligent Robots and Systems, 2013, pp. 3907–3914. doi: 10.1109...
2013
-
[10]
Morten, Modeling goals and functions of complex industrial plants, Applied Artificial Intelligence 8 (2) (1994) 259–283
L. Morten, Modeling goals and functions of complex industrial plants, Applied Artificial Intelligence 8 (2) (1994) 259–283. doi:10.1080/ 08839519408945442. 16
1994
-
[11]
Hern ´andez Corbato, J
C. Hern ´andez Corbato, J. Bermejo, R. Sanz, A self-adaptation framework based on functional knowledge for augmented autonomy in robots, In- tegrated Computer-Aided Engineering 25 (2018) 1–16. doi:10.3233/ ICA-180565
2018
-
[12]
Weyns, N
D. Weyns, N. Bencomo, R. Calinescu, J. C ´amara, C. Ghezzi, V . Grassi, L. Grunske, P. Inverardi, J. J ´ez´equel, S. Malek, R. Mirandola, M. Mori, G. Tamburrelli, Perpetual assurances for self-adaptive systems, CoRR abs/1903.04771. arXiv:1903.04771. URL http://arxiv.org/abs/1903.04771
1903 arXiv
-
[13]
Lemos, H
R. Lemos, H. Giese, H. M ¨uller, J. Andersson, M. Litoiu, B. Schmerl, G. Tamura, N. Villegas, T. V ogel, D. Weyns, L. Baresi, B. Becker, N. Ben- como, Y . Brun, B. Cukic, R. Desmarais, S. Dustdar, G. Engels, J. Wuttke, Software Engineering for Self-Adaptive Systems: A Second R...
2013 doi
-
[14]
I. U, D. Weyns, Activforms: Active formal models for self-adaptation, in: In Proc. of the Int. Conf. on Software Engineering for Adaptive and Self-Managing Systems (SEAMS2014), 2014, pp. 125 – 134
2014
-
[15]
Zhang, B
J. Zhang, B. H. C. Cheng, Model-based development of dynamically adaptive software, in: In Proc. of the Int. Conf. on Software Engineer- ing, 2006, pp. 371 – 380
2006
-
[16]
J. O. Kephart, D. M. Chess, The vision of autonomic computing, Com- puter 36 (1) (2003) 41–50. doi:10.1109/MC.2003.1160055
2003 arXiv
-
[17]
Schleno ff, J
C. Schleno ff, J. Albus, E. Messina, A. Barbera, R. Madhavan, S. Bal- akirsky, Using 4d /rcs to address ai knowledge integration, AI Mag. 27 (2006) 71–81
2006
-
[18]
Prestes, J
E. Prestes, J. Carbonera, S. Fiorini, V . Jorge, M. Abel, R. Madhavan, A. Locoro, P. Gonc ¸alves, M. Barreto, M. Habib, A. Chibani, S. G´erard, Y . Amirat, C. Schlenoff, Towards a core ontology for robotics and au- tomation, Robotics and Autonomous Systems 61 (2013) 1193–1204....
2013 doi
-
[19]
A. B. d. O. Neto, J. A. Silva, M. E. Barreto, Prototyping and validating the cora ontology: Case study on a simulated reconnaissance mission, in: 2019 Latin American Robotics Symposium (LARS), 2019 Brazilian Symposium on Robotics (SBR) and 2019 Workshop on Robotics in Edu- cat...
2019
-
[20]
Balakirsky, C
S. Balakirsky, C. Schleno ff, S. R. Fiorini, S. Redfield, M. Bar- reto, H. Nakawala, J. L. Carbonera, L. Soldatova, J. Bermejo-Alonso, F. Maikore, P. J. Goncalves, E. De Momi, V . R. Kumar, T. Haidegger, Towards a robot task ontology standard, in: Proceedings of the ASME 2017 ...
2017
-
[21]
Czarnecki, Operational world model ontology for automated driving systems – part 1: Road structure, Tech
K. Czarnecki, Operational world model ontology for automated driving systems – part 1: Road structure, Tech. rep., Waterloo Intelligent Systems Engineering Lab (2018). doi:10.13140/RG.2.2.15521.30568
2018
-
[22]
Czarnecki, Operational world model ontology for automated driving systems – part 2: Road users, animals, other obstacles, and environmen- tal conditions, Tech
K. Czarnecki, Operational world model ontology for automated driving systems – part 2: Road users, animals, other obstacles, and environmen- tal conditions, Tech. rep., Waterloo Intelligent Systems Engineering Lab (2018). doi:10.13140/RG.2.2.11327.00165
2018
-
[23]
J. Thai, M. Gruninger, Robot meets world, in: In Proc. of the Joint Ontol- ogy Workshop, JOWO., 2020
2020
-
[24]
Tenorth, D
M. Tenorth, D. Jain, M. Beetz, Knowledge processing for cognitive robots, KI-Kunstliche Intelligenz 24 (2010) 233–340
2010
-
[25]
Beetz, D
M. Beetz, D. Beßler, A. Haidu, M. Pomarlan, A. Bozcuoglu, G. Bartels, Know rob 2.0—a 2nd generation knowledge processing framework for cognition-enabled robotic agents, in: In Proc. of the 2018 IEEE Int. Conf. on Robotics and Automation (ICRA), 2018, pp. 512–519
2018
-
[26]
Scioni, N
E. Scioni, N. H ¨ubel, S. Blumenthal, A. Shakhimardanov, M. Klotzb¨ucher, H. Garcia, H. Bruyninckx, Hierarchical hypergraphs for knowledge- centric robot systems: a composable structural meta model and its domain specific language NPC4 7 (1) (2016) 55–74
2016
-
[27]
Taherinejad, P
N. Taherinejad, P. Lewis, A. Jantsch, A. M. Rahmani, L. Esterle, Resource constrained self-aware cyber-physical systems (tutorial), 2019. doi:10. 1109/FAS-W.2019.00071
2019
-
[28]
B. W. Israelsen, N. R. Ahmed, E. W. Frew, D. Lawrence, B. Argrow, Machine self-confidence in autonomous systems via meta-analysis of de- cision processes, CoRR abs/1810.06519. arXiv:1810.06519. URL http://arxiv.org/abs/1810.06519
-
[29]
Sweet, N
N. Sweet, N. Ahmed, U. Kuter, C. Miller, Towards self-confidence in autonomous systems, 2016. doi:10.2514/6.2016-1651
2016 doi
-
[30]
Hern ´andez Corbato, Z
C. Hern ´andez Corbato, Z. Milosevic, C. Olivares, G. Rodriguez, C. Rossi, Meta-control and Self-Awareness for the UX-1 Autonomous Underwater Robot, 2020, pp. 404–415. doi:10.1007/978-3-030-35990-4_33
2020 doi
-
[31]
Lewis, A
P. Lewis, A. Chandra, F. Faniyi, K. Glette, T. Chen, R. Bahsoon, J. Tor- resen, Architectural aspects of self-aware and self-expressive computing systems: From psychology to engineering, Computer 48 (2015) 62–70. doi:10.1109/MC.2015.235
2015 doi
-
[32]
Bermejo, R
J. Bermejo, R. Sanz, M. Rodriguez, C. Hern ´andez Corbato, An ontologi- cal framework for autonomous systems modelling 3
-
[33]
O. Tas, S. Hoermann, B. Sch ¨aufele, F. Kuhnt, Automated vehicle system architecture with performance assessment, 2017. doi:10.1109/ITSC. 2017.8317862
2017
-
[34]
W. A. Waymore, Model-based systems engineering: An introduction to the mathematical theory of discrete systems and to the tricotyledon theory of system design, 1st Edition, CRC Press, 1993
1993
-
[35]
Bjelonic, YOLO ROS: Real-time object detection for ROS, https: //github.com/leggedrobotics/darknet_ros (2016–2018)
M. Bjelonic, YOLO ROS: Real-time object detection for ROS, https: //github.com/leggedrobotics/darknet_ros (2016–2018)
2016
-
[36]
Dynamics, Spot
B. Dynamics, Spot. URL https://www.bostondynamics.com/spot
-
[37]
Studio, Respeaker core v2.0
S. Studio, Respeaker core v2.0. URL https://wiki.seeedstudio.com/ReSpeaker_Core_v2.0/
-
[38]
Pribadi, The grakn.ai ontology: simplicity and maintainability, in comparison with traditional ontology languages and tools (2021)
H. Pribadi, The grakn.ai ontology: simplicity and maintainability, in comparison with traditional ontology languages and tools (2021). URL https://blog.grakn.ai/the-grakn-ai-ontology-simplicity-and-maintainability-ab78340f5ff6
2021
-
[39]
J. Sijs, J. Fletcher, An online knowledge base to model real-world, indoor environments for robots conducting a search operation with uncertainty, in: submitted to the 2021 IEEE /RSJ International Conference on Intelli- gent Robots and Systems (IROS’21)., 2021
2021
-
[40]
Mittal, A
A. Mittal, A. K. Moorthy, A. C. Bovik, Blind /referenceless image spatial quality evaluator, in: 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR), 2011, pp. 723–727. doi:10.1109/ACSSC.2011.6190099. Appendices 17 (a) Mod...
2011
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.