REVIEW 3 major objections 6 minor 22 references
RCE: An Integration Environment for Engineering and Science
T0 review · 3 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read RCE turns ad-hoc engineering handoffs into automated, distributed multidisciplinary workflows.
desk verdict RCE is a real, clearly described open-source workflow integration tool, but its core usability and efficiency claims are supported only by anecdotes, not by measurements; as a software paper it deserves a serious review, not as a research contribution. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central machinery is the RCE workflow execution service paired with the tool-integration wrapper. Each tool is wrapped by a definition of input and output data types, optional pre- and post-scripts that convert data between RCE's common formats and tool-specific layouts, and the command to launch the tool. The execution service then runs every tool with no inputs, collects outputs, routes them to connected downstream inputs, and repeats; remote instances communicate through service-interface remote procedure calls, with relay nodes forwarding messages between otherwise disjoint networks. This wrapper-and-dataflow design lets tools running on different operating systems, clusters, or owners' machines appear side by side in the graphical editor and lets the same workflow execute on whatever nodes are available.
What would settle it
The observable test is to start a two-tool RCE workflow whose second tool lives on a remote instance reached only through a relay, then sever the relay link after the first tool finishes; if the workflow controller cannot continue, report an error, or recover, the paper's claim that RCE executes workflows on arbitrary networked nodes over the Internet is not supported for that failure mode.
Extended reading notes
Core claim
The paper's central claim is that RCE gives engineering teams a single place to formalize, execute, and trace multidisciplinary workflows. The authors would state it as: RCE makes it easy for collaborating engineers to contribute their individual disciplinary tools to a multidisciplinary design or analysis, and it simplifies the subsequent analysis of the workflow's results. Concretely, an engineer integrates a tool once by defining its inputs and outputs, optional pre- and post-scripts, and the command to launch it; RCE then treats that tool as a component that runs on the machine where it was published. Workflows are built by dragging these components into a graph, and execution follows the dataflow: start every tool that has no inputs, collect outputs as tools finish, forward those outputs to the tools that need them, and repeat until no tool produces more data. All inputs and outputs are collected by the workflow controller and stored centrally, giving participants access to the data during and after the run.
Load-bearing premise
The load-bearing premise is that all machines running RCE can reach each other through a working network; the paper says it assumes the networks themselves are connected via the Internet, and if that link drops, the distributed workflow cannot communicate and the paper describes no recovery mechanism.
Editorial extensions
If this is right
- Engineering teams can automate the handoff of data between tools that run on different operating systems and different machines, so a workflow no longer depends on one person manually moving files.
- Independent branches of a workflow execute in parallel automatically, as illustrated by the low- and high-fidelity aircraft analyses that previously ran sequentially.
- All inputs and outputs are stored centrally by the workflow controller, so participants can inspect or analyze results during and after a run, and the provenance of each result is available for later review.
- Because tools run on the machine where they were published, proprietary or hardware-bound tools can participate without being copied to other machines, and newly deployed versions are picked up immediately.
- The user can designate a server as the workflow controller and shut down their local machine during long-running workflows.
Reading between the lines
- A controlled comparison against manually orchestrated workflows could measure the claimed efficiency gain in wall-clock time and error rate; the paper reports self-assessed increases but not such measurements.
- The same wrapper-and-workflow model could be applied outside engineering, for example to scientific data pipelines, since the execution engine treats any command-line tool with defined inputs and outputs identically.
- The relay-based network design suggests a natural path to cross-organization collaboration where each partner runs a relay; the paper itself lists encrypted, authenticated transfer of sensitive data as future work, so that scenario depends on a not-yet-delivered component.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper describes RCE (Remote Component Environment), an open-source workflow integration environment developed at DLR. It reports the system's user-facing features: wizard-based tool integration, a graphical workflow editor, distributed execution of workflows over networked RCE instances, central collection and storage of all workflow data, and support for active development versions of tools. It outlines the architecture (Java, Eclipse RCP, OSGi services, JMS/SSH communication) and presents a fictitious aviation wing-design example. It then summarizes several DLR projects (FrEACs, Digital-X, PEGASUS, TRIAD, CLAVA) in which RCE was used, with users reported to be more productive. The paper concludes with future work on workflow modularization, cloud support, and secure communication.
Significance. RCE appears to be a real, open-source system with a sensible modular architecture; the OSGi service design, central provenance collection, and support for heterogeneous runtime environments are credible strengths. The paper ships a Zenodo DOI for the software, which makes claims checkable. However, the paper's headline claims that RCE 'makes it easy' and 'greatly increased efficiency' are not supported by any systematic evaluation; the only evidence is anecdotal and largely self-referential project reports. The usefulness of the paper as a research artifact therefore depends on either adding evaluative evidence or substantially reframing the claims as an experience/software report.
major comments (3)
- [Section 1 and Section 4] The central usability and efficiency claim is asserted without measured evidence. The abstract and Section 1 state that RCE 'makes it easy' and that users 'greatly increased their efficiency'; Section 4 repeats these claims and Section 4.2 says performance 'improved markedly' [9]. No user study, task completion times, error rates, speedup measurements, or comparison against a baseline (e.g., ad-hoc file transfer or a commercial tool) are provided. Section 4 itself concedes that impact is hard to measure. Because RCE is open-source with a Zenodo DOI, an evaluation is feasible; without it, the main claim cannot be verified by the reader.
- [Section 4] The supporting evidence for impact is largely self-referential. The claim that 'numerous users have lauded particular features' is backed by reference [5], the authors' own AIAA paper, and the project successes are described in papers by the same development and user community ([9], [10], [14], [19], [22]). These are not independent verification. I would ask the authors to either supply independently collected user evidence, quantitative workflow metrics, or clearly label Section 4 as an experience report rather than an evaluation.
- [Section 2.1] The description of workflow execution is too underspecified to support the reproducibility of the central execution claim. The text says that execution continues 'until no tool has produced any further output data,' but the paper also advertises optimization loops (Dakota integration) and iterative design workflows; a dataflow engine with this termination rule does not explain how loop iterations or convergence criteria are handled, nor how concurrent data dependencies are scheduled. Please specify the execution semantics (e.g., dataflow firing rules, loop handling, termination conditions) or provide a traceable example with a small workflow.
minor comments (6)
- [Section 2.2] 'JavaX JMS' is not a standard name; use 'Java Message Service (JMS)' or 'javax.jms.'
- [Section 4] 'features of RCE that have of great use in their projects' should read 'that have been of great use.'
- [Section 1 (Related Work)] The statement that 'no other software shares the concept and aim of RCE' is too strong; at least Kepler, Taverna, Pegasus, and Nextflow provide distributed scientific workflow management and should be discussed or explicitly differentiated.
- [Reference [14]] 'Bhnke' should be 'Böhnke' (and the umlaut should be preserved in the citation).
- [Manuscript availability] The manuscript would be easier to verify if the software availability were stated in the text (e.g., a URL to the repository or release) rather than only through reference [4].
- [Section 4.2] 'The performance of these individual steps improved markedly' would benefit from stating the measured metric (wall-clock time, turnaround time, number of manual interventions) and the baseline.
Circularity Check
No structural circularity; the only self-referential element is a minor self-citation in the impact section, and the central software claims are independently checkable.
-
other
[Section 4 (Impact), first paragraph; supported by reference [5]]
"However, numerous users have lauded particular features of RCE that have of great use in their projects, such as the capability to create repeatable and reusable workflows, or the ability to seamlessly perform simulations on a distributed network [5]."
The citation attached to this user-praise claim is reference [5], a prior paper by the same DLR author group (Boden, Flink, Mischke, Schaffert, Weinert, Wohlan, Schreiber, et al.), not an independent user survey or benchmark. The impact evidence therefore reduces to a self-citation rather than receiving external support. This is a minor self-referential loop only: the main technical content of the paper is self-contained, and the existence and core functionality of RCE can be independently verified through the open-source release identified by the Zenodo DOI.
full rationale
This paper is a software description rather than a derivation; it contains no equations, fitted parameters, or quantitative predictions whose values could reduce to their own inputs. The technical sections (Sections 2 and 3) describe RCE's functionality and architecture in a self-contained way, and the central claim that the software exists and enables graphical, distributed workflow execution is independently checkable through the open-source code and published DOI. The only self-citation carrying evidential weight appears in Section 4, where the claim that users laud RCE's features is backed by reference [5], the authors' own prior paper. This makes the impact discussion partly self-referential, but the paper itself admits that impact is 'hard to measure' and this discussion is not load-bearing for the main technical claims. The network-connectivity assumption in Section 3 is an explicit stated precondition rather than a concealed input. Overall, no meaningful derivation chain is circular; the minor self-citation warrants a low score rather than a finding of substantive circularity.
Assumptions & free parameters
assumptions (2)
- domain assumption The networks connecting RCE instances are connected via the Internet; otherwise no communication is possible.
- domain assumption Each disciplinary tool can be integrated into RCE by defining inputs, outputs, and pre/post-scripts.
Cite this review
Pith. "Pith review of RCE: An Integration Environment for Engineering and Science." pith.science (2026). https://pith.science/paper/JZQWUYGI
@misc{pith2026190803461,
author = {Pith},
title = {Pith review of: RCE: An Integration Environment for Engineering and Science},
year = {2026},
howpublished = {\url{https://pith.science/paper/JZQWUYGI}},
note = {Machine review of arXiv:1908.03461}
}
read the original abstract
We present RCE (Remote Component Environment), an open-source framework developed primarily at DLR (German Aerospace Center) that enables its users to construct and execute multidisciplinary engineering workflows comprising multiple disciplinary tools. To this end, RCE supplies users with an easy-to-use graphical interface that allows for the intuitive integration of disciplinary tools. Users can execute the individual tools on arbitrary nodes present in the network and all data accrued during the execution of the workflow are collected and stored centrally. Hence, RCE makes it easy for collaborating engineers to contribute their individual disciplinary tools to a multidisciplinary design or analysis, and simplifies the subsequent analysis of the workflow's results.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[9]
In: 18th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference
Goertz, S., Ilic, C., Jepsen, J., Leitner, M., Schulze, M., Schuster, A., Scherer, J., Becker, R., Zur, S., Petsch, M.: Multi-Level MDO of a Long-Range Transport Aircraft Using a Distributed Analysis Frame- work. In: 18th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference. AIAA (2017). https://doi.org/10.2514/6.2017-4326
-
[5]
Boden, B., Flink, J., Mischke, R., Schaffert, K., Weinert, A., Wohlan, A., Ilic, C., Wunderlich, T., Liersch, C.M., Goertz, S., Ciampa, P.D., Moerland, E.: Distributed Multidisciplinary Optimization and Collaborative Process Development Using RCE. In: AIAA Aviation 2019 Forum. American Institute of Aeronautics and Astronautics (June 2019). https://doi.org/...
-
[10]
G¨ ortz, S., Ilic, C., Abu-Zurayk, M., Liepelt, R., Jepsen, J., F¨ uhrer, T., Becker, R.G., Scherer, J., Kier, T., Siggel, M.: Collaborative Multi-Level MDO Process Development and Application to Long-Range Transport Aircraft. In: ICAS 2016 (2016), available at https://www.icas.org/ICAS_ARCHIVE/ICAS2016/data/papers/ 2016_0345_paper.pdf
work page 2016
-
[14]
In: 17th AIAA Aviation Technology, Integration, and Operations Conference
Moerland, E., Pfeiffer, T., Bhnke, D., Jepsen, J., Freund, S., Liersch, C.M., Chiozzotto, G.P., Klein, C., Scherer, J., Hasan, Y.J., Flink, J.: On the Design of a Strut-Braced Wing Configuration in a Collaborative Design Environment. In: 17th AIAA Aviation Technology, Integration, and Operations Conference. American Institute of Aeronautics and Astronautics...
-
[19]
Journal of Engineering for Gas Turbines and Power 141(1) (September 2018)
Reitenbach, S., Krumme, A., Behrendt, T., Schn¨ os, M., Schmidt, T., H¨ onig, S., Mischke, R., Moerland, E.: Design and Application of a Multi-Disciplinary Pre-Design Process for Novel Engine Concepts. Journal of Engineering for Gas Turbines and Power 141(1) (September 2018). https://doi.org/10.1115/1.4040750
-
[22]
Weiand, P., Buchwald, M., Schwinn, D.: Process Development for Integrated and Distributed Rotorcraft De- sign. Aerospace 6(2) (2019). https://doi.org/10.3390/aerospace6020023, http://www.mdpi.com/2226-4310/ 6/2/23 11
-
[1]
Adams, B., Bauman, L., Bohnhoff, W., Dalbey, K., Ebeida, M., Eddy, J., Eldred, M., Hough, P., Hu, K., Jakeman, J., Stephens, J., Swiler, L., Vigil, D., , Wildey, T.: Dakota, A Multilevel Parallel Object- Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sen- sitivity Analysis: Version 6.0 Users Manual. Sandia ...
work page 2014
-
[2]
Apache Software Foundation, Cloudera, Hortonworks: Apache Nifi, available at https://nifi.apache.org/
Show all 22 references
-
[3]
Backus, J., IBM, ISO: The Fortran Programming Language
-
[4]
https://doi.org/10.5281/zenodo.3691675 10
Boden, B., Flink, J., Mischke, R., Schaffert, K., Weinert, A., Wohlan, A., Schreiber, A.: RCE (November 2019). https://doi.org/10.5281/zenodo.3691675 10
2019 doi
-
[6]
Eclipse Foundation: Eclipse Equinox, available at https://www.eclipse.org/equinox/
-
[7]
Eclipse Foundation: Rich Client Platform, https://wiki.eclipse.org/Rich_Client_Platform
-
[8]
In: 69th International Astronautical Congress (IAC) (October 2018), available athttps://elib.dlr.de/122158/
Fischer, P.M., Deshmukh, M., Koch, A.D., Mischke, R., Gomez, A.M., Schreiber, A., Gerndt, A.: Enabling a Conceptual Data Model and Workflow Integration Environment for Concurrent Launch Vehicle Analysis. In: 69th International Astronautical Congress (IAC) (October 2018), availa...
2018
-
[11]
Structural and Multidisciplinary Optimization 59(4), 1075–1104 (April 2019)
Gray, J.S., Hwang, J.T., Martins, J.R.R.A., Moore, K.T., Naylor, B.A.: OpenMDAO: An open-source frame- work for multidisciplinary design, analysis, and optimization. Structural and Multidisciplinary Optimization 59(4), 1075–1104 (April 2019). https://doi.org/10.1007/s00158-019-02211-z
2019 doi
-
[12]
KNIME AG: KNIME, https://www.knime.com/
-
[13]
MathWorks, Inc.: MATLAB, https://www.mathworks.com/products/matlab.html
-
[15]
OSGi Alliance: OSGi Compendium Release 7 - Declarative Services Specification, https://osgi.org/ specification/osgi.cmpn/7.0.0/service.component.html
-
[16]
(ed.): A Holistic Approach to Ship Design
Papanikolaou, A. (ed.): A Holistic Approach to Ship Design. Springer International Publishing (2019). https://doi.org/10.1007/978-3-030-02810-7
2019 doi
-
[17]
Phoenix Integration: Model Center, https://www.phoenix-int.com
-
[18]
Python Contributors: The Python Programming Language, available at https://www.python.org
-
[20]
Internationales Verkehrswesen (2), 49–53 (2019)
Seum, S., Ehrenberger, S., Kuhnimhof, T., Winkler, C.: Verkehr und seine Umweltwirkungen. Internationales Verkehrswesen (2), 49–53 (2019)
2019
-
[21]
Sun Microsystems: The Java Programming Language, https://www.oracle.com/java
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.