ChronoLLM: A Framework for Customizing Large Language Model for Digital Twins generalization based on PyChrono

Dan Negrut; Harry Zhang; Jingquan Wang; Jinlong Wu; Khailanii Slaton; Radu Serban; Shu Wang

REVIEW 4 major objections 7 minor 100 references

ChronoLLM: A Framework for Customizing Large Language Model for Digital Twins generalization based on PyChrono

T0 review · 4 major / 7 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Fine-tuning lifts an LLM's PyChrono script success from about 40% to 85%.

desk verdict Fine-tuning recipe is plausible and the paper is honest about its in-distribution test, but the central 40-to-85 claim rests on an unreleased judge and a self-referential benchmark; send it to review with a demand for the missing artifacts. read the letter →

arxiv 2501.04062 v1 pith:BE32FXPJ submitted 2025-01-07 cs.SE cs.AIcs.CE

Jingquan Wang , Harry Zhang , Khailanii Slaton , Shu Wang , Radu Serban , Jinlong Wu , Dan Negrut This is my paper · ORCID

classification cs.SEcs.AIcs.CE

keywords largelanguagemodelsPyChronodigitaltwinscodegenerationfine-tuninglow-rankadaptationcontinualpretrainingmultibodydynamics

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that a general-purpose large language model can be turned into a reliable writer of PyChrono simulation scripts by continuing its pretraining on Chrono-related materials and then fine-tuning it on curated instruction–code pairs. The authors report that the best fine-tuned model, GPT-4o-mini, reaches an average document reference score near 70 and roughly 85% success on the SimBench digital-twin generation test, against about 40% for the unmodified model. If the result holds outside the benchmark, it would let engineers describe a multibody system in natural language and get a working simulation script without hand-writing the 18,000-plus PyChrono API calls. The paper is careful to note that SimBench tests are in-distribution because the test prompts overlap the training data, so the headline numbers describe near-training performance rather than proven generalization to novel PyChrono tasks.

What carries the argument

The carrying mechanism is the fine-tuning pipeline itself: continual pretraining with a causal language modeling objective on domain texts (with a warmup strategy to limit catastrophic forgetting), followed by supervised fine-tuning using Low-Rank Adaptation (LoRA), which freezes the base weights and trains low-rank update matrices. The four JSON SFT datasets are the knowledge carriers—simulation-generation instructions, chain-of-thought breakdowns, natural-language-to-API mappings, and API-to-natural-language mappings—that teach the model both the current PyChrono API surface and the expected format of a correct simulation script. Evaluation rests on the J-LLM judge, an LLM-based scorer that compares generated code against an expert reference script and API documentation, with the score reported as the average document reference score.

What would settle it

Take the fine-tuned GPT-4o-mini and run it on a set of PyChrono tasks built from API features and scenario categories absent from its training data, then score by executing the generated code (pass@k) and by human expert review instead of the J-LLM judge; if success drops back toward the roughly 40% baseline, the reported improvement was benchmark-specific rather than a general PyChrono scripting ability.

Watch

Extended reading notes

Core claim

The central claim is that a two-stage customization pipeline—continued causal-language-model pretraining on PyChrono documentation, code examples, forum Q&A, and solver material, followed by supervised fine-tuning on four instruction datasets (simulation generation, chain-of-thought, natural-language-to-API, and API-to-natural-language)—produces a domain-specialized LLM that outperforms both the base model and in-context learning on digital-twin code generation. On SimBench, the fine-tuned GPT-4o-mini variant scores close to 70 in average document reference score and about 85% success rate, versus about 40% for the base model, and it also outperforms models fine-tuned with a "Hacked SimBench" baseline trained directly on the exact test prompts. The paper frames this as evidence that fine-tuning, rather than prompt engineering, is the effective route for embedding PyChrono-specific knowledge in an LLM.

Load-bearing premise

The reported gains rest on the assumption that the J-LLM judge and the SimBench test set measure how good generated PyChrono code really is; since the judge, test set, and implementations are not released, an independent reader cannot check whether the 85% success rate reflects true code quality or the judge's preferences.

Editorial extensions

If this is right

If the 85% success rate transfers to held-out tasks, a fine-tuned small model like GPT-4o-mini could serve as a low-cost, low-latency code generator for PyChrono users, replacing expensive prompt-engineering calls to larger closed models.
The four-way SFT data format (simulation, chain-of-thought, NL2API, API2NL) gives a reusable recipe for adapting LLMs to other large simulation libraries with big API surfaces.
The warmup-only continual pretraining strategy, without replay or regularization, means the approach is reproducible with only model weights and domain text, which is the situation for most open-source LLMs.
Because the test is in-distribution, the results should be read as evidence that fine-tuning embeds PyChrono knowledge effectively, not as proof of generalization to unseen simulation scenarios; this is the authors' own caveat.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

A natural next test is to build an out-of-distribution split—tasks whose API calls, object types, or scenario categories do not appear in the training corpus—so the 85% figure can be separated into memorization of SimBench prompts and genuine PyChrono competence.
The same pipeline could be pointed at the older-to-newer API migration problem the paper inventories: resolving old Chrono API calls to current names is a mechanical task well suited to the NL2API/API2NL format, and a model so trained could double as a migration tool for existing user scripts.
Because the J-LLM judge is itself an LLM using reference code, the reported improvements may partly reflect the judge preferring outputs that stylistically resemble the fine-tuning data; an execution-based pass@k measure with human adjudication on the same prompts would isolate functional correctness.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The genuinely new thing here is the target: a fine-tuning recipe for PyChrono code generation, with a concrete pipeline covering continual pretraining, LoRA, and SFT data synthesized from docs, examples, and forums. The paper is honestly written about the evaluation's main limitation -- Section 4.2 explicitly says testing on SimBench is in-distribution because the fine-tuning and ICL datasets come from the same public sources. The related-work tables are actually useful, and the LDA analysis of support-forum topics gives some context for why PyChrono is a good testbed.

The soft spot is the empirical headline. The 85% versus 40% success-rate jump is not something you can check from the preprint. The benchmark (SimBench) and the judge (J-LLM) come from the authors' own prior work, neither the test set nor the judge prompts are released, and there are no execution-based pass@k results even though Section 4.1 claims all metric families were used. The 'Hacked SimBench' baseline, designed to control for memorization, is described but never reported. So the improvement could reflect a real fine-tuning benefit, or it could be the judge rewarding outputs that resemble near-training reference code. The authors themselves concede the overlap, which makes the conclusion's claim about generalizing across PyChrono tasks go beyond the evidence.

This is not a fatal flaw in the approach. The method is a standard application of known fine-tuning techniques -- the paper says so -- and the authors clearly know the literature. The honesty about the in-distribution test is welcome. But a reader cannot parse the claimed effect size without the promised artifacts. If the GitHub release ships the training data, the test prompts, the judge implementation, and the Hacked baseline results, the contribution becomes checkable and probably solid. As submitted, it is conditional.

The paper deserves a serious referee, not a desk reject. The research question -- does domain fine-tuning help code generation for a niche simulation library -- is legitimate, and the method section is detailed enough to reproduce once the artifacts appear. I would send it out with clear instructions that the missing evaluation material must be provided or the paper is not acceptable. I would bring it to a reading group as a case study in LLM evaluation circularity, not for the numbers.

Referee Report

4 major / 7 minor

Summary. The paper presents ChronoLLM, a framework for customizing open-source and API-based LLMs for generating PyChrono simulation scripts (digital twins). The pipeline consists of continual pretraining on Chrono-related documentation, code examples, and forum Q&A, followed by supervised fine-tuning (SFT) and/or parameter-efficient fine-tuning (LoRA) on synthesized instruction datasets. The authors evaluate several base models (GPT-4o, GPT-4o-mini, LLaMA3-70B, Gemma2-27B) under in-context learning and fine-tuning configurations, using a benchmark (SimBench) and an LLM-as-a-judge (J-LLM) from their prior work. The headline empirical claim is that a fine-tuned GPT-4o-mini achieves an average document reference score near 70 and a success rate of approximately 85%, versus about 40% for the base model. The paper explicitly states in Section 4.2 that the SimBench test is in-distribution because the fine-tuning and in-context learning data are synthesized from the same public PyChrono sources as the benchmark. The manuscript also describes a 'Hacked SimBench' baseline but reports no results for it.

Significance. If the reported gains were shown to hold under rigorous, out-of-distribution evaluation, the framework would be a useful contribution to domain-specific code generation for physics simulation libraries. The paper describes a complete and reproducible-sounding pipeline, including a detailed data synthesis procedure in Appendix A, and it is honest in Section 4.2 about the in-distribution nature of the test. However, the central generalization claim is currently supported only by in-distribution scores from an unreleased LLM judge, with no execution-based metrics and no results for the proposed control baseline. The practical significance for the digital-twin generalization use case is therefore conditional on additional evidence that the reader cannot independently verify from the submitted manuscript.

major comments (4)

[Section 4.2] The paper admits that testing on SimBench is an in-distribution test because the fine-tuning and in-context learning datasets are synthesized from the same public PyChrono sources as SimBench. This admission directly undermines the abstract and conclusion claims that the framework generalizes across PyChrono tasks. The 'Hacked SimBench' baseline, which is the only described control for this overlap, is introduced in Section 4.2 but no results or analysis are presented anywhere in the manuscript, so it cannot substantiate the claim of superiority under identical data conditions. The authors should either provide out-of-distribution results (e.g., held-out PyChrono features, newer versions of the API, or tasks outside the benchmark distribution) or explicitly restrict their claims to in-distribution performance.
[Section 4.1 and Figures 4-5] Section 4.1 states that the numerical evaluation 'employ[s] all the aforementioned metrics,' including BLEU, CodeBLEU, pass@k, and compile@k, but Section 4.2 and Figures 4 and 5 report only the J-LLM document reference score and the J-LLM success rate. No execution-based or similarity-based metric results appear anywhere in the paper, despite the conclusion claiming improvements 'in metrics like BLEU, CodeBLEU, and pass@k.' This mismatch between the claimed and reported evaluation makes the empirical contribution incomplete and prevents verification of the core claim.
[Section 4.1 and Section 6] The headline 85% success rate rests entirely on the J-LLM judge, which is an LLM-as-a-judge introduced in the authors' prior work [100]. The judge implementation, the SimBench test prompts, the fine-tuning dataset, and any inter-annotator agreement or correlation analysis with human judgments are not provided in the manuscript. Section 6 itself concedes that comprehensive evaluation of LLMs is an open problem. Given that the judge compares generated code against reference code and may reward textual similarity, the reported fine-tuning gain could partly be an artifact of the judge favoring outputs that resemble the reference scripts seen during training. The authors should release the judge and test data, report agreement with human ratings, and ideally report a subset of execution-based pass@k results to support the claim.
[Abstract and Section 5] The abstract and conclusion generalize from the in-distribution SimBench numbers to broad claims about 'generalization across various PyChrono tasks' and 'substantial enhancements in simulation setup speed.' The paper presents no measurement of simulation setup speed, no out-of-distribution task evaluation, and no evidence that the generated code executes correctly. These claims exceed what the evidence in Section 4 can support and should be revised to match the scope of the reported evaluation.

minor comments (7)

[Section 1.3] The text contains a placeholder reference 'see Section ??' after the claim that LLM performance on Chrono-specific tasks is insufficient; this cross-reference should be completed.
[Throughout] The model name is inconsistent: the title uses 'ChronoLLM,' while the abstract and text use 'ChronoLlama' (and at least one instance of 'ChronoLLM'). Please standardize the naming.
[Section 2.2 and Section 4.2] The notation for the models is inconsistent: 'GPT-4O' and 'GPT-4O mini' appear in Section 2.2, while 'GPT-4o-mini' is used elsewhere, and the fine-tuned model is referred to as both 'gpt-40-mini-f9-t0.1' and 'gpt40mini_finetuned.json' in Figures 4 and 5. Please unify the notation and explain the fine-tuning identifier format.
[Section 3.3] The dataset files are described as 'pychrono_sft_sim.json' in the text but the example in the Simulation Generation subsection is titled 'pychrono_sft_robot_sim.json'; this is likely a typo and should be corrected.
[Section 3.2.1] The acronym is spelled 'LoRa' for Low-Rank Adaptation, but the standard spelling is 'LoRA'; please use 'LoRA' consistently throughout, including in Table 1.
[Section 4.2] The paper states that evaluation categories include multiple domains but Figure 3 is not referenced in the text and its caption does not explain how the categories relate to the test set; a citation and a brief description would improve clarity.
[Declarations] The manuscript states that 'All codes, data, and models used in this study will be open-sourced on GitHub. The link will be provided in the final version of the paper.' Since the review is based on the submitted version, the absence of the repository link prevents independent verification of the results; please provide the link or state that the artifacts are available upon request.

Circularity Check

3 steps flagged · score 6.0 of 10

The headline 85% success rate is an in-distribution score from the authors' own SimBench/J-LLM pipeline, so the central generalization claim is not independently established.

fitted input called prediction [Section 4.2 (Test Models, Baselines, and Assumptions)]
"Consequently, our fine-tuning and in-context learning datasets are synthesized from the same data sources, resulting in an inevitable overlap between the SimBench testing data and the training set. Therefore, testing on SimBench constitutes an in-distribution test"

The model is fine-tuned on data synthesized from the same public PyChrono sources that are the raw data of SimBench, and the paper explicitly concedes the overlap. The central numerical claim (gpt-40-mini-f9-t0.1 success rate ~85% vs ~40% for base GPT-4o-mini, Figures 4 and 5) is then measured on SimBench. That is a measurement of fit to the training distribution, not a prediction of generalization. The 'Hacked SimBench' baseline that would control for memorization is described but no results are reported, so the reported gain cannot be separated from training-set overlap.
self citation load bearing [Section 4.1 (Metrics for Evaluating Digital Twin Generation)]
"In our previous work [100], we introduced the J-LLM Judge, which utilizes reference code and API documentation to assess performance. Our findings indicate that the J-LLM Judge offers a more reliable evaluation metric compared to similarity-based methods like CodeBLEU and ROUGE-L Sum."

The entire evaluation instrument (SimBench and the J-LLM Judge) is imported from the authors' prior publication [100], and its reliability is asserted by the same group rather than demonstrated in this paper. All headline results in Figures 4 and 5 rest on this self-cited judge. The judge implementation, the SimBench test set, and inter-annotator agreement data are not released, and the promised execution-based metrics (pass@k, compile@k) are not reported in the results despite Section 4.1 saying 'we employ all the aforementioned metrics'. The conclusion citing 'higher scores in metrics like BLEU, CodeBLEU, and pass@k' therefore refers to metrics not shown, leaving the self-cited judge as the load-bearing evidence.

1 more flagged steps

self definitional [Appendix A, Figure 2 (J-LLM judge instructions)]
"Your task is to evaluate a simulation script by comparing it against a reference script generated by experts... Compare the provided code to the reference script. Deduct 15 points for each missing essential component (e.g., system initialization, body creation, visualization) that is present in the reference script."

The 'document reference score' is, by the rubric's own words, a measure of how closely the generated script matches a reference script: deductions are defined for components 'present in the reference script', API use is compared against the reference, and documentation quality is judged against the reference. The fine-tuning and continual-pretraining data are synthesized from the same PyChrono code and documentation sources that generate those reference scripts, and Section 4.2 admits the resulting overlap. A model trained to reproduce reference-derived code examples will, by construction, score highly on a judge whose rubric rewards matching the reference.

full rationale

The central claim that fine-tuning produces a large gain in PyChrono digital-twin generation is evaluated through a self-referential chain: the benchmark (SimBench) and judge (J-LLM) come from the authors' own prior work [100]; the judge's rubric explicitly rewards similarity to reference code; the fine-tuning data is synthesized from the same PyChrono sources as the benchmark; and Section 4.2 admits the test is in-distribution. The 'Hacked SimBench' control that would quantify memorization is never executed or reported. Section 4.1 promises execution-based metrics, but none appear in the results, and Section 6 concedes that LLM evaluation comprehensiveness is an open problem. These passages are weighed as explicit limitations: they show the reported 85% success rate is not an independent measure of generalization. The finding is not that the fine-tuned model is necessarily bad, but that the paper's derivation of its strongest claim reduces largely to an in-distribution, self-authored, reference-similarity-based evaluation. A score of 6 reflects partial circularity: the metric is partly defined in terms of the training target, yet the work still contains independent components such as the data pipeline description and the base-model comparisons.

Assumptions & free parameters 3 free parameters · 4 assumptions · 1 invented entities

The central claims rest on several quantities chosen by the authors: the exact fine-tuning configurations, the composition of the synthesized training data, and the rubric parameters of the J-LLM judge from their prior work. None of these are fully specified or shipped in the preprint. The Hacked SimBench baseline is an invented evaluation construct with no reported output. There are no new physical entities or mathematical axioms; the assumptions are all domain-level judgments about evaluation validity and data representativeness.

free parameters (3)

Fine-tuning hyperparameters = Not reported in the preprint
Section 2.3.1 and Section 3.2.1 describe the training stages and LoRA mechanism (W0 + BA with rank r) but do not give concrete values for r, learning rate, warmup duration, or epochs, which are required to reproduce the reported gains.
SFT dataset composition weights = Not reported in the preprint
Section 3.3 describes four JSON files (sim, COT, NL2API, API2NL) and a data synthesis pipeline with LLM-based generation, but does not report the number of examples per category or the deduplication thresholds, which affect what the model learns.
J-LLM judge scoring rubric parameters = Rubric weights defined in Figure 2 (40 completeness, 30 correctness, 10 quality, 10 efficiency, 5 error handling, 5…
The evaluation outcome is determined by a rubric whose point deductions are chosen by hand (15 points per missing component, 10 for incorrect configuration, and so on). The scale is an arbitrary design choice of the authors' prior work [100], and the reported scores inherit its subjectivity.

assumptions (4)

domain assumption The J-LLM judge provides a reliable evaluation of PyChrono code quality.
The paper relies on the J-LLM judge from prior work [100] for all headline scores. The judge is itself an LLM, and no evidence is presented in this preprint for its validity on the specific test prompts.
domain assumption Continued pretraining with only a warmup strategy sufficiently mitigates catastrophic forgetting.
Section 2.3 argues that warmup is the only feasible mitigation because original training data is unavailable, but provides no measurements of general capability retention or forgetting on standard benchmarks after continued pretraining.
domain assumption The LDA topic analysis of the Project Chrono Google forum accurately reflects user challenges.
Section 1.3 uses LDA on subject lines to identify three topics and reports percentages 38%, 37%, and 20%, but gives no validation of the topic model, no number of topics tested, and no inter-annotator agreement.
domain assumption SimBench test prompts are representative of real PyChrono usage.
The benchmark comes from the authors' prior work [100]. The paper states the test is in-distribution and does not characterize how well SimBench covers the 18,320 APIs mentioned in Section 1.3.

invented entities (1)

Hacked SimBench baseline
purpose: A baseline trained directly on exact SimBench test data to assess how much of the fine-tuning gain comes from memorizing test prompts.
Described in Section 4.2 as a fairness baseline but no results, training details, or model outputs are reported, so it provides no falsifiable or checkable prediction.

how reviews work

0 comments

Cite this review

Pith. "Pith review of ChronoLLM: A Framework for Customizing Large Language Model for Digital Twins generalization based on PyChrono." pith.science (2026). https://pith.science/paper/BE32FXPJ

@misc{pith2026250104062,
  author       = {Pith},
  title        = {Pith review of: ChronoLLM: A Framework for Customizing Large Language Model for Digital Twins generalization based on PyChrono},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BE32FXPJ}},
  note         = {Machine review of arXiv:2501.04062}
}

read the original abstract

Recently, the integration of advanced simulation technologies with artificial intelligence (AI) is revolutionizing science and engineering research. ChronoLlama introduces a novel framework that customizes the open-source LLMs, specifically for code generation, paired with PyChrono for multi-physics simulations. This integration aims to automate and improve the creation of simulation scripts, thus enhancing model accuracy and efficiency. This combination harnesses the speed of AI-driven code generation with the reliability of physics-based simulations, providing a powerful tool for researchers and engineers. Empirical results indicate substantial enhancements in simulation setup speed, accuracy of the generated codes, and overall computational efficiency. ChronoLlama not only expedites the development and testing of multibody systems but also spearheads a scalable, AI-enhanced approach to managing intricate mechanical simulations. This pioneering integration of cutting-edge AI with traditional simulation platforms represents a significant leap forward in automating and optimizing design processes in engineering applications.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

100 extracted references · 45 canonical work pages

[100]

https://arxiv.org/abs/2408.11987

Wang, J., Zhang, H., Unjhawala, H.M., Negrut, P., Wang, S., Slaton, K., Ser- ban, R., Wu, J.-L., Negrut, D.: SimBench: A Rule-Based Multi-Turn Interaction Benchmark for Evaluating an LLM’s Ability to Generate Digital Twins (2024). https://arxiv.org/abs/2408.11987

work page arXiv 2024
[1]

In: High Performance Computing in Science and Engineering: Second International Conference, HPCSE 2015, Sol´ aˇ n, Czech Republic, May 25-28, 2015, Revised Selected Papers 2, pp

Tasora, A., Serban, R., Mazhar, H., Pazouki, A., Melanz, D., Fleischmann, J., Taylor, M., Sugiyama, H., Negrut, D.: Chrono: An open source multi-physics dynamics engine. In: High Performance Computing in Science and Engineering: Second International Conference, HPCSE 2015, Sol´ aˇ n, Czech Republic, May 25-28, 2015, Revised Selected Papers 2, pp. 19–49 (2...

2016
[2]

In: Advances in Nonlinear Dynamics, pp

Benatti, S., Young, A., Elmquist, A., Taves, J., Serban, R., Mangoni, D., Tasora, A., Negrut, D.: Pychrono and Gym-Chrono: A deep reinforcement learning framework leveraging multibody dynamics to control autonomous vehicles and robots. In: Advances in Nonlinear Dynamics, pp. 573–584. Springer, ??? (2022)

2022
[3]

Skorupa, T., Boyle, S.P., Mange, J., Kedziorek, D., Lucas, C., Goodin, C., Priddy, J.D., Walker, K., Puhr, M., Mazzola, M.S.: The high performance 21 ' & $ % You a r e a PyChrono e x p e r t t a s k e d w i t h e v a l u a t i n g a s i m u l a t i o n s c r i p t by c o m p a r i n g i t a g a i n s t a r e f e r e n c e s c r i p t g e n e r a t e d by ...

2017
[4]

Balling, O., McCullough, M., Hodges, H., Pulley, R., Jayakumar, P.: Tracked and wheeled vehicle benchmark – a demonstration of simulation maturity for next generation NATO Reference Mobility Model. In: Ground Vehicle Systems 22 ' & $ % Your t a s k i s t o g e n e r a t e h i g h−q u a l i t y , c o n t e x t−r i c h q u e s t i o n−and −a n s w e r p a i...

2018
[5]

CEAS Space Journal 7(3), 335–346 (2015)

Toso, M., Pennestr ` ı, E., Rossi, V.: ESA multibody simulator for spacecrafts’ ascent and landing in a microgravity environment. CEAS Space Journal 7(3), 335–346 (2015)

2015
[6]

Multibody System Dynamics39(1-2), 3–20 (2017)

Ferrari, F., Tasora, A., Masarati, P., Lavagna, M.: N-body gravitational and contact dynamics for asteroid aggregation. Multibody System Dynamics39(1-2), 3–20 (2017)

2017
[7]

In: AIAA Scitech 2020 Forum, p

Narayanan, S., Barnhart, D., Rogers, R., Ruffatto, D., Schaler, E., Van Crey, N., Dean, G., Bhanji, A., Bernstein, S., Singh, A., Almeida, O., Sampathkumar, S., Maness, E., Rughani, R.: REACCH-reactive electro-adhesive capture cloth mechanism to enable safe grapple of cooperative/non-cooperative space debris. In: AIAA Scitech 2020 Forum, p. 2134 (2020)

2020

Show all 100 references

[8]

Computers & Graphics 116, 23 ' & $ % You ’ r e an e x p e r t i n t h e PyChrono s i m u l a t o r

Li, M., Zhu, L., Yan, Y., Zhao, Z., Song, A.: Computational design of planet regolith sampler based on bayesian optimization. Computers & Graphics 116, 23 ' & $ % You ’ r e an e x p e r t i n t h e PyChrono s i m u l a t o r . Your t a s k i s t o g e n e r a t e q u e s t i o...

2023
[9]

In: 2017 International Joint Conference on Neural Networks (IJCNN), pp

Cook, D., Vardy, A.: Towards real-time robot simulation on uneven terrain using neural networks. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1688–1695 (2017). IEEE

2017
[10]

In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp

McCormac, J., Handa, A., Leutenegger, S., Davison, A.J.: Scenenet RGB-D: Can 5m synthetic images beat generic imagenet pre-training on indoor segmen- tation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2678–2687 (2017)

2017
[11]

arXiv preprint arXiv:1801.08839 (2018)

Xu, W., Li, Y., Lu, C.: Generating instance segmentation annotation by geometry-guided GAN. arXiv preprint arXiv:1801.08839 (2018)

2018 arXiv
[12]

In: Com- putational Science and Computational Intelligence (CSCI), 2016 International Conference On, pp

Mange, J., Pace, S., Hundich, A., Sawka, P.: Distributed simulation of the effects of autonomous behavior on battery consumption in ground vehicles. In: Com- putational Science and Computational Intelligence (CSCI), 2016 International Conference On, pp. 633–636 (2016). IEEE

2016
[13]

In: Military Technologies (ICMT), 2017 International Conference On, pp

Goodin, C., Carrillo, J.T., McInnis, D.P., Cummins, C.L., Durst, P.J., Gates, B.Q., Newell, B.S.: Unmanned ground vehicle simulation with the virtual autonomous navigation environment. In: Military Technologies (ICMT), 2017 International Conference On, pp. 160–165 (2017). IEEE

2017
[14]

In: Ground Vehicle Systems Engineering and Technology Symposium (2017)

Haraus, N., Serban, R., Fleischmann, J.: Performance analysis of constant speed local obstacle avoidance controller using an mpc algorithm on granular terrain. In: Ground Vehicle Systems Engineering and Technology Symposium (2017)

2017
[15]

IEEE Transactions on Robotics (2023) 24

Shen, C., Yu, S., Epureanu, B.I., Ersal, T.: An efficient global trajectory planner for highly dynamical nonholonomic autonomous vehicles on 3d terrains. IEEE Transactions on Robotics (2023) 24

2023
[16]

Agriculture 14(3), 499 (2024)

Szabo, A., Doba, D.K., Aradi, S., Kiss, P.: Model development for off-road traction control: A linear parameter-varying approach. Agriculture 14(3), 499 (2024)

2024
[17]

Journal of Marine Science and Engineering 12(5), 701 (2024)

Liang, G., Xin, Z., Ding, Q., Liu, S., Ren, L.: Numerical study on the swimming and energy self-sufficiency of multi-joint robotic fish. Journal of Marine Science and Engineering 12(5), 701 (2024)

2024
[18]

Vibroengineering PROCEDIA 18, 123–127 (2018)

Jon´ ak, M., Hlouˇ sek, D., ˇReh´ ak, K.: Experimental verification of the power required for the movement of the tracked vehicle. Vibroengineering PROCEDIA 18, 123–127 (2018)

2018
[19]

In: 11th International SPHERIC Workshop – Munich Germany, June 14-16, 2016 (2016)

Brito, M., Canelas, R., Ferreira, R., Garc ´ ıa Feal, O., Dom ´ ınguez, J.M., Crespo, A., Neves, M.: Coupling between DualSPHysics and Chrono-Engine: towards large scale HPC multiphysics simulations. In: 11th International SPHERIC Workshop – Munich Germany, June 14-16, 2016 (2016)

2016
[20]

KSCE Journal of Civil Engineering, 1–10 (2019)

Wang, B., Li, Q., Liu, T., Peng, W.: Analysis of cable under dynamic contact and large deformation. KSCE Journal of Civil Engineering, 1–10 (2019)

2019
[21]

In: Fluid Power Systems Technology, vol

Liermann, M., Feller, C., Lindinger, F., Runge, D.: Immersive 3D vehicle sim- ulation for hardware-in-the-loop testing of mobile hydraulic controls. In: Fluid Power Systems Technology, vol. 59339, pp. 001–01052 (2019). American Society of Mechanical Engineers

2019
[22]

In: ASME Turbo Expo 2018: Turbomachinery Technical Conference and Exposition, pp

Perez-Becker, S., Saverin, J., Marten, D., Alber, J., Pechlivanoglou, G., Paschereit, C.: Investigations on the fatigue load reduction potential of advanced control strategies for multi-MW wind turbines using a free vortex wake model. In: ASME Turbo Expo 2018: Turbomachinery T...

2018
[23]

Journal of Engineering for Gas Turbines and Power 141(4), 041014 (2019)

Marten, D., Lennie, M., Pechlivanoglou, G., Paschereit, C.O., Bianchini, A., Ferrara, G., Ferrari, L.: Benchmark of a novel aero-elastic simulation code for small scale V A WT analysis. Journal of Engineering for Gas Turbines and Power 141(4), 041014 (2019)

2019
[24]

In: Proceedings of the European Wave and Tidal Energy Conference, vol

Ogden, D., Quinton, Z., Lataillade, T., Pallud, M.: Hydrochrono: An open-source hydrodynamics package for project chrono. In: Proceedings of the European Wave and Tidal Energy Conference, vol. 15 (2023). https://doi.org/10.36688/ ewtec-2023-473 . https://www.osti.gov/biblio/2005593

2023
[25]

In: SPE Latin American and Caribbean Petroleum Engineering Conference (2020)

Losoya, E.Z., Gildin, E., Noynaert, S.F., Medina-Zetina, Z., Crain, T., Stewart, S., Hicks, J.: An open-source enabled drilling simulation consortium for academic and commercial applications. In: SPE Latin American and Caribbean Petroleum Engineering Conference (2020). Society...

2020
[26]

https://groups.google.com/forum/#! forum/projectchrono

Project Chrono: Chrono User Forum. https://groups.google.com/forum/#! forum/projectchrono. Accessed: 2023-09-11 (2023)

2023
[27]

https://anaconda.org/projectchrono/pychrono

Project Chrono Development Team: PyChrono: A Python wrapper for the Chrono multi-physics library. https://anaconda.org/projectchrono/pychrono. Accessed: 2023-01-14

2023
[28]

https://hub.docker.com/ r/uwsbel/projectchrono

Project Chrono Team: Project Chrono Docker Images. https://hub.docker.com/ r/uwsbel/projectchrono. Accessed: 2023-04-20

2023
[29]

https://github.com/projectchrono/ chrono

Project Chrono Team: Chrono: An Open Source Framework for the Physics- Based Simulation of Dynamic Systems. https://github.com/projectchrono/ chrono. Accessed: 2022-01-10 (2020)

2020
[30]

arXiv preprint arXiv:2001.08361 (2020)

Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., Amodei, D.: Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020)

2020 arXiv
[31]

arXiv preprint arXiv:2203.15556 (2022)

Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D.d.L., Hendricks, L.A., Welbl, J., Clark, A., et al.: Training compute- optimal large language models. arXiv preprint arXiv:2203.15556 (2022)

2022 arXiv
[32]

arXiv preprint arXiv:2206.07682 (2022)

Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al.: Emergent abilities of large language models. arXiv preprint arXiv:2206.07682 (2022)

2022 arXiv
[33]

Schaeffer, R., Miranda, B., Koyejo, S.: Are emergent abilities of large language models a mirage? Advances in Neural Information Processing Systems36 (2024)

2024
[34]

OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Ale- man, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., Avila, R., Babuschkin, I., Balaji, S., Balcom, V., Baltescu, P., Bao, H., Bavarian, M., Bel- gum, J., Bello, I., Berdine, J., Bernadett-Sh...

2024
[35]

https://arxiv.org/abs/2005.14165

Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Nee- lakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Win- ter, C., Hesse, C., Chen, M., Sigler, E.,...

2020 arXiv
[36]

arXiv preprint arXiv:2312.11805 (2023)

Team, G., Anil, R., Borgeaud, S., Wu, Y., Alayrac, J.-B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A.M., Hauth, A., et al.: Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023)

2023 arXiv
[37]

https: //www-cdn.anthropic.com/bd2a28d2535bfb0494cc8e2a3bf135d2e7523226/ Model-Card-Claude-2.pdf

Anthropic: Model Card and Evaluations for Claude Models (2023). https: //www-cdn.anthropic.com/bd2a28d2535bfb0494cc8e2a3bf135d2e7523226/ Model-Card-Claude-2.pdf

2023
[38]

ACM computing surveys (csur) 53(3), 1–34 (2020)

Wang, Y., Yao, Q., Kwok, J.T., Ni, L.M.: Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur) 53(3), 1–34 (2020)

2020
[39]

Advances in neural information processing systems 35, 24824–24837 (2022)

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, 27 D., et al.: Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35, 24824–24837 (2022)

2022
[40]

arXiv preprint arXiv:2112.00114 (2021)

Nye, M., Andreassen, A.J., Gur-Ari, G., Michalewski, H., Austin, J., Bieber, D., Dohan, D., Lewkowycz, A., Bosma, M., Luan, D., et al.: Show your work: Scratchpads for intermediate computation with language models. arXiv preprint arXiv:2112.00114 (2021)

2021 arXiv
[41]

arXiv preprint arXiv:2109.04332 (2021)

Gu, Y., Han, X., Liu, Z., Huang, M.: Ppt: Pre-trained prompt tuning for few-shot learning. arXiv preprint arXiv:2109.04332 (2021)

2021 arXiv
[42]

arXiv preprint arXiv:2110.07602 (2021)

Liu, X., Ji, K., Fu, Y., Tam, W.L., Du, Z., Yang, Z., Tang, J.: P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks. arXiv preprint arXiv:2110.07602 (2021)

2021 arXiv
[43]

arXiv preprint arXiv:2101.00190 (2021)

Li, X.L., Liang, P.: Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190 (2021)

2021 arXiv
[44]

In: The 2023 Conference on Empirical Methods in Natural Language Processing (2023)

Hu, Z., Wang, L., Lan, Y., Xu, W., Lim, E.-P., Bing, L., Xu, X., Poria, S., Lee, R.K.-W.: Llm-adapters: An adapter family for parameter-efficient fine-tuning of large language models. In: The 2023 Conference on Empirical Methods in Natural Language Processing (2023)

2023
[45]

In: International Conference on Learning Representations (2022)

Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W.: LoRA: Low-rank adaptation of large language mod- els. In: International Conference on Learning Representations (2022). https://openreview.net/forum?id=nZeVKeeFYf9

2022
[46]

arXiv preprint arXiv:2204.05862 (2022)

Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al.: Training a helpful and harm- less assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862 (2022)

2022 arXiv
[47]

arXiv preprint arXiv:2401.16445 (2024)

Chen, L., Bhattacharjee, A., Ahmed, N., Hasabnis, N., Oren, G., Vo, V., Jan- nesari, A.: Ompgpt: A generative pre-trained transformer model for openmp. arXiv preprint arXiv:2401.16445 (2024)

2024 arXiv
[48]

arXiv preprint arXiv:2312.13322 (2023)

Kadosh, T., Hasabnis, N., Vo, V.A., Schneider, N., Krien, N., Capota, M., Wasay, A., Ahmed, N., Willke, T., Tamir, G., et al.: Domain-specific code lan- guage models: Unraveling the potential for hpc codes and tasks. arXiv preprint arXiv:2312.13322 (2023)

2023 arXiv
[49]

https://github.com/meta-llama/ llama3/blob/main/MODEL CARD.md

AI@Meta: Llama 3 Model Card (2024). https://github.com/meta-llama/ llama3/blob/main/MODEL CARD.md

2024
[50]

Multibody System Dynamics, 1–23 (2024) 28

Gerstmayr, J., Manzl, P., Pieber, M.: Multibody models generated from natural language. Multibody System Dynamics, 1–23 (2024) 28

2024
[51]

Multibody System Dynamics, 1–29 (2023)

Gerstmayr, J.: Exudyn–a c++-based python package for flexible multibody systems. Multibody System Dynamics, 1–29 (2023)

2023
[52]

Journal of Machine Learning for Modeling and Computing 4(4) (2023)

Kumar, V., Gleyzer, L., Kahana, A., Shukla, K., Karniadakis, G.E.: Mycrunchgpt: A llm assisted framework for scientific machine learning. Journal of Machine Learning for Modeling and Computing 4(4) (2023)

2023
[53]

Journal of Computational Physics 378, 686–707 (2019) https://doi.org/10.1016/j.jcp.2018.10.045

Raissi, M., Perdikaris, P., Karniadakis, G.E.: Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics 378, 686–707 (2019) https://doi.org/10.1016/...

2019 doi
[54]

Computers and Geotechnics 169, 106237 (2024) https://doi.org/10.1016/j.compgeo.2024

Kim, D., Kim, T., Kim, Y., Byun, Y.-H., Yun, T.S.: A chatgpt-matlab framework for numerical modeling in geotechnical engineering applications. Computers and Geotechnics 169, 106237 (2024) https://doi.org/10.1016/j.compgeo.2024. 106237

2024 doi
[55]

IEEE Transactions on Neural Networks and Learning Systems (2023)

Taylor, N., Zhang, Y., Joyce, D.W., Gao, Z., Kormilitzin, A., Nevado-Holgado, A.: Clinical prompt learning with frozen language models. IEEE Transactions on Neural Networks and Learning Systems (2023)

2023
[56]

Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozi` ere, B., Goyal, N., Hambro, E., Azhar, F., Rodriguez, A., Joulin, A., Grave, E., Lample, G.: LLaMA: Open and Efficient Foundation Language Models (2023)

2023
[57]

Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bash- lykov, N., Batra, S., Bhargava, P., Bhosale, S., Bikel, D., Blecher, L., Ferrer, C.C., Chen, M., Cucurull, G., Esiobu, D., Fernandes, J., Fu, J., Fu, W., Fuller, B., Gao, C., Goswami, V., Goyal, N...

2023
[58]

arXiv preprint arXiv:2308.12950 (2023)

Roziere, B., Gehring, J., Gloeckle, F., Sootla, S., Gat, I., Tan, X.E., Adi, Y., Liu, J., Remez, T., Rapin, J., et al.: Code llama: Open foundation models for code. arXiv preprint arXiv:2308.12950 (2023)

2023 arXiv
[59]

Jiang, A.Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D.S., Casas, D., Bressand, F., Lengyel, G., Lample, G., Saulnier, L., Lavaud, L.R., Lachaux, M.-A., Stock, P., Scao, T.L., Lavril, T., Wang, T., Lacroix, T., Sayed, W.E.: Mistral 7B (2023) 29

2023
[60]

arXiv preprint arXiv:2403.08295 (2024)

Team, G., Mesnard, T., Hardin, C., Dadashi, R., Bhupatiraju, S., Pathak, S., Sifre, L., Rivi` ere, M., Kale, M.S., Love, J., et al.: Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295 (2024)

2024 arXiv
[61]

https://goo.gle/codegemma

Hartman, A.J., Hu, A., Choquette-Choo, C., Zhao, H., Fine, J., Hui, J., Shen, J., Kelley, J., Howland, J., Bansal, K., Vilnis, L., Wirth, M., Nguyen, N., Michel, P., Choy, P., Joshi, P., Kumar, R., Hashmi, S., Agrawal, S., Zuo, S., Warkentin, T., Gong, Z.e.a.: CodeGemma: Open ...

2024
[62]

Abdin, M., Jacobs, S.A., Awan, A.A., Aneja, J., Awadallah, A., Awadalla, H., Bach, N., Bahree, A., Bakhtiari, A., Bao, J., Behl, H., Benhaim, A., Bilenko, M., Bjorck, J., Bubeck, S., Cai, Q., Cai, M., Mendes, C.C.T., Chen, W., Chaudhary, V., Chen, D., Chen, D., Chen, Y.-C., Ch...

2024
[63]

arXiv preprint arXiv:2310.02031 (2023)

Bi, Z., Zhang, N., Xue, Y., Ou, Y., Ji, D., Zheng, G., Chen, H.: Oceangpt: A large language model for ocean science tasks. arXiv preprint arXiv:2310.02031 (2023)

2023 arXiv
[64]

Acikgoz, E.C., ˙Ince, O.B., Bench, R., Boz, A.A., Kesen, Erdem, A., Erdem, E.: Hippocrates: An Open-Source Framework for Advancing Large Language Models in Healthcare (2024)

2024
[65]

arXiv preprint arXiv:2308.15366 (2023)

Gu, Z., Zhu, B., Zhu, G., Chen, Y., Tang, M., Wang, J.: Anomalygpt: Detect- ing industrial anomalies using large vision-language models. arXiv preprint arXiv:2308.15366 (2023)

2023 arXiv
[66]

arXiv preprint arXiv:2402.01738 (2024)

Aragon´ es-Soria, Y., Oriol, M.: C4q: A chatbot for quantum. arXiv preprint arXiv:2402.01738 (2024)

2024 arXiv
[67]

https://arxiv

Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2019). https://arxiv. org/abs/1810.04805 30

2019 arXiv
[68]

Schneider, N., Hasabnis, N., Vo, V.A., Kadosh, T., Krien, N., Capot˘ a, M., Tamir, G., Willke, T., Ahmed, N., Pinter, Y., Mattson, T., Oren, G.: MPIrigen: MPI Code Generation through Domain-Specific Language Models (2024)

2024
[69]

Zhao, J., Wang, T., Abid, W., Angus, G., Garg, A., Kinnison, J., Sherstinsky, A., Molino, P., Addair, T., Rishi, D.: LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report (2024)

2024
[70]

Advances in Neural Information Processing Systems 35, 1950–1965 (2022)

Liu, H., Tam, D., Muqeeth, M., Mohta, J., Huang, T., Bansal, M., Raffel, C.A.: Few-shot parameter-efficient fine-tuning is better and cheaper than in-context learning. Advances in Neural Information Processing Systems 35, 1950–1965 (2022)

2022
[71]

in-context learning: A fair comparison and evaluation

Mosbach, M., Pimentel, T., Ravfogel, S., Klakow, D., Elazar, Y.: Few-shot fine- tuning vs. in-context learning: A fair comparison and evaluation. arXiv preprint arXiv:2305.16938 (2023)

2023 arXiv
[72]

In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, pp

Sievert, C., Shirley, K.: Ldavis: A method for visualizing and interpreting topics. In: Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, pp. 63–70 (2014)

2014
[73]

http://api

Project Chrono: Chrono Documentation and API Reference. http://api. projectchrono.org/. Accessed: 2021-11-24

2021
[74]

arXiv preprint arXiv:2401.04088 (2024)

Jiang, A.Q., Sablayrolles, A., Roux, A., Mensch, A., Savary, B., Bamford, C., Chaplot, D.S., Casas, D.d.l., Hanna, E.B., Bressand, F., et al.: Mixtral of experts. arXiv preprint arXiv:2401.04088 (2024)

2024 arXiv
[75]

arXiv preprint arXiv:2107.03374 (2021)

Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H.P.d.O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al.: Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)

2021 arXiv
[76]

arXiv preprint arXiv:2009.03300 (2020)

Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., Stein- hardt, J.: Measuring massive multitask language understanding. arXiv preprint arXiv:2009.03300 (2020)

2020 arXiv
[77]

Li, R., Allal, L.B., Zi, Y., Muennighoff, N., Kocetkov, D., Mou, C., Marone, M., Akiki, C., Li, J., Chim, J., et al.: Starcoder: may the source be with you! arXiv preprint arXiv:2305.06161 (2023)

2023 arXiv
[78]

arXiv preprint arXiv:2403.15796 (2024)

Du, Z., Zeng, A., Dong, Y., Tang, J.: Understanding emergent abilities of language models from the loss perspective. arXiv preprint arXiv:2403.15796 (2024)

2024 arXiv
[79]

Trends in cognitive sciences 3(4), 128–135 (1999) 31

French, R.M.: Catastrophic forgetting in connectionist networks. Trends in cognitive sciences 3(4), 128–135 (1999) 31

1999
[80]

In: International Conference on Learning Representations 2022 (2022)

Wu, T., Caccia, M., Li, Z., Li, Y.F., Qi, G., Haffari, G.: Pretrained language model in continual learning: A comparative study. In: International Conference on Learning Representations 2022 (2022). OpenReview

2022
[81]

Gupta, K., Th´ erien, B., Ibrahim, A., Richter, M.L., Anthony, Q., Belilovsky, E., Rish, I., Lesort, T.: Continual pre-training of large language models: How to (re) warm your model? arXiv preprint arXiv:2308.04014 (2023)

2023 arXiv
[82]

Proceedings of the national academy of sciences 114(13), 3521–3526 (2017)

Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al.: Over- coming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences 114(13), 3521–3526 (2017)

2017
[83]

Advances in neural information processing systems 30 (2017)

Lopez-Paz, D., Ranzato, M.: Gradient episodic memory for continual learning. Advances in neural information processing systems 30 (2017)

2017
[84]

arXiv preprint arXiv:2305.06599 (2023)

Li, J., Li, G., Li, Y., Jin, Z.: Structured chain-of-thought prompting for code generation. arXiv preprint arXiv:2305.06599 (2023)

2023 arXiv
[85]

arXiv preprint arXiv:2110.04366 (2021)

He, J., Zhou, C., Ma, X., Berg-Kirkpatrick, T., Neubig, G.: Towards a unified view of parameter-efficient transfer learning. arXiv preprint arXiv:2110.04366 (2021)

2021 arXiv
[86]

In: The Twelfth International Conference on Learning Representa- tions (2023)

Zhang, R., Han, J., Liu, C., Zhou, A., Lu, P., Qiao, Y., Li, H., Gao, P.: Llama- adapter: Efficient fine-tuning of large language models with zero-initialized attention. In: The Twelfth International Conference on Learning Representa- tions (2023)

2023
[87]

arXiv preprint arXiv:2104.08691 (2021)

Lester, B., Al-Rfou, R., Constant, N.: The power of scale for parameter-efficient prompt tuning. arXiv preprint arXiv:2104.08691 (2021)

2021 arXiv
[88]

In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp

Zaken, E.B., Goldberg, Y., Ravfogel, S.: Bitfit: Simple parameter-efficient fine- tuning for transformer-based masked language-models. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 1–9 (2022)

2022
[89]

arXiv preprint arXiv:2402.12354 (2024)

Hayou, S., Ghosh, N., Yu, B.: Lora+: Efficient low rank adaptation of large models. arXiv preprint arXiv:2402.12354 (2024)

2024 arXiv
[90]

Advances in Neural Information Processing Systems 36 (2024)

Dettmers, T., Pagnoni, A., Holtzman, A., Zettlemoyer, L.: Qlora: Efficient fine- tuning of quantized llms. Advances in Neural Information Processing Systems 36 (2024)

2024
[91]

Zhao, J., Zhang, Z., Chen, B., Wang, Z., Anandkumar, A., Tian, Y.: GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection (2024)

2024
[92]

ACM Transactions on Intelligent Systems and Technology 15(3), 1–45 (2024)

Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., 32 Wang, C., Wang, Y., et al.: A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology 15(3), 1–45 (2024)

2024
[94]

In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp

Papineni, K., Roukos, S., Ward, T., Zhu, W.-J.: Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2002)

2002
[95]

Evtikhiev, M., Bogomolov, E., Sokolov, Y., Bryksin, T.: Out of the bleu: How should we assess quality of the code generation models? Journal of Systems and Software 203, 111741 (2023) https://doi.org/10.1016/j.jss.2023.111741

2023
[96]

arXiv preprint arXiv:1803.01937 (2018)

Ganesan, K.: Rouge 2.0: Updated and improved measures for evaluation of summarization tasks. arXiv preprint arXiv:1803.01937 (2018)

2018 arXiv
[97]

In: Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming, pp

Xu, F.F., Alon, U., Neubig, G., Hellendoorn, V.J.: A systematic evaluation of large language models of code. In: Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming, pp. 1–10 (2022)

2022
[98]

Advances in Neural Information Processing Systems 36 (2024)

Liu, J., Xia, C.S., Wang, Y., Zhang, L.: Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. Advances in Neural Information Processing Systems 36 (2024)

2024
[99]

https://arxiv.org/abs/ 2306.05685

Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E.P., Zhang, H., Gonzalez, J.E., Stoica, I.: Judging LLM- as-a-Judge with MT-Bench and Chatbot Arena (2023). https://arxiv.org/abs/ 2306.05685

2023 arXiv
[101]

Yao, Y., Xu, X., Liu, Y.: Large Language Model Unlearning (2024). https:// arxiv.org/abs/2310.10683 33 ' & $ % Your t a s k i s t o g e n e r a t e q u e s t i o n−and −a n s w e r p a i r s f o r a g i v e n PyChrono markdown f i l e , f o c u s i n g on∗∗ d e b u g g i n g t...

2024 arXiv

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.

[1] [100]

https://arxiv.org/abs/2408.11987

Wang, J., Zhang, H., Unjhawala, H.M., Negrut, P., Wang, S., Slaton, K., Ser- ban, R., Wu, J.-L., Negrut, D.: SimBench: A Rule-Based Multi-Turn Interaction Benchmark for Evaluating an LLM’s Ability to Generate Digital Twins (2024). https://arxiv.org/abs/2408.11987

work page arXiv 2024

[2] [1]

In: High Performance Computing in Science and Engineering: Second International Conference, HPCSE 2015, Sol´ aˇ n, Czech Republic, May 25-28, 2015, Revised Selected Papers 2, pp

Tasora, A., Serban, R., Mazhar, H., Pazouki, A., Melanz, D., Fleischmann, J., Taylor, M., Sugiyama, H., Negrut, D.: Chrono: An open source multi-physics dynamics engine. In: High Performance Computing in Science and Engineering: Second International Conference, HPCSE 2015, Sol´ aˇ n, Czech Republic, May 25-28, 2015, Revised Selected Papers 2, pp. 19–49 (2...

2016

[3] [2]

In: Advances in Nonlinear Dynamics, pp

Benatti, S., Young, A., Elmquist, A., Taves, J., Serban, R., Mangoni, D., Tasora, A., Negrut, D.: Pychrono and Gym-Chrono: A deep reinforcement learning framework leveraging multibody dynamics to control autonomous vehicles and robots. In: Advances in Nonlinear Dynamics, pp. 573–584. Springer, ??? (2022)

2022

[4] [3]

Skorupa, T., Boyle, S.P., Mange, J., Kedziorek, D., Lucas, C., Goodin, C., Priddy, J.D., Walker, K., Puhr, M., Mazzola, M.S.: The high performance 21 ' & $ % You a r e a PyChrono e x p e r t t a s k e d w i t h e v a l u a t i n g a s i m u l a t i o n s c r i p t by c o m p a r i n g i t a g a i n s t a r e f e r e n c e s c r i p t g e n e r a t e d by ...

2017

[5] [4]

Balling, O., McCullough, M., Hodges, H., Pulley, R., Jayakumar, P.: Tracked and wheeled vehicle benchmark – a demonstration of simulation maturity for next generation NATO Reference Mobility Model. In: Ground Vehicle Systems 22 ' & $ % Your t a s k i s t o g e n e r a t e h i g h−q u a l i t y , c o n t e x t−r i c h q u e s t i o n−and −a n s w e r p a i...

2018

[6] [5]

CEAS Space Journal 7(3), 335–346 (2015)

Toso, M., Pennestr ` ı, E., Rossi, V.: ESA multibody simulator for spacecrafts’ ascent and landing in a microgravity environment. CEAS Space Journal 7(3), 335–346 (2015)

2015

[7] [6]

Multibody System Dynamics39(1-2), 3–20 (2017)

Ferrari, F., Tasora, A., Masarati, P., Lavagna, M.: N-body gravitational and contact dynamics for asteroid aggregation. Multibody System Dynamics39(1-2), 3–20 (2017)

2017

[8] [7]

In: AIAA Scitech 2020 Forum, p

Narayanan, S., Barnhart, D., Rogers, R., Ruffatto, D., Schaler, E., Van Crey, N., Dean, G., Bhanji, A., Bernstein, S., Singh, A., Almeida, O., Sampathkumar, S., Maness, E., Rughani, R.: REACCH-reactive electro-adhesive capture cloth mechanism to enable safe grapple of cooperative/non-cooperative space debris. In: AIAA Scitech 2020 Forum, p. 2134 (2020)

2020