Pith. sign in

Paper Citation Record · LEDGER

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models

As of 16 August 2026, this Paper Citation Record lists 45 of 45 outbound references and 2 inbound Pith citation observations for arXiv:2507.05565.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.05565 v1

Coverage vector

measured 45 of 45 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T19:29:07.243886Z

measured 47 of 47 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-27T19:17:17.920263Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T22:07:25.966002Z

Reference resolution

45 of 45 outbound references displayed

  • verified exact0
  • verified fuzzy44
  • unresolved1
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 4ec3922e-f744-440d-a4a3-71977f79a7cd · outbound

This paper cites In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 1490–1498.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 1490–1498

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:17.873064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:01.726553Z digest=sha256:dcf6c881da1914657653f352eab68603b68690b18a4eea5135e9d4adc47fd650

Observation 8a6f5796-8fb6-4161-86af-4d2b9b39e010 · outbound

This paper cites In: Proceedings of the 33rd international conference on software engineering, pp 1–10.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the 33rd international conference on software engineering, pp 1–10

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:17.690532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:01.851632Z digest=sha256:83d22e32b83e134469114a0eae029e7fc01184bc076630f55e7a5d9d01f9093b

Observation 8b5e48c9-a667-45b5-bca7-97a6974b282f · outbound

This paper cites In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp 1264–1274.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp 1264–1274

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:17.513312Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:01.995731Z digest=sha256:af3c698679e3301ddb8c32946210c6f59d3dd7da86a0a5006ea4d3309d7b0d60

Observation e9a3f294-d44d-4b2f-927c-235ba5b4f4ca · outbound

This paper cites Swarm and Evolutionary Computation 51:100598.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Swarm and Evolutionary Computation 51:100598

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:17.238657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.128016Z digest=sha256:68688c5bcc8445e4afd33caa755992307b311d23c90476132526976d5bc1f646

Observation 6bb42584-3c35-45fa-adad-793dc054ddf7 · outbound

This paper cites (2018) Universal sentence encoder.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2018) Universal sentence encoder

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:17.027646Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.305139Z digest=sha256:bc62b1299e1a84cc7aae3e9fae797ed0c7e8bb0e0ae0ea18bbae874f5624f46a

Observation f1109551-3cd7-477b-a716-c5c838e91675 · outbound

This paper cites ACM Computing Surveys (CSUR) 51(1):1–27.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models ACM Computing Surveys (CSUR) 51(1):1–27

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:16.769569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.466633Z digest=sha256:8dd6108f62345b734ef1b8ae43bddac4036a84e7d16975ca873892d9320c5b04

Observation 65489b6a-825c-4dcd-9a59-860529aeb82e · outbound

This paper cites an unresolved cited work.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T19:29:16.502771Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.564512Z digest=sha256:6b2322f0d3a55330d3ac3a30fb2d1d490ab4279f2ccdc5705b87100e038a0d47

Observation 0db65580-441f-4061-b1e2-bfc1090cf7c2 · outbound

This paper cites In: 2022 29th Asia-Pacific Software Engineering Conference (APSEC), IEEE, pp 209–218.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: 2022 29th Asia-Pacific Software Engineering Conference (APSEC), IEEE, pp 209–218

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:16.191374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.685234Z digest=sha256:f83389319fe307aca552d8c299eb31f603e447e5e9fc066b753367f6aa0b8307

Observation 17332158-cfd3-4d87-8104-891c2b123013 · outbound

This paper cites (2022) Palm: Scaling language modeling with pathways.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2022) Palm: Scaling language modeling with pathways

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:15.902554Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.826291Z digest=sha256:1a45b6aeae8fab201df12d5ed350157edd8a1c37da48b0731deca4850faf25bb

Observation b9c03105-2e0e-4126-8a53-3052c5fb0097 · outbound

This paper cites IEEE transactions on evolutionary computation 6(2):182–197.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models IEEE transactions on evolutionary computation 6(2):182–197

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:15.716059Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:02.931145Z digest=sha256:a5ff38068aeda9afc61a8c75d1c1f82295a5e63f3cc92c778a6f3341777302e4

Observation 427cf72c-06fe-4970-9915-416033e20904 · outbound

This paper cites Technometrics 6(3):241– 252.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Technometrics 6(3):241– 252

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:15.495664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.054813Z digest=sha256:85a364018c31f8f556c16503869c58d62e0ec115adf3a8cdaee0963c984628f7

Observation 2069ba63-aba0-4282-958f-987888dd9fa1 · outbound

This paper cites In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp 31–36.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp 31–36

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:15.275583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.155220Z digest=sha256:9c08d127bbbd03d99ca00601d913dabe45a77a16cc1dcbd90517695ee84eae71

Observation 6fd16673-1df1-4b85-9a28-4aeb1cd1c1cf · outbound

This paper cites arXiv preprint arXiv:231003533.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:231003533

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:15.012474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.298923Z digest=sha256:ce4521442b856a15c906a4287b4b464a72fb0febc6cf75fc669bb415826ec058

Observation c13f6df3-38d9-4f56-92fc-8eda517eefc9 · outbound

This paper cites (2021) Limitations of transformers on clinical text classification.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2021) Limitations of transformers on clinical text classification

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:14.772392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.458721Z digest=sha256:f8836d5c0a04833ea5429dad69702abebe8e03f95f686a908870dd86ddcd3fe7

Observation 58622522-031b-443b-b2e3-a062fa47ad3d · outbound

This paper cites (2024) The llama 3 herd of models.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2024) The llama 3 herd of models

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:14.547269Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.551571Z digest=sha256:d3ad24a6d4325d32a7c353b850fab5818f0d11a29cd51eda5ff0d3aa6d647abf

Observation 81986da5-e1db-484a-b14c-65307b5864f1 · outbound

This paper cites In: LASER Summer School on Software Engineering, Springer, pp 1–59.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: LASER Summer School on Software Engineering, Springer, pp 1–59

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:14.302373Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.657560Z digest=sha256:78ff59f36b7637eaa5f8bd2565d51153165aa94b44ffdebf48ef50b900881bc2

Observation b01b8366-011e-48c8-97a7-564aadd2007d · outbound

This paper cites In: 2024 IEEE Conference on Software Testing, Verification and Validation (ICST), IEEE.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: 2024 IEEE Conference on Software Testing, Verification and Validation (ICST), IEEE

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:14.085363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.773940Z digest=sha256:13812e27aed3ad186174570fb0b172b8936c738ecf8ff7125156c1cb64b39446

Observation a6441aa6-e652-46c5-a971-62bea4821cd6 · outbound

This paper cites In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 8018–8025.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 8018–8025

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:13.861010Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.895151Z digest=sha256:a656c1b2d3eeb17798a27e4f38478d19b938a30858cc3cc9a8bdc2b52016d0b0

Observation 9c74f791-b1ba-402c-964a-086d80f23ebb · outbound

This paper cites Journal of the American statistical Association 47(260):583–621.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Journal of the American statistical Association 47(260):583–621

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:13.597259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:03.983820Z digest=sha256:096b99e340d9131f8220fb96389c284db4584c0cfa64b0742239b7189164fcf6

Observation ce67ce54-d0ca-465c-a9d6-02d8bc84584a · outbound

This paper cites In: 26th Annual Network and Distributed System Security Symposium.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: 26th Annual Network and Distributed System Security Symposium

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:13.366063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.098796Z digest=sha256:5f46819536be08e9a2721be2a9ef242fffbaa92b8e47962081383502ff46d5c3

Observation 2f9bbc29-a8db-4112-ac1a-0474f6bd5f35 · outbound

This paper cites Transactions on Machine Learning Research URL https://openreview.net/forum?id=iO4LZibEqW, featured Certification, Ex- pert Certification.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Transactions on Machine Learning Research URL https://openreview.net/forum?id=iO4LZibEqW, featured Certification, Ex- pert Certification

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:13.168419Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.252924Z digest=sha256:9844593a48c4adf790a70fedf2cfa02841de130045ae27e55cf6a62530876dbd

Observation b2690bff-9236-4e92-9718-7264a29f2b4e · outbound

This paper cites arXiv preprint arXiv:200408994.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:200408994

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:12.961000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.346145Z digest=sha256:eb830f48cf390a358d1aa4ec1fc5e20a333cefce6d83c92b83cbbf5d694d4859

Observation 52668627-caf3-4376-8eb4-aa35982d7a49 · outbound

This paper cites The Corsini encyclopedia of psychology pp 1–1 Title Suppressed Due to Excessive Length 29.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models The Corsini encyclopedia of psychology pp 1–1 Title Suppressed Due to Excessive Length 29

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:12.725282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.478356Z digest=sha256:8b6c367d6ac8e7b6cdbf6b22a56dd92819ca9b4cc332c7f6b3cc382169ff6a7f

Observation ac0cd029-e9b8-4df1-990f-14b9cd20fa7a · outbound

This paper cites URL https://ai.meta.com/llama/.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models URL https://ai.meta.com/llama/

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:12.502843Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.598690Z digest=sha256:00f1f6490f94257971f92dca634b1db74588f672f8bfc4f057fc9f50b0f7168d

Observation 09e58ad7-8f35-4b5d-8d5c-b973c3bb4052 · outbound

This paper cites MIT press.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models MIT press

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:12.293461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.693577Z digest=sha256:148b21285915ac0260ff44556eaca0f571fc79dac83d17e0bc98fa27a6db3ab1

Observation 5dcdeeae-bbb8-4e6f-8516-bc3646b62c62 · outbound

This paper cites Nature 616(7956):259–265.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Nature 616(7956):259–265

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:12.046127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.794908Z digest=sha256:2aa5ccb020813a3e4e455f42aca2e6326fdda80835be8ef71ee47bc7e3e6be63

Observation 1fb47d2c-6a3a-4f94-9982-dfb3484f2790 · outbound

This paper cites Computers and Education: Artificial Intelligence 2:100033.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Computers and Education: Artificial Intelligence 2:100033

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:11.835072Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:04.947433Z digest=sha256:4ca77c4b38d9fd58bce57f11664c39b841fbaaa495c6e9e4cc2cc2e890c1fb0b

Observation 0894dae2-1a3f-4fd1-a8cb-374aaa998cea · outbound

This paper cites URL https://openai.com/blog/openai-api.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models URL https://openai.com/blog/openai-api

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:11.569820Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.081443Z digest=sha256:ec2983afbdabc2dbd6f6dff3a902da1992933e6f115362bcfa52b18851a94c8b

Observation e5c5f139-c453-4b27-b954-f263288cc0cb · outbound

This paper cites arXiv preprint arXiv:240214992.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:240214992

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:11.318477Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.217649Z digest=sha256:7bd37cca204d2ea4dcc560411be974279121eb160f597038fbf2446364ceadfa

Observation 3ec0a5dd-4bcd-4af2-89e4-21886af91959 · outbound

This paper cites Neurocomputing 492:278–307.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Neurocomputing 492:278–307

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:11.044074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.368998Z digest=sha256:326ecfcfb7dcfcbc23090b647dc0ed2b2994271e82d8cba13511a1fa18b93a9e

Observation bad95aa9-61f5-430e-919f-ce87a0f6ea66 · outbound

This paper cites In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 4902–4912.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 4902–4912

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:10.816478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.543451Z digest=sha256:1aa23f207a2fd5ada191b9a9bfa0e95656ef1958d2f1f367c3048ff0aa775643

Observation 9786e35f-f83d-4df3-aa50-3faf91fba263 · outbound

This paper cites (2024) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2024) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:10.655156Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.639639Z digest=sha256:d0961c3bcde05ee5994efbb3a37637cf0e02c3229e1b671fd0fed611e8927cee

Observation 17a0fa51-9377-4cc1-8afc-deb6a9c36101 · outbound

This paper cites URL https://github.com/openai/tiktoken.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models URL https://github.com/openai/tiktoken

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:10.428457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.752865Z digest=sha256:7541f97e915ac2cd2d30a425188c02638605552803e948df13941d440f876917

Observation e17a901b-15f0-4ba8-b15b-76ab586477d8 · outbound

This paper cites Journal of Educational and Behavioral Statistics 25(2):101–132.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models Journal of Educational and Behavioral Statistics 25(2):101–132

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:10.213607Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:05.879588Z digest=sha256:f160614a68b3b02ba1c2f4294484de8496899f7f85f557a453c509866677e255

Observation a32c4337-9f71-42ca-9a74-fdf15e77810f · outbound

This paper cites arXiv preprint arXiv:220501287.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:220501287

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:09.975037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.003720Z digest=sha256:7cb2f6a8195c83be7f10913355b5ebc9d826119de8a5db6385ef1a972558a799

Observation 2faa3b83-8c7a-4834-ae69-ebf23433a8e6 · outbound

This paper cites arXiv preprint arXiv:230514950.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:230514950

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:09.756182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.123841Z digest=sha256:9a9059aa74bc2cd4e4558b23f395f87844df130ec380f71a97faa9c6736584d1

Observation 8acac21c-4c0a-403f-ade5-25f6c9e3ff59 · outbound

This paper cites In: The Twelfth International Conference on Learning Representations (ICLR), URL https://openreview.net/forum?id=VVgGbB9TNV.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: The Twelfth International Conference on Learning Representations (ICLR), URL https://openreview.net/forum?id=VVgGbB9TNV

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:09.541775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.250379Z digest=sha256:bce62dd7ccdd31ed98ad30bc8a3762a2e74aa40828216f4ecad8bdb9f7546d6c

Observation 0507e38d-32ff-4964-8236-1c86c68b53ee · outbound

This paper cites (2009) Random search algorithms.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2009) Random search algorithms

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:09.295405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.353319Z digest=sha256:eabe65012340c27fd693be766ff2850da71814db5af30ae2d3e9495bacc58ebd

Observation 95115836-d478-4f92-b4ae-756f3f04552e · outbound

This paper cites IEEE Transactions on evolutionary computation 11(6):712–731.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models IEEE Transactions on evolutionary computation 11(6):712–731

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:09.050691Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.474100Z digest=sha256:34ca567f948c246bab4ed729c5ccaa826fbe4d40fd12e8d41f219a3296143568

Observation 91f5514f-10c7-443f-862a-8e61a6d2e9ef · outbound

This paper cites In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 6600–6610.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp 6600–6610

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:08.768966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.582488Z digest=sha256:8ef0d7b98c59b022694f259cdaffcd412f91cf6bdb9bd880b5f357c1c49d148c

Observation 61bd82b9-8c64-4152-abf8-d42d1a7dd426 · outbound

This paper cites ACM Transactions on Software Engineering and Methodology.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models ACM Transactions on Software Engineering and Methodology

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:08.554499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.732385Z digest=sha256:f949078233106c4249204ad607e440c1f82a031f339ee297f73e64230d1a717f

Observation 4acbbfee-2440-483b-9381-ec5b13021136 · outbound

This paper cites (2023) Promptbench: Towards evaluating the robustness of large language models on adversarial prompts.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models (2023) Promptbench: Towards evaluating the robustness of large language models on adversarial prompts

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:08.337108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:06.870343Z digest=sha256:2e04980c0cf704836fabc03c87d9bc95368f9f343dc4b769092ce05be21406f5

Observation ca684891-b6b1-467f-812d-4e5cc9b2f98a · outbound

This paper cites EUROGEN Evolutionary Methods for Design, Optimization and Control with 30 Sangwon Hyun et al.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models EUROGEN Evolutionary Methods for Design, Optimization and Control with 30 Sangwon Hyun et al

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:08.030093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:07.018949Z digest=sha256:3f6ad28a5f651b0817effd7021ab58d73529088cced3e0f357d67cbcfac5fcfa

Observation 3854d4b9-74ce-4622-b0ed-cf8b1a744d11 · outbound

This paper cites IEEE Transactions on evolutionary computation 7(2):117–132.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models IEEE Transactions on evolutionary computation 7(2):117–132

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:07.779134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:07.114011Z digest=sha256:4b0337c7378380a531810a81607dd74341576da796e2abc8fb74a9552c7222d9

Observation 64f088df-b64f-472b-b8f6-63e100dbb8e9 · outbound

This paper cites arXiv preprint arXiv:230715043.

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models arXiv preprint arXiv:230715043

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:29:07.511164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-06T19:29:07.243886Z digest=sha256:64b1c27548886af656aa62ddd2f9ff8991b0bab81e661fca034f307603cd6d79

Pith citing papers

Observation 6f60e64d-7c02-4ff8-931e-2f71230ef7bd · inbound

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey cites this paper.

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models

Reference 40

Resolution
verified exact
arxiv_id, observed 2026-05-15T05:19:46.612259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-05-15T05:15:57.846560Z digest=sha256:165ec7ea05e99cc17f7af5bc338ccde02f69c86abb5549aa21bc8f3c519033ae

Observation ec0223d7-d85f-408f-812c-d0388c2b9c54 · inbound

Minimum Complete MR Subsets under Semantic-Mutation Fault Models: A Support-Set Domination Boundary cites this paper.

Minimum Complete MR Subsets under Semantic-Mutation Fault Models: A Support-Set Domination Boundary Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models

Reference 18

Resolution
verified exact
arxiv_id, observed 2026-07-02T22:07:25.968112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-06-27T19:17:17.920263Z digest=sha256:4b4dee4e6e7f6c143799f316e432791558cd2ffcd78167721d2ecc22c8ac9fc6