Pith. sign in

Paper Citation Record · LEDGER

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle

As of 15 August 2026, this Paper Citation Record lists 67 of 67 outbound references and 0 inbound Pith citation observations for arXiv:2412.14215.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.14215 v1

Coverage vector

measured 67 of 67 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T12:55:17.192320Z

measured 67 of 67 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

67 of 67 outbound references displayed

  • verified exact0
  • verified fuzzy33
  • unresolved34
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d0b77b7a-e7f8-4f3b-9db1-805f085c0be0 · outbound

This paper cites Can large language models truly understand prompts? A case study with negated prompts,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Can large language models truly understand prompts? A case study with negated prompts,

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.987133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.953454Z digest=sha256:74b60d985dca45f6da6416406f23821a56cd93dc372367ec34ba993fddfdcb7e

Observation 0921da5b-9d0e-4364-86e6-508ba8af8fe6 · outbound

This paper cites A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT,

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:16.957924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:16.957924Z digest=sha256:710fd74136c5ef450c0db6e947409c267d3673ec65bbbabd7b5585fcce5f41e6

Observation 4735b89c-b4cd-48e4-9dd1-db0956205d90 · outbound

This paper cites The prompt report: A systematic survey of prompting techniques,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle The prompt report: A systematic survey of prompting techniques,

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.968792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.961982Z digest=sha256:a8caaf2222493c76fbf22667ebb1c64de554c0415f23f44fd13f0ee25579e803

Observation 3a9f691a-64bf-4c86-8066-c178f57dbe51 · outbound

This paper cites A survey of DevOps concepts and challenges,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A survey of DevOps concepts and challenges,

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.957331Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.965666Z digest=sha256:efcdf8aca9777facefba520b3d7d471f41cad2363629fef46bc018fc506dca85

Observation 2a1eb472-ed40-4ca9-b041-12d384d464f1 · outbound

This paper cites Continuous integration.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Continuous integration

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.944051Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.969384Z digest=sha256:03211daa8f52ba76618d3a2d7d9d63c2477272c69ed36c96f1b551e553ddf8fb

Observation 39714163-1e86-4c64-a88e-aaf58863f7cf · outbound

This paper cites The agile manifesto,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle The agile manifesto,

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.931474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.973230Z digest=sha256:c42400924691ddb5bfa178c7624a1ffab74c7d3f38d1d0316a268f387af8558c

Observation 588669e4-ec0e-4a4e-a7a3-1b28e2203c49 · outbound

This paper cites Humble and D.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Humble and D

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.919621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.977209Z digest=sha256:d7c6321fcc6aa5a8bad9728e8c8f2642d3dd2870d212fce26bec314918bc256d

Observation dccd5f73-5b3d-41fa-9784-53cb286cacc5 · outbound

This paper cites Continuous delivery: Huge benefits, but challenges too,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Continuous delivery: Huge benefits, but challenges too,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.907303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.980586Z digest=sha256:04452a65737543e6811db2035f9033523fa1217f91fe29e46ba6b6d65d2b7c4f

Observation 431e1631-5d1d-42b7-b1cc-adff772f66a7 · outbound

This paper cites Dustin, J.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Dustin, J

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.895386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.983974Z digest=sha256:1d17921ff3b71f58a752bd9a68a90f16fd9114d7611af958536729cba6f65026

Observation 3c336da3-2842-4895-a6be-ecc1ffcc5630 · outbound

This paper cites Gregory and L.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Gregory and L

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.883665Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.987543Z digest=sha256:55d280f72bbc03546cc946efc3dee46c4752db6f8f8a614f3d938aaee8ce241c

Observation cc41fb01-2764-459d-89fe-efa8771015fb · outbound

This paper cites Cohn, Succeeding with agile: software development using Scrum.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Cohn, Succeeding with agile: software development using Scrum

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.872000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:16.991183Z digest=sha256:f99966d2e19110ce29c85817609bec15f9f918bb7a643deafeac7d62685fddef

Observation 96d3eeb7-23ad-4dcf-ab07-d239adb3131a · outbound

This paper cites A Survey of Large Language Models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A Survey of Large Language Models,

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:16.994671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:16.994671Z digest=sha256:cd82f1cb701529ccb240d56ce992686a1c4cd9c42893840c2414746da5a2ac7b

Observation 8b467228-ce22-49ae-b96f-9c76edc13326 · outbound

This paper cites Learning to control fast-weight memories: An alternative to dynamic recurrent networks,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Learning to control fast-weight memories: An alternative to dynamic recurrent networks,

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:16.997892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:16.997892Z digest=sha256:baaf9dd287bc18805cfbc1d69d8e15094916eea7e309c987f3bf012db3994fcd

Observation bd11347f-0e9f-4011-b371-7d6da4247345 · outbound

This paper cites Neural machine translation by jointly learning to align and translate,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Neural machine translation by jointly learning to align and translate,

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.846612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.001344Z digest=sha256:e9e7e513f132e43d4e0fac9861e87bf7f67253ab5e4d7b7face16de20ac2e9e1

Observation dcd17c20-afde-44df-a48a-b80f3b0136b4 · outbound

This paper cites Attention is all you need,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Attention is all you need,

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.004924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.004924Z digest=sha256:ea9182f6ef8b08d49a93eaefd0d2a3ac4a2d6d7e0fed01f7288ee66e7dd18448

Observation a0ea03b7-dc93-4df1-8e16-7e5f4b037516 · outbound

This paper cites Long short-term memory,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Long short-term memory,

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.008487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.008487Z digest=sha256:24cfeaa720c22022f9a895912fbe007bec27ec029f95a2abadeeec518daf223c

Observation 338f7dc6-2ebc-4a8c-bb2c-dbcbb674921c · outbound

This paper cites Improving language understanding by generative pre-training,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Improving language understanding by generative pre-training,

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.012023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.012023Z digest=sha256:d42711055c11a759990c2e6065adc7691183b49843fca071d78cf51fb9a45cf7

Observation 96790c25-6c19-402a-8b32-e8ff2f2d1f7a · outbound

This paper cites Language models are unsupervised multitask learners,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Language models are unsupervised multitask learners,

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.015681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.015681Z digest=sha256:b407b63d49cccd6ae03ae4bd9b075885ef494db9d4103f41f526923da57a1409

Observation d34fca33-19c8-4834-9adb-e577d54a8b60 · outbound

This paper cites Language models are few-shot learners,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Language models are few-shot learners,

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.019307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.019307Z digest=sha256:bfdd6273cb0b9818287e44d14b6f570894b91a99e847d89bdf5064a2a682c41a

Observation 04fb0e6a-f5d9-42a6-986a-8eb457907d04 · outbound

This paper cites Training language models to follow instructions with human feedback,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Training language models to follow instructions with human feedback,

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.022675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.022675Z digest=sha256:f65c4d34598460f104d6fe37619fb21b4612a3112f3511471948338f2cc07314

Observation 8fbf5640-4681-4feb-8787-583b35257891 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle LLaMA: Open and Efficient Foundation Language Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.026049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.026049Z digest=sha256:70a7b11b1a1cf85b58b4aeb7410bb63740d428260f03e1ed8df6b99661d58d44

Observation b7130fd9-f1e7-4c7b-b81a-780c978971ab · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.029634Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.029634Z digest=sha256:7aabb697355c79ec847a69d3d4215a042ff95911fe41ec18dc16589436b120a2

Observation 91e594e4-143f-4619-b597-902869bdf229 · outbound

This paper cites Training Compute-Optimal Large Language Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Training Compute-Optimal Large Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.033057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.033057Z digest=sha256:efed1ea983988171d7308fb3ee0d244025d694ba5d2b13da1f37127183859662

Observation 728875c5-5bf1-480a-86a5-a0c302de48a9 · outbound

This paper cites Textbooks Are All You Need.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Textbooks Are All You Need

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.036882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.036882Z digest=sha256:6d24a7b9f6799dd8f425b3da84309a0e5a97a25ddb535b844f0e32b824ae9bdb

Observation f476ed1f-c91a-4b7c-ad3b-638afe37550a · outbound

This paper cites The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.040675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.040675Z digest=sha256:cc89e329442240f06cb0177fc1d9c3bfc997a8c241215fa0d00532e5f2863eb4

Observation 0b6aeda7-644e-4dd3-a320-9a3c4c64d457 · outbound

This paper cites Russell and P.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Russell and P

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.795291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.044429Z digest=sha256:e74a5e47f4a2a2ee60ffb729c9a5cc77d606eb110056e0eade254f8f98192b3c

Observation 3502b415-3285-457d-a97a-2a89b2a2e295 · outbound

This paper cites The Rise and Potential of Large Language Model Based Agents: A Survey.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle The Rise and Potential of Large Language Model Based Agents: A Survey

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.048058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.048058Z digest=sha256:903cf501b1e9d429b821471382588593c8e876d7e3d375f08cec8cd08c981f01

Observation 134ab627-4475-4dc1-931c-1f763ef2ea8b · outbound

This paper cites A survey on large language model based autonomous agents,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A survey on large language model based autonomous agents,

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.784006Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.051934Z digest=sha256:9d2d948615299b8fd97165174e375fd80d6c1d6dd90032f3111e42ad3b123e12

Observation 9f14cc08-a57c-4714-8eff-ba0a8d656876 · outbound

This paper cites LLM Powered Autonomous Agents.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle LLM Powered Autonomous Agents

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.772921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.055610Z digest=sha256:ea092737c052e47e881d3a7d5b57cd09188347cf12aeabee48c11ba963d93fbe

Observation 23d4bb8e-fe44-4cf9-a116-13bbd715cf42 · outbound

This paper cites A Comprehensive Overview of Large Language Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A Comprehensive Overview of Large Language Models

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.059188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.059188Z digest=sha256:e1b7426513d976dffa11eca3fd50a595c0857603cb5ba6fc2e41a39a24ab375b

Observation f175117b-b076-4b5a-886c-d32ea7479c8b · outbound

This paper cites Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.063053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.063053Z digest=sha256:7b5c6a9c30bab2618d97e02df39e4e05af9ebd4d943cf7ed672a18e68f77d4a8

Observation 4d21f804-26e4-48ac-8cec-175d3b2726db · outbound

This paper cites React: Synergizing reasoning and acting in language models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle React: Synergizing reasoning and acting in language models,

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.066831Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.066831Z digest=sha256:0893169365eec490aecf4777262769c827b2b38354518925b9470e3c38e57a13

Observation 25080b5b-c8e2-4290-ad27-9a9a8a8592f2 · outbound

This paper cites AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.070191Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.070191Z digest=sha256:eb71ee979bfa3d0d0f487dae1f8bb151aa042a333f90076e95012975e9036c7e

Observation d2c3cddf-293c-4a86-ad69-30c820e95d21 · outbound

This paper cites Bleu: a method for automatic evaluation of machine translation,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Bleu: a method for automatic evaluation of machine translation,

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.754919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.073985Z digest=sha256:e6afcf377861fbf6a4e6b1eff3f74de076b245944e99c241987058645b5d6749

Observation 1e91865f-e8b7-4439-ae0d-3ab50e61029e · outbound

This paper cites Recall oriented understudy of gisting evaluation,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Recall oriented understudy of gisting evaluation,

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.743057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.077518Z digest=sha256:9ca0e457875c22336cbade3a7e20d241f720fd9ee66381c84fd1aac7109f92fd

Observation c55b68a2-ae9c-4e81-9544-60028dd85dee · outbound

This paper cites GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.080855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.080855Z digest=sha256:c226c02508c79adf10faea2b489681d26e8fa02c98b4e89284851174b3590d32

Observation d12eee62-f31e-4fdd-97a7-d92ef964210b · outbound

This paper cites Benchmarking LLM powered Chatbots: Methods and Metrics.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Benchmarking LLM powered Chatbots: Methods and Metrics

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.084581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.084581Z digest=sha256:c8a3c5f86b7d18ceaca7bd9ebcd5b8be47149852efe6742655af1f63402883be

Observation 8a25d082-b242-461d-b61a-1984e2b7326c · outbound

This paper cites The power of Generative AI: A review of requirements, models, input–output formats, evaluation metrics, and challenges,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle The power of Generative AI: A review of requirements, models, input–output formats, evaluation metrics, and challenges,

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.730336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.088203Z digest=sha256:f48b9974cb517065e56ce338943799360614f70852f1ccb3916818c0d93c8b3e

Observation 3ac51c20-6664-42f0-b909-35f5d2080424 · outbound

This paper cites Modern Question Answering Datasets and Benchmarks: A Survey.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Modern Question Answering Datasets and Benchmarks: A Survey

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.091540Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.091540Z digest=sha256:99a6830df666f803e1d138c013a193afa2da66b47aee4dadd01886c50f6b6caa

Observation 44f21c17-7ad7-41c9-9db5-d863d6d31403 · outbound

This paper cites Survey of hallucination in natural language generation,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Survey of hallucination in natural language generation,

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.095313Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.095313Z digest=sha256:d80972b16932edab9223c50ef4bd46c89b8ad2b3b00cfb2635dfa71fb47e6225

Observation 7757eab8-60b4-4d05-bc47-720a7d41a650 · outbound

This paper cites Retrieval Augmentation Reduces Hallucination in Conversation.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Retrieval Augmentation Reduces Hallucination in Conversation

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.098471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.098471Z digest=sha256:551b1417fadeb9487038896680140910ab419d4a788ecf7978055fab0a10e385

Observation 29b3fef9-24d8-499f-914d-e887a043bc2e · outbound

This paper cites Hallucination is inevitable: An innate limitation of large language models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Hallucination is inevitable: An innate limitation of large language models,

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.707892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.102033Z digest=sha256:edb07edbe7dfaca2319abfb7df7077dd7f48ad39910edd74f90221ad754fe022

Observation 8b6c2f1c-00a6-45de-a067-cdb84363e537 · outbound

This paper cites LLMs Will Always Hallucinate, and We Need to Live With This,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle LLMs Will Always Hallucinate, and We Need to Live With This,

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.696291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.105659Z digest=sha256:7f0cdf40ff1eaf22d8d7a01895b685b555fcc69a20c48d2ca7166e4f5a959b73

Observation dba214a3-3fad-4437-b51e-605b02267279 · outbound

This paper cites Universal and Transferable Adversarial Attacks on Aligned Language Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Universal and Transferable Adversarial Attacks on Aligned Language Models

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.109031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.109031Z digest=sha256:dfbd2072ed9e0623aca531e8ea400350ac7ebf10b3e61e8e7a9a964a0fef63f2

Observation 97ced399-5649-443b-8510-3f8cc2eba861 · outbound

This paper cites A comprehensive study of jailbreak attack versus defense for large language models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A comprehensive study of jailbreak attack versus defense for large language models,

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.685142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.112622Z digest=sha256:e826b69a258455a7e6ed5ad697824d079feb2d3436db9dd567ddaa6941f8412f

Observation 08094d71-73a4-437b-8e67-6f4c55261021 · outbound

This paper cites Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoning,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoning,

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.673601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.116146Z digest=sha256:7e1f23fdaab23d389e3c10ff66c3d13d6eddbb184afef80bb014a4fc186e3c0c

Observation 5a3de844-5045-4f0f-b1a1-653142cae779 · outbound

This paper cites A survey on evaluation of large language models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A survey on evaluation of large language models,

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.119647Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.119647Z digest=sha256:a3e77234dd77c6ae0a0c37bd92f0e577e275500c32a206a77b49236780170437

Observation b2ce581e-6843-40a0-baf7-b43b17f98892 · outbound

This paper cites Software Testing of Generative AI Systems: Challenges and Opportunities,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Software Testing of Generative AI Systems: Challenges and Opportunities,

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.654239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.123052Z digest=sha256:210085d5ffb4b2fe8687420cf47f119a62df940e09deaf343f82f5dd74855001

Observation f7c36c03-2abd-4a1f-890c-492b5bcf4306 · outbound

This paper cites Continuous integration of machine learning models with ease.ml/ci: Towards a rigorous yet practical treatment,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Continuous integration of machine learning models with ease.ml/ci: Towards a rigorous yet practical treatment,

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.641995Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.126499Z digest=sha256:45da94200d9963e5226c51fb3a3489f4bbead21223968a9b09bacfdb7cd260c4

Observation 00ec46a6-cb1c-4b04-900e-43236ac7c5c7 · outbound

This paper cites Machine learning operations (MLOps): Overview, definition, and architecture,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Machine learning operations (MLOps): Overview, definition, and architecture,

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.630264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.129873Z digest=sha256:1b1cd865c8a2e29d22903cc0c8d798880707e2254af128c7960b519c77028ebf

Observation f783dca7-e9d7-403b-aead-e0722aeaf872 · outbound

This paper cites Hidden technical debt in machine learning systems,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Hidden technical debt in machine learning systems,

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.618027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.133653Z digest=sha256:ef44b9e41dbfcfc315a37f1432caaebf8a23b8263a55feddacb5783546cffc5b

Observation a3e431a8-4f11-493c-939d-f6dcbd8311e4 · outbound

This paper cites Large Language Model Operations (LLMOps): Definition, Challenges, and Lifecycle Management,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Large Language Model Operations (LLMOps): Definition, Challenges, and Lifecycle Management,

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.606642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.137133Z digest=sha256:ef7f9599a02855212ac4448ef766dc29c902e4346eb97e06421647e91bc9bdac

Observation f9bb069e-4479-458b-9e66-55c2bbb3975a · outbound

This paper cites On the Opportunities and Risks of Foundation Models.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle On the Opportunities and Risks of Foundation Models

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.140403Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.140403Z digest=sha256:7a7118cf85bff7981af88609eaeac589dec08e30da61532852133237a326f585

Observation 0db3e435-eeeb-406a-9e52-bf3c12fed28e · outbound

This paper cites Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing,

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.144093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.144093Z digest=sha256:7b992cae5a452e68e9291adf78504767f4d76cb7f225b701f7cf52840fbe05d0

Observation 27b8839d-dc3b-4c25-805a-8365dc9eaf5e · outbound

This paper cites DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.147500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.147500Z digest=sha256:32f5f11b7f1ee2d4d498cab56174ee081f19274454c4452d3e41c611faae556c

Observation 460c496f-006d-45b9-bfab-1d1c75bb766f · outbound

This paper cites Judging LLM-as-a-judge with mt-bench and chatbot arena,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Judging LLM-as-a-judge with mt-bench and chatbot arena,

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.587381Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.151432Z digest=sha256:d0c59229a1f60634c5439be0cdb7d45de26e1965553f35a4c27ece8e2a37aebe

Observation 91b577b7-7f72-44ba-92cb-c51d58cbf01e · outbound

This paper cites Sequel: A structured english query language,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Sequel: A structured english query language,

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.576298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.154970Z digest=sha256:b2acfa451cc14621eae8469540748475c5e0a01d538239c51055dcf681dea291

Observation 48970021-d76c-41f8-9100-88be6dedb7be · outbound

This paper cites Retrieval-augmented generation for knowledge-intensive NLP tasks,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Retrieval-augmented generation for knowledge-intensive NLP tasks,

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.565180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.158334Z digest=sha256:980c2832e20421501d0e1680e96c03606f5a5dc58519610a0d5123910b562a49

Observation 0939e63f-328f-4645-acd7-6c0806f05b06 · outbound

This paper cites Billion-scale similarity search with GPUs,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Billion-scale similarity search with GPUs,

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.553678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.162124Z digest=sha256:44c6e949d26075ed9a2020291c518042ba1990ee50a39bea643bbbdd14276c73

Observation 9fda2aff-9fac-455c-a828-f95682f2dfc2 · outbound

This paper cites A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.165625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.165625Z digest=sha256:7b69f3dff898165bbb94c274e89d3882ef9610022156c46e28c072b14574b663

Observation 82938c2b-39db-4adb-b4c4-dfc49088a089 · outbound

This paper cites Apple intelligence foundation language models,.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Apple intelligence foundation language models,

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-11T12:55:17.169468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T12:55:17.169468Z digest=sha256:6ca372b4aa91246bc377c9c4bea1aca76ac8f6cdf94a0d623557330fb8568f89

Observation f17c13b5-ff0c-4828-bac4-9811f3c2be4d · outbound

This paper cites What are the names and salaries of employees in the Marketing department?.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle What are the names and salaries of employees in the Marketing department?

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.541891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.173355Z digest=sha256:ec55e847688a16a7cd6d6bca2426b823bfb4958be9dc3d3cfd1bcd0fceb799ab

Observation cb421e56-e8df-4d24-8c68-c64a3ad6f5f0 · outbound

This paper cites List all employees in the Engineering department.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle List all employees in the Engineering department

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.528482Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.177045Z digest=sha256:05a75d6096ed0dab4d9f796b6cd6741f43ddc213ca8f5ddf1f43b74d899af5c8

Observation 4e67e503-7ab1-400c-ace3-f32e12a6b075 · outbound

This paper cites an unresolved cited work.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:55:17.515948Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.180825Z digest=sha256:190d7c6a3ca9fc9e0e48a1e9c49a65f81151a371802e907693189048af1a2157

Observation b35672b5-b655-40b5-9e69-93b924bc059e · outbound

This paper cites an unresolved cited work.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Unresolved cited work

Reference 65

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:55:17.504392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.184445Z digest=sha256:a36e1b17a98b287ff2fc950214630c457a838c8e992d20be52e87019d50e3442

Observation 80768e8b-4cbc-40c1-bce1-425a25c3a02f · outbound

This paper cites an unresolved cited work.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-11T12:55:17.492575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.188141Z digest=sha256:f6a77c6cbe4403c8585cab6a2683748c61a0743ed4d864897c18b3c35499be6c

Observation 72e4537a-3829-47eb-84f7-bed194328f02 · outbound

This paper cites " " You a r e a h e l p f u l r e s t a u r a n t a g e n t f o r t h e r e s t a u r a n t.

Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle " " You a r e a h e l p f u l r e s t a u r a n t a g e n t f o r t h e r e s t a u r a n t

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T12:55:17.481294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

source=pdf_text observed=2026-08-11T12:55:17.192320Z digest=sha256:ce11175114a8aaffa65e926c409c1030d14e40fcca038027c681caa6e08cd348

Pith citing papers

No inbound Pith citation observations are available.