Pith. sign in

Paper Citation Record · LEDGER

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks

As of 17 August 2026, this Paper Citation Record lists 100 of 221 outbound references and 1 inbound Pith citation observation for arXiv:2504.17421.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.17421 v2

Coverage vector

measured 100 of 221 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T10:44:46.451764Z

measured 101 of 101 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T15:06:48.172897Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-06T15:06:50.262608Z

Reference resolution

100 of 221 outbound references displayed

  • verified exact4
  • verified fuzzy0
  • unresolved96
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ae7a00be-dfab-4723-8ef0-9866f8457b81 · outbound

This paper cites Will we run out of data? limits of llm scaling based on human-generated data, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Will we run out of data? limits of llm scaling based on human-generated data, 2024

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.077507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.077507Z digest=sha256:05cf2b67991bc2d3f3418fd07f7da9e97c4632dc42b6aae740a544309c8d52da

Observation 07727109-f02b-4531-a945-e919ee30e9c4 · outbound

This paper cites Advances and open challenges in federated foundation models, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Advances and open challenges in federated foundation models, 2024

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.082175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.082175Z digest=sha256:36933386a1b287f313b454249c6cbb8ae43864e8f35d1b0647625d1e8a139a79

Observation 31d85340-9411-4ff6-b3c7-2ff91a4035f4 · outbound

This paper cites an unresolved cited work.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.086132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.086132Z digest=sha256:589e459910d0414aac6eeee733153c75dbd32928e1cc06e0420f23779ade592a

Observation 527d3174-11b7-4fef-8030-b82b01d05bd7 · outbound

This paper cites Introducing chatgpt.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Introducing chatgpt

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.089945Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.089945Z digest=sha256:488552d93e9ecef58e306c9e7259861fd002390c612b9027978e99b98cff2f6e

Observation af8c0acd-5306-4feb-bc2c-7af90109f607 · outbound

This paper cites Gpt-4 technical report.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Gpt-4 technical report

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.093978Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.093978Z digest=sha256:a9dc5b1167a1e966f0ec9f6740e08e4384796542ff689701dce59a3931c9a029

Observation 70885717-2d2e-45eb-bd85-f5a05ab14dbd · outbound

This paper cites A Survey of Resource-efficient LLM and Multimodal Foundation Models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks A Survey of Resource-efficient LLM and Multimodal Foundation Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.098253Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.098253Z digest=sha256:f1d7821dd2941c8663e9b69790f66ba440f8dbe8c226328910194b77d1ce99eb

Observation 7b7bb11c-3f88-485b-9ddc-b45ad2aefa6c · outbound

This paper cites BloombergGPT: A Large Language Model for Finance.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks BloombergGPT: A Large Language Model for Finance

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.102577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.102577Z digest=sha256:833d9741e250faf8a8c66c578ef9a46cdbc30aa6b7cd94608adab50fb51650c0

Observation 7c74216d-1016-45a3-bfff-45fa5d4bef14 · outbound

This paper cites Deepseek-v3 technical report, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Deepseek-v3 technical report, 2024

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.106712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.106712Z digest=sha256:dc76a129110b99ec5d86c0ecb3742d1a41fd0eb87b3faf341a17ec174a6a738b

Observation f5d49f81-cf27-47ff-80f0-f807de58cd04 · outbound

This paper cites Deep residual learning for image recognition.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Deep residual learning for image recognition

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.110505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.110505Z digest=sha256:3de1f9174c29d97d3e869e935271ba1d7085f2ae6ae6df19aff13ca47c31809d

Observation b7ac0d16-bb52-4bd6-941f-50645fefc05f · outbound

This paper cites Long short-term memory.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Long short-term memory

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.114047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.114047Z digest=sha256:a672bb551d7c0dc3ce14c138e778fe96a248348a8aa2a766ec0bd47f556c4b5c

Observation 05bedc8c-0d2b-4d19-ab7b-834d5d2416a6 · outbound

This paper cites Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.117544Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.117544Z digest=sha256:dc1f7276afec08f589f8512629fbad8fe4f696552d3917b33f32a6427db8c18a

Observation e9e4c3a2-f206-4108-81ff-2ac42a1922d8 · outbound

This paper cites Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S

Reference 12

Resolution
verified exact
raw_fallback, observed 2026-08-16T10:44:47.573116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-16T10:44:46.121847Z digest=sha256:9f447fa99882b8ab9d130a9a60d7abf1a35b30d1fec3a51568d772a722a088c4

Observation 68f055be-55bc-4fb4-b49e-5855ce1e97e0 · outbound

This paper cites LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.125414Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.125414Z digest=sha256:034ebb0f7fbda662662e501170926355709c9eb14f2609aa76b89775907badfa

Observation 82cac1bc-6ae8-4799-a838-7966cef55311 · outbound

This paper cites Biogpt: generative pre-trained transformer for biomedical text generation and mining.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Biogpt: generative pre-trained transformer for biomedical text generation and mining

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.129251Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.129251Z digest=sha256:27e0c40c5a4eaa7b99dbd38f851221e1d9ae0b9df48cf17668b475208934b0ea

Observation b9014512-4479-4c95-ae2c-a21167ef14d6 · outbound

This paper cites Biobert: a pre-trained biomedical language representation model for biomedical text mining.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Biobert: a pre-trained biomedical language representation model for biomedical text mining

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.132808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.132808Z digest=sha256:198e413f93285d5c6f43c8791aacefe864c875a8a98bee7c60ec25e04753f4f7

Observation 59b71b4e-61dd-424f-90a2-66564b91019d · outbound

This paper cites Phi-2: The surprising power of small language models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Phi-2: The surprising power of small language models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.136432Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.136432Z digest=sha256:933718aa9d0c106301e187dd7a73196bdfce903a96bc5243559c647e0d6687b8

Observation d3db265d-71df-46bd-a432-afa0e82f4b68 · outbound

This paper cites Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.140106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.140106Z digest=sha256:f6030dee2642a2dff5bec567ace22c79733079b531b001a2039927c31d247c69

Observation c6de4bfd-d438-4fe7-a782-d176b87ec8cb · outbound

This paper cites Introducing llama 3.1: Our most capable models to date.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Introducing llama 3.1: Our most capable models to date

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.144106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.144106Z digest=sha256:a1cb65158d42b1c2edc04246d01eb599a4c83b0008f67262a7c1c08beb6576d3

Observation 0c6e4c52-0611-45b6-9119-64a7cc100f88 · outbound

This paper cites Position: Will we run out of data? limits of llm scaling based on human-generated data.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Position: Will we run out of data? limits of llm scaling based on human-generated data

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.147996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.147996Z digest=sha256:9ca4431d3a4c491b72dc7f70e98ec15313377971383dd53e14225914b7d0d6ad

Observation f34243cf-7323-4ab0-a22e-dadcf06348ad · outbound

This paper cites Communication- efficient learning of deep networks from decentralized data.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Communication- efficient learning of deep networks from decentralized data

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.151585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.151585Z digest=sha256:6e4a76e9e09d74369de4ca7f186230c4149717750ad6ff6f56d7c51aa86ce84b

Observation bd4229b0-1843-4e8b-9108-4712b7a83b91 · outbound

This paper cites Federated machine learning: Concept and applications.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Federated machine learning: Concept and applications

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.155080Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.155080Z digest=sha256:6d2418bfeda62e8659763ddf02ef5328fbffb98f653d6efbb96df1c65f1e06bb

Observation fdf85488-a96e-4866-91a1-c649e5da8534 · outbound

This paper cites Regulation (eu) 2016/679 of the european parliament and of the council.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Regulation (eu) 2016/679 of the european parliament and of the council

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.158929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.158929Z digest=sha256:eb46259940f75070318baddad9dda75437e517a17d21a4054c3d4bf3e2074f07

Observation bf51ba86-2fe7-450d-afb1-c1a1782c224d · outbound

This paper cites California consumer privacy act (ccpa).

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks California consumer privacy act (ccpa)

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.162479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.162479Z digest=sha256:156221e630290b6eca4ea274b28d27a51dcd174d72347cb75880f92ad6096ef9

Observation ab0c4571-c533-486e-8abc-8c19690dd72a · outbound

This paper cites Health insurance portability and accountability act of 1996.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Health insurance portability and accountability act of 1996

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.166212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.166212Z digest=sha256:3fb361bdcdac4c0703f6a5b61fae891f115ea839cc91498e7ecce5ad580a26d8

Observation cce5260c-d642-4aff-aa63-b8556e91582e · outbound

This paper cites Federated learning for healthcare domain-pipeline, applications and challenges.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Federated learning for healthcare domain-pipeline, applications and challenges

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.170572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.170572Z digest=sha256:93c5daedf29e329ce71645569c997dc77d547a7b017f3ffd522a43483f9ceec4

Observation befa89dc-6e55-4ccc-a6e3-268998941ffd · outbound

This paper cites Review on security of federated learning and its application in healthcare.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Review on security of federated learning and its application in healthcare

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.174476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.174476Z digest=sha256:acc43ab6dc063bc8c671e9dd02063b61d7b64fb48795a395a94215437d147d1c

Observation cc06179b-4f86-408d-b09d-13dd5d26de26 · outbound

This paper cites Deep learning-based classification of mesothelioma improves prediction of patient outcome.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Deep learning-based classification of mesothelioma improves prediction of patient outcome

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.178325Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.178325Z digest=sha256:bb80595615a6bd6b50985324e06ee1d2446d08e7b162b171871666da5aea53a0

Observation fa1acefb-4e18-461a-9b28-56d2b7bd8bea · outbound

This paper cites Use of Federated Learning and Blockchain towards Securing Financial Services.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Use of Federated Learning and Blockchain towards Securing Financial Services

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-08-16T10:44:47.479355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-16T10:44:46.182455Z digest=sha256:f593e590acac85758789f54b0e52c4105b83ac6613f338362f3089fbb3e76e49

Observation b04be903-2488-4035-9ea3-1d4aca24b738 · outbound

This paper cites Efficient and secure federated learning for financial applications.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Efficient and secure federated learning for financial applications

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.186624Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.186624Z digest=sha256:898031e7d1283de590a7a47d399229d24f970e17707f9ace68ead0bbf20c5459

Observation 256d069d-0885-4a48-b047-1ff9985fdb9d · outbound

This paper cites Machine learning ledger orchestration for drug discovery, 2019.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Machine learning ledger orchestration for drug discovery, 2019

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.190177Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.190177Z digest=sha256:90fbf874cfc9f4a36095e8a0fa51e6934034998dcb3f39025f700ca5554f73cd

Observation fb081879-77f1-466f-9a68-54e210dc4157 · outbound

This paper cites Protecting intellectual property of large language model-based code generation apis via watermarks.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Protecting intellectual property of large language model-based code generation apis via watermarks

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.193921Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.193921Z digest=sha256:09af8774532e810ba5b4984f963632ca6c93d2bdb57694632a98d6e0fcb550e3

Observation 9ab6d9e9-0f38-41a3-8b2d-f43e18a7d63a · outbound

This paper cites History, Development, and Principles of Large Language Models-An Introductory Survey.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks History, Development, and Principles of Large Language Models-An Introductory Survey

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.197542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.197542Z digest=sha256:a2f36dc75107cd390feec694610e6739582836d71d6ceaa5a54f3e8dc2db6a9c

Observation a84c1ff4-ebd7-435a-afdb-3f69d751aed0 · outbound

This paper cites Llmcarbon: Modeling the end-to-end carbon footprint of large language models, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Llmcarbon: Modeling the end-to-end carbon footprint of large language models, 2024

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.201585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.201585Z digest=sha256:c627be07043a19b89776daede19a31ceb3990d0bf9f2ba0c7a7ef5479ade350f

Observation 212d1029-726d-4da1-bb87-6875f225b0dd · outbound

This paper cites A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.205388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.205388Z digest=sha256:572bb1b863df846538262a1ab429178922065176608993de258e83dd5718ccca

Observation bfc85f36-16d2-42c7-b222-6e4f8f77264c · outbound

This paper cites Distilling the Knowledge in a Neural Network.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Distilling the Knowledge in a Neural Network

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.209671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.209671Z digest=sha256:bc0c19f7594e2828fc506039a021365452baf1adc79440e18c390e4fb09698fe

Observation 08b9cd34-4037-4c19-96e3-482974b1f47f · outbound

This paper cites Knowledge distillation: A survey.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Knowledge distillation: A survey

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.213444Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.213444Z digest=sha256:eaa9a5bf3cf8f1a345bc5f336c8ef4c604c54ec688a75cc7f7b662c2ca9ad6f3

Observation 0d87b8bf-6bc0-4cf8-9865-ac7df6ff5267 · outbound

This paper cites A Survey on Knowledge Distillation of Large Language Models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks A Survey on Knowledge Distillation of Large Language Models

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.216890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.216890Z digest=sha256:52a24e289171a7f12b8d39e80dcb7500d60b5b01a0e59200f5814c63fb882e53

Observation 501693a4-87f2-4c75-b476-91e7da505dd6 · outbound

This paper cites Survey on knowledge distillation for large language models: Methods, evaluation, and application.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Survey on knowledge distillation for large language models: Methods, evaluation, and application

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.220701Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.220701Z digest=sha256:d6154c35c6fc64836e56b593cb62ba81f02708bdf81f4fb19081a62a344818bc

Observation e83767b1-ff40-4b35-9743-d8602ef382d1 · outbound

This paper cites MiniLLM: On-Policy Distillation of Large Language Models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks MiniLLM: On-Policy Distillation of Large Language Models

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.224100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.224100Z digest=sha256:0541b827db5302a30a1028d36ff133fffb581cebc94ffaf3bc2c95fdba8c9cf7

Observation bfbf1d8d-1bf6-4009-a24e-70471d6885d7 · outbound

This paper cites On-policy distillation of language models: Learning from self-generated mistakes.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks On-policy distillation of language models: Learning from self-generated mistakes

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.227990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.227990Z digest=sha256:41fe4f919096c7a2dba400a83d874e8a83f1f1664850eb60aebefbce4a607ff5

Observation 25091c87-e6bf-4592-a6be-23d7031f6541 · outbound

This paper cites For distillation, tokens are not all you need.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks For distillation, tokens are not all you need

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.231960Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.231960Z digest=sha256:c1b4ccefb75884bece708cde27a7a9db78547eee492b2373239e435ccdcd0183

Observation 3b407a54-23fb-4bbc-bca7-28af039a29f2 · outbound

This paper cites Baby llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Baby llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.235369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.235369Z digest=sha256:31467f47bcde577798b15abb40bac13f675aab5b21e8b9c65c2af6b2bb36c573

Observation d0fc7f33-c572-4ede-8942-ae1d0ca3df4c · outbound

This paper cites LLAVADI: What Matters For Multimodal Large Language Models Distillation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks LLAVADI: What Matters For Multimodal Large Language Models Distillation

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.239106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.239106Z digest=sha256:e4372e7972f4f010ee8af621f697eff2227f14376bc57b017a60ef1d8e2d0f93

Observation 011c436e-9a8b-40ab-a24e-d24962197328 · outbound

This paper cites Less is more: Task-aware layer-wise distillation for language model compression.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Less is more: Task-aware layer-wise distillation for language model compression

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.242858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.242858Z digest=sha256:6bc40879e230d3eb6cdc3df8a12f65c4a8c821c5eab5caa760ebe4d062fa4809

Observation 5a0cc5d4-9173-4538-b088-2c889a83fbdf · outbound

This paper cites DDK: Distilling Domain Knowledge for Efficient Large Language Models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks DDK: Distilling Domain Knowledge for Efficient Large Language Models

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.246457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.246457Z digest=sha256:cb374eb2095a92f212ea9bad2200bcb407bc5f9e8d2a631cddc42926df9ff4d7

Observation baab51d5-428b-4f44-841f-ca0e02aeecef · outbound

This paper cites an unresolved cited work.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Unresolved cited work

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.250219Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.250219Z digest=sha256:7a25e89a4239fcbe8c9a470dc9129c40dee8745d53662a8d6e223731fcb3b1a9

Observation acb1a683-5d2f-4b38-99be-39ac61898fb5 · outbound

This paper cites Crash: Clustering, removing, and sharing enhance fine-tuning without full large language model.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Crash: Clustering, removing, and sharing enhance fine-tuning without full large language model

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.254026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.254026Z digest=sha256:b93183b85d28986416baa275029b2ce86859ce22642a625cd4d4b4a402c53939

Observation 9f821dc6-2f87-4765-98dd-cb3ce3c74dc9 · outbound

This paper cites Orchestration of emulator assisted mobile edge tuning for ai foundation models: A multi-agent deep reinforcement learning approach, 2023.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Orchestration of emulator assisted mobile edge tuning for ai foundation models: A multi-agent deep reinforcement learning approach, 2023

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.257878Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.257878Z digest=sha256:54afaf0b80eca5905890644ba54ab24f01cec98c44287c010b52a05533a34662

Observation f40ceb06-56c4-4ea1-9e0d-097122db45b4 · outbound

This paper cites Offsite-Tuning: Transfer Learning without Full Model.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Offsite-Tuning: Transfer Learning without Full Model

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.261726Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.261726Z digest=sha256:bfc948ac4090d7daacdb746584e3d8f3009d1e8d2a4f3a10faa2f7cc415b7fdd

Observation a2876486-338c-44e2-b9a5-48247a362d89 · outbound

This paper cites Fedpft: Federated proxy fine-tuning of foundation models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Fedpft: Federated proxy fine-tuning of foundation models

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.265382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.265382Z digest=sha256:b56fc26e8e7b6154c2036d4d42a93ab59b4a6627554cf255175e1443dd665be7

Observation 67e5378f-63a6-4a09-aa01-2facb45ec082 · outbound

This paper cites FedMD: Heterogenous Federated Learning via Model Distillation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks FedMD: Heterogenous Federated Learning via Model Distillation

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.268594Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.268594Z digest=sha256:518c5fd57916f990f7d555abf19f70afe46d77be91aba41c1ec110fd2806ab25

Observation 3a62eff5-5d0d-4af3-800e-f24bbb5a4dec · outbound

This paper cites Ensemble attention distillation for privacy-preserving federated learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Ensemble attention distillation for privacy-preserving federated learning

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.272871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.272871Z digest=sha256:f8b1d39d6766f1f09708a4120f17ef985c10655ba4238666135c557f210eb84f

Observation 7e4bcab2-6b0c-474b-b714-87e7a6a5e628 · outbound

This paper cites Preserving privacy in federated learning with ensemble cross-domain knowledge distillation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Preserving privacy in federated learning with ensemble cross-domain knowledge distillation

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.276375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.276375Z digest=sha256:338dfb4e6fd2ff8d36757e361b93cc409c7d5f5bba87ac8a43f949c2863c58c3

Observation 4ab9d33c-c3f6-4736-b589-19e938d32925 · outbound

This paper cites Data shunt: Collaboration of small and large models for lower costs and better performance.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Data shunt: Collaboration of small and large models for lower costs and better performance

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.280179Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.280179Z digest=sha256:7920cd117f6449cf36fc9a4b680633fbd038e87b473964141b45d769acc7d560

Observation bf0a6ef3-1e1a-4627-a2dd-4cdea7fb5f8f · outbound

This paper cites Parameterized knowledge transfer for personalized federated learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Parameterized knowledge transfer for personalized federated learning

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.284082Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.284082Z digest=sha256:5f284c992c14bbad47ffa9bb375e1a2b5832ea87b91d33a03f07043930b80a83

Observation a5e262d6-e8b5-44e4-b40e-7a9c7609ae28 · outbound

This paper cites Ensemble distillation for robust model fusion in federated learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Ensemble distillation for robust model fusion in federated learning

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.287781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.287781Z digest=sha256:9ce96b0cedf3228c051a3a1a8c489aaadea2e264b9c6ab8a55f82a26e85b6599

Observation bed5d0a6-22d4-4739-9edf-410889bcb96e · outbound

This paper cites Depth anything: Unleashing the power of large-scale unlabeled data.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Depth anything: Unleashing the power of large-scale unlabeled data

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.291496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.291496Z digest=sha256:54144cd0a78952991701d980ea982bb6a505087df8d55871410a7e8c8477be95

Observation cd7adc2e-ccf4-4dce-85e7-b4578323cd13 · outbound

This paper cites Robust federated learning with noisy and heterogeneous clients.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Robust federated learning with noisy and heterogeneous clients

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.295172Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.295172Z digest=sha256:6e2540d800eb55bb6dd92064f7fd7a3f94821149bdcb93a34dca2392ce470f41

Observation 0eeb8e14-547b-41a4-82d5-c3564d6b240f · outbound

This paper cites Fedtgp: Trainable global prototypes with adaptive-margin- enhanced contrastive learning for data and model heterogeneity in federated learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Fedtgp: Trainable global prototypes with adaptive-margin- enhanced contrastive learning for data and model heterogeneity in federated learning

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.298784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.298784Z digest=sha256:a8c357ae428c83de9c6211961d4db84b8093687978dea7e0aec3e5287a15bd31

Observation 9316be4a-f07b-407b-9d44-2e54592468f0 · outbound

This paper cites An upload-efficient scheme for transferring knowledge from a server-side pre-trained generator to clients in heterogeneous federated learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks An upload-efficient scheme for transferring knowledge from a server-side pre-trained generator to clients in heterogeneous federated learning

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.302487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.302487Z digest=sha256:58a6f488ed2249a8688db364fce43f223bdc2b362942c82d1ed6abec3fbbd925

Observation 23c3a549-51d9-4166-9a34-a95158e04955 · outbound

This paper cites Learning from human educational wisdom: A student-centered knowledge distillation method.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Learning from human educational wisdom: A student-centered knowledge distillation method.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.306152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.306152Z digest=sha256:735a53ffa01c93cc4dcc7a001c7d56a529e662b76f92bf0ba7498019ad52e269

Observation e5b36ebc-94c8-410c-b770-2ccc830933dc · outbound

This paper cites Bert learns to teach: Knowledge distillation with meta learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Bert learns to teach: Knowledge distillation with meta learning

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.309919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.309919Z digest=sha256:479dbeaf8e246f6fa893d08632911e9d31ef98f550001c018b75257335ee0bb5

Observation 2aa8ca11-d740-474b-ae70-58dd9f7cbe4b · outbound

This paper cites Fedgems: Federated learning of larger server models via selective knowledge fusion, 2021.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Fedgems: Federated learning of larger server models via selective knowledge fusion, 2021

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.313567Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.313567Z digest=sha256:d8cb8503864d0e0f687a1d45c2c796194e1ef9a671a94acea7430308a030f07d

Observation 53593872-91e9-4c34-8cb2-cb02754c28fb · outbound

This paper cites Multimodal Federated Learning via Contrastive Representation Ensemble.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Multimodal Federated Learning via Contrastive Representation Ensemble

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.317246Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.317246Z digest=sha256:e025a90d2491744d65bf24e51ae16663054971370c8a67d8161fb698a345495b

Observation 9355f99e-8834-46d6-a432-ea3a2f808460 · outbound

This paper cites Ideal: Query-efficient data-free learning from black-box models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Ideal: Query-efficient data-free learning from black-box models

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.321296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.321296Z digest=sha256:a3bebba4be3a0b608a3b2f8d07a763c9da87ebdfa15156b33b3b7714542a009d

Observation 45537e89-01b9-4769-b292-b9c29fd0bfef · outbound

This paper cites Towards data-free model stealing in a hard label setting.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Towards data-free model stealing in a hard label setting

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.324812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.324812Z digest=sha256:c114acbdee5bd8e5fe69f5ce7cd87c00fe09d22d60081fcc699f9138d4cefe6e

Observation 99a43378-b052-4007-9267-08b137970370 · outbound

This paper cites Zero-shot knowledge distillation from a decision-based black-box model.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Zero-shot knowledge distillation from a decision-based black-box model

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.328453Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.328453Z digest=sha256:b4473fb906b40895943073268ca04065eb2decfc5fe97f0de4e1b15589ac22d9

Observation f36365d1-0b86-405a-bc48-364988448f52 · outbound

This paper cites Bridging the gap between decision and logits in decision- based knowledge distillation for pre-trained language models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Bridging the gap between decision and logits in decision- based knowledge distillation for pre-trained language models

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.332161Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.332161Z digest=sha256:0361dc42ded173bcd5f058b27de884ceaeaa61971122281839e669a149ee92e0

Observation 2dd21afb-196a-4f87-a249-7e8edfdda47f · outbound

This paper cites Synthetic data distillation enables the extraction of clinical information at scale.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Synthetic data distillation enables the extraction of clinical information at scale

Reference 69

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.335887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.335887Z digest=sha256:6cc586733608ea0ba0213377211d473e6fdc2ebe973433884a883b17f54b565b

Observation 8c6c23a4-8ac0-45fe-86ef-393c9747ed5d · outbound

This paper cites ZeroGen: Efficient zero-shot learning via dataset generation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks ZeroGen: Efficient zero-shot learning via dataset generation

Reference 70

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.339545Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.339545Z digest=sha256:9baaad31efcc7977ba25149543ebb30781aa34f294b402a69be88ca5b6fc83da

Observation c8c8c076-7abd-4f2c-ae65-36a0adcd13c9 · outbound

This paper cites ProGen: Progressive zero- shot dataset generation via in-context feedback.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks ProGen: Progressive zero- shot dataset generation via in-context feedback

Reference 71

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.343330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.343330Z digest=sha256:b1372867c3f31521b8ef4f47fe20ae554b6d46e9f210fc7697c255faeb9448b9

Observation 8a469541-c0e0-47e7-bac9-655870860a6f · outbound

This paper cites Generating training data with language models: Towards zero-shot language understanding.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Generating training data with language models: Towards zero-shot language understanding

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.347192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.347192Z digest=sha256:f127b171d048ed882d925c6ad742d260a9b97d26711a641799be447e26640a73

Observation f48b7cfe-8cea-4c1e-a25b-64908c6b7c5e · outbound

This paper cites Self-guided noise-free data generation for efficient zero-shot learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Self-guided noise-free data generation for efficient zero-shot learning

Reference 73

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.350901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.350901Z digest=sha256:1d053b0dd33affd4f5705e0633d50466af8283440b07af30d71fd94b211bb770

Observation 75743248-dc6f-44d3-9b33-5134231957cb · outbound

This paper cites FuseGen: PLM Fusion for Data-generation based Zero-shot Learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks FuseGen: PLM Fusion for Data-generation based Zero-shot Learning

Reference 74

Resolution
verified exact
local_arxiv, observed 2026-08-16T10:44:47.351960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-16T10:44:46.354663Z digest=sha256:35caba645e5f616a5cffc17cb6eeffd349123e7a97eceddf1c90925506e5c522

Observation 0ca54650-e4fd-4abf-9808-bf8551cd04ab · outbound

This paper cites Retrieval-based knowledge transfer: An effective approach for extreme large language model compression.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Retrieval-based knowledge transfer: An effective approach for extreme large language model compression

Reference 75

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.358568Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.358568Z digest=sha256:e81f78b027c2c4186336452ee6053998bec6a97c084f15e8d395ac107c92c00f

Observation 1ee041d7-ac44-4558-b998-134b7c065fed · outbound

This paper cites Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective

Reference 76

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.362152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.362152Z digest=sha256:68aefc4e29ba8628c7b0dcde6aaf9c40a68c7a4f1623c57ceff7b16e05eec5e2

Observation a9ec2050-7224-4056-830e-33fde7f91982 · outbound

This paper cites Mutual enhancement of large and small language models with cross-silo knowledge transfer, 2023.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Mutual enhancement of large and small language models with cross-silo knowledge transfer, 2023

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.366082Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.366082Z digest=sha256:c0cb33248d8b350491030240e5cc22706ae205233880b2e0fbb75ec57886b036

Observation 0c3bf45a-3457-4962-bfe4-25e013b7be68 · outbound

This paper cites Zico Kolter.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Zico Kolter

Reference 78

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.369657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.369657Z digest=sha256:386107d68217380fe2b16f581da751ffd5754fe933ca6cf5182bcb75d6d9c3d1

Observation eb166ea0-28ce-416c-a97d-ff972c092f70 · outbound

This paper cites Zeroquant: Efficient and affordable post-training quantization for large-scale transformers.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Zeroquant: Efficient and affordable post-training quantization for large-scale transformers

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.373198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.373198Z digest=sha256:887c676d1a729b127b7df4230a123f980e5ddb7dedcf1b69cbc3bb33f2d8bd71

Observation 86366c57-49d8-4123-9ff7-202ab917a613 · outbound

This paper cites Initializing models with larger ones, 2023.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Initializing models with larger ones, 2023

Reference 80

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.376718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.376718Z digest=sha256:87ee3705ea985f8cceb86a9e338c5b7886146ee18d1063901465c797b7cc26d3

Observation 89a2ed07-072d-4ec6-aaef-8d04619476b8 · outbound

This paper cites Learning to Teach with Student Feedback.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Learning to Teach with Student Feedback

Reference 81

Resolution
verified exact
local_arxiv, observed 2026-08-16T10:44:47.323674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-16T10:44:46.380503Z digest=sha256:a75bec1e343eec14b19304d2b9b651d8b9da58437f880dacd280d5f54b0274b0

Observation 653bd436-6f53-43c6-bc0f-4519ce29138c · outbound

This paper cites Meta pseudo labels.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Meta pseudo labels

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.384437Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.384437Z digest=sha256:f2626e5844a3281b0d406642b97065de714a805fbc9b25d6d5191bc823817175

Observation fcafe17f-c28b-4962-99c2-7311316d8390 · outbound

This paper cites Dual knowledge distillation for bidirectional neural machine translation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Dual knowledge distillation for bidirectional neural machine translation

Reference 83

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.388105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.388105Z digest=sha256:81e3b1e53b220dac8907cf9b83c77ba8b2143d32f5d82102c9c6dab3b0822d7a

Observation 1e94c6be-7799-44a1-80c9-a93f4ec14fd6 · outbound

This paper cites Shadow knowledge distillation: Bridging offline and online knowledge transfer.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Shadow knowledge distillation: Bridging offline and online knowledge transfer

Reference 84

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.391962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.391962Z digest=sha256:2a95c7b40795c74d8c22f8e955456fee86f93c53f8d2fccd35aade4de22a1139

Observation 5631268b-b98b-4d40-aa12-e532f4a0fb99 · outbound

This paper cites Reverse knowledge distillation: Training a large model using a small one for retinal image matching on limited data.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Reverse knowledge distillation: Training a large model using a small one for retinal image matching on limited data

Reference 85

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.395826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.395826Z digest=sha256:453ed4e4abe221d943f2d89f8ed2b0714ab5ec058f85d9e50f1f019197216f51

Observation 13d67b45-d8fe-4b8e-8b78-77de7cca103d · outbound

This paper cites Weak-to-strong generalization: Eliciting strong capabilities with weak supervision.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Weak-to-strong generalization: Eliciting strong capabilities with weak supervision

Reference 86

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.399291Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.399291Z digest=sha256:c334bd47c8acc8a07ff1d405feaf15dde196267c32c9e637ea29c1bf5969963e

Observation 4ffe2dac-ddb9-426f-bf2a-02594e7649a1 · outbound

This paper cites FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models

Reference 87

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.402923Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.402923Z digest=sha256:eea4fa744435af5a1822b503c33a2eafa71f86ceb162eb606116cdc1c4903d72

Observation 4095410a-db30-48bc-b56a-10be0e0a3220 · outbound

This paper cites Federated learning with gan-based data synthesis for non-iid clients.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Federated learning with gan-based data synthesis for non-iid clients

Reference 88

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.407011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.407011Z digest=sha256:26858bf195743eecb06c77dfd0056e30710bdfb94f7b7cd9c5f90f17db1bdcfc

Observation 365e18fa-c049-4bba-a284-34eaf167b378 · outbound

This paper cites Gfl: Federated learning on non-iid data via privacy-preserving synthetic data.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Gfl: Federated learning on non-iid data via privacy-preserving synthetic data

Reference 89

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.411120Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.411120Z digest=sha256:5220d2fc8f46887a6302fa789a6f7d10799871b72288f3e3214ab69f033ff881

Observation 054a8ce7-5a98-4b47-a802-060b2d8b3028 · outbound

This paper cites Harnessing large- language models to generate private synthetic text, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Harnessing large- language models to generate private synthetic text, 2024

Reference 90

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.415019Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.415019Z digest=sha256:d3ca8a98cac98694867e339fc6594fa53080cb82cb1ba9032d0e79426a4d139d

Observation 0673faaf-d50e-4656-87f7-f2adf60cf415 · outbound

This paper cites Privacy-preserving instructions for aligning large language models, 2024.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Privacy-preserving instructions for aligning large language models, 2024

Reference 91

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.418584Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.418584Z digest=sha256:f876b88838fa0d9e7e8582c3bc1b9b05e4578b68f51de3d955c74bd11bac9e17

Observation a069455d-a82d-497d-9dd4-58c076cb719d · outbound

This paper cites Stable federated learning with dataset condensation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Stable federated learning with dataset condensation

Reference 92

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.422209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.422209Z digest=sha256:437b249884c7d7033890048d5df0c17013295eb9d44a737c18aefe2a0c29c50a

Observation 3f8db6b6-0076-4ceb-bec3-f5ff6b18a893 · outbound

This paper cites Federated learning via decentralized dataset distillation in resource-constrained edge environments.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Federated learning via decentralized dataset distillation in resource-constrained edge environments

Reference 93

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.426199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.426199Z digest=sha256:d0697c292cb784a8fcdb7db916adb81c6443a7a7096f25b023faaba4ae874acb

Observation 1521c53d-a7c0-48aa-99b6-5cfb6c1f123e · outbound

This paper cites Distilled One-Shot Federated Learning.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Distilled One-Shot Federated Learning

Reference 94

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.429615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.429615Z digest=sha256:e916b06b64f81e93dee3da75cb8c8511d4c7f75375ffd7c87776d49ff19ebbf0

Observation f4570f03-8979-4dfc-80e8-0ef801e708c6 · outbound

This paper cites Dataset Distillation.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Dataset Distillation

Reference 95

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.433313Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.433313Z digest=sha256:9db4bfc97f0b950e6786494055a98d120fa8c9611a4375f4243b80f45e7a9571

Observation bca449ac-7084-42ab-bcd7-e365633c9d33 · outbound

This paper cites Dataset Condensation with Gradient Matching.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Dataset Condensation with Gradient Matching

Reference 96

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.437416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.437416Z digest=sha256:2bb01fa6d3ab12ca0ddb5ffe6598dd3019bade59ad2cc431ecf0ad8391abc1c8

Observation 7d7faec7-e866-4541-bdf2-38ba4ad635f8 · outbound

This paper cites Dauphin, and David Lopez-Paz.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Dauphin, and David Lopez-Paz

Reference 97

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.441320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.441320Z digest=sha256:15ca1471ad52435347e9812943a3de5968c3649f10ab8f6b55ce04816875c5ab

Observation 2ba250a1-8151-4485-91c2-e4738ae7d0e6 · outbound

This paper cites Mix2fld: Downlink federated learning after uplink federated distillation with two-way mixup.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Mix2fld: Downlink federated learning after uplink federated distillation with two-way mixup

Reference 98

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.444872Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.444872Z digest=sha256:eeac73eecb04d74f555c3a8afcbf75d98e56f49380c6aa6b49a32eae38ac2c9b

Observation 94e8fefb-568d-4595-9d9f-abbeae50b9f7 · outbound

This paper cites Differentially private synthetic data via foundation model APIs 1: Images.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Differentially private synthetic data via foundation model APIs 1: Images

Reference 99

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.448467Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.448467Z digest=sha256:14b466f7b5244ba7c324880377ea03da5e969a88f1cae4f626b771240c68a5dc

Observation 50ddea9a-c945-47ab-9d93-cbaf7ff53d12 · outbound

This paper cites Differentially Private Synthetic Data via Foundation Model APIs 2: Text.

Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Reference 100

Resolution
unresolved
no resolver link, observed 2026-08-16T10:44:46.451764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T10:44:46.451764Z digest=sha256:62b6bb844b7c53c24b873ecf8cca81be5044b4cf0865d7ee87da5a8b3e38780d

Pith citing papers

Observation c35419c0-6f1e-4660-8682-238d0f362c13 · inbound

Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges cites this paper.

Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks

Reference 90

Resolution
verified exact
local_arxiv, observed 2026-08-06T15:06:50.267056Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-06T15:06:48.172897Z digest=sha256:aeeb0f0fbdf34042ec514744cd90e8ac7e6122895a24960076eddcb80cfc0056