REVIEW 4 major objections 5 minor 1 cited by
Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring
T0 review · 4 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Prompt-only LLMs can perform basic non-intrusive load monitoring without training, but their accuracy trails specialized deep-learning models; their strengths are cross-house transfer and readable explanations.
desk verdict Prompt-only LLMs for NILM are honestly benchmarked and fall short of DL baselines, but the cross-region generalization claim is not supported by the experiments as designed. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying mechanism is the prompt itself, specifically the knowledge-injection and context blocks of the framework. Appliance features estimated by statistics from a few training houses are written into the prompt, and the state predictions from the previous window are appended as context; the LLM is instructed to output JSON state sequences. Ablations show that adding context delivers the largest single performance boost and that power range is the most decisive appliance feature: removing it drops the F1 score from 0.5376 to 0.3008, while removing pattern description only lowers it to 0.5725. The framework's sensitivity analyses establish that window length and context length must be tuned to model capacity—longer windows help larger LLMs but cause smaller ones to violate the required output format.
What would settle it
Run the same framework with knowledge extracted from REDD houses 2–3 but test on an unseen UK-DALE house (house 1 or 5) rather than house 2; if overall F1 collapses toward chance, the cross-region generalization claim fails. As a second check, replace the injected power ranges with deliberately wrong values and confirm the F1 falls back to the no-knowledge level of about 0.30, which would show the prompt, not some latent model knowledge, is carrying the capability.
Extended reading notes
Core claim
The paper's central discovery is a capability boundary for prompt-only LLMs in NILM. Using the proposed framework, a prompt composed of a role/task description, statistical appliance knowledge (standby power, power range, typical duration, usage pattern), a one-shot example, and the previous window's predicted states turns a general LLM into a zero-shot appliance-state detector. On REDD house 1 and UK-DALE house 2 the optimized prompt yields overall F1 scores of 0.4397 and 0.6120 for the stronger LLM, versus 0.7289 and 0.8721 for the Seq2Point CNN baseline; power estimation is weaker still, with signal aggregate error of about 0.425 versus 0.170 for the baseline. Appliances with sharp, high-power signatures or strong periodicity are detected most reliably, while multi-stage devices such as dishwashers are frequently masked by other loads. The same prompt, with only the knowledge block rewritten, transfers to the unseen US house and to the UK appliance set, and the model supplies natural-language justifications that can be checked against the aggregate signal. The paper reads these results as defining the boundary: prompt-only LLMs are not accuracy-competitive, but they offer training-free deployment, easy adaptation, and explainability.
Load-bearing premise
The claim that the approach generalizes rests on the assumption that appliance characteristics measured in a few known houses describe the same appliance types in unseen houses well enough for a text-only prompt to recognize them.
Editorial extensions
If this is right
- A zero-training NILM deployment is possible: adapting to a new house or a different regional appliance set means editing the prompt's knowledge block, not retraining a model.
- LLM-based disaggregation is usable where transparency matters more than peak accuracy, since every ON/OFF decision comes with a textual rationale that can be compared with the aggregate power trace.
- The accuracy gap quantifies what prompt-only knowledge can capture: distinctive signatures (peak power, periodic cycling) transfer, while multi-stage signatures like a dishwasher's are lost among other loads.
- Practitioners should pair window length and context length with model capacity; beyond a window of about 30 samples, smaller models' output format stability degrades sharply.
- Power-value estimation is not yet practical by prompting alone, so near-term applications should treat appliance state detection as the deliverable.
Reading between the lines
- A strict cross-region test remains open: the UK knowledge and the UK test set both come from house 2, so applying REDD-derived knowledge to an unseen UK house would be the decisive experiment for the regional generalization claim.
- Because power range alone carries most of the gain, automatically mining sharper appliance signatures (e.g., per-cycle envelopes or duration distributions) from unlabeled aggregate data could cheaply raise zero-shot accuracy.
- The emitted rationales could be used as machine-checkable evidence rather than decoration: a threshold rule can verify each explanation against the aggregate signal and flag disagreements, turning explainability into a quality-control loop.
- The context block acts as a hand-written state smoother; an agent that maintains a longer internal belief state across windows might close part of the gap with trained models without fine-tuning.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces LLM4NILM, a prompt-based framework that uses general-purpose large language models (LLMs) for non-intrusive load monitoring (NILM) without any model training. The framework injects appliance knowledge (power range, standby power, duration, usage pattern), one-shot examples, timestamps, and contextual information from previous windows into a prompt. The authors evaluate state-detection performance on REDD and UK-DALE, compare against Seq2Seq and Seq2Point baselines, and report that LLMs lag specialized DL models in F1 score but claim strong zero-shot generalization across houses and regions, as well as human-readable explainability. The paper also includes ablations of prompt components, knowledge-injection factors, window size, context length, and model capacity, concluding that LLMs are not ready to replace DL methods but may complement them in adaptable, transparent systems.
Significance. If the claims hold, this is a useful capability-boundary study: it is among the first systematic evaluations of prompt-only LLMs for NILM, and it honestly documents a clear accuracy gap while exploring generalization and explainability. The ablations are informative, particularly the finding that power range is the most influential knowledge component and that context length has a non-monotonic effect. The headline negative result (LLMs lag specialized models) is consistently supported by Table 3 across both datasets. The main advertised positive claim, however, is cross-region generalization, and that claim is currently under-supported by the experimental design.
major comments (4)
- [Section 6, Section 6.2, Section 3.1] The cross-region generalization claim (RQ2, abstract, Section 6.2) is not actually tested. Section 6 states that for UK-DALE, "we use data from house 2, splitting it into training (70%), validation (10%), and testing (20%)," while Section 3.1 says appliance knowledge is "extracted from historical data using statistical methods." Thus the UK-DALE test set is a later time slice of the same household used to derive the prompt knowledge, not an unseen house in a new region. The REDD experiment (knowledge from houses 2/3, test on unseen house 1) supports cross-house generalization, but no experiment evaluates an unseen UK household. The claim of "generalization ... across different houses and even regions" therefore rests on a single in-house temporal split and should be revised, or the experiment should be rerun on a held-out UK-DALE house.
- [Section 6, Table 3] The LLM results are stochastic API outputs, but each reported F1 score appears to come from a single run with no variance, repetition, temperature setting, or seed information. Given the large gaps between models (e.g., GPT-4.1-mini vs. DeepSeek-V3-0324 on REDD), single-run point estimates are insufficient to establish stable model rankings or reliable performance levels. The paper should report mean and standard deviation over multiple calls, or at least specify the sampling parameters and justify that the reported values are representative.
- [Section 6, Section 3.1] It is unclear whether the UK-DALE appliance knowledge (standby power, power range, duration, usage pattern) is computed from the training split only or from the full house-2 dataset. If the knowledge statistics are computed before the temporal split, information from the test period could leak into the prompts. The manuscript should state explicitly which portion of house 2 is used for knowledge extraction and, if necessary, recompute the statistics on the training split.
- [Section 6.3, Appendix B] The explainability evaluation is purely qualitative. The paper states that explanations are "verifiable" and compares them against ground truth and the aggregate signal, but no systematic protocol, metric, or inter-annotator assessment is provided. As explainability is one of the three central research questions, the RQ3 claim would be stronger with a defined evaluation procedure, even a simple correctness-rate measure over a sample of explanations.
minor comments (5)
- [Figure 6a] The caption states that the dishwasher is omitted from the figure, yet the overall F1 score includes it; this makes the overall trend hard to interpret because the composition of the average changes with appliance coverage. A note explaining how the overall score is computed in the figure would help.
- [Table 2] The rows of Table 2 are not labeled, so the reader must infer which knowledge combinations correspond to each row. Adding row labels or checkmarks for Power, Duration, and Pattern would improve readability.
- [Section 4.3] The Output Normalizer uses forward padding or truncation for misaligned outputs. Since the LLM is penalized for length errors, the choice of padding direction could affect appliance-state boundaries; a brief discussion of this effect would be useful.
- [Appendix A] The prompt template is helpful but omits the concrete appliance knowledge values used for REDD and UK-DALE (e.g., the actual power ranges and durations). Providing the exact knowledge entries in an appendix or supplementary file would make the study reproducible.
- [Section 5.1] The phrase "unseen REDD test set" in the caption of Figure 4 is slightly misleading because the knowledge is derived from houses 2 and 3, so the house is unseen but the appliance types and their statistical features are known. The wording could be clarified.
Circularity Check
No significant circularity: prompt-only NILM evaluation is empirical and self-contained against external benchmarks.
full rationale
The paper's central claims are empirical comparisons, not derivations that reduce to their inputs. Appliance knowledge is 'extracted from historical data using statistical methods' (Section 3.1) from REDD houses 2/3 and the UK-DALE house 2 training split, then injected into prompts and evaluated on the REDD house 1 test set (an unseen house) and the UK-DALE house 2 test split. That is a normal transfer/evaluation protocol: the knowledge is fit to a training source and tested on held-out data; the reported F1 scores are not algebraically forced by the knowledge values. Prompt-component ablations and window/context sensitivity analyses are similarly empirical. The paper's self-citations (e.g., [11], [27], [29]) appear in background or formatting contexts and are not load-bearing; no uniqueness theorem or ansatz is imported from the authors' prior work. The only notable weakness is that the claimed 'cross-region' generalization for UK-DALE is tested on a temporal split of the same house (house 2) used to derive the knowledge, so the evidence does not fully support generalization to a new UK household. That is a limitation in the support for a generalization claim, not a circular derivation; accordingly, no circular step is identified.
Assumptions & free parameters
free parameters (4)
- Ground-truth ON/OFF power thresholds =
microwave 200W, fridge 50W, dishwasher 10W, washing machine 20W, kettle 2000W
- Prompt knowledge features (power range, standby power, ON duration, usage pattern, cycle duration) =
per-appliance statistics estimated from REDD houses 2/3 and UK-DALE house 2 training data
- Window size and context length =
window 100, context 10 for large-scale evaluation
- Output normalizer rules =
forward padding or truncation for misaligned outputs; malformed outputs discarded
assumptions (4)
- domain assumption Fixed power thresholds faithfully represent true appliance ON/OFF states (Section 4.1)
- domain assumption Appliance knowledge features estimated from the training houses transfer to unseen houses (Section 3.1, Section 6.2)
- domain assumption JSON-mode API outputs, after normalization, are a fair representation of LLM performance (Section 4.3)
- standard math The NILM disaggregation problem is ill-posed and requires priors (Section 1, citing Hart 1992)
Cite this review
Pith. "Pith review of Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring." pith.science (2026). https://pith.science/paper/SQIMMC2M
@misc{pith2026250506330,
author = {Pith},
title = {Pith review of: Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring},
year = {2026},
howpublished = {\url{https://pith.science/paper/SQIMMC2M}},
note = {Machine review of arXiv:2505.06330}
}
read the original abstract
Non-intrusive load monitoring (NILM) aims to disaggregate total electricity consumption into individual appliance usage, thus enabling more effective energy management. While deep learning has advanced NILM, it remains limited by its dependence on labeled data, restricted generalization, and lack of explainability. This paper introduces the first prompt-based NILM framework that leverages large language models (LLMs) with in-context learning. We design and evaluate prompt strategies that integrate appliance features, contextual information, and representative time-series examples through extensive case studies. Extensive experiments on the REDD and UK-DALE datasets show that LLMs guided solely by prompts deliver only basic NILM capabilities, with performance that lags behind traditional deep-learning models in complex scenarios. However, the experiments also demonstrate strong generalization across different houses and even regions by simply adapting the injected appliance features. It also provides clear, human-readable explanations for the inferred appliance states. Our findings define the capability boundaries of using prompt-only LLMs for NILM tasks. Their strengths in generalization and explainability present a promising new direction for the field.
Figures
Figures from the paper (4 more)
Forward citations
Cited by 1 Pith paper
-
UST-SSM: Unified Spatio-Temporal State Space Models for Point Cloud Video Modeling
A point cloud video action recognition model is claimed (UST-SSM), but the submitted full text is an unrelated energy disaggregation paper, so the central claim is unverifiable.
Reference graph
Works this paper leans on
-
[1]
Nonintrusive appliance load monitoring
George W Hart. Nonintrusive appliance load monitoring. Proceedings of the IEEE, 80(12):1870–1891, 1992
work page 1992
-
[2]
Non-intrusive load monitoring approaches for disaggregated energy sensing: A survey
Ahmed Zoha, Alexander Gluhak, Muhammad Ali Imran, and Sutharshan Ra- jasegarar. Non-intrusive load monitoring approaches for disaggregated energy sensing: A survey. Sensors, 12(12):16838–16866, 2012
work page 2012
-
[3]
Redd: A public data set for energy disag- gregation research
J Zico Kolter and Matthew J Johnson. Redd: A public data set for energy disag- gregation research. In Workshop on data mining applications in sustainability (SIGKDD), San Diego, CA , volume 25, pages 59–62. Citeseer, 2011
work page 2011
-
[4]
Stephen Makonin and Fred Popowich. Nonintrusive load monitoring (nilm) performance evaluation: A unified approach for accuracy reporting. Energy Efficiency, 8:809–814, 2015
work page 2015
-
[5]
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. nature, 521(7553):436–444, 2015
2015
-
[6]
Neural nilm: Deep neural networks applied to energy disaggregation
Jack Kelly and William Knottenbelt. Neural nilm: Deep neural networks applied to energy disaggregation. In Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments , pages 55–64, 2015
work page 2015
-
[7]
A regression approach to single-channel speech separation via high-resolution deep neural networks
Jun Du, Yanhui Tu, Li-Rong Dai, and Chin-Hui Lee. A regression approach to single-channel speech separation via high-resolution deep neural networks. IEEE/ACM Transactions on Audio, Speech, and Language Processing , 24(8):1424– 1437, 2016
work page 2016
-
[8]
Sequence-to-point learning with neural networks for non-intrusive load monitoring
Chaoyun Zhang, Mingjun Zhong, Zongzuo Wang, Nigel Goddard, and Charles Sutton. Sequence-to-point learning with neural networks for non-intrusive load monitoring. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence , 2018
work page 2018
Show all 38 references
-
[9]
Bert4nilm: A bidirectional transformer model for non-intrusive load monitoring
Zhenrui Yue, Camilo Requena Witzig, Daniel Jorde, and Hans-Arno Jacobsen. Bert4nilm: A bidirectional transformer model for non-intrusive load monitoring. In Proceedings of the 5th International Workshop on Non-Intrusive Load Monitoring, pages 89–93, 2020
2020
-
[10]
Auglpn-nilm: Augmented light- weight parallel network for nilm embedding attention module over sequence to point
Wuqing Yu, Linfeng Yang, and Xiangyu Liu. Auglpn-nilm: Augmented light- weight parallel network for nilm embedding attention module over sequence to point. Sustainable Energy, Grids and Networks , 38:101378, 2024
2024
-
[11]
Towards real-world deployment of nilm systems: Challenges and practices
Junyu Xue, Yu Zhang, Xudong Wang, Yi Wang, and Guoming Tang. Towards real-world deployment of nilm systems: Challenges and practices. In 2024 IEEE International Conference on Sustainable Computing and Communications (Sus- tainCom), pages 16–23, 2024
2024
-
[12]
A survey of large language models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. A survey of large language models. arXiv preprint arXiv:2303.18223, 2023
2023 arXiv
-
[13]
A survey on in-context learning
Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Jingyuan Ma, Rui Li, Heming Xia, Jingjing Xu, Zhiyong Wu, Baobao Chang, et al. A survey on in-context learning. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 1107–1128, 2024. Junyu Xu...
2024
-
[14]
A survey of zero-shot learning: Settings, methods, and applications
Wei Wang, Vincent W Zheng, Han Yu, and Chunyan Miao. A survey of zero-shot learning: Settings, methods, and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 10(2):1–37, 2019
2019
-
[15]
Generalizing from a few examples: A survey on few-shot learning
Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur), 53(3):1–34, 2020
2020
-
[16]
The uk-dale dataset, domestic appliance- level electricity demand and whole-house demand from five uk homes
Jack Kelly and William Knottenbelt. The uk-dale dataset, domestic appliance- level electricity demand and whole-house demand from five uk homes. Scientific data, 2(1):1–14, 2015
2015
-
[17]
Approximate inference in additive factorial hmms with application to energy disaggregation
J Zico Kolter and Tommi Jaakkola. Approximate inference in additive factorial hmms with application to energy disaggregation. In Artificial intelligence and statistics, pages 1472–1482. PMLR, 2012
2012
-
[18]
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE , 86(11):2278– 2324, 1998
1998
-
[19]
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735–1780, 1997
1997
-
[20]
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in Neural Information Processing Systems (NeurIPS) , volume 30, 2017
2017
-
[21]
A review of current methods and challenges of advanced deep learning-based non-intrusive load monitoring (nilm) in residential context
Hasan Rafiq, Prajowal Manandhar, Edwin Rodriguez-Ubinas, Omer Ahmed Qureshi, and Themis Palpanas. A review of current methods and challenges of advanced deep learning-based non-intrusive load monitoring (nilm) in residential context. Energy and Buildings, page 113890, 2024
2024
-
[22]
Using explain- ability tools to inform nilm algorithm performance: a decision tree approach
Rachel Stephen Mollel, Lina Stankovic, and Vladimir Stankovic. Using explain- ability tools to inform nilm algorithm performance: a decision tree approach. In Proceedings of the 9th ACM International Conference on Systems for Energy- Efficient Buildings, Cities, and Transporta...
2022
-
[23]
Toward transparent load disaggregation—a framework for quantitative evaluation of explainability using explainable ai
Djordje Batic, Vladimir Stankovic, and Lina Stankovic. Toward transparent load disaggregation—a framework for quantitative evaluation of explainability using explainable ai. IEEE Transactions on Consumer Electronics , 70(1):4345–4356, 2023
2023
-
[24]
Toward explainable nilm: Real-time event-based nilm framework for high-frequency data
Grigorii Gerasimov, Ilia Kamyshev, Sahar Moghimian Hoosh, Elena Gryazina, and Henni Ouerdane. Toward explainable nilm: Real-time event-based nilm framework for high-frequency data. arXiv preprint arXiv:2501.16841, 2025
2025
-
[25]
Transfer learning for multi-objective non-intrusive load monitoring in smart building
Dandan Li, Jiangfeng Li, Xin Zeng, Vladimir Stankovic, Lina Stankovic, Changjiang Xiao, and Qingjiang Shi. Transfer learning for multi-objective non-intrusive load monitoring in smart building. Applied Energy, 329:120223, 2023
2023
-
[26]
Adaptive fusion feature transfer learning method for nilm
Keqin Li, Jian Feng, Juan Zhang, and Qi Xiao. Adaptive fusion feature transfer learning method for nilm. IEEE Transactions on Instrumentation and Measurement, 72:1–12, 2023
2023
-
[27]
Evsense: A robust and scalable approach to non-intrusive ev charging detection
Xudong Wang, Guoming Tang, Yi Wang, Srinivasan Keshav, and Yu Zhang. Evsense: A robust and scalable approach to non-intrusive ev charging detection. In Proceedings of the Thirteenth ACM International Conference on Future Energy Systems, pages 307–319, 2022
2022
-
[28]
A semi-supervised load identification method with class incremental learning
Leixin Qiu, Tao Yu, and Chaofan Lan. A semi-supervised load identification method with class incremental learning. Engineering Applications of Artificial Intelligence, 131:107768, 2024
2024
-
[29]
Fednilm: Applying federated learning to nilm applications at the edge
Yu Zhang, Guoming Tang, Qianyi Huang, Yi Wang, Kui Wu, Keping Yu, and Xun Shao. Fednilm: Applying federated learning to nilm applications at the edge. IEEE Transactions on Green Communications and Networking , 7(2):857–868, 2022
2022
-
[30]
Federated learning-based non-intrusive load monitoring adaptive to real-world heterogeneities
Qingquan Luo, Chaofan Lan, Tao Yu, Minhang Liang, Wencong Xiao, and Zhen- ning Pan. Federated learning-based non-intrusive load monitoring adaptive to real-world heterogeneities. Scientific Reports, 15(1):18223, 2025
2025
-
[31]
Promptcast: A new prompt-based learning paradigm for time series forecasting
Hao Xue and Flora D Salim. Promptcast: A new prompt-based learning paradigm for time series forecasting. IEEE Transactions on Knowledge and Data Engineering, 36(11):6851–6864, 2023
2023
-
[32]
Large language models are zero-shot time series forecasters
Nate Gruver, Marc Finzi, Shikai Qiu, and Andrew G Wilson. Large language models are zero-shot time series forecasters. Advances in Neural Information Processing Systems, 36:19622–19635, 2023
2023
-
[33]
Large language models for time series: A survey
Xiyuan Zhang, Ranak Roy Chowdhury, Rajesh K Gupta, and Jingbo Shang. Large language models for time series: A survey. arXiv preprint arXiv:2402.01801, 2024
2024 arXiv
-
[34]
Chain-of-thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems , 35:24824–24837, 2022
2022
-
[35]
Unisep: Universal target audio separation with language models at scale
Yuanyuan Wang, Hangting Chen, Dongchao Yang, Weiqin Li, Dan Luo, Guangzhi Li, Shan Yang, Zhiyong Wu, Helen Meng, and Xixin Wu. Unisep: Universal target audio separation with language models at scale. arXiv preprint arXiv:2503.23762, 2025
2025 arXiv
-
[36]
Lisa: Reasoning segmentation via large language model
Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, and Jiaya Jia. Lisa: Reasoning segmentation via large language model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9579–9589, 2024
2024
-
[37]
Transfer learning for non-intrusive load monitoring
Michele D’Incecco, Stefano Squartini, and Mingjun Zhong. Transfer learning for non-intrusive load monitoring. IEEE Transactions on Smart Grid, 11(2):1419–1429, 2019
2019
-
[38]
APPLIANCE_NAMES[0]_status
Rachel Stephen Mollel, Lina Stankovic, and Vladimir Stankovic. Explainability- informed feature selection and performance prediction for nonintrusive load monitoring. Sensors, 23(10):4845, 2023. A PROMPTS Role. You are an expert system specializing in Non-intrusive Load Monito...
2023
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.