REVIEW 3 major objections 4 minor 48 references
Towards Requirements for a Demand Side Response Energy Management System for Households
T0 review · 3 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read Household energy automation will be rejected without manual override, report finds
desk verdict A competent, honest requirements elicitation for household demand-response automation, but the self-selected Bristol sample and deferred analysis details mean its requirements are hypotheses about acceptance, not established universal constraints. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is a twelve-part requirements table, organised into five groups (Control, Per-Device Automation, Personalisation, Default Participation, Education), which the authors update from an earlier pilot study using this study's interview and workshop data. The requirements table carries the argument by converting qualitative themes into concrete design constraints, such as manual override (R1), selective per-device automation (R4), personalisation (R5), and informing users of gains and losses (R11). The supporting machinery is a Grounded Theory analysis of semi-structured interviews, validated through two co-design workshops where participants worked through time-preference setting, user journeys, and pricing exercises.
What would settle it
A field trial with a larger, more representative sample that offers full-house automation without manual override and measures continued use and satisfaction would test the claim: if a substantial fraction of users accept the automated service without ever using an override, then the report's conclusion that manual override is 'essential' would be contradicted.
Extended reading notes
Core claim
The paper's central claim is that an automated energy management service for households must support manual override, per-device automation, personalisation, transparent data handling, and clear feedback, because without these features it will not be accepted by households. In the authors' words, 'Manual override is viewed as essential', and the updated requirements table confirms selective per-device automation and personalisation as preferred. The study further finds that users are motivated by both environmental and financial outcomes, that they expect the system to fit existing routines before changing them, and that data-privacy concerns are real but often met with resignation. The conclusion is that a future system should be clear, easy to use, initially aligned to current practices, and designed so that users benefit from participating rather than lose by not engaging.
Load-bearing premise
The study assumes that its 45 self-selected participants—28 interviewees and 17 workshop attendees, mostly drawn from Bristol and the researchers' social networks—represent the diversity of households at large; Section 3.1 admits that participation was driven by who responded to appeals.
Editorial extensions
If this is right
- Any household demand-side response service that omits manual override is likely to be rejected, because users want to respond to pressing household needs and maintain a sense of control.
- Automation should be selectable per device rather than applied uniformly, since washing machines, dryers, and dishwashers have different constraints and different comfort levels for delayed unloading.
- Personalisation across days, seasons, and household circumstances is necessary, as routines vary between weekdays and weekends and between different types of households.
- Transparent data handling and visible feedback on energy use, cost, and environmental impact are needed to build trust, especially during the initial period when users are verifying that the system works correctly.
- Time-of-use pricing can encourage demand shifting, but it must be structured so that low-income or high-need households are not penalised, and it should be combined with environmental and social motivators.
Reading between the lines
- The report implies that acceptance should be measured not just by initial sign-up but by continued use after the novelty wears off; a service that fails to provide timely feedback or easy override will likely see drop-off, which is a testable prediction for future trials.
- The finding that most participants accepted data sharing as inevitable suggests that explicit, simple opt-in choices about data use could become a differentiator between energy services, turning resignation into informed consent; this is an extension the paper does not develop.
- The 'new normal' pattern described by participants—where initial discomfort fades as habits form—points toward a longitudinal study design: acceptance may increase over weeks, so short-term pilot results may understate the long-term viability of automation.
- The pricing example based on shifting a 1.5 kWh appliance from a 24p peak to an 8p off-peak band could be turned into a simple calculator for householders to see their own potential savings, an application the paper mentions only in the context of the workshop.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper reports a qualitative requirements elicitation exercise for a household demand-side response (DSR) energy management system, conducted in collaboration with the Bristol REPLICATE Smart Homes project. The study comprises semi-structured interviews with 28 householders (16 REPLICATE participants and 12 external colleagues/friends) and two co-design workshops with 17 participants. The authors present thematic findings on domestic practices, attitudes to automation, system use, motivations/rewards, and data access, and update a set of requirements previously proposed in their pilot study (Section 5.1, Table). The central claim is that a household DSR automation service must support manual override, per-device automation, personalisation, transparent data handling, and clear feedback in order to be accepted by households at large.
Significance. If the reported requirements are robust, the paper offers useful, concrete design guidance for domestic DSR services, including a user-journey framework and practical recommendations for the REPLICATE trial. The authors are transparent about their recruitment constraints, and the combination of interviews and workshops is a reasonable qualitative design for an early-stage elicitation. However, because the analysis and validation results are deferred to a separate paper and the sample is a self-selected convenience sample, the requirements are currently best read as candidate hypotheses for the study population rather than established constraints for households generally.
major comments (3)
- [Section 3.3 and Section 5.1] Section 3.3 states that 'the theory building and validation results will be detailed in a separate paper,' and the requirements table in Section 5.1 provides no traceability from the interview/workshop data to the updated requirements (no coding scheme, theme definitions, or indicative evidence for individual rows). Since the central contribution is the requirements set, the reader cannot independently assess the empirical grounding of the 'Updated overview' column; the claims of validation through the workshops are not substantiated in this report.
- [Section 3.1 and Section 2.2] The study's participants are a self-selected convenience sample: the 28 interviewees were drawn from REPLICATE volunteers and the authors' colleagues/friends, and the paper acknowledges in Section 3.1 that 'the reality was driven by who responded to appeals for participation.' The key research question in Section 2.2 asks what requirements are needed for adoption by 'households at large,' and the abstract repeats this universal framing. Without demographic data on the sample or a transferability argument, the leap from these 45 Bristol participants to households at large is not justified; the report should either soften the claims or add a limitations section explicitly scoping the requirements to the Bristol trial context.
- [Section 3.2 and Section 4] Section 3.2 says the workshops were used to 'validate' the interview findings, but the paper reports no details on the validation exercises (e.g., the 'additional brief questionnaire' from workshop 2), no results from those exercises, and no indication of whether any interview themes were refuted or modified. The thematic findings in Sections 4.1-4.5 are presented with illustrative quotes, but the prevalence or representativeness of each theme is not reported. To support the claim that the requirements are validated, the authors should report the workshop validation outcomes and, ideally, some evidence of theme frequencies or at least a clear statement that this is an exploratory elicitation with candidate requirements.
minor comments (4)
- [Section 5.1, R9] There is a typo: 'carful thought' should be 'careful thought'.
- [Section 5.2] The tariff table is difficult to parse; the column headers and the 'average April May June' row are not clearly aligned, and the time band row seems to overlap with the tariff row. Please reformat for readability.
- [Section 3.3] The report cites the pilot study [6] and uses it as the starting point for the requirements table, but does not summarize the pilot's methods or findings; adding a brief description would help readers understand the provenance of the initial requirements.
- [Figure 1] Figure 1 is referenced in Section 4.3 and its caption appears, but the figure image is not present in the version I reviewed; please ensure the figure is included and legible.
Circularity Check
No construction-level circularity; the only self-citation is to the authors' pilot as a starting point, and the central requirements are updated from new interviews and workshops.
full rationale
This report makes no mathematical or model-based derivation: its central claims are qualitative requirements elicited from 28 interviews and developed/validated in two workshops, so there are no fitted parameters or equations whose outputs reduce to their inputs. The requirements table in Section 5.1 does begin from the authors' own pilot study, with 'Our earlier pilot study [6] suggested the following requirements for DSR automation service to households (in column 2) - this is updated below with data from this research', but the updated claims are explicitly supported by new participant data and workshop exercises, making the self-citation a starting hypothesis rather than load-bearing evidence. Section 3.3 and Section 4 note that detailed theory-building and validation results will be reported in a separate paper, which limits the checkable evidence in this report but is not a circular reduction. Likewise, the acknowledged self-selection of participants (Section 3.1: 'the reality was driven by who responded to appeals for participation') is a representativeness limitation affecting generalization to households at large, not a circularity in the derivation of the requirements. Overall, the proposed design constraints - manual override, per-device automation, personalisation, transparent data handling, and feedback - are grounded in the elicited data rather than being equivalent to the study's inputs by definition.
Assumptions & free parameters
assumptions (2)
- domain assumption Participants are representative of households at large
- domain assumption Thematic coding and workshop feedback validate the interview findings
Cite this review
Pith. "Pith review of Towards Requirements for a Demand Side Response Energy Management System for Households." pith.science (2026). https://pith.science/paper/33XTFXOU
@misc{pith2026190802617,
author = {Pith},
title = {Pith review of: Towards Requirements for a Demand Side Response Energy Management System for Households},
year = {2026},
howpublished = {\url{https://pith.science/paper/33XTFXOU}},
note = {Machine review of arXiv:1908.02617}
}
read the original abstract
Demand response is considered to be one of the key means through which peak energy demand could be ameliorated. This report presents a requirements elicitation exercise (undertaken in collaboration with the Bristol City Council, UK) to elicit the requirements that a smart appliance automation service for domestic energy demand response management must address to be accepted by the households. The study comprises of an interview study with 28 householders, the findings from which were validated through two co-design workshops.
Figures
Reference graph
Works this paper leans on
-
[6]
References and further reading 15
-
[1]
Introduction The purpose of this report is to inform the design of household energy management service trials in the context of the Bristol REPLICATE (REnaissance in PLaces with Innovative Citizenship And Technology) Smart Homes project. The University of Bristol (through the collaboration of the EPSRC Household Supplier Energy Market (HoSEM) and Refactor...
-
[2]
Context 2 2.1 Background 2 2.2 REPLICATE (REnaissance in PLaces with Innovative Citizenship And TEchnology) 3
-
[3]
Methodology 4 3.1 Interviews: 4 3.2 Workshops 4 3.3 Analysis 4
-
[4]
Thematic Findings 5 4.1 Domestic practices and routines 5 4.2 What would automation mean to the user? 6 4.3 Using an energy management system 8 4.4 Motivations, rewards and pricing 10 4.5 Access to and use of data 12
-
[5]
Discussion and conclusions 13 5.1 Summarised Requirements for DSR automation 13 5.2 REPLICATE - specific outcomes / recommendations 14
-
[7]
Acknowledgements 15 Appendix 1: FAQs derived from the interviews 16 2
-
[8]
Context In order to address climate change issues, energy use must be more efficient and based on generation from renewable sources . In the UK, progress is being made and e lectricity is increasingly coming from clean renewable sources such as wind and solar - these are different from dirty fossil fuel-based power as their supply is intermittent and requ...
work page 2017
Show all 48 references
-
[9]
element of this work for the purpose of our report. In particular, we are interested in their research question: ‘What are the key factors affecting consumer engagement in terms of: recruitment, level of response and persistence?’ Key findings are listed in the bullet points b...
2015
-
[10]
We also do not discuss the pre-interview trial, which is already reported in [6]
Methodology Our qualitative study sought to inform the design of the energy management service, using interviews and workshops to explore household limitations, expectations and acceptability of such services , from the perspective of the participating Bristol households. We a...
2018
-
[11]
The theory building and validation results will be detailed in a separate paper
Thematic Findings Here we present the identified/validated themes from the interviews and workshop data. The theory building and validation results will be detailed in a separate paper. 4.1 Domestic practices and routines Our interviews showed how participants went about their...
-
[12]
For most of these there is some small fle xibility – for example the evening meal might be shiftable by 30mins but not 60mins
Cooking appliances – this includes electric hobs, ovens, microwave, kettle, toaster, food mixer / blender. For most of these there is some small fle xibility – for example the evening meal might be shiftable by 30mins but not 60mins. But, for many, the need / desire for susten...
-
[13]
A number of households have at least one sound system on all evening whilst others cited the needs of children in relation to consoles and television
Entertainment – including games consoles, televisions and sound systems. A number of households have at least one sound system on all evening whilst others cited the needs of children in relation to consoles and television. Again, there is small shiftability but use is perceiv...
-
[14]
Household / work management – PC, electric heating, electric shower and water heating , lighting, hoover, iron
-
[15]
Personal – hairdryer, electric razor and toothbrush; chargers for laptop, phone, tablet etc. 4.2 What would automation mean to the user? We asked participants about the likely benefits and possible problems that they could envisage using an automated system (e.g., connected to...
-
[16]
Convenience takes a number of forms: Optimisation of energy and price by handing over control so that the system can make best price and energy decisions within constraints set by the user. The user has the reassurance that use of clean energy is optimised and energy is being ...
-
[17]
I think there should me more sort of advice about how you can be more efficient and that sort of thing. And maybe sort of tailored to you, rather than just random
Energy efficiency is the core ambition, for users this means better use of resources and better understanding of their energy use. Some points are discussed below: The facts that the management system can make decisions based on availability of renewable energy and that will h...
-
[18]
I think that is good the automation thing. I think that would be good, if overall it helped cut costs then I’m for it
Financial benefits Most interview respondents expected to see some sort of financial benefit and v ariable pricing is one approach that we explored in the workshop s. Users need more information on possible savings and expect the system to support financially beneficial decisi...
-
[19]
Reducing risk of appliance failure / malfunction – which was a concern of the interviewees Malfunction might be through the appliance overheating or other problems whilst the appliance is in use remotely through the management system. The workshop participants suggested that t...
-
[20]
As so often mentioned, information is key – for example on when best to use energy with real-time updates, monthly summar ies and neighbourhood comparisons
Helping to bring about bigger “smart” changes Beyond domestic automation of particular appliance s, users were also interested in how this connects to a bigger picture in terms of new ‘smart’ approaches to household and city management and how it might help us collectively und...
-
[21]
We won’t find it a problem because we’d adapt and think, well we can’t use things at certain time so you’d use it when you could
Alienation from ‘normal’, the ‘robots’ are taking over and ‘big brother is watching’ are all concerns relating to an automated energy / home management systems. Whilst these concerns were recognised, users also suggested that energy management systems could become a ‘new norma...
-
[22]
Setting time preferences: using a 24hr clock face, participants worked through how they might set usage time-bands for each appliance. Key issues in relation to setting time preferences for operation of appliances: • Dryer and dishwasher use s are easier to shift – particularl...
-
[23]
I would sacrifice, you know, if something was maybe a bit disruptive or not perfect, then I would rather sacrifice that to reduce the energy consumption
Service delivery: We used the notion of user journey ( as shown in Fig. 1 ) to help users think through the steps of using an energy management system and what they might find or need at each step. The steps can be grouped into four main phases, with their relevant issues disc...
-
[24]
Requirements Group Initial Requirement Updated overview Control R1
Discussion and conclusions 5.1 Summarised Requirements for DSR automation Our earlier pilot study [6] suggested the following requirements for DSR automation service to households (in column 2)– this is updated below with data from this research and this table summarises some ...
-
[25]
some use dishwashers regularly at night whilst others worry about fire safety and want to be present and awake whilst it is in operation
-
[26]
Personalisation R6
in family households with small children, one parent manages most of the washing whilst in shared households, those with lodgers or with adult children devices have multiple users. Personalisation R6. Set own goals Drivers for engaging with automation services vary, although m...
-
[27]
References and further reading
-
[28]
A focus on Small Energy Users
Realising the potential of demand-side response to 2025. A focus on Small Energy Users. Summary Report November 2017. Department for Business Energy and Industrial Strategy, UK
2025
-
[29]
A focus on small energy users
Realising the Potential of Demand-side response to 2025. A focus on small energy users. Summary Report; Rapid Evidence Assessment report. November 2017. Department for Business Energy and Industrial Strategy, UK
2025
-
[30]
Greenwich Energy Heroes: https://greenwichenergyhero.org/
-
[31]
The Solent Achieving Value from Efficiency (SAVE) project: https://save-project.co.uk/
-
[32]
Agile Octopus - A consumer-led shift to a low carbon future (2018) Octopus Energy https://octopus.energy/static/consumer/documents/agile-report.pdf
2018
-
[33]
Ruzanna Chitchyan, Palvi Shah, Caroline Bird
Eliciting Requirements for Demand Response Service Design to Households: A Pilot Study. Ruzanna Chitchyan, Palvi Shah, Caroline Bird. EASE 2019, Copenhagen. URL: https://dl.acm.org/citation.cfm?id=3319355
2019
-
[34]
Acknowledgements Our thanks to the interviewees and workshop participants for their time and openness in responding to the questions and exercises, and to the REPLICATE team at Bristol City Council for their input to the design of the study and access to relevant project data....
2020
-
[35]
Who do I contact if I need help with the system? See your ‘useful contacts’ sheet provided
-
[36]
The energy management system can only work when smart control is switched on so simply switch this off if you have any concerns and contact the project team
What happens if my appliance or the EMS malfunctions? If your appliance malfunctions please contact Samsung support. The energy management system can only work when smart control is switched on so simply switch this off if you have any concerns and contact the project team
-
[37]
What happens if there is a power cut? The energy management system will not function in this instance
-
[38]
Do I need to do anything with my home wifi? No
-
[39]
If you have a tablet then you can use the app on that also
My phone is quite old, will I still be able to take part? Providing it is a smart phone and you have downloaded the smartthings app then yes. If you have a tablet then you can use the app on that also
-
[40]
Can more than one person have the app? Yes
-
[41]
What do you mean by ‘use times’? The times at which your machine will be used
-
[42]
Will the app tell me when my appliance will finish / has finished running? If you set notifications for this then yes
-
[43]
I want to be there when my appliance is running, will I be able to set it so that it does not run when I am out? We recommend using the appliance when you are at home so please bear this in mind when setting your preferences
-
[44]
I don’t like my washing being left in the machine after it has run, will I be able to set it so that it finishes running when I am available to empty it? Yes you will have total control when you set your start (and therefore end) time
-
[45]
How long will I have to wait once I have loaded my appliance? If you have loaded your appliance at a peak time, the energy management system may delay this so yes you would wait until the peak time ends
-
[46]
Will you provide feedback on how the system is working for me / for everyone? Yes you will be able to achieve a Gold, Silver or Bronze standard in terms of compliance with the energy management system preferences to work when energy is greener and cheaper to provide
-
[47]
You will be able to see your level of compliance with the energy management system through a Gold, Silver, Bronze rating
How will I be able to find out how much energy has been saved / shifted? The amount of energy used will not differ. You will be able to see your level of compliance with the energy management system through a Gold, Silver, Bronze rating
-
[48]
The cost will depend on how much you pay for your electricity and will vary between household
How do I know how much energy different settings use and how much they cost? Please see your user manual for energy use guidance. The cost will depend on how much you pay for your electricity and will vary between household
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.