Pith. sign in

REVIEW 4 major objections 6 minor 1 cited by

Price Aware Power Split Control in Heterogeneous Battery Storage Systems

T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read The paper claims that jointly optimizing price-aware dispatch and internal power splitting in one EMS yields distinct, complementary strengths for LP and RL controllers.

desk verdict Useful integrated BESS dispatch/power-split framework, but the headline LP/RL trade-off is uninterpretable without the missing objective weights. read the letter →

arxiv 2507.00628 v1 pith:MVJZPH2S submitted 2025-07-01 eess.SY cs.SY

Sheng Yin , Vivek Teja Tanjavooru , Thomas Hamacher , Christoph Goebel , Holger Hesse This is my paper · ORCID
classification eess.SYcs.SY
keywords batteryenergystoragesystemspowersplitcontrolreinforcementlearninglinearprogrammingstateofchargebalancingthermalprice-awareschedulingheterogeneousmulti-stringBESS
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Commercial battery storage systems usually split control into a high-level scheduler that reacts to electricity prices and a low-level power splitter that balances strings, leaving money and battery health on the table. The paper tries to close that gap with a single framework that decides, at every 15-minute step, both how much power the whole battery trades with the grid and how that power is divided between two heterogeneous strings, while tracking cost, state-of-charge imbalance, and temperature imbalance. It compares a rolling-horizon linear program (with perfect or persistent forecasts) against a reinforcement-learning controller pre-trained by cloning LP solutions, on a simulated industrial site with one 300 kWh and one 200 kWh string. The central result is a trade-off: LP achieves 33% greater cumulative savings and better SOC balance, while RL achieves roughly 10% higher system efficiency and better temperature balance, with more adaptability to forecast errors. If this holds, EMS designs need not choose between economic and physical objectives, and the choice between model-based and learning-based control can be made by the operating environment.

What carries the argument

The load-bearing object is the weighted-sum objective of Eq. (3): minimize over time $x\cdot\text{cost}_t + y\cdot \Delta soc_t + z\cdot \Delta \tau_t$, where the first term is electricity cost, the second is the summed absolute deviation of each string's SOC from the mean, and the third is the analogous temperature deviation. The same expression, with cost replaced by cost reduction, serves as the RL reward in Eq. (18), so both controllers optimize the identical scalarized goal. Around that objective, a coupled electro-thermal simulation chain—inverter power loss, SOC–open-circuit-voltage relation, equivalent circuit current, and a lumped thermal model—converts the two power set points into the SOC and temperature values that feed the balancing terms; the LP solves this rolling horizon with forecasts, and the RL agent observes state $s_t = [p^L_t, p^{PV}_t, soc^{B1}_{t-1}, soc^{B2}_{t-1}, \tau^{B1}_{t-1}, \tau^{B2}_{t-1}, k^{ToU}_t]$ and outputs $a_t = [p^{B1}_t, p^{B2}_t]$.

What would settle it

Rerun the 365-day scenario with the same code but with the normalization weights explicitly varied, for example setting the temperature term to zero or making it dominate the cost term; if the LP-vs-RL ranking on savings, efficiency, SOC, and temperature does not stay qualitatively the same across those weight settings, the claimed trade-off depends on an arbitrary scalarization rather than on the controllers themselves.

Watch

Extended reading notes

Core claim

On the paper's own terms, the discovery is that a one-stage, price-aware power split controller is achievable and that the two optimization families are complementary rather than one dominant. In 365-day simulation, the LP benchmark with perfect forecasts produced 33% larger cumulative savings than RL and kept the two strings' SOC closer to the mean, while the RL controller produced about 10% higher system efficiency and kept temperatures more uniform; under a 7-day scenario with imbalanced initial SOC and temperature, LP with perfect foresight exploited a predictable active phase and maximized savings, whereas RL matched it on most metrics and outperformed the persistent-forecast LP under uncertainty. The authors attribute the RL efficiency edge to lower throughput-related losses and the LP savings edge to sharper exploitation of price differences, and they note that even the perfect-foresight LP is not globally optimal because of its limited rolling horizon and simplified battery model.

Load-bearing premise

The load-bearing premise is that the unstated normalization weights x, y, z in the objective and reward define the right trade-off among cost, SOC balance, and temperature balance; if different weights were chosen, the LP dispatch and the RL reward would both change, and the reported 33%-savings versus 10%-efficiency comparison could flip.

Editorial extensions

If this is right

  • Operating a heterogeneous multi-string battery as one monolithic unit is suboptimal; dispatch and power split can live in a single optimization stage without giving up either economic or physical goals.
  • For operators with reliable forecasts and stable conditions, LP remains the benchmark for savings and SOC homogeneity; under forecast uncertainty, an RL policy pre-trained on LP solutions can maintain efficiency and thermal balance without a forecast model.
  • Savings and efficiency are not aligned: the controller that saves more money runs the batteries harder and loses more energy, so EMS design must state which metric is primary.
  • The behavior-cloned PPO approach makes RL training feasible for BESS control, since the policy starts from LP demonstrations rather than from random exploration.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The unreported normalization weights (x, y, z) in Eq. (3) are an unexamined degree of freedom: different weight choices would change both the LP dispatch and the RL reward, potentially inverting the reported trade-offs between savings, SOC balance, and temperature balance.
  • Because temperature balance improves with RL while savings improve with LP, a practical hybrid might use LP for day-ahead energy trading and RL for intra-day power split, but the paper does not test that combination.
  • The paper measures savings and efficiency but not battery aging directly; if temperature uniformity is a proxy for longer life, the RL advantage may translate into deferred replacement cost, a link the authors leave implicit.
  • The claims are established in one simulated industrial site with one price profile; scaling to more strings, different chemistries, or real market prices is a testable extension rather than a demonstrated result.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes a unified framework for the simultaneous optimization of external battery dispatch (price-aware charge/discharge scheduling) and internal power split among heterogeneous battery strings, with secondary objectives of SOC and temperature balancing. Two controller families are compared: a rolling-horizon linear program (LP) with perfect or persistent forecasts, and a proximal policy optimization (PPO) reinforcement-learning controller that is first pre-trained by behavior cloning from LP expert trajectories. Using the EMSx dataset and a detailed electro-thermal battery simulation, the authors run a 365-day long-term scenario and a 7-day short-term scenario with asymmetric initial conditions. The headline findings are that LP yields 33% greater cumulative savings and better SOC balance, while RL achieves 10% higher system efficiency and better temperature balance, with RL showing more adaptability under forecast uncertainty.

Significance. The paper addresses a real and relevant gap: most BESS EMS studies treat the system as a single homogeneous unit, whereas commercial multi-string systems require joint handling of economic dispatch and internal heterogeneity. The contribution of an integrated, open simulation framework with electro-thermal models is valuable, and comparing model-based and learning-based controllers in the same environment is timely. If the claims are confirmed, the paper would provide a useful benchmark for EMS research. However, the central trade-off results are conditioned on scalarization weights that are never reported, and the RL method is not independent of the LP due to behavior cloning. These issues are fixable with additional experiments and transparency, but as written they limit the reproducibility and robustness of the conclusions.

major comments (4)
  1. [Eq. (3) and Eq. (18)] The scalarization weights x, y, z in the objective function are never reported. Equation (3) defines the LP objective as a weighted sum of cost, SOC imbalance, and temperature imbalance, and Equation (18) uses the same weighted sum as the RL reward. The text only says the coefficients are 'selected such that each individual objective is normalized,' but neither the values nor the normalization procedure are given. Because these weights define the Pareto trade-off between economic savings and balancing objectives, the headline results (33% greater savings for LP, 10% higher efficiency for RL, and the SOC versus temperature trade-off) are conditional on an unreported choice. A sensitivity analysis over (x,y,z) is required to establish that the reported trade-offs are robust; without it, the central empirical claim is not reproducible.
  2. [Section II-B] The RL controller is not model-free in the usual sense: it is pre-trained by behavior cloning from LP expert trajectories generated under perfect forecasts. The abstract and introduction repeatedly call the RL approach 'model-free,' but the policy is initialized from and bounded by the LP's solution structure. The comparison is therefore between LP and an LP-initialized learner, not between independent model-free and model-based methods. This conflation affects the interpretation of the 10% efficiency advantage and the adaptability claims in Scenario 2. The authors should either drop the 'model-free' characterization or include a fully model-free baseline for comparison.
  3. [Section IV-B] In Scenario 2, only RL* is evaluated, where RL* is the instance selected from 10 training runs based on savings. This is a selection-bias problem: reporting the best seed on the evaluation metric inflates the RL results and makes the comparison with the deterministic LP controllers unfair. The paper should report the distribution over the 10 seeds (e.g., mean and interquartile range) for Scenario 2, or justify why a single selected instance is representative. Similarly, the headline long-term numbers in Fig. 2 are point estimates without confidence intervals; the authors should state the variability across seeds.
  4. [Eq. (19)] The system efficiency metric η is defined as 1 − (Σ losses)/(Σ |pB|·Δt). This ratio depends on total absolute battery throughput: a controller that uses the battery less will tend to show higher efficiency even if its absolute losses are similar or lower. The metric is also undefined if total throughput is zero. The short-term results in Fig. 4 show that RL* incurs higher absolute losses than the LP solutions, yet the long-term results report 10% higher efficiency for RL. The authors should clarify how the efficiency metric interacts with throughput and report absolute losses and throughput separately, otherwise the efficiency advantage may be an artifact of the metric definition.
minor comments (6)
  1. [Eqs. (1) and (13)] Equation (1) uses a static selling tariff kSell, while Eq. (13) writes kSell_t, implying time dependence; please clarify whether the selling tariff is constant or time-varying.
  2. [Eq. (19)] The notation pBESS[m]_t = Σ_m pB[m]_t is confusing; the left-hand side should be the total battery power, not an indexed quantity. Please correct the notation.
  3. [Abstract and Conclusion] The numbers '33% greater savings' and '10% higher efficiency' appear only in the abstract and conclusion. The results section should state these percentages explicitly and identify the reference controller (LPp or LPf) for each comparison.
  4. [Fig. 2] The axis labels for savings and temperature omit units (presumably € and °C), and the caption 'Saving ( )' appears incomplete. Please include units throughout.
  5. [Section II-B] The term 'model-free RL' is used despite the behavior-cloning warm start; please qualify this wording to avoid misleading readers (see major comment 2).
  6. [Section III-A] The paper claims an open-source framework but does not provide a repository URL or licensing information. Please add the link or specify where the code will be released.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the LP/RL comparison is empirical, and the shared scalarized objective is disclosed rather than hidden.

full rationale

The paper's central claims are empirical comparisons from simulation, not derivations from first principles. The RL reward in Eq. (18) is indeed the negative of the LP objective in Eq. (3) shifted by the no-battery cost, and the RL policy is pre-trained on LP expert trajectories in Section II-B. However, the paper states this openly: the reward is 'defined according to Equation (3)' and the method is explicitly 'behavior cloning from Linear Programming solutions.' This is a benchmarking design choice, not a hidden reduction of the results to the inputs. The headline metrics—savings, DeltaSOC, DeltaTau, and efficiency—are computed from the simulation outputs (Eqs. (1), (14), (15), (19)), not read off from the objective or the expert trajectories, so the reported trade-offs are not forced by construction. The unreported normalization weights (x,y,z) in Eq. (3) are a reproducibility and sensitivity-analysis concern, because different weights could change the reported trade-offs, but this is not circularity: the weights are not fitted to a subset of the outcome metrics and then renamed as predictions. The self-citations ([2] for the thermal model, [14] for the BC-LP PPO framework) are method components, not load-bearing uniqueness or existence theorems, and the present paper describes the relevant parts of the method inline. No circular step can be exhibited beyond the disclosed design equivalence between the LP objective and the RL reward, which does not constitute a circularity violation. Score 0.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

The central comparisons rest on the scalarized objective (x,y,z), the simplified linear models used inside the LP optimizer, the market price assumptions, and the transferability of the EMSx dataset. No new physical entity is introduced; the BC-LP PPO procedure is a training method, not an entity. The unreported weights are the most consequential free design choice because they define both the LP objective and the RL reward.

free parameters (4)
  • Multi-objective weights (x, y, z) in Eq. (3) = Not reported
    Weights normalize cost, SOC imbalance, and temperature imbalance; values not given. They set the LP dispatch and the RL reward, so all trade-off results depend on them.
  • Tax ratio k for energy trading in Eq. (1) = Not reported
    k scales both purchase and sell prices and directly affects the savings metric; its value is not specified in the manuscript.
  • LP rolling-horizon length and re-optimization interval = Not reported
    The rolling-horizon LP performance depends on the forecast window and update frequency, which are not stated.
  • RL training budget and PPO hyperparameters = Not reported
    Total episodes, learning rates, entropy coefficients, and behavior-cloning ratio are not reported; RL variance across seeds is shown but training details are absent.
assumptions (4)
  • domain assumption The linear SOC dynamics in Eq. (7) and linear thermal dynamics in Eq. (9) are adequate surrogates for the detailed electro-thermal simulator used for evaluation.
    The LP optimizer uses simplified linear models while the environment uses an ECM plus thermal model; the paper itself notes this simplification reduces LP accuracy, so the adequacy of the surrogate is load-bearing.
  • ad hoc to paper Operator preferences are representable as a fixed weighted sum of cost, SOC imbalance, and temperature imbalance.
    Eq. (3) and Eq. (18) impose a scalarized objective with weights x,y,z chosen for normalization; no elicitation or sensitivity analysis is provided.
  • domain assumption Scaling day-ahead market prices to a ToU tariff and applying a fixed feed-in tariff is a valid market model for the studied site.
    The price model in Section III-A fixes purchase rates in a 0.18 to 0.38 EUR/kWh band and a sell tariff, with no market feedback or tariff-structure sensitivity.
  • domain assumption The EMSx dataset ID 4 is representative of realistic industrial load and PV profiles.
    All results are generated from this single dataset; transferability to other sites or seasons is assumed but not tested.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Price Aware Power Split Control in Heterogeneous Battery Storage Systems." pith.science (2026). https://pith.science/paper/MVJZPH2S

@misc{pith2026250700628,
  author       = {Pith},
  title        = {Pith review of: Price Aware Power Split Control in Heterogeneous Battery Storage Systems},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MVJZPH2S}},
  note         = {Machine review of arXiv:2507.00628}
}
read the original abstract

This paper presents a unified framework for the optimal scheduling of battery dispatch and internal power allocation in Battery energy storage systems (BESS). This novel approach integrates both market-based (price-aware) signals and physical system constraints to simultaneously optimize (1) external energy dispatch and (2) internal heterogeneity management of BESS, enhancing its operational economic value and performance. This work compares both model-based Linear Programming (LP) and model-free Reinforcement Learning (RL) approaches for optimization under varying forecast assumptions, using a custom Gym-based simulation environment. The evaluation considers both long-term and short-term performance, focusing on economic savings, State of Charge (SOC) and temperature balancing, and overall system efficiency. In summary, the long-term results show that the RL approach achieved 10% higher system efficiency compared to LP, whereas the latter yielded 33% greater cumulative savings. In terms of internal heterogeneity, the LP approach resulted in lower mean SOC imbalance, while the RL approach achieved better temperature balance between strings. This behavior is further examined in the short-term evaluation, which indicates that LP delivers strong optimization under known and stable conditions, whereas RL demonstrates higher adaptability in dynamic environments, offering potential advantages for real-time BESS control.

Figures

Figures reproduced from arXiv: 2507.00628 by the authors.

Figure 1
Figure 1. Integrated EMS framework comprising the energy [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Long-Term average performance assessment of RL and [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. EMSx input dataset for ToU tariff. 0 100 Saving ( ) LP p LP f RL * 0.0 0.5 S O C 0 5 10 (° C) 0 1 2 3 4 5 6 7 Time (Day) 0 100 Loss (kWh) [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Short-term control performance of RL and LP based [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Multi-Objective Nonlinear Power Split Control For BESS With Real-Time Simulation Feedback

    eess.SY 2025-07 conditional novelty 5.0 of 10

    A simulation study showing that a mixed-integer nonlinear model-predictive controller can balance inverter and battery losses in multi-string battery storage, with small efficiency and thermal gains.

Reference graph

Works this paper leans on

20 extracted references · 17 canonical work pages · cited by 1 Pith paper

  1. [1]

    Battery energy storage technology for power systems—an overview,

    K. C. Divya and J. Østergaard, “Battery energy storage technology for power systems—an overview,” Electric power systems research, vol. 79, no. 4, pp. 511–520, 2009

    work page 2009

  2. [2]

    Optimal power split control for state of charge balancing in battery systems with integrated spatial thermal analysis and aging estima- tion,

    V . T. Tanjavooru, M. Graner, P. Pant, T. Hamacher, and H. Hesse, “Optimal power split control for state of charge balancing in battery systems with integrated spatial thermal analysis and aging estima- tion,” Wiley Energy Storage , 2025, peer-reviewed version available at [10.22541/au.173641852.23711820/v1]

    work page arXiv 2025

  3. [3]

    An integrated approach for the analysis and control of grid connected energy storage systems,

    C. Patsios, B. Wu, E. Chatzinikolaou, D. J. Rogers, N. Wade, N. P. Brandon, and P. Taylor, “An integrated approach for the analysis and control of grid connected energy storage systems,” Journal of Energy Storage, vol. 5, pp. 48–61, 2016

    work page 2016

  4. [4]

    Optimal bidding strategy of battery storage in power markets considering performance- based regulation and battery cycle life,

    G. He, Q. Chen, C. Kang, P. Pinson, and Q. Xia, “Optimal bidding strategy of battery storage in power markets considering performance- based regulation and battery cycle life,” IEEE Transactions on Smart Grid, vol. 7, no. 5, pp. 2359–2367, 2015

    work page 2015

  5. [5]

    Reconfigurable battery techniques and systems: A survey,

    S. Ci, N. Lin, and D. Wu, “Reconfigurable battery techniques and systems: A survey,” IEEE access, vol. 4, pp. 1175–1189, 2016

    work page 2016

  6. [6]

    Multibattery optimal coordination control for home energy management systems via distributed iterative adaptive dynamic programming,

    Q. Wei, D. Liu, G. Shi, and Y . Liu, “Multibattery optimal coordination control for home energy management systems via distributed iterative adaptive dynamic programming,” IEEE Transactions on Industrial Elec- tronics, vol. 62, no. 7, pp. 4203–4214, 2015

    work page 2015

  7. [7]

    Model predictive control for in- tersubmodule state-of-charge balancing in cascaded h-bridge converter- based battery energy storage systems,

    G. Liang, E. Rodriguez, G. G. Farivar, E. Nunes, G. Konstantinou, C. D. Townsend, R. Leyva, and J. Pou, “Model predictive control for in- tersubmodule state-of-charge balancing in cascaded h-bridge converter- based battery energy storage systems,” IEEE Transactions on Industrial Electronics, vol. 71, no. 6, pp. 5777–5786, 2023

    work page 2023

  8. [8]

    Modeling of lithium-ion battery degradation for cell life assessment,

    B. Xu, A. Oudalov, A. Ulbig, G. Andersson, and D. S. Kirschen, “Modeling of lithium-ion battery degradation for cell life assessment,” IEEE Transactions on Smart Grid , vol. 9, no. 2, pp. 1131–1140, 2016

    work page 2016

Show all 20 references
  1. [9]

    Optimal integration of a hybrid solar-battery power source into smart home nanogrid with plug- in electric vehicle,

    X. Wu, X. Hu, Y . Teng, S. Qian, and R. Cheng, “Optimal integration of a hybrid solar-battery power source into smart home nanogrid with plug- in electric vehicle,” Journal of power sources , vol. 363, pp. 277–283, 2017

    2017

  2. [10]

    Aging aware operation of lithium-ion battery energy storage systems: A review,

    N. Collath, B. Tepe, S. Englberger, A. Jossen, and H. Hesse, “Aging aware operation of lithium-ion battery energy storage systems: A review,” Journal of Energy Storage , vol. 55, p. 105634,

  3. [11]

    Improved ocv model of a li-ion nmc battery for online soc estimation using the extended kalman filter,

    I. Baccouche, S. Jemmali, B. Manai, N. Omar, and N. Amara, “Improved ocv model of a li-ion nmc battery for online soc estimation using the extended kalman filter,” Energies, vol. 10, no. 6, p. 764, 2017

    2017

  4. [12]

    Methods for state-of-charge de- termination and their applications,

    S. Piller, M. Perrin, and A. Jossen, “Methods for state-of-charge de- termination and their applications,” Journal of Power Sources , vol. 96, no. 1, pp. 113–120, 2001

    2001

  5. [13]

    Analysis of the maximal possible grid relief from pv-peak-power impacts by using storage systems for increased self-consumption,

    J. Mosh ¨ovel, K.-P. Kairies, D. Magnor, M. Leuthold, M. Bost, S. G ¨ahrs, E. Szczechowicz, M. Cramer, and D. U. Sauer, “Analysis of the maximal possible grid relief from pv-peak-power impacts by using storage systems for increased self-consumption,” Applied Energy, vol. 137, ...

    2015

  6. [14]

    Boosting the performance of deep reinforcement learning for energy management systems using behavior cloning from linear programming solutions,

    S. Yin, C. Goebel, and H. Hesse, “Boosting the performance of deep reinforcement learning for energy management systems using behavior cloning from linear programming solutions,” in Proceedings of the 16th ACM International Conference on Future Energy Systems (e-Energy ’25). N...

    2025

  7. [15]

    Emsx: a numerical benchmark for energy management systems,

    A. Le Franc, P. Carpentier, J.-P. Chancelier, and M. De Lara, “Emsx: a numerical benchmark for energy management systems,” Energy Systems, vol. 14, no. 3, pp. 817–843, 2023

    2023

  8. [16]

    Gurobi Optimizer Reference Manual,

    Gurobi Optimization, LLC, “Gurobi Optimizer Reference Manual,”

  9. [17]

    Stable-baselines3: Reliable reinforcement learning implementations,

    A. Raffin, A. Hill, A. Gleave, A. Kanervisto, M. Ernestus, and N. Dormann, “Stable-baselines3: Reliable reinforcement learning implementations,” Journal of Machine Learning Research , vol. 22, no. 268, pp. 1–8, 2021. [Online]. Available: http://jmlr.org/papers/v22/ 20-1364.html

    2021

  10. [18]

    imitation: Clean imitation learning implementations,

    A. Gleave, M. Taufeeque, J. Rocamonde, E. Jenner, S. H. Wang, S. Toyer, M. Ernestus, N. Belrose, S. Emmons, and S. Russell, “imitation: Clean imitation learning implementations,” arXiv:2211.11972v1[ cs.LG], 2022. [Online]. Available: https://arxiv. org/abs/2211.11972

    2022 arXiv

  11. [2022]

    Available: https://linkinghub.elsevier.com/retrieve/pii/ S2352152X2201622X

    [Online]. Available: https://linkinghub.elsevier.com/retrieve/pii/ S2352152X2201622X

  12. [2024]

    Available: https://www.gurobi.com

    [Online]. Available: https://www.gurobi.com

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.