REVIEW 4 major objections 6 minor 24 references
Dilated Balanced Cross Entropy Loss for Medical Image Segmentation
T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read A weighted cross-entropy loss that also weights each object's surrounding pixels can match the performance of Dice+CE in medical segmentation.
desk verdict A simple new weighting scheme for cross-entropy that performs comparably to Dice+CE, but single-run results and per-dataset tuning of the one hyperparameter leave the practical claim conditional. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machine is the pixel-wise weight map $M = \max_c W_c$, where $W_c$ is the dilated, area-normalized mask of class $c$. Given binary ground-truth masks $B_c$ and a disk structuring element of radius $R$, each mask is dilated to $B'_c$, normalized by its area to $W_c = B'_c / \sum B'_c$, and the per-pixel maximum over classes is the loss weight. The CE loss map is then multiplied pointwise by $M$ and summed. This construction carries the argument: it moves balancing weight from the object to its uncertain boundary zone, bounds the weight of tiny classes through dilation, and lets the smallest object dominate where masks overlap.
What would settle it
Select $R$ by cross-validation on a validation split for each task, then compare DBCE against plain CE and Dice+CE on the same held-out test sets; if DBCE no longer beats CE or matches Dice+CE, the claim is settled false. A more mechanism-specific test would measure the false-positive rate in the ring around each object, since DBCE should cut it relative to balanced CE.
Extended reading notes
Core claim
The central claim is that balanced cross-entropy fails because it over-weights the object and under-weights the surrounding background, and that this can be fixed by dilating each class mask before computing balancing weights. In DBCE, each binary class mask is dilated with a disk-shaped structuring element, the dilated mask is normalized by its own area, and at every pixel the loss weight is the maximum of these normalized values across classes; this weight map is multiplied into the CE loss map. Because the max operation makes the smallest object dominate overlapping dilated regions, and because dilation sets a floor on the effective area of tiny classes, the weighting is both stronger for small structures and less noisy than inverse-frequency balancing. The paper's experimental claim is that, with only the dilation radius as an added hyperparameter, this weighting outperforms CE and balanced CE on polyp, skin-lesion, and multi-organ segmentation, and is similar to Dice+CE.
Load-bearing premise
The method's advantage rests on choosing the dilation radius $R$ per dataset, and the paper sets $R$ empirically (20 pixels for two tasks, 10 for the third) without reporting a validation-based selection rule; if $R$ was chosen to fit the test results, the reported improvements over plain cross-entropy may not transfer.
Editorial extensions
If this is right
- With the right spatial weighting, a weighted cross-entropy loss can match a region-based loss like Dice+CE on binary and multiclass medical segmentation.
- Per-sample weights can be computed on the fly from each label map, removing the need to precompute class frequencies over the whole training set.
- The method specifically lowers false positives in the area around objects, the failure mode that plain balanced CE worsens.
- The dilation radius $R$ is a single interpretable knob: $R=0$ reproduces balanced CE, large $R$ erases the balancing effect, and intermediate values give the reported improvement.
- DBCE reaches Dice-comparable accuracy without changing the network, data, or training schedule, so the reported gains are attributable to the loss function.
Reading between the lines
- The paper leaves implicit that the dilation radius could be annealed over training: a large radius early would stabilize learning, and shrinking it later would sharpen boundary emphasis; this is a testable extension the authors do not report.
- Because the weight map is built from normalized dilated masks, DBCE behaves like a soft distance-to-object attention; connecting it to boundary losses or distance-transform losses could yield variants the paper does not discuss.
- A portability test the paper does not run is to fix one radius across many datasets or choose $R$ by validation rather than by inspecting test performance; until such a rule exists, the claimed advantage over plain CE remains conditional on dataset-specific tuning.
- The weighting recipe is class-agnostic, so it could transfer to non-medical sparse-object segmentation, such as aerial or satellite imagery, though the paper only evaluates medical benchmarks.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a pixel-wise weighting scheme for cross-entropy loss in medical image segmentation. Instead of weighting each class by the inverse of its global frequency, as in balanced CE, the method dilates each class mask with a disk structuring element, computes the inverse of the dilated area, and assigns each pixel the maximum of these inverse-area weights across classes. The resulting dilated balanced CE (DBCE) loss is compared against CE, balanced CE, and Dice+CE on three tasks: polyp segmentation (Kvasir-SEG to CVC-ClinicDB), skin lesion segmentation (ISIC 2018), and Synapse multi-organ segmentation. The reported results show that DBCE outperforms CE by small margins (mDice gains of +0.61, +0.97, +0.58 on the three tasks) and is close to Dice+CE, with the conclusion that a properly weighted CE can match a region-based loss.
Significance. If the reported results hold, the paper would provide a simple and inexpensive alternative to region-based losses: a weighted cross-entropy loss whose weights are derived from dilated masks, applicable to both binary and multi-class segmentation. The method is easy to implement, and the experiments span three commonly used public datasets with a standard U-Net backbone, which lends practical relevance. The paper also honestly discusses the sensitivity of the loss to the dilation radius in Figure 5. However, the significance is tempered by the absence of uncertainty quantification and by the small, possibly within-noise improvements over CE. The core claim is that DBCE is a generalizable replacement for Dice+CE, but the evidence is conditional on the choice of the dilation radius and on single-seed evaluation.
major comments (4)
- [Sec. 3.2, Fig. 5] The dilation radius R is the only method-specific hyperparameter, and it is set "empirically" per dataset (R=20 for polyp and skin lesion, R=10 for Synapse). Figure 5 shows a pronounced performance optimum near R=20 for the polyp task, with a large drop for other radii. The manuscript does not describe a validation-based selection procedure (e.g., a held-out split or cross-validation). If R was chosen by inspecting test-set performance, the reported gains over CE in Tables 1-3 are optimistically biased, and the method's advantage over CE is conditional on dataset-specific tuning. The paper should either report a principled tuning rule (e.g., pick R on a validation split) or show results for a fixed, transferable R across all datasets.
- [Sec. 3.3, Tables 1-3] All experiments are based on a single training run per loss, and no error bars, confidence intervals, or significance tests are reported. The central claim that DBCE outperforms CE and matches Dice+CE rests on small differences: e.g., Table 1 shows mDice of 88.85 for DBCE vs. 88.24 for CE, and Table 3 shows mDice of 81.68 for DBCE vs. 81.75 for Dice+CE. These differences are within a few tenths of a point and cannot be distinguished from run-to-run variation without at least multiple seeds and a paired test. Please report mean and standard deviation over multiple seeds (3-5) and, if possible, per-fold comparisons for the Synapse dataset.
- [Table 3] The aggregate claim that DBCE produces "similar results" to Dice+CE hides notable organ-level differences. For example, DBCE is 0.95 points worse on Aorta (90.84 vs. 91.79) and 1.54 points worse on Pancreas (66.54 vs. 68.08), while being 1.33 points better on Spleen (91.12 vs. 89.79). These differences are not discussed. If the conclusion is that DBCE is comparable to Dice+CE across organs, the organ-wise pattern should be addressed; if not, the conclusion should be restricted to the aggregate metric.
- [Sec. 4, Conclusion] The wording "produces superior results compared to CE" appears in the Conclusion and is also implied in the Abstract. Given the small margins (mDice gains of 0.6-1.0 points) and the absence of statistical support, this is stronger than the evidence warrants. Either provide significance testing or revise the claim to "comparable to, or slightly better than, CE" to avoid overstating the finding.
minor comments (6)
- [Abstract] In the abstract, "improved my modifying" should read "improved by modifying".
- [Eqs. (2)-(5)] The mathematical typesetting of Equations (2) through (5) appears garbled in the manuscript, particularly the normalization in Eq. (4); please provide a clean, unambiguous formulation of the weight map.
- [Fig. 5] Please state in the caption or text what metric is plotted on the vertical axis (presumably mDice on the test set) and clarify whether the curve represents a single run or an average.
- [Sec. 3.2] The training details list epoch counts (600, 200, 300) but not batch size or whether the same training budget was kept for all losses; these details are needed for reproducibility.
- [References] Reference [5] appears twice in the text: once for the U-Net architecture (Ronneberger et al.) and once for Bertels et al. on optimizing the Dice score; please fix the citation numbering.
- [Figs. 2-4] The qualitative examples are illustrative, but the selection criteria for the displayed slices are not stated; please specify whether they are selected randomly or by other criteria.
Circularity Check
No significant circularity: DBCE is defined by construction and evaluated on external benchmarks.
full rationale
The paper's central object, the DBCE loss, is explicitly defined in Eqs. (2)-(5) as a weighted CE loss whose pixel-wise weights are derived from dilated class masks; no quantity in the definition presupposes the reported segmentation results. The experimental claims are supported by comparisons on external datasets (Kvasir-SEG/CVC-ClinicDB, ISIC 2018, Synapse) against CE, balanced CE, and Dice+CE baselines, with training conditions kept fixed across losses. The only method-specific hyperparameter, the dilation radius R, is stated to be set empirically per dataset (Sec. 3.2), and its effect is directly investigated in Fig. 5; this is a tunable hyperparameter rather than a fitted quantity renamed as a prediction. There is no self-citation chain, no imported uniqueness theorem, and no known result merely renamed. Possible test-set selection of R is a reproducibility concern, not a circularity concern, because the method's benefit is asserted empirically rather than derived from the choice of R.
Assumptions & free parameters
free parameters (1)
- dilation radius R =
20 pixels (polyp, skin lesion), 10 pixels (multi-organ)
assumptions (2)
- domain assumption Segmentation errors are concentrated in and around object boundaries, so weighting the dilated surround reduces false positives.
- ad hoc to paper Dilating masks with a disk structuring element and taking the max of inverse-area weights yields an effective balancing strategy.
Cite this review
Pith. "Pith review of Dilated Balanced Cross Entropy Loss for Medical Image Segmentation." pith.science (2026). https://pith.science/paper/TRTAOAVX
@misc{pith2026241206045,
author = {Pith},
title = {Pith review of: Dilated Balanced Cross Entropy Loss for Medical Image Segmentation},
year = {2026},
howpublished = {\url{https://pith.science/paper/TRTAOAVX}},
note = {Machine review of arXiv:2412.06045}
}
read the original abstract
A novel method for tackling the problem of imbalanced data in medical image segmentation is proposed in this work. In balanced cross entropy (CE) loss, which is a type of weighted CE loss, the weight assigned to each class is the in-verse of the class frequency. These balancing weights are expected to equalize the effect of each class on the overall loss and prevent the model from being biased towards the majority class. But, as it has been shown in previous studies, this method degrades the performance by a large margin. Therefore, balanced CE is not a popular loss in medical segmentation tasks, and usually a region-based loss, like the Dice loss, is used to address the class imbalance problem. In the pro-posed method, the weighting of cross entropy loss for each class is based on a dilated area of each class mask, and balancing weights are assigned to each class together with its surrounding pixels. The goal of this study is to show that the performance of balanced CE loss can be greatly improved my modifying its weighting strategy. Experiments on different datasets show that the proposed dilated balanced CE (DBCE) loss outperforms the balanced CE loss by a large margin and produces superior results compared to CE loss, and its performance is similar to the performance of the combination of Dice and CE loss. This means that a weighted cross entropy loss with the right weighing strategy can be as effective as a region-based loss in handling the problem of class imbalance in medical segmentation tasks.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
Ma J, Chen J, Ng M, Huang R, Li Y, Li C, Yang X, Mar tel AL.: Loss odyssey in medical image segmentation. In: Medical Image Analysis. (2021)
work page 2021
-
[2]
In: Proceedings of the IEEE international conference on computer vision (2017)
Lin TY, Goyal P, Girshick R, He K, Dollár P.: Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision (2017)
work page 2017
-
[3]
In: Proceedings of t he IEEE conference on computer vision and pattern recognition (2017)
Pohlen T, Hermans A, Mathias M, Leibe B.: Full-resolution residual networks for semantic segmentation in street scenes. In: Proceedings of t he IEEE conference on computer vision and pattern recognition (2017)
work page 2017
-
[4]
In: Medical Image Computing and Computer-Assisted Intervention–MICCAI (2015)
Ronneberger O, Fischer P, Brox T.: U-net: Convoluti onal networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI (2015)
work page 2015
-
[5]
In: Medical Image Computing and Computer Assisted Intervention–MICCAI (2019)
Bertels J, Eelbode T, Berman M, Vandermeulen D, Maes F, Bisschops R, Blaschko MB.: Optimizing the dice score and jaccard index for med ical image segmentation: Theory and 10 practice. In: Medical Image Computing and Computer Assisted Intervention–MICCAI (2019)
work page 2019
-
[6]
In: Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
He K, Zhang X, Ren S, Sun J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
work page 2016
-
[7]
arXiv preprint arXiv:2302.01027
Fitzgerald K, Matuszewski B.: FCB-SwinV2 Transformer for Polyp Segmentation. arXiv preprint arXiv:2302.01027. (2023)
arXiv 2023
-
[8]
In: Multimed ia Modeling: 26th International Con- ference, MMM (2020)
Jha D, Smedsrud PH, Riegler MA, Halvorsen P, de Lan ge T, Johansen D, Johansen HD.: Kvasir-seg: A segmented polyp dataset. In: Multimed ia Modeling: 26th International Con- ference, MMM (2020)
work page 2020
Show all 24 references
-
[9]
saliency maps from physicians
Bernal J, Sánchez FJ, Fernández-Esparrach G, Gil D, Rodríguez C, Vilariño F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy : Validation vs. saliency maps from physicians. In: Computerized medical imaging and graphics. (2015)
2015
-
[10]
arXiv preprint arXiv:1902.03368
Codella N, Rotemberg V, Tschandl P, Celebi ME, Dusza S, Gutman D, Helba B, Kalloo A, Liopyris K, Marchetti M, Kittler H.: Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imagin g collaboration (isic). arXiv preprint arXiv:1902....
2019 arXiv
-
[11]
In: Medi cal Image Computing and Computer Assisted Intervention–MICCAI (2020)
Fu S, Lu Y, Wang Y, Zhou Y, Shen W, Fishman E, Yuill e A.: Domain adaptive relational reasoning for 3d multi-organ segmentation. In: Medi cal Image Computing and Computer Assisted Intervention–MICCAI (2020)
2020
-
[12]
arXiv preprint arXiv:2102.04306
Chen J, Lu Y, Yu Q, Luo X, Adeli E, Wang Y, Lu L, Yuille AL, Zhou Y.: Transunet: Trans- formers make strong encoders for medical image segm entation. arXiv preprint arXiv:2102.04306. (2021)
2021 arXiv
-
[13]
: Pranet: Parallel reverse attention network for polyp segmentation
Fan DP, Ji GP, Zhou T, Chen G, Fu H, Shen J, Shao L. : Pranet: Parallel reverse attention network for polyp segmentation. In: International c onference on medical image computing and computer-assisted intervention-MICCA (2020)
2020
-
[14]
In: Proceedings of the 29th ACM International Conference on Multimedia (2021)
Kim T, Lee H, Kim D.: Uacanet: Uncertainty augmented context attention for polyp seg- mentation. In: Proceedings of the 29th ACM International Conference on Multimedia (2021)
2021
-
[15]
Multi-scale hierarchical v ision transformer with cascaded at- tention decoding for medical image segmentation
Rahman MM, Marculescu R. Multi-scale hierarchical v ision transformer with cascaded at- tention decoding for medical image segmentation. In: Medical Imaging with Deep Learning (2024)
2024
-
[16]
In: Proceedings of the IEEE/CVF conferenc e on computer vision and pattern recognition (2019)
Cui Y, Jia M, Lin TY, Song Y, Belongie S.: Class-balanced loss based on effective number of samples. In: Proceedings of the IEEE/CVF conferenc e on computer vision and pattern recognition (2019)
2019
-
[17]
In: IEEE Transactions on knowledge and data engineering
He H, Garcia EA.: Learning from imbalanced data. In: IEEE Transactions on knowledge and data engineering. (2009)
2009
-
[18]
In: Computerized Medical Imaging and Graphics
Taghanaki SA, Zheng Y, Zhou SK, Georgescu B, Sharma P, Xu D, Comaniciu D, Hamarneh G.: Combo loss: Handling input and output imbalance in multi-organ segmentation. In: Computerized Medical Imaging and Graphics. (2019)
2019
-
[19]
In: IEEE transactions on medical imag- ing
Zhou Z, Siddiquee MM, Tajbakhsh N, Liang J.: Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. In: IEEE transactions on medical imag- ing. (2019)
2019
-
[20]
arXiv preprint arXiv:1605.06885
Wu Z, Shen C, Hengel AV.: Bridging category-level and instance-level semantic image seg- mentation. arXiv preprint arXiv:1605.06885. (2016)
2016 arXiv
-
[21]
In: Proceedings of the Asian conference on computer vision (2020)
Sinha S, Ohashi H, Nakamura K.: Class-wise difficul ty-balanced loss for solving class-im- balance. In: Proceedings of the Asian conference on computer vision (2020)
2020
-
[22]
I n: Proceedings of the IEEE international conference on computer vision (2015)
Xie S, Tu Z.: Holistically-nested edge detection. I n: Proceedings of the IEEE international conference on computer vision (2015)
2015
-
[23]
In: Medical Image Computing and Computer Assisted Intervention– MICCAI (2020)
Shirokikh B, Shevtsov A, Kurmukov A, Dalechina A, Krivov E, Kostjuchenko V, Golanov A, Belyaev M.: Universal loss reweighting to balanc e lesion size inequality in 3D medical Dilated Balanced Cross Entropy Loss for Medical Ima ge Segmentation 11 image segmentation. In: Medical...
2020
-
[24]
In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 6th International Workshop, BrainLes 2020, Held in Conjunction with MICCAI (2020)
Isensee F, Jäger PF, Full PM, Vollmuth P, Maier-Hei n KH.: nnU-Net for brain tumor seg- mentation. In: Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 6th International Workshop, BrainLes 2020, Held in Conjunction with MICCAI (2020)
2020
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.