Pith. sign in

REVIEW 4 major objections 5 minor 18 references

Automatic Rodent Brain MRI Lesion Segmentation with Fully Convolutional Networks

T0 review · 4 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read RatLesNet, a 3D fully convolutional network with 0.37M parameters, segments ischemic stroke lesions in rat brain MRI with an average Dice of 0.88 in five-fold cross-validation, outperforming 3D U-Net and VoxResNet, and reaches 0.79 in…

desk verdict A compact 3D FCN for rat lesion segmentation that is genuinely useful; the main superiority claim needs significance testing. read the letter →

arxiv 1908.08746 v1 pith:VVZAY7Q5 submitted 2019-08-23 eess.IV cs.CV

classification eess.IVcs.CV
keywords RatLesNetfullyconvolutionalnetworklesionsegmentationbrainMRIischemicstroke3DDicecoefficientcross-studygeneralization
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

RatLesNet is a 3D fully convolutional network, a neural network that maps an entire 3D image directly to per-voxel labels, built specifically for segmenting stroke lesions from rat brain MRI. The paper claims that this small network—0.37 million parameters—beats two general-purpose 3D segmentation networks, 3D U-Net and VoxResNet, on the task: average Dice 0.88 versus 0.85 and 0.64 in five-fold cross-validation, and 0.79 versus 0.76 and 0.62 when trained on one study and tested on three others. A sympathetic reader would care because manual lesion tracing is slow, subjective, and a bottleneck in preclinical stroke research, and an automatic method that runs on unprocessed images in about half a second per scan could make large cohort studies routine. The paper also reports that RatLesNet's average Dice exceeds the measured inter-operator agreement between two human segmentations, and that its boundaries look qualitatively cleaner around the lesion.

What carries the argument

The argument is carried by RatLesNet's dense-block architecture: within each block, every $3\times3\times3$ convolution is concatenated with all preceding feature maps in that block (growth rate 18), $1\times1\times1$ convolutions reset the channel count between blocks, and max-pooling with index-preserving unpooling halves and restores spatial dimensions. This lets the network see the full 3D volume while keeping parameters at 0.37M, which the paper says reduces overfitting relative to 3D U-Net's 19M and VoxResNet's 1.5M parameters. Training uses raw standardized T2 volumes with a mini-batch of 1, cross-entropy loss, and early stopping on validation loss; inference takes about half a second per scan.

What would settle it

Re-run the five-fold cross-validation using a second independent operator's manual segmentations as ground truth; if RatLesNet's average Dice falls to the measured inter-operator level of about 0.73, the reported 0.88 reflects the reference annotator's style rather than true lesion boundaries.

Watch

Extended reading notes

Core claim

The central discovery is that a compact dense-block architecture designed for the specific geometry of rodent stroke lesions outperforms larger networks built for anatomical segmentation, despite making no use of preprocessing, skull-stripping, or post-processing. RatLesNet processes each whole $256\times256\times18$ volume with $1\times1\times1$ convolutions for channel adjustment, dense blocks with growth rate 18, and max-pooling/unpooling that reuses pooling indices to restore spatial resolution. In five-fold cross-validation on the 02NOV2016 study, the paper reports an average Dice of 0.88 (0.76 excluding lesion-free sham animals), above the inter-operator Dice of 0.87 (0.73 excluding shams); on generalization to three other studies it averages 0.79, with the best scores on 24-hour post-stroke scans and a lower 0.68 on the 35-day study, where VoxResNet scores 0.71. The paper frames this as the first fully convolutional network specifically designed for rat brain lesion segmentation, with an architecture that accepts any input-channel count and therefore extends to multimodal MRI.

Load-bearing premise

The manual segmentations used for training and evaluation are treated as ground truth, and the four studies are assumed similar enough to transfer; if the reference labels carry one annotator's bias or the studies differ too much, the reported Dice gaps do not show true segmentation accuracy.

Editorial extensions

If this is right

  • Preclinical stroke pipelines can replace manual tracing with fully automatic RatLesNet segmentation on raw T2-weighted MRI, eliminating the skull-stripping, bias correction, and hole-filling steps that earlier rodent lesion tools require.
  • A whole-volume 3D network with 0.37M parameters trains in about six hours on one GPU and segments a scan in about half a second, making segmentation of hundreds of animals practical.
  • Because the input channel count is configurable, the same architecture can be applied to multimodal or multi-sequence MRI without structural changes.
  • On 24-hour post-stroke lesions from unseen studies, RatLesNet's average Dice (0.82 and 0.84) exceeds the measured inter-operator agreement of 0.73, indicating automatic segmentations can be at least as reproducible as human ones for that stage.
  • The lower Dice of 0.68 on the 35-day study shows the generalization is lesion-stage dependent; adding chronic-stage lesions to training is the direct extension the paper acknowledges.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper suggests the parameter gap explains the accuracy gap, but it does not isolate capacity from architecture; a controlled comparison that matches parameter budgets across designs would test that explanation.
  • Because the network is trained against a single operator's labels and evaluated on that same reference, the 0.88 Dice may partly reflect learning that operator's delineation style; using an ensemble of expert segmentations as training targets would probe this.
  • The dense-block plus $1\times1\times1$ bottleneck pattern that works here for rare lesion voxels is a candidate for other small-lesion or small-animal segmentation tasks where datasets are too small for large 3D networks.
  • Adding chronic-stage training examples and a scanner-matched validation set would likely raise the 35-day study's Dice above VoxResNet's 0.71, since the training study contains only 2-hour and 24-hour lesions.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes RatLesNet, a compact 3D fully convolutional network (0.37M parameters) for automatic segmentation of ischemic lesions in T2-weighted rat brain MRI. It is trained and evaluated on 131 scans from four tMCAO studies. In a five-fold cross-validation experiment on one study (02NOV2016), the authors report an average Dice of 0.88, exceeding 3D U-Net (0.64) and VoxResNet (0.85) when all animals are included, and 0.76 vs 0.70 and 0.30 respectively when sham animals are excluded. In a cross-study generalization test, training on 02NOV2016 and testing on the other three studies yields average Dice of 0.79 for RatLesNet, 0.76 for VoxResNet, and 0.62 for 3D U-Net. The authors also claim that RatLesNet exceeds inter-operator variability (average Dice 0.87 including shams). The paper emphasizes that the method requires no skull-stripping, bias-field correction, or post-processing.

Significance. If the reported performance holds, RatLesNet would be a practically valuable tool for preclinical stroke research, where manual segmentation is time-consuming and subjective. The evaluation design is a strength: it includes a multi-study dataset, a realistic cross-study generalization test, and comparisons against two strong 3D FCN baselines. The architecture's small parameter count and ability to process entire volumes without preprocessing are also attractive for reproducibility and clinical translation. However, the central claim of superiority over VoxResNet rests on small average Dice differences with overlapping standard deviations and no statistical testing, and the cross-study result reverses on one of the three test studies. The evidence is promising but not yet conclusive.

major comments (4)
  1. [Section 3, Table 1 (Cross-validation)] No statistical significance testing or confidence intervals are provided for the comparison between RatLesNet and VoxResNet. The differences are small relative to the reported variability: for example, at 2h without shams, RatLesNet gives 0.67±0.12 vs VoxResNet 0.60±0.16; at 24h without shams, 0.85±0.11 vs 0.79±0.20; and on average without shams, 0.76±0.14 vs 0.70±0.20. Since the same test folds are used for all methods, a paired per-animal test (e.g., Wilcoxon signed-rank test) or bootstrap confidence intervals on the paired differences is needed to support the abstract's claim that RatLesNet is 'quantitatively better' than the compared architectures.
  2. [Section 2 and Section 3, Table 1 (Inter-operator comparison)] The statement that RatLesNet 'achieves higher Dice coefficients than inter-operator variability' is not supported. The average Dice including sham animals is 0.88 for RatLesNet vs 0.87 for inter-operator agreement, a difference of 0.01; excluding shams it is 0.76 vs 0.73. Moreover, the inter-operator benchmark is based on only one additional manual segmentation of a single study, and RatLesNet is trained on the reference annotator's labels. Exceeding that benchmark may therefore reflect learning the reference annotator's segmentation style rather than improved biological accuracy. The authors should qualify this claim and, if possible, evaluate against multiple independent raters.
  3. [Section 3, Table 2 (Generalization capability)] The cross-study generalization claim is not robust across studies. RatLesNet outperforms VoxResNet by large margins on 03MAY2016 (0.82 vs 0.77) and 02OCT2017 (0.84 vs 0.78), but on 03AUG2015 VoxResNet achieves the highest Dice (0.71±0.23 vs 0.68±0.26 for RatLesNet). Because no significance testing is provided, the overall claim that RatLesNet 'outperformed the other FCNs at generalizing' rests on averaging over studies and may depend on the particular composition of the test set. The authors should report per-study pairwise statistical comparisons and discuss the time-point difference (35 days for 03AUG2015 vs 2h/24h in the training data) as a likely source of the reversal.
  4. [Section 3, Cross-validation paragraph] The sentence 'The models that provided the reported results were trained with the best performing learning rate found' is ambiguous and potentially consequential. If the learning rate was selected using the held-out test studies, the generalization results would be invalid. If it was selected using the validation folds inside the cross-validation procedure, this should be stated explicitly. Please clarify the model-selection protocol.
minor comments (5)
  1. [Abstract] The phrase 'between 3.7% and 38% higher' is ambiguous because Dice improvements can be reported as absolute percentage points or relative percentages. Please specify which convention is used.
  2. [Section 2 and Table 1] The inter-operator Dice of 0.73 reported in the text is inconsistent with the 'Inter-operator' column in Table 1, which shows an average of 0.87 when shams are included. Please clarify how sham animals (no lesion) enter the inter-operator Dice computation, e.g., whether they are assigned Dice 1 by convention.
  3. [Section 2, Training] The text states that Adam was used 'with a starting learning rate of 10^-5', but later the models are said to be trained with the 'best performing learning rate found'. Please state the final learning rate(s) used and the search procedure.
  4. [Figure 2] The architecture diagram is difficult to interpret: the number of channels at each stage and the positions of the 1x1 convolution bottleneck layers are not annotated. Adding these details would improve reproducibility.
  5. [Section 3, Figure 3 caption] The phrase 'crispier' in the text describing VoxResNet's predictions is informal; consider using 'sharper' or 'more clearly defined'.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: empirical segmentation evaluation against held-out labels and external baselines.

full rationale

RatLesNet is an empirical architecture paper: the network is trained on manual lesion labels and evaluated against held-out labels via 5-fold cross-validation and on three studies not used for training. No network parameter is fitted from the test labels, and the test labels serve only as comparison targets for Dice scoring. The compared methods (3D U-Net and VoxResNet) are external architectures, and the network design is not derived from the target segmentation labels. The reported inter-operator Dice of 0.73 is a descriptive reference for human variability, not an input to the loss function or a fitted target. There are no equations in which a predicted quantity reduces to an input by construction, and no load-bearing self-citation chain is present. The lack of statistical significance testing is a methodological concern about whether the superiority claim is established, not evidence of circularity. The derivation and evaluation chain is therefore self-contained with respect to the paper's core empirical claims.

Assumptions & free parameters 4 free parameters · 3 assumptions · 0 invented entities

The central claim rests on the quality of the provided ground-truth labels, the comparability of the four studies, and the appropriateness of the evaluation metric. The architecture has several hand-picked hyperparameters, but the main load-bearing assumption is that the reference segmentations are reliable enough to train and evaluate on.

free parameters (4)
  • growth rate = 18
    Number of channels added by each dense block; chosen by hand, no ablation reported to justify this value.
  • initial learning rate = 1e-5 for RatLesNet; 'best performing' for baselines
    Learning rate is a tuned hyperparameter. The paper states models were trained with the best performing learning rate found, but the selection procedure is not described, which could affect comparisons.
  • early stopping patience = 5 epochs
    Training stops after 5 consecutive validation loss increases; chosen by hand without supporting experiments.
  • maximum training epochs = 1000
    Training cap chosen by hand; the actual number of epochs run is not reported for each architecture.
assumptions (3)
  • domain assumption The provided manual lesion segmentations are accurate enough to serve as ground truth for training and evaluation.
    Section 2 states segmentations were provided in NIfTI files and used directly; only a subset of 02NOV2016 was independently re-segmented to estimate inter-rater variability (Dice 0.73). Errors in these labels affect all reported metrics.
  • domain assumption The four studies are comparable enough for cross-study generalization testing.
    All data are T2-weighted 7T rat brain scans from the same supplier, but acquisition time-points and study protocols differ. The network trained on 02NOV2016 is tested on 03AUG2015, 03MAY2016, and 02OCT2017; performance drops on 03AUG2015 (35-day time-point), indicating domain shift.
  • domain assumption Dice coefficient is an appropriate evaluation metric for lesion segmentation with class imbalance.
    Dice is a standard metric in segmentation, but it can be sensitive to small lesions and class imbalance. The authors use it without discussing its limitations in this context.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Automatic Rodent Brain MRI Lesion Segmentation with Fully Convolutional Networks." pith.science (2026). https://pith.science/paper/VVZAY7Q5

@misc{pith2026190808746,
  author       = {Pith},
  title        = {Pith review of: Automatic Rodent Brain MRI Lesion Segmentation with Fully Convolutional Networks},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/VVZAY7Q5}},
  note         = {Machine review of arXiv:1908.08746}
}
read the original abstract

Manual segmentation of rodent brain lesions from magnetic resonance images (MRIs) is an arduous, time-consuming and subjective task that is highly important in pre-clinical research. Several automatic methods have been developed for different human brain MRI segmentation, but little research has targeted automatic rodent lesion segmentation. The existing tools for performing automatic lesion segmentation in rodents are constrained by strict assumptions about the data. Deep learning has been successfully used for medical image segmentation. However, there has not been any deep learning approach specifically designed for tackling rodent brain lesion segmentation. In this work, we propose a novel Fully Convolutional Network (FCN), RatLesNet, for the aforementioned task. Our dataset consists of 131 T2-weighted rat brain scans from 4 different studies in which ischemic stroke was induced by transient middle cerebral artery occlusion. We compare our method with two other 3D FCNs originally developed for anatomical segmentation (VoxResNet and 3D-U-Net) with 5-fold cross-validation on a single study and a generalization test, where the training was done on a single study and testing on three remaining studies. The labels generated by our method were quantitatively and qualitatively better than the predictions of the compared methods. The average Dice coefficient achieved in the 5-fold cross-validation experiment with the proposed approach was 0.88, between 3.7% and 38% higher than the compared architectures. The presented architecture also outperformed the other FCNs at generalizing on different studies, achieving the average Dice coefficient of 0.79.

Figures

Figures reproduced from arXiv: 1908.08746 by the authors.

Figure 1
Figure 1. Representative lesion progression of a rat at 2h, 24h and 35 days after MCA occlusion. The arrows point to the lesion, which appear hyperintense in T2-weighted images on the right hemisphere. acquisitions were performed at different time-points in a horizontal 7T magnet, more specifically at 2 hours (12 animals from 02NOV2016 study), 24 hours (12 animals from 02NOV2016 and all animals from 03MAY2016 and 02OCT2017) a… view at source ↗
Figure 2
Figure 2. Overview of the network architecture. Training: The network was trained on entire T2-weighted images with a reso￾lution of 256x256x18 voxels and a mini-batch size of 1. Image intensities in each volume were standardized by subtracting their mean and dividing them by their standard deviation. Cross-entropy loss function was minimized using Adam [11] with a starting learning rate of 10−5 . Training lasted for a maximu… view at source ↗
Figure 3
Figure 3. Top: A slice of a T2-weighted rat brain image with lesion and its segmentation. Bottom: segmentations generated by 3D U-Net, VoxResNet and our architecture in the cross-validation test. eralization capabilities [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

18 extracted references · 11 canonical work pages

  1. [1]

    In: 12th {USENIX} Symposium on Operating Systems Design and Im- plementation ({OSDI} 16)

    Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghe- mawat, S., Irving, G., Isard, M., et al.: Tensorflow: A system for large-scale machine learning. In: 12th {USENIX} Symposium on Operating Systems Design and Im- plementation ({OSDI} 16). pp. 265–283 (2016)

  2. [2]

    IEEE transactions on medical imaging 37(7), 1678–1689 (2018)

    Arnaud, A., Forbes, F., Coquery, N., Collomb, N., Lemasson, B., Barbier, E.L.: Fully automatic lesion localization and characterization: Application to brain tu- mors using multiparametric quantitative mri data. IEEE transactions on medical imaging 37(7), 1678–1689 (2018)

  3. [3]

    NeuroImage 170, 446–455 (2018)

    Chen, H., Dou, Q., Yu, L., Qin, J., Heng, P.A.: Voxresnet: Deep voxelwise residual networks for brain segmentation from 3d mr images. NeuroImage 170, 446–455 (2018)

  4. [4]

    Journal of Cerebral Blood Flow & Metabolism 38(8), 1371–1383 (2018)

    Choi, C.H., Yi, K.S., Lee, S.R., Lee, Y., Jeon, C.Y., Hwang, J., Lee, C., Choi, S.S., Lee, H.J., Cha, S.H.: A novel voxel-wise lesion segmentation technique on 3.0-t diffusion mri of hyperacute focal cerebral ischemia at 1 h after permanent mcao in rats. Journal of Cerebral Blood Flow & Metabolism 38(8), 1371–1383 (2018)

  5. [5]

    In: International conference on medical image computing and computer-assisted intervention

    C ¸ i¸ cek,¨O., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. pp. 424–432. Springer (2016) 8 J. M. Valverde et al

  6. [6]

    Journal of neuroscience methods (2019)

    De Feo, R., Giove, F.: Towards an efficient segmentation of small rodents brain: a short critical review. Journal of neuroscience methods (2019)

  7. [7]

    Ecology 26(3), 297–302 (1945)

    Dice, L.R.: Measures of the amount of ecologic association between species. Ecology 26(3), 297–302 (1945)

  8. [8]

    Medical image analysis 35, 18–31 (2017)

    Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.M., Larochelle, H.: Brain tumor segmentation with deep neural net- works. Medical image analysis 35, 18–31 (2017)

Show all 18 references
  1. [9]

    In: Proceedings of the IEEE conference on computer vision and pattern recognition

    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 770–778 (2016)

  2. [10]

    In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 4700–4708 (2017)

  3. [11]

    arXiv preprint arXiv:1412.6980 (2014)

    Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  4. [12]

    Koizumi, J., Yoshida, Y., Nakazawa, T., Ooneda, G.: Experimental studies of is- chemic brain edema. 1. a new experimental model of cerebral embolism in rats in which recirculation can be introduced in the ischemic area. Jpn J stroke 8, 1–8 (1986)

  5. [13]

    Frontiers in neuroinformatics 11, 3 (2017)

    Mulder, I.A., Khmelinskii, A., Dzyubachyk, O., de Jong, S., Rieff, N., Wermer, M.J., Hoehn, M., Lelieveldt, B.P., van den Maagdenberg, A.M.: Automated is- chemic lesion segmentation in mri mouse brain data after transient middle cerebral artery occlusion. Frontiers in neuroinfo...

  6. [14]

    In: International MICCAI Brainlesion Workshop

    Myronenko, A.: 3d mri brain tumor segmentation using autoencoder regularization. In: International MICCAI Brainlesion Workshop. pp. 311–320. Springer (2018)

  7. [15]

    In: Proceedings of the IEEE international conference on computer vision

    Noh, H., Hong, S., Han, B.: Learning deconvolution network for semantic segmen- tation. In: Proceedings of the IEEE international conference on computer vision. pp. 1520–1528 (2015)

  8. [16]

    In: International Conference on Medical image computing and computer-assisted intervention

    Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedi- cal image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. pp. 234–241. Springer (2015)

  9. [17]

    NeuroImage 186, 713–727 (2019)

    Roy, A.G., Conjeti, S., Navab, N., Wachinger, C., Initiative, A.D.N., et al.: Quick- nat: A fully convolutional network for quick and accurate segmentation of neu- roanatomy. NeuroImage 186, 713–727 (2019)

  10. [18]

    In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018)

    Roy, S., Knutsen, A., Korotcov, A., Bosomtwi, A., Dardzinski, B., Butman, J.A., Pham, D.L.: A deep learning framework for brain extraction in humans and an- imals with traumatic brain injury. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). pp. 687...

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.