REVIEW 4 major objections 6 minor 1 cited by
Cell as Point: One-Stage Framework for Efficient Cell Tracking
T0 review · 4 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read A one-stage cell tracker that treats each cell as a point matches multi-stage pipelines at 8–32x lower inference cost.
desk verdict CAP is a sensible CoTracker adaptation for cell tracking with a clean division representation, but the 'one-stage / no segmentation' claim falls apart on the KIT-GE first-frame initialization and the speedups are likely overstated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing representation is the cell point trajectory with visibility: each cell is a point $(x,y)$, a binary visibility flag marks existence, and each predicted point owns three location slots for the mother cell and two possible daughter cells, so division is represented natively. Association is carried by 4D correlation volumes between tracking features and multi-scale image features around estimated locations, refined iteratively by a transformer with cross-trajectory/time attention. Around this core, AEG sampling selects training clips that contain complete division events, and RAW inference processes long sequences by rolling a window and appending newly born cells to the query set.
What would settle it
Run CAP on the same ISBI sequences with first-frame query points initialized from (a) the segmentation-based output, (b) centroids of the tracking ground-truth masks, and (c) the same points shifted by a few pixels of Gaussian noise; if TRA collapses under (b) or (c), the framework's independence from a detection or segmentation stage is not established.
Extended reading notes
Core claim
The paper's central discovery is that a point-based sequence model can jointly track all cells in a microscopy video by iteratively refining their trajectories and visibilities. The model predicts, for each tracked cell, its own location and the locations of two potential daughter cells, updated through a transformer with cross-trajectory/time attention and RAFT-style correlation volumes. Two mechanisms make this practical: AEG sampling forces the training sequence to include complete division events, countering the rarity of mitosis, and RAW inference rolls a fixed-size window forward, inserting newly appearing cells as new query points in long sequences. On the DeepCell and ISBI CTC benchmarks, the framework reaches the best or competitive tracking accuracy among the tested methods, including zero structural errors and a TRA of 0.985 on U373, while requiring only 1.1–7.1 seconds per sequence.
Load-bearing premise
The claim that the pipeline is one-stage and bypasses detection and segmentation depends on treating the first-frame cell locations, which are produced by an external segmentation-based method, as harmless initialization; if those points are inaccurate or if that step counts as a detection or segmentation stage, the central claim weakens.
Editorial extensions
If this is right
- Training no longer requires segmentation masks; tracking ground truth (coarse masks and lineage graphs) suffices.
- Inference time drops to a few seconds per sequence, which is an order of magnitude faster than the compared multi-stage systems.
- Rare cell divisions can be learned reliably by biasing the sampled clips toward complete division events.
- Long sequences can be tracked with a fixed-size window, so memory and compute no longer grow with full sequence length.
- The ablations indicate that cross-trajectory attention and a feature stride of 4 are both necessary for the reported accuracies.
Reading between the lines
- Editorial inference: the framework's one-stage status is conditional, because first-frame cell locations come from an external segmentation-based method; replacing that initialization with cheap centroid extraction or with tracking ground-truth masks is a direct test of how much of the staging claim actually carries.
- Editorial inference: the same point-trajectory machinery may transfer to other biological imaging tasks with division and merging events, such as bacterial colony or organelle tracking, where mask-level annotation is the bottleneck.
- Editorial inference: AEG sampling could be generalized from division events to other rare but decisive cell behaviors, such as apoptosis, and its probability schedule could be made adaptive to per-sequence event rates rather than a dataset-global statistic.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes CAP (Cell as Point), a one-stage cell tracking framework that treats each cell as a point and uses a transformer with cross-trajectory/time attention to jointly predict cell trajectories and visibilities. The method introduces adaptive event-guided (AEG) sampling to address division-event imbalance and a rolling-as-window (RAW) inference strategy for long sequences. The authors evaluate on DeepCell and ISBI CTC benchmarks, reporting competitive TRA scores (e.g., 0.985 on U373) and 8-32x inference speedups over existing methods, with claimed elimination of detection/segmentation stages and reduced annotation requirements.
Significance. Strengths: the paper evaluates on multiple public benchmarks with standard TRA metrics, provides ablations for the main components, and makes code/checkpoints available. If the one-stage claim and efficiency comparison were substantiated, CAP would be a practically useful contribution to cell tracking. However, the central claims are not yet supported: the testing procedure relies on an external segmentation-based method (KIT-GE) for first-frame initialization, and the reported inference times appear to exclude this preprocessing, undermining the 'one-stage' and speedup claims. The AEG probability formula is also internally inconsistent with its stated purpose. These issues are addressable but require substantive revision.
major comments (4)
- [Section 4.1.1 (Implementation Details); Section 5] The testing process states: 'we preprocess the first frame for each sequence using [70] to select query points Q and start the process of window rolling.' Reference [70] is KIT-GE, a CNN-based distance-prediction segmentation and graph-matching method. This external dependency directly contradicts the central claim that CAP 'eliminates the need for explicit detection or segmentation' and the conclusion's statement that CAP 'eliminates the need for a separate segmentation or detection stage.' Moreover, the inference times reported for CAP in Tables 2 and 3 (e.g., 1.3 s on HeLa) appear to exclude the KIT-GE preprocessing pass, while the baseline times are full-pipeline times. The claimed 8-32x speedup is therefore not an end-to-end comparison. Please report full end-to-end inference time including initialization, or provide an internal initialization mechanism, and revise the claims accordingly.
- [Section 3.2.1, Eq. for P_AEG] The probability of applying AEG is defined as PAEG = Ndiv×Tdiv/T, where Ndiv is the total number of divisions in the sequence and Tdiv is the duration of a division event. This quantity is not guaranteed to be in [0,1]: on HeLa, for instance, 189 divisions with Tdiv on the order of a few frames and T=42 would give PAEG>1. Conversely, on a dataset with very few divisions (PC-3 has 5 divisions in 50 frames), PAEG becomes small, so AEG sampling would rarely be triggered precisely when division events are rarest. This is the opposite of the stated goal of 'prioritizes cell division events.' Please clarify the intended formula, add normalization or an alternative definition, and demonstrate that the sampling actually increases the proportion of division-containing windows.
- [Algorithm 1 (RAW inference)] The inner loop 'for i←0 to lwin do tcur ← tcur + i; ...' increments tcur by i for each i, so after the loop tcur advances by lwin(lwin+1)/2 rather than by lwin. This makes the algorithm as written non-reproducible and inconsistent with the text, which says the window slides frame-by-frame. Please correct the pseudocode to tcur ← tcur + 1 (or an equivalent step) and ensure the 'find new cell(s)' condition is defined.
- [Tables 2-6] All TRA values are reported as single numbers without error bars, confidence intervals, or multiple runs. Several comparisons are close (e.g., 3T3: CAP 0.854 vs GNN 0.857; GOWT1: CAP 0.960 vs KIT-GE 0.966), so the claims of 'consistent improvements' and 'promising performance' cannot be assessed statistically. Please provide variance estimates or multiple-seed results, at least for the main comparisons.
minor comments (6)
- [Abstract vs. Section 4.1.1] The abstract states that 'The code and model checkpoints will be available soon,' while the paper header lists a GitHub URL and says the code is available. Please make these statements consistent.
- [Equation (2)] The notation '2s' in the correlation volume formula is ambiguous; the text describes a kernel size of 2^s × 2^s, so the equation should use superscripts consistently.
- [Table 4] The columns and numbers in Table 4 are not aligned correctly; for example, the GOWT1 row appears to contain '0.8830.9210.878' with no separators, and the sequence labels do not line up with the values. Please reformat.
- [Figure 1(b)] The caption states '2.9s' as the inference time, but no dataset in Tables 2 or 3 has exactly 2.9 s; please clarify whether this is an average and over which datasets.
- [Section 3.2.1] The term 'T anchors' is introduced without definition; please define the anchor set and explain how it is used in sampling.
- [Algorithm 1] The condition 'find new cell(s)' is not defined; the model's visibility output presumably yields new cells, but the pseudocode should specify how this is determined from the predicted visibilities.
Circularity Check
No significant circularity: the tracking results are evaluated on external benchmarks and do not reduce to fitted inputs or self-citations.
full rationale
The paper's derivation chain is empirical rather than circular. CAP predicts cell point trajectories and visibilities from an input sequence, supervised by tracking ground truth through trajectory regression and visibility cross-entropy losses (Eqs. 4-5), and is evaluated with the external ISBI/CTMC TRA metric against published baselines. No parameter is fitted to the evaluation subset and then renamed as a prediction, and no load-bearing claim is justified solely by a self-citation. The one genuinely questionable point is consistency, not circularity: Section 4.1.1 states that the testing process 'preprocess the first frame for each sequence using [70] to select query points Q', where [70] (KIT-GE) is a CNN-based segmentation and graph-matching method. This means the 'one-stage, no detection/segmentation' claim and the reported 8-32x speedups exclude an external segmentation-based initialization stage. That is a substantive correctness and reporting concern, and the Limitations section does not disclose it, but it is not an instance of a derivation reducing to its own inputs by construction. The central tracking accuracy is still produced by CAP's own transformer on external benchmarks, so under the stated circularity criteria the honest finding is no significant circularity.
Assumptions & free parameters
free parameters (5)
- Training clip length T_s =
24
- Inference window length l_win =
100
- Feature stride s =
4
- Correlation offset radius Δ =
3
- Number of correlation scales S =
4
assumptions (4)
- domain assumption Cell tracking can be reduced to tracking centroid points with binary visibility, ignoring shape and overlap.
- domain assumption Pre-trained CoTracker weights trained on synthetic RGB video transfer to grayscale microscopy after fine-tuning.
- domain assumption Initial query points can be obtained from KIT-GE without contradicting the one-stage claim.
- standard math The AOGM-based TRA metric correctly measures tracking quality.
Cite this review
Pith. "Pith review of Cell as Point: One-Stage Framework for Efficient Cell Tracking." pith.science (2026). https://pith.science/paper/CYBJJYQ7
@misc{pith2026241114833,
author = {Pith},
title = {Pith review of: Cell as Point: One-Stage Framework for Efficient Cell Tracking},
year = {2026},
howpublished = {\url{https://pith.science/paper/CYBJJYQ7}},
note = {Machine review of arXiv:2411.14833}
}
read the original abstract
Conventional multi-stage cell tracking approaches rely heavily on detection or segmentation in each frame as a prerequisite, requiring substantial resources for high-quality segmentation masks and increasing the overall prediction time. To address these limitations, we propose CAP, a novel end-to-end one-stage framework that reimagines cell tracking by treating Cell as Point. Unlike traditional methods, CAP eliminates the need for explicit detection or segmentation, instead jointly tracking cells for sequences in one stage by leveraging the inherent correlations among their trajectories. This simplification reduces both labeling requirements and pipeline complexity. However, directly processing the entire sequence in one stage poses challenges related to data imbalance in capturing cell division events and long sequence inference. To solve these challenges, CAP introduces two key innovations: (1) adaptive event-guided (AEG) sampling, which prioritizes cell division events to mitigate the occurrence imbalance of cell events, and (2) the rolling-as-window (RAW) inference strategy, which ensures continuous and stable tracking of newly emerging cells over extended sequences. By removing the dependency on segmentation-based preprocessing while addressing the challenges of imbalanced occurrence of cell events and long-sequence tracking, CAP demonstrates promising cell tracking performance and is 8 to 32 times more efficient than existing methods. The code and model checkpoints are available at https://github.com/YXSong000/CAP.
Figures
Figures from the paper (5 more)
Forward citations
Cited by 1 Pith paper
-
ScSAM: Debiasing Morphology and Distributional Variability in Subcellular Semantic Segmentation
ScSAM fuses frozen SAM and MAE embeddings with a fusion module and class prompt encoder, reporting state-of-the-art organelle segmentation on BetaSeg islet datasets.
Reference graph
Works this paper leans on
-
[70]
Tim Scherr, Katharina L ¨offler, Moritz B ¨ohland, and Ralf Mikut. Cell segmentation and tracking using cnn-based dis- tance predictions and a graph-based matching strategy.PLoS One, page e0243219, 2020. 2, 6, 8, 9, 10
work page 2020
-
[1]
Multi-class cell de- tection using spatial context representation
Shahira Abousamra, David Belinsky, John Van Arnam, Fe- licia Allard, Eric Yee, Rajarsi Gupta, Tahsin Kurc, Dimitris Samaras, Joel Saltz, and Chao Chen. Multi-class cell de- tection using spatial context representation. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 4005–4014, 2021. 2
2021
-
[2]
Joint cell segmentation and tracking using cell proposals
Saad Ullah Akram, Juho Kannala, Lauri Eklund, and Janne Heikkil¨a. Joint cell segmentation and tracking using cell proposals. In2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), pages 920–924, 2016. 2
2016
-
[3]
Cell Tracking via Proposal Generation and Selection
Saad Ullah Akram, Juho Kannala, Lauri Eklund, and Janne Heikkil¨a. Cell tracking via proposal generation and selec- tion.arXiv preprint arXiv:1705.03386, 2017. 2
work page Pith review arXiv 2017
-
[4]
S. Anjum. Ctmc: Cell tracking with mitosis detection dataset challenge. InCVPR Workshops, 2020. 3, 8
2020
-
[5]
A probabilistic approach to joint cell tracking and segmentation in high-throughput microscopy videos.Medical image analysis, pages 140–152, 2018
Assaf Arbelle, Jose Reyes, Jia-Yun Chen, Galit Lahav, and Tammy Riklin Raviv. A probabilistic approach to joint cell tracking and segmentation in high-throughput microscopy videos.Medical image analysis, pages 140–152, 2018. 2
2018
-
[6]
Fitvid: Overfitting in pixel-level video prediction.arXiv preprint arXiv:2106.13195, 2020
Mohammad Babaeizadeh, Mohammad Taghi Saffar, Suraj Nair, Sergey Levine, Chelsea Finn, and Dumitru Erhan. Fitvid: Overfitting in pixel-level video prediction.arXiv preprint arXiv:2106.13195, 2020. 4
arXiv 2020
-
[7]
Dmnet: Dual-stream marker guided deep network for dense cell segmentation and lineage tracking
Rina Bao, Noor M Al-Shakarji, Filiz Bunyak, and Kannap- pan Palaniappan. Dmnet: Dual-stream marker guided deep network for dense cell segmentation and lineage tracking. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3361–3370, 2021. 2
2021
Show all 96 references
-
[8]
Graph neural net- work for cell tracking in microscopy videos
Tal Ben-Haim and Tammy Riklin-Raviv. Graph neural net- work for cell tracking in microscopy videos. InProceedings of the European Conference on Computer Vision, pages 610–
-
[9]
Cell segmentation and tracking in phase contrast images using graph cut with asymmetric boundary costs
Robert Bensch and Olaf Ronneberger. Cell segmentation and tracking in phase contrast images using graph cut with asymmetric boundary costs. In2015 IEEE 12th Inter- national Symposium on Biomedical Imaging (ISBI), pages 1220–1223, 2015. 2
2015
-
[10]
Reliable cell tracking by global data association
Ryoma Bise, Zhaozheng Yin, and Takeo Kanade. Reliable cell tracking by global data association. In2011 IEEE Inter- national Symposium on Biomedical Imaging: From Nano to Macro, pages 1004–1010, 2011. 2
2011
-
[11]
Cell tracking under high confluency conditions by candidate cell region detection-based-association ap- proach.Biomedical Engineering, pages 1004–1010, 2013
Ryoma Bise, Yoshitaka Maeda, Mee-hae Kim, and Masahiro Kino-Oka. Cell tracking under high confluency conditions by candidate cell region detection-based-association ap- proach.Biomedical Engineering, pages 1004–1010, 2013
2013
-
[12]
High- speed tracking-by-detection without using image informa- tion
Erik Bochinski, V olker Eiselein, and Thomas Sikora. High- speed tracking-by-detection without using image informa- tion. In2017 14th IEEE International Conference on Ad- vanced Video and Signal Based Surveillance, pages 1–6,
-
[13]
Ultrack: pushing the limits of cell tracking across biological scales.bioRxiv, 2024
Jord ˜ao Bragantini, Ilan Theodoro, Xiang Zhao, Teun APM Huijben, Eduardo Hirata-Miyasaki, Shruthi VijayKumar, Akilandeswari Balasubramanian, Tiger Lao, Richa Agrawal, Sheng Xiao, et al. Ultrack: pushing the limits of cell tracking across biological scales.bioRxiv, 2024. 2
2024
-
[14]
Large- scale multi-hypotheses cell tracking using ultrametric con- tours maps
Jord ˜ao Bragantini, Merlin Lange, and Lo ¨ıc Royer. Large- scale multi-hypotheses cell tracking using ultrametric con- tours maps. InComputer Vision – ECCV 2024, pages 36–54, Cham, 2025. Springer Nature Switzerland. 2
2024
-
[15]
Lucas/kanade meets horn/schunck: Combining local and global optic flow methods.International Journal of Com- puter Vision, pages 211–231, 2005
Andres Bruhn, Joachim Weickert, and Christoph Schn ¨orr. Lucas/kanade meets horn/schunck: Combining local and global optic flow methods.International Journal of Com- puter Vision, pages 211–231, 2005. 3
2005
-
[16]
Automated detection and tracking of cell clusters in time-lapse fluorescence microscopy im- ages.Journal of Medical and Biological Engineering, pages 18–25, 2017
Yuan-Hsiang Chang, Hideo Yokota, Kuniya Abe, Chia-Tong Tang, and Ming-Dar Tasi. Automated detection and tracking of cell clusters in time-lapse fluorescence microscopy im- ages.Journal of Medical and Biological Engineering, pages 18–25, 2017. 2
2017
-
[17]
Cmtt-jtracker: a fully test-time adaptive framework serving automated cell lineage construction.Briefings in Bioinformatics, 25(6): bbae591, 2024
Liuyin Chen, Sanyuan Fu, and Zijun Zhang. Cmtt-jtracker: a fully test-time adaptive framework serving automated cell lineage construction.Briefings in Bioinformatics, 25(6): bbae591, 2024. 2
2024
-
[18]
Chapter 5 - cell tracking in time-lapse microscopy image sequences
Mei Chen. Chapter 5 - cell tracking in time-lapse microscopy image sequences. InComputer Vision for Microscopy Image Analysis, pages 101–129. Academic Press, 2021. 2
2021
-
[19]
Cell- track r-cnn: A novel end-to-end deep neural network for cell segmentation and tracking in microscopy images
Yuqian Chen, Yang Song, Chaoyi Zhang, Fan Zhang, Lauren O’Donnell, Wojciech Chrzanowski, and Weidong Cai. Cell- track r-cnn: A novel end-to-end deep neural network for cell segmentation and tracking in microscopy images. In2021 IEEE 18th International Symposium on Biomedical I...
2021
-
[20]
TAP-vid: A benchmark for track- ing any point in a video.Advances in Neural Information Processing Systems, pages 13610–13626, 2022
Carl Doersch, Ankush Gupta, Larisa Markeeva, Adria Re- casens, Lucas Smaira, Yusuf Aytar, Joao Carreira, Andrew Zisserman, and Yi Yang. TAP-vid: A benchmark for track- ing any point in a video.Advances in Neural Information Processing Systems, pages 13610–13626, 2022. 2
2022
-
[21]
Flownet: Learning optical flow with convolutional networks
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, and Thomas Brox. Flownet: Learning optical flow with convolutional networks. InPro- ceedings of the IEEE International Conference on Computer ...
2015
-
[22]
Cell mi- gration/invasion assays and their application in cancer drug discovery.Biotechnology annual review, pages 391–421,
Suzanne A Eccles, Carol Box, and William Court. Cell mi- gration/invasion assays and their application in cancer drug discovery.Biotechnology annual review, pages 391–421,
-
[23]
Comput- erized cell tracking: Current methods, tools and challenges
Neda Emami, Zahra Sedaei, and Reza Ferdousi. Comput- erized cell tracking: Current methods, tools and challenges. Visual Informatics, pages 1–13, 2021. 1
2021
-
[24]
Automatic fusion of segmentation and tracking labels
Cem Emre Akbas, Vladimir Ulman, Martin Maska, Florian Jug, and Michal Kozubek. Automatic fusion of segmentation and tracking labels. InProceedings of the European Confer- ence on Computer Vision Workshops, 2018. 1
2018
-
[25]
Deepkymotracker: A tool for accurate construction of cell lineage trees for highly motile cells.PloS one, 20(2):e0315947, 2025
Khelina Fedorchuk, Sarah M Russell, Kajal Zibaei, Mo- hammed Yassin, and Damien G Hicks. Deepkymotracker: A tool for accurate construction of cell lineage trees for highly motile cells.PloS one, 20(2):e0315947, 2025. 1
2025
-
[26]
Trackastra: Transformer-based cell tracking for live-cell microscopy
Benjamin Gallusser and Martin Weigert. Trackastra: Transformer-based cell tracking for live-cell microscopy. In European Conference on Computer Vision, pages 467–484. Springer, 2024. 1, 2, 9, 10 14
2024
-
[27]
The light-sheet microscopy revolution.Journal of Optics, page 053002,
John M Girkin and Mariana Torres Carvalho. The light-sheet microscopy revolution.Journal of Optics, page 053002,
-
[28]
Celltrackscolab is a plat- form that enables compilation, analysis, and exploration of cell tracking data.Plos Biology, 22(8):e3002740, 2024
Estibaliz G ´omez-de Mariscal, Hanna Grobe, Joanna W Pylv¨an¨ainen, Laura X ´enard, Ricardo Henriques, Jean-Yves Tinevez, and Guillaume Jacquemet. Celltrackscolab is a plat- form that enables compilation, analysis, and exploration of cell tracking data.Plos Biology, 22(8):e300...
2024
-
[29]
Particle video revisited: Tracking through occlusions using point trajectories
Adam W Harley, Zhaoyuan Fang, and Katerina Fragkiadaki. Particle video revisited: Tracking through occlusions using point trajectories. InProceedings of the European Confer- ence on Computer Vision, 2022. 3
2022
-
[30]
Cell tracking with deep learning for cell detection and motion estimation in low- frame-rate
Junya Hayashida and Ryoma Bise. Cell tracking with deep learning for cell detection and motion estimation in low- frame-rate. InMedical Image Computing and Computer As- sisted Intervention, pages 397–405. Springer, 2019. 2
2019
-
[31]
Mpm: Joint representation of motion and position map for cell tracking
Junya Hayashida, Kazuya Nishimura, and Ryoma Bise. Mpm: Joint representation of motion and position map for cell tracking. InThe IEEE Conference on Computer Vision and Pattern Recognition, 2020. 1, 2
2020
-
[32]
Con- sistent cell tracking in multi-frames with spatio-temporal context by object-level warping loss
Junya Hayashida, Kazuya Nishimura, and Ryoma Bise. Con- sistent cell tracking in multi-frames with spatio-temporal context by object-level warping loss. InProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1727–1736, 2022. 1, 2
2022
-
[33]
Osamu Hirose, Shotaro Kawaguchi, Terumasa Tokunaga, Yu Toyoshima, Takayuki Teramoto, Sayuri Kuge, Takeshi Ishi- hara, Yuichi Iino, and Ryo Yoshida. Spf-celltracker: Track- ing multiple cells with strongly-correlated moves using a spatial particle filter.IEEE/ACM transactions o...
2017
-
[34]
Visual tracking of numerous targets via multi- bernoulli filtering of image data.Pattern Recognition, pages 3625–3635, 2012
Reza Hoseinnezhad, Ba-Ngu V o, Ba-Tuong V o, and David Suter. Visual tracking of numerous targets via multi- bernoulli filtering of image data.Pattern Recognition, pages 3625–3635, 2012
2012
-
[35]
Visual mitosis detection and cell tracking using labeled multi-bernoulli filter
Mohammed I Hossain, Amirali K Gostar, Alireza Bab- Hadiashar, and Reza Hoseinnezhad. Visual mitosis detection and cell tracking using labeled multi-bernoulli filter. In2018 21st International Conference on Information Fusion, pages 1–5. IEEE, 2018. 2
2018
-
[36]
Flownet 2.0: Evolu- tion of optical flow estimation with deep networks
Eddy Ilg, Nikolaus Mayer, Tonmoy Saikia, Margret Keuper, Alexey Dosovitskiy, and Thomas Brox. Flownet 2.0: Evolu- tion of optical flow estimation with deep networks. InPro- ceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2462–2470, 2017. 3
2017
-
[37]
Cell division and the mitotic spindle.The Journal of cell biology, pages 131s–147s, 1981
Shinya Inou ´e. Cell division and the mitotic spindle.The Journal of cell biology, pages 131s–147s, 1981. 4
1981
-
[38]
Unsupervised learning of multi-frame optical flow with occlusions
Joel Janai, Fatma Guney, Anurag Ranjan, Michael Black, and Andreas Geiger. Unsupervised learning of multi-frame optical flow with occlusions. InProceedings of the European Conference on Computer Vision, 2018. 3
2018
-
[39]
Multiple particle tracking in time-lapse synchrotron x-ray images using dis- criminative appearance and neighbouring topology learning
Hye-Won Jung, Sang-Heon Lee, Martin Donnelley, David Parsons, Victor Stamatescu, and Ivan Lee. Multiple particle tracking in time-lapse synchrotron x-ray images using dis- criminative appearance and neighbouring topology learning. Pattern Recognition, pages 485–497, 2019. 2
2019
-
[40]
Tracking correction method for rapid and random protein molecules movement
Satoshi Kamiya, Keisuke Toida, Taka-aki Tsunoyama, and Kazuhiro Hotta. Tracking correction method for rapid and random protein molecules movement. InProceedings of the Asian Conference on Computer Vision (ACCV), pages 3022– 3037, 2024. 2
2024
-
[41]
Measures for ranking cell trackers without manual validation.Pattern recognition, pages 2849–2859, 2013
Andrey Kan, Christopher Leckie, James Bailey, John Markham, and Rajib Chakravorty. Measures for ranking cell trackers without manual validation.Pattern recognition, pages 2849–2859, 2013. 8
2013
-
[42]
Co- tracker3: Simpler and better point tracking by pseudo- labelling real videos.arXiv preprint arXiv:2410.11831,
Nikita Karaev, Iurii Makarov, Jianyuan Wang, Natalia Neverova, Andrea Vedaldi, and Christian Rupprecht. Co- tracker3: Simpler and better point tracking by pseudo- labelling real videos.arXiv preprint arXiv:2410.11831,
-
[43]
Co- Tracker: It is better to track together
Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, and Christian Rupprecht. Co- Tracker: It is better to track together. InProceedings of the European Conference on Computer Vision, 2024. 3, 7
2024
-
[44]
Phase contrast time-lapse microscopy datasets with auto- mated and manual cell tracking annotations.Scientific data, 5(1):1–12, 2018
Dai Fei Elmer Ker, Sungeun Eom, Sho Sanami, Ryoma Bise, Corinne Pascale, Zhaozheng Yin, Seung-il Huh, Elvira Osuna-Highley, Silvina N Junkers, Casey J Helfrich, et al. Phase contrast time-lapse microscopy datasets with auto- mated and manual cell tracking annotations.Scientifi...
2018
-
[45]
Cell tracking-by- detection using elliptical bounding boxes.Journal of Visual Communication and Image Representation, page 104425,
Lucas N Kirsten and Claudio R Jung. Cell tracking-by- detection using elliptical bounding boxes.Journal of Visual Communication and Image Representation, page 104425,
-
[46]
Learning from imbalanced data: open challenges and future directions.Progress in artificial intel- ligence, pages 221–232, 2016
Bartosz Krawczyk. Learning from imbalanced data: open challenges and future directions.Progress in artificial intel- ligence, pages 221–232, 2016. 3
2016
-
[47]
Spatial omics and multiplexed imaging to explore cancer biology
Sabrina M Lewis, Marie-Liesse Asselin-Labat, Quan Nguyen, Jean Berthelet, Xiao Tan, Verena C Wimmer, Del- phine Merino, Kelly L Rogers, and Shalin H Naik. Spatial omics and multiplexed imaging to explore cancer biology. Nature methods, pages 997–1012, 2021. 1
2021
-
[48]
Cell population tracking and lineage construction with spatiotemporal context.Medical image analysis, pages 546–566, 2008
Kang Li, Eric D Miller, Mei Chen, Takeo Kanade, Lee E Weiss, and Phil G Campbell. Cell population tracking and lineage construction with spatiotemporal context.Medical image analysis, pages 546–566, 2008. 1
2008
-
[49]
Towards an end-to-end framework for flow-guided video inpainting
Zhen Li, Cheng-Ze Lu, Jianhua Qin, Chun-Le Guo, and Ming-Ming Cheng. Towards an end-to-end framework for flow-guided video inpainting. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17562–17571, 2022. 2
2022
-
[50]
Mitosis detection in phase contrast microscopy image sequences of stem cell populations: A critical review.IEEE Transactions on Big Data, pages 443–457, 2017
An-An Liu, Yao Lu, Mei Chen, and Yu-Ting Su. Mitosis detection in phase contrast microscopy image sequences of stem cell populations: A critical review.IEEE Transactions on Big Data, pages 443–457, 2017. 2
2017
-
[51]
Overfitting the data: Compact neu- ral video delivery via content-aware feature modulation
Jiaming Liu, Ming Lu, Kaixin Chen, Xiaoqi Li, Shizun Wang, Zhaoqing Wang, Enhua Wu, Yurong Chen, Chuang Zhang, and Ming Wu. Overfitting the data: Compact neu- ral video delivery via content-aware feature modulation. In Proceedings of the IEEE/CVF International Conference on Co...
2021
-
[52]
Automatic 3d tracking system for large swarm of moving objects.Pattern Recognition, pages 384–396, 2016
Ye Liu, Shuohong Wang, and Yan Qiu Chen. Automatic 3d tracking system for large swarm of moving objects.Pattern Recognition, pages 384–396, 2016. 6 15
2016
-
[53]
A graph- based cell tracking algorithm with few manually tunable pa- rameters and automated segmentation error correction.PloS one, page e0249257, 2021
Katharina L ¨offler, Tim Scherr, and Ralf Mikut. A graph- based cell tracking algorithm with few manually tunable pa- rameters and automated segmentation error correction.PloS one, page e0249257, 2021. 2
2021
-
[54]
Embed- track—simultaneous cell segmentation and tracking through learning offsets and clustering bandwidths.IEEE Access, pages 77147–77157, 2022
Katharina L ¨offler and Ralf Mikut. Embed- track—simultaneous cell segmentation and tracking through learning offsets and clustering bandwidths.IEEE Access, pages 77147–77157, 2022. 1, 2, 6, 9, 10
2022
-
[55]
Tracking of non- brownian particles using the viterbi algorithm
Klas EG Magnusson and Joakim Jald ´en. Tracking of non- brownian particles using the viterbi algorithm. In2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), pages 380–384. IEEE, 2015. 2
2015
-
[56]
Klas E. G. Magnusson, Joakim Jald ´en, Penney M. Gilbert, and Helen M. Blau. Global linking of cell tracks using the viterbi algorithm.IEEE Transactions on Medical Imaging, pages 911–929, 2015. 2
2015
-
[57]
The cell tracking challenge: 10 years of objective benchmarking.Nature Methods, pages 1010–1020, 2023
Martin Ma ˇska, Vladim´ır Ulman, Pablo Delgado-Rodriguez, Estibaliz G ´omez-de Mariscal, Tereza Ne ˇcasov´a, Fidel A Guerrero Pe ˜na, Tsang Ing Ren, Elliot M Meyerowitz, Tim Scherr, Katharina L¨offler, et al. The cell tracking challenge: 10 years of objective benchmarking.Natu...
2023
-
[58]
Cell tracking accuracy measurement based on comparison of acyclic oriented graphs.PloS one, page e0144959, 2015
Pavel Matula, Martin Ma ˇska, Dmitry V Sorokin, Petr Mat- ula, Carlos Ortiz-de Sol ´orzano, and Michal Kozubek. Cell tracking accuracy measurement based on comparison of acyclic oriented graphs.PloS one, page e0144959, 2015. 8, 9
2015
-
[59]
Accurate cell tracking and lineage construction in live-cell imaging ex- periments with deep learning.Biorxiv, page 803205, 2019
Erick Moen, Enrico Borba, Geneva Miller, Morgan Schwartz, Dylan Bannon, Nora Koe, Isabella Camplisson, Daniel Kyme, Cole Pavelchek, Tyler Price, et al. Accurate cell tracking and lineage construction in live-cell imaging ex- periments with deep learning.Biorxiv, page 803205, 2...
2019
-
[60]
S. Na. Segment any cell: A sam-based auto-prompting fine- tuning framework for nuclei segmentation.arXiv, 2024. 2
2024
-
[61]
Weakly-supervised cell tracking via backward-and-forward propagation
Kazuya Nishimura, Junya Hayashida, Chenyang Wang, Dai Fei Elmer Ker, and Ryoma Bise. Weakly-supervised cell tracking via backward-and-forward propagation. InProceed- ings of the European Conference on Computer Vision, pages 104–121. Springer, 2020. 2
2020
-
[62]
Distnet2d: Leveraging long-range temporal information for efficient segmentation and track- ing.PRX Life, page 023004, 2024
Jean Ollion, Martin Maliet, Caroline Giuglaris, ´Elise Vacher, and Maxime Deforet. Distnet2d: Leveraging long-range temporal information for efficient segmentation and track- ing.PRX Life, page 023004, 2024. 2
2024
-
[63]
Cell-tractr: A transformer-based model for end-to-end segmentation and tracking of cells.bioRxiv, pages 2024–07, 2024
Owen M O’Connor and Mary J Dunlop. Cell-tractr: A transformer-based model for end-to-end segmentation and tracking of cells.bioRxiv, pages 2024–07, 2024
2024
-
[64]
Cell-tractr: A transformer-based model for end-to-end segmentation and tracking of cells.PLOS Computational Biology, page e1013071, 2025
Owen M O’Connor and Mary J Dunlop. Cell-tractr: A transformer-based model for end-to-end segmentation and tracking of cells.PLOS Computational Biology, page e1013071, 2025. 9
2025
-
[65]
Cou- pled minimum-cost flow cell tracking for high-throughput quantitative analysis.Medical image analysis, pages 650– 668, 2011
Dirk Padfield, Jens Rittscher, and Badrinath Roysam. Cou- pled minimum-cost flow cell tracking for high-throughput quantitative analysis.Medical image analysis, pages 650– 668, 2011. 2
2011
-
[66]
Instance segmentation and tracking with cosine embeddings and recurrent hourglass networks
Christian Payer, Darko ˇStern, Thomas Neff, Horst Bischof, and Martin Urschler. Instance segmentation and tracking with cosine embeddings and recurrent hourglass networks. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention, pages 3–11. Springer,
-
[67]
J regularization improves imbalanced multiclass seg- mentation
Fidel A Guerrero Pena, Pedro D Marrero Fernandez, Paul T Tarr, Tsang Ing Ren, Elliot M Meyerowitz, and Alexandre Cunha. J regularization improves imbalanced multiclass seg- mentation. In2020 IEEE 17th International Symposium on Biomedical Imaging, pages 1–5. IEEE, 2020. 1
2020
-
[68]
Cell lin- eage tracing in lens-free microscopy videos
Markus Rempfler, Sanjeev Kumar, Valentin Stierle, Philipp Paulitschke, Bjoern Andres, and Bjoern H Menze. Cell lin- eage tracing in lens-free microscopy videos. InMedical Im- age Computing and Computer-Assisted Intervention- MIC- CAI 2017: 20th International Conference, Quebec...
2017
-
[69]
Cell tracking and the development of cell-based therapies: a view from the cardiovascular cell therapy research network
Martin Rodriguez-Porcel, Marvin W Kronenberg, Timo- thy D Henry, Jay H Traverse, Carl J Pepine, Stephen G Ellis, James T Willerson, Lemuel A Moy ´e, and Robert D Simari. Cell tracking and the development of cell-based therapies: a view from the cardiovascular cell therapy rese...
2012
-
[71]
Omni- flow: Human omnidirectional optical flow
Roman Seidel, Andr ´e Apitzsch, and Gangolf Hirtz. Omni- flow: Human omnidirectional optical flow. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3678–3681, 2021. 3
2021
-
[72]
Bayesian tracking for fluorescence microscopic imaging
Ihor Smal, Wiro Niessen, and Erik Meijering. Bayesian tracking for fluorescence microscopic imaging. In3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006., pages 550–553. IEEE, 2006. 2
2006
-
[73]
Fuzzy-based propaga- tion of prior knowledge to improve large-scale image analy- sis pipelines.Plos one, page e0187535, 2017
Johannes Stegmaier and Ralf Mikut. Fuzzy-based propaga- tion of prior knowledge to improve large-scale image analy- sis pipelines.Plos one, page e0187535, 2017. 2
2017
-
[74]
Cellpose: a generalist algorithm for cellular segmentation.Nature methods, pages 100–106, 2021
Carsen Stringer, Tim Wang, Michalis Michaelos, and Mar- ius Pachitariu. Cellpose: a generalist algorithm for cellular segmentation.Nature methods, pages 100–106, 2021. 2, 6
2021
-
[75]
Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume
Deqing Sun, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 8934–8943,
-
[76]
Raft: Recurrent all-pairs field transforms for optical flow
Zachary Teed and Jia Deng. Raft: Recurrent all-pairs field transforms for optical flow. InProceedings of the European Conference on Computer Vision, pages 402–419. Springer,
-
[77]
Automated cell tracking using 3d nnunet and light sheet microscopy to quantify regional deformation in zebrafish.bioRxiv, 2024
Tanveer Teranikar, Saad Saeed, The Van Le, Yoonsuk Kang, Gilberto Hernandez Jr, Phuc Nguyen, Yichen Ding, Cheng- Jen Chuong, Jin Young Lee, Hyunsuk Ko, et al. Automated cell tracking using 3d nnunet and light sheet microscopy to quantify regional deformation in zebrafish.bioRx...
2024
-
[78]
Network flow integer program- ming to track elliptical cells in time-lapse sequences.IEEE Transactions on Medical Imaging, pages 942–951, 2016
Engin T ¨uretken, Xinchao Wang, Carlos J Becker, Carsten Haubold, and Pascal Fua. Network flow integer program- ming to track elliptical cells in time-lapse sequences.IEEE Transactions on Medical Imaging, pages 942–951, 2016. 2 16
2016
-
[79]
Automated deep lineage tree analysis using a bayesian single cell tracking approach.Frontiers in Com- puter Science, 3:734559, 2021
Kristina Ulicna, Giulia Vallardi, Guillaume Charras, and Alan R Lowe. Automated deep lineage tree analysis using a bayesian single cell tracking approach.Frontiers in Com- puter Science, 3:734559, 2021. 2
2021
-
[80]
An objective comparison of cell-tracking algorithms.Nature methods, pages 1141–1152, 2017
Vladim ´ır Ulman, Martin Ma ˇska, Klas EG Magnusson, Olaf Ronneberger, Carsten Haubold, Nathalie Harder, Pavel Mat- ula, Petr Matula, David Svoboda, Miroslav Radojevic, et al. An objective comparison of cell-tracking algorithms.Nature methods, pages 1141–1152, 2017. 3, 7, 8, 9
2017
-
[81]
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. Attention is all you need. InAdvances in Neu- ral Information Processing Systems. Curran Associates, Inc.,
-
[82]
Tracking everything everywhere all at once
Qianqian Wang, Yen-Yu Chang, Ruojin Cai, Zhengqi Li, Bharath Hariharan, Aleksander Holynski, and Noah Snavely. Tracking everything everywhere all at once. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, 2023. 3
2023
-
[83]
Cris: Clip- driven referring image segmentation
Zhaoqing Wang, Yu Lu, Qiang Li, Xunqiang Tao, Yandong Guo, Mingming Gong, and Tongliang Liu. Cris: Clip- driven referring image segmentation. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11686–11695, 2022. 2
2022
-
[84]
Star-convex polyhedra for 3d object detec- tion and segmentation in microscopy
Martin Weigert, Uwe Schmidt, Robert Haase, Ko Sugawara, and Gene Myers. Star-convex polyhedra for 3d object detec- tion and segmentation in microscopy. InProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3666–3673, 2020. 2, 6
2020
-
[85]
Unsupervised learning of object-centric embeddings for cell instance segmentation in microscopy images
Steffen Wolf, Manan Lalit, Katie McDole, and Jan Funke. Unsupervised learning of object-centric embeddings for cell instance segmentation in microscopy images. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 21263–21272, 2023. 2
2023
-
[86]
Accurate optical flow via direct cost volume processing
Jia Xu, Ren ´e Ranftl, and Vladlen Koltun. Accurate optical flow via direct cost volume processing. InProceedings of the IEEE Conference on Computer Vision and Pattern Recogni- tion, pages 1289–1297, 2017. 3
2017
-
[87]
Spatial- temporal relation networks for multi-object tracking
Jiarui Xu, Yue Cao, Zheng Zhang, and Han Hu. Spatial- temporal relation networks for multi-object tracking. InPro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 3988–3998, 2019. 2
2019
-
[88]
Cell segmentation, tracking, and mitosis detection using temporal context
Fuxing Yang, Michael A Mackey, Fiorenza Ianzini, Greg Gallardo, and Milan Sonka. Cell segmentation, tracking, and mitosis detection using temporal context. InInternational Conference on Medical Image Computing and Computer- Assisted Intervention, pages 302–309. Springer, 2005. 2
2005
-
[89]
Deep learning in medical image super resolution: a review.Applied Intelligence, pages 20891–20916, 2023
Hujun Yang, Zhongyang Wang, Xinyao Liu, Chuangang Li, Junchang Xin, and Zhiqiong Wang. Deep learning in medical image super resolution: a review.Applied Intelligence, pages 20891–20916, 2023. 2
2023
-
[90]
Prediction of sequen- tial organelles localization under imbalance using a balanced deep u-net.Scientific reports, page 2626, 2020
Novanto Yudistira, Muthusubash Kavitha, Takeshi Itabashi, Atsuko H Iwane, and Takio Kurita. Prediction of sequen- tial organelles localization under imbalance using a balanced deep u-net.Scientific reports, page 2626, 2020. 4
2020
-
[91]
Optical flow and scene flow estimation: A survey
Mingliang Zhai, Xuezhi Xiang, Ning Lv, and Xiangdong Kong. Optical flow and scene flow estimation: A survey. Pattern Recognition, page 107861, 2021. 3
2021
-
[92]
Unsupervised 3d end-to-end medical image registration with volume tweening network.IEEE Journal of Biomedical and Health Informatics, pages 1394–1404, 2020
Shengyu Zhao, Tingfung Lau, Ji Luo, Eric I-Chao Chang, and Yan Xu. Unsupervised 3d end-to-end medical image registration with volume tweening network.IEEE Journal of Biomedical and Health Informatics, pages 1394–1404, 2020. 2
2020
-
[93]
Harley, Bokui Shen, Gordon Wet- zstein, and Leonidas J
Yang Zheng, Adam W. Harley, Bokui Shen, Gordon Wet- zstein, and Leonidas J. Guibas. Pointodyssey: A large-scale synthetic dataset for long-term point tracking. InProceed- ings of the IEEE/CVF International Conference on Com- puter Vision, 2023. 3
2023
-
[94]
Joint multi-frame detection and segmentation for multi-cell tracking
Zibin Zhou, Fei Wang, Wenjuan Xi, Huaying Chen, Peng Gao, and Chengkang He. Joint multi-frame detection and segmentation for multi-cell tracking. InImage and Graphics: 10th International Conference, ICIG 2019, Beijing, China, August 23–25, 2019, Proceedings, Part II 10, pages 435–
2019
-
[446]
Springer, 2019. 2 17
2019
-
[626]
6, 9, 10
Springer, 2022. 6, 9, 10
2022
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.