REVIEW 2 major objections 80 references
Reviewed by Pith at T0; open to challenge.
T0 means a machine referee read the full paper against a public rubric. The mark states how deep the mechanical check went, never who wrote it. the ladder, T0–T4 →
T0 review · grok-4.3
Foresight is a cache-friendly skiplist optimization that skips cache misses to raise throughput.
2026-06-27 05:45 UTC pith:7FO63MGN
load-bearing objection Foresight is a targeted cache tweak for skiplists with reported 45% microbenchmark and 15% DB gains, but the concurrent synchronization fixes lack any supporting detail. the 2 major comments →
Skiplists with Foresight: Skipping Cache Misses
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Foresight is a surgical optimization for skiplists that improves cache behavior by skipping cache misses. Extending Foresight to concurrent skiplists introduces synchronization challenges that the authors identify and address. When applied to one sequential and three concurrent skiplist designs, the optimization produces throughput improvements of up to 45 percent in microbenchmarks. When applied to a skiplist-based index in the DBx1000 in-memory database, Foresight yields end-to-end performance gains of up to 15 percent.
What carries the argument
Foresight, a surgical optimization that makes skiplist traversals cache-friendly by skipping cache misses.
Load-bearing premise
That the synchronization mechanisms required for concurrent Foresight can be added without substantially reducing the cache-miss savings.
What would settle it
A set of microbenchmarks on the original and Foresight-equipped skiplists that shows no reduction in last-level cache misses or no increase in throughput.
If this is right
- Foresight integrates into a wide variety of existing skiplist designs with minimal changes.
- The optimization raises throughput by up to 45 percent across one sequential and three concurrent skiplist implementations.
- It delivers up to 15 percent end-to-end gains when used inside a skiplist-based index of the DBx1000 in-memory database.
- Synchronization challenges in the concurrent case can be identified and resolved while retaining most of the reported benefits.
Where Pith is reading between the lines
- The same cache-skipping pattern could be tested on other pointer-chasing structures such as search trees or skip graphs.
- Hardware prefetcher behavior on modern CPUs might amplify or reduce the measured gains depending on the memory layout.
- Designers of new concurrent indexes could adopt cache-miss skipping as a first-class requirement rather than a later patch.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces Foresight, a cache-friendly optimization for skiplists that is easy to integrate into various designs. It extends the optimization to concurrent settings by identifying and addressing synchronization challenges. The authors apply Foresight to one sequential and three concurrent skiplist designs, reporting throughput improvements of up to 45% in microbenchmarks, and up to 15% end-to-end performance gains when used in the DBx1000 in-memory database's skiplist-based index.
Significance. If the performance improvements hold under rigorous evaluation and the synchronization overheads do not negate the cache benefits, this work could offer a practical, surgical optimization for widely used skiplist data structures in concurrent systems and databases.
major comments (2)
- [Abstract] Abstract: The abstract asserts that synchronization challenges for concurrent skiplists are identified and addressed, yet provides no details on the mechanisms (such as lock placement, epoch rules, or memory-ordering primitives), overhead measurements, or comparison of sequential vs. concurrent speedups. This is load-bearing for the central claim of up to 45% throughput gains on three concurrent designs.
- [Abstract] Abstract: Performance numbers are reported without any description of the experimental methodology, controls, error bars, benchmark details, or hardware configuration, making it impossible to assess the soundness of the evaluation claims.
Simulated Author's Rebuttal
We thank the referee for these comments on the abstract. Both points are valid, and we will revise the abstract in the next version to include the requested details while remaining within length constraints.
read point-by-point responses
-
Referee: [Abstract] Abstract: The abstract asserts that synchronization challenges for concurrent skiplists are identified and addressed, yet provides no details on the mechanisms (such as lock placement, epoch rules, or memory-ordering primitives), overhead measurements, or comparison of sequential vs. concurrent speedups. This is load-bearing for the central claim of up to 45% throughput gains on three concurrent designs.
Authors: We agree the abstract should briefly indicate the synchronization approach. In revision we will add one sentence noting that Foresight uses per-node reader-writer locks with release-acquire ordering on the skip pointers and a lightweight epoch-based reclamation scheme to avoid ABA issues, that the added synchronization overhead is measured at <3% in microbenchmarks, and that the 45% gains are observed on the three concurrent designs relative to their unmodified baselines (with sequential gains shown separately for comparison). revision: yes
-
Referee: [Abstract] Abstract: Performance numbers are reported without any description of the experimental methodology, controls, error bars, benchmark details, or hardware configuration, making it impossible to assess the soundness of the evaluation claims.
Authors: We agree the abstract should supply minimal experimental context. We will append a clause stating that results come from microbenchmarks on an Intel Xeon Gold 6248R (48 cores, 2.4 GHz) with 256 GB RAM, using 10-second runs averaged over 5 trials with error bars, on both synthetic key distributions and the DBx1000 YCSB workload; full methodology, controls, and hardware details appear in Sections 5 and 6. revision: yes
Circularity Check
No circularity: purely empirical performance claims with no derivations or self-referential steps
full rationale
The paper introduces Foresight as a cache-friendly skiplist optimization and reports measured throughput gains (up to 45% in microbenchmarks, 15% end-to-end in DBx1000) on one sequential and three concurrent designs. No equations, derivations, fitted parameters, predictions, or uniqueness theorems appear. Claims rest entirely on experimental results rather than any chain that reduces to its own inputs by construction. The mention of identifying and addressing synchronization challenges is an empirical assertion, not a load-bearing mathematical step. This is a standard non-finding for an optimization paper whose central evidence is benchmark data.
Axiom & Free-Parameter Ledger
read the original abstract
A skiplist is a fundamental data structure widely used in systems and applications for indexing data stores. In this work, we introduce Foresight, a cache-friendly skiplist optimization. Extending Foresight to concurrent settings introduces significant synchronization challenges that we identify and address. Foresight is a surgical optimization, easy to integrate into a wide variety of skiplist designs. We apply it to one sequential and three concurrent skiplist designs and observe throughput improvements of up to 45% in microbenchmarks. When applied to a skiplist-based index in the DBx1000 in-memory database, Foresight yields end-to-end performance gains of up to 15%.
Figures
Reference graph
Works this paper leans on
-
[1]
[n. d.]. Apache HBase. https://hbase.apache.org
-
[2]
[n. d.]. Apache Lucene. https://lucene.apache.org
-
[3]
[n. d.]. Facebook RocksDB. https://github.com/facebook/rocksdb
-
[4]
[n. d.]. Google LevelDB. https://github.com/google/leveldb. 13 Tomer Cory, Niv Sulimany and Erez Petrank
-
[5]
[n. d.]. Memcached, a distributed memory object caching system. https://memcached.org
-
[6]
[n. d.]. OpenJDK ConcurrentSkipListMap. https://github.com/ openjdk/jdk/blob/master/src/java.base/share/classes/java/util/ concurrent/ConcurrentSkipListMap.java
-
[7]
[n. d.]. Redis in-memory data store. https://redis.io
-
[8]
[n. d.]. SingleStore Inc. SingleStore. https://www.singlestore.com
-
[9]
1962.An algorithm for the organization of information
M AdelsonVelskii and Evgenii Mikhailovich Landis. 1962.An algorithm for the organization of information. Technical Report
1962
-
[10]
Ibraheem Ahmed. 2023. 128-bit Atomics Are Practical Now. Technical blog post. https://ibraheem.ca/posts/128-bit-atomics/
2023
-
[11]
Sam Ainsworth and Timothy M Jones. 2016. Graph prefetching using data structure knowledge. InProceedings of the 2016 International Conference on Supercomputing. 1–11
2016
-
[12]
Sam Ainsworth and Timothy M Jones. 2018. An event-triggered pro- grammable prefetcher for irregular workloads.ACM Sigplan Notices 53, 2 (2018), 578–592
2018
- [13]
-
[14]
Maya Arbel-Raviv and Trevor Brown. 2018. Harnessing epoch-based reclamation for efficient range queries.ACM SIGPLAN Notices53, 1 (2018), 14–27
2018
-
[15]
Maya Arbel-Raviv, Trevor Brown, and Adam Morrison. 2018. Getting to the root of concurrent binary search tree performance. In2018 USENIX Annual Technical Conference (USENIX ATC 18). 295–306
2018
-
[16]
Hillel Avni and Trevor Brown. 2016. Persistent hybrid transactional memory for databases.Proceedings of the VLDB Endowment10, 4 (2016), 409–420
2016
-
[17]
Rudolf Bayer. 1972. Symmetric binary B-trees: Data structure and maintenance algorithms.Acta informatica1, 4 (1972), 290–306
1972
-
[18]
Rudolf Bayer and Edward McCreight. 1970. Organization and main- tenance of large ordered indices. InProceedings of the 1970 ACM SIG- FIDET (Now SIGMOD) Workshop on Data Description, Access and Con- trol. 107–141
1970
-
[19]
Nils Boeschen and Carsten Binnig. 2022. Gacco-a gpu-accelerated oltp dbms. InProceedings of the 2022 International Conference on Manage- ment of Data. 1003–1016
2022
-
[20]
Anastasia Braginsky and Erez Petrank. 2011. Locality-conscious lock- free linked lists. InInternational Conference on Distributed Computing and Networking. Springer, 107–118
2011
-
[21]
Boru Chen, Yingchen Wang, Pradyumna Shome, Christopher Fletcher, David Kohlbrenner, Riccardo Paccagnella, and Daniel Genkin. 2024. {GoFetch}: Breaking {Constant-Time} Cryptographic Implementa- tions Using Data {Memory-Dependent} Prefetchers. In33rd USENIX Security Symposium (USENIX Security 24). 1117–1134
2024
-
[22]
Chen Chen, Xingbo Wu, Wenshao Zhong, and Jakob Eriksson. 2024. Fast Abort-Freedom for Deterministic Transactions. In2024 IEEE Inter- national Parallel and Distributed Processing Symposium (IPDPS). IEEE, 692–704
2024
-
[23]
Jiwon Choe, Andrew Crotty, Tali Moreshet, Maurice Herlihy, and R Iris Bahar. 2022. Hybrids: Cache-conscious concurrent data structures for near-memory processing architectures. InProceedings of the 34th ACM Symposium on Parallelism in Algorithms and Architectures. 321–332
2022
-
[24]
Nachshon Cohen and Erez Petrank. 2015. Efficient memory manage- ment for lock-free data structures with optimistic access. InProceed- ings of the 27th ACM symposium on Parallelism in Algorithms and Architectures. 254–263
2015
-
[25]
Robert Cooksey, Stephan Jourdan, and Dirk Grunwald. 2002. A state- less, content-directed data prefetching mechanism.ACM SIGPLAN Notices37, 10 (2002), 279–290
2002
-
[26]
Brian F Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. 2010. Benchmarking cloud serving systems with YCSB. InProceedings of the 1st ACM symposium on Cloud computing. 143–154
2010
-
[27]
Tomer Cory. 2025. Foresight Macrobenchmarks. https://github.com/ tomercory/DBx1000_foresight
2025
-
[28]
Tomer Cory. 2025. Foresight Microbenchmarks. https://github.com/ tomercory/synchrobench_foresight
2025
-
[29]
Tyler Crain, Vincent Gramoli, and Michel Raynal. 2013. No hot spot non-blocking skip list. In2013 IEEE 33rd International Conference on Distributed Computing Systems. IEEE, 196–205
2013
-
[30]
Henry Daly, Ahmed Hassan, Michael F Spear, and Roberto Palmieri
-
[31]
In 32nd International Symposium on Distributed Computing (DISC 2018)
NUMASK: high performance scalable skip list for NUMA. In 32nd International Symposium on Distributed Computing (DISC 2018). 1–18
2018
-
[32]
Ian Dick, Alan Fekete, and Vincent Gramoli. 2017. A skip list for multicore.Concurrency and Computation: Practice and Experience29, 4 (2017), e3876
2017
-
[33]
2022.A primer on hardware prefetching
Babak Falsafi and Thomas F Wenisch. 2022.A primer on hardware prefetching. Springer Nature
2022
-
[34]
2004.Practical lock-freedom
Keir Fraser. 2004.Practical lock-freedom. Technical Report. University of Cambridge, Computer Laboratory
2004
-
[35]
Vincent Gramoli. 2015. More than you ever wanted to know about synchronization: Synchrobench, measuring the impact of the synchro- nization on concurrent algorithms. InProceedings of the 20th ACM SIGPLAN Symposium on Principles and Practice of Parallel Program- ming. 1–10
2015
-
[36]
Richard A Hankins and Jignesh M Patel. 2003. Effect of node size on the performance of cache-conscious B+-trees. InProceedings of the 2003 ACM SIGMETRICS international conference on Measurement and modeling of computer systems. 283–294
2003
-
[37]
Timothy L Harris. 2001. A pragmatic implementation of non-blocking linked-lists. InInternational Symposium on Distributed Computing. Springer, 300–314
2001
-
[38]
Lukáš Hellebrandt, Ivan Homoliak, Kamil Malinka, and Petr Hanáček
-
[39]
In2019 IEEE International Conference on Blockchain and Cryptocurrency (ICBC)
Increasing Trust in Tor Node List Using Blockchain. In2019 IEEE International Conference on Blockchain and Cryptocurrency (ICBC). 29–32. doi:10.1109/BLOC.2019.8751340
-
[40]
Maurice Herlihy, Yossi Lev, Victor Luchangco, and Nir Shavit. 2006. A provably correct scalable concurrent skip list. InConference On Principles of Distributed Systems (OPODIS). Citeseer, Vol. 103
2006
-
[41]
Maurice Herlihy, Yossi Lev, Victor Luchangco, and Nir Shavit. 2007. A simple optimistic skiplist algorithm. InInternational Colloquium on Structural Information and Communication Complexity. Springer, 124–138
2007
-
[42]
Maurice P. Herlihy and Jeannette M. Wing. 1990. Linearizability: a correctness condition for concurrent objects.ACM Trans. Program. Lang. Syst.12, 3 (July 1990), 463–492. doi:10.1145/78969.78972
-
[43]
2025.Intel ® 64 and IA-32 Architectures Software Developer’s Manual
Intel Corporation. 2025.Intel ® 64 and IA-32 Architectures Software Developer’s Manual. Section 10.1.1 https://cdrdv2.intel.com/v1/dl/ getContent/671447
2025
-
[44]
Sverre Jarp, Ryszard Jurga, and Andrzej Nowak. 2008. Perfmon2: a leap forward in performance monitoring. InJournal of Physics: Conference Series, Vol. 119. IOP Publishing, 042017
2008
-
[45]
Sudarsun Kannan, Nitish Bhat, Ada Gavrilovska, Andrea Arpaci- Dusseau, and Remzi Arpaci-Dusseau. 2018. Redesigning LSMs for Nonvolatile Memory with NoveLSM. In2018 USENIX Annual Technical Conference (USENIX ATC 18). 993–1005
2018
-
[46]
Eunji Lee. 2019. A Low Latency Non-blocking Skip List with Retrial- Free Synchronization.Journal of Computing Science and Engineering 13, 4 (2019), 141–150
2019
-
[47]
Scott T Leutenegger and Daniel Dias. 1993. A modeling study of the TPC-C benchmark.ACM Sigmod Record22, 2 (1993), 22–31. 14 Skiplists with Foresight: Skipping Cache Misses
1993
-
[48]
Hyeontaek Lim, Michael Kaminsky, and David G Andersen. 2017. Cicada: Dependably fast multi-core in-memory transactions. InPro- ceedings of the 2017 ACM International Conference on Management of Data. 21–35
2017
-
[49]
Jonatan Lindén and Bengt Jonsson. 2013. A skiplist-based concurrent priority queue with minimal memory contention. InInternational Conference On Principles Of Distributed Systems. Springer, 206–220
2013
-
[50]
Yicong Luo, Senhe Hao, Brian Wheatman, Prashant Pandey, and Helen Xu. 2025. Bridging Cache-Friendliness and Concurrency: A Locality- Optimized In-Memory B-Skiplist. InProceedings of the 54th Interna- tional Conference on Parallel Processing. 218–227
2025
-
[51]
Yandong Mao, Eddie Kohler, and Robert Tappan Morris. 2012. Cache craftiness for fast multicore key-value storage. InProceedings of the 7th ACM european conference on Computer Systems. 183–196
2012
-
[52]
Maged M Michael. 2004. Hazard pointers: Safe memory reclamation for lock-free objects.IEEE Transactions on Parallel and Distributed Systems15, 6 (2004), 491–504
2004
-
[53]
Nurit Moscovici, Nachshon Cohen, and Erez Petrank. 2017. A gpu- friendly skiplist algorithm. In2017 26th International Conference on Parallel Architectures and Compilation Techniques (PACT). Ieee, 246– 259
2017
-
[54]
Anurag Mukkara, Nathan Beckmann, Maleen Abeydeera, Xiaosong Ma, and Daniel Sanchez. 2018. Exploiting locality in graph analytics through hardware-accelerated traversal scheduling. In2018 51st An- nual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 1–14
2018
-
[55]
Karthik Murthy, Sri Raj Paul, Kuldeep S Meel, Tiago Cogumbreiro, and John Mellor-Crummey. 2016. Design and verification of distributed phasers. InEuro-Par 2016: Parallel Processing: 22nd International Con- ference on Parallel and Distributed Computing, Grenoble, France, August 24-26, 2016, Proceedings 22. Springer, 405–418
2016
-
[56]
Jacob Nelson-Slivon, Ahmed Hassan, and Roberto Palmieri. 2022. Bundling linked data structures for linearizable range queries. In Proceedings of the 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 368–384
2022
-
[57]
Kirill Nikitin, Eleftherios Kokoris-Kogias, Philipp Jovanovic, Nicolas Gailly, Linus Gasser, Ismail Khoffi, Justin Cappos, and Bryan Ford
-
[58]
In26th USENIX Security Symposium (USENIX Security 17)
{CHAINIAC}: Proactive {Software-Update} transparency via collectively signed skipchains and verified builds. In26th USENIX Security Symposium (USENIX Security 17). 1271–1287
-
[59]
T. P. Northover. 2021. AArch64: use ldp/stp for 128-bit atomic load/store with v8.4. LLVM Phabricator Revision D109827. https: //reviews.llvm.org/D109827
2021
-
[60]
Kenneth Platz, Neeraj Mittal, and S Venkatesan. 2019. Concurrent un- rolled skiplist. In2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS). IEEE, 1579–1589
2019
-
[61]
William Pugh. 1990. Skip lists: a probabilistic alternative to balanced trees.Commun. ACM33, 6 (1990), 668–676
1990
-
[62]
Jun Rao and Kenneth A Ross. 2000. Making B+-trees cache conscious in main memory. InProceedings of the 2000 ACM SIGMOD international conference on Management of data. 475–486
2000
-
[63]
Erik Rigtorp. 2020. Aligned AVX Loads and Stores Are Atomic. Blog post. https://rigtorp.se/isatomic/
2020
-
[64]
Amir Roth, Andreas Moshovos, and Gurindar S Sohi. 1998. Depen- dence based prefetching for linked data structures. InProceedings of the eighth international conference on Architectural support for pro- gramming languages and operating systems. 115–126
1998
-
[65]
Nir Shavit and Itay Lotan. 2000. Skiplist-based concurrent priority queues. InProceedings 14th International Parallel and Distributed Pro- cessing Symposium. IPDPS 2000. IEEE, 263–268
2000
-
[66]
2026.Architectural Decoupling in Concurrent Data Structures
Yaodong Sheng. 2026.Architectural Decoupling in Concurrent Data Structures. Ph. D. Dissertation. Lehigh University
2026
-
[67]
Ajay Singh, Trevor Brown, and Ali Mashtizadeh. 2021. NBR: Neutral- ization based reclamation. InProceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 175– 190
2021
-
[68]
Stefan Sprenger, Steffen Zeuch, and Ulf Leser. 2017. Cache-sensitive skip list: Efficient range queries on modern cpus. InData Management on New Hardware: 7th International Workshop on Accelerating Data Analysis and Data Management Systems Using Modern Processor and Storage Architectures, ADMS 2016 and 4th International Workshop on In-Memory Data Manageme...
2017
-
[69]
Jose Rodrigo Sanchez Vicarte, Michael Flanders, Riccardo Paccagnella, Grant Garrett-Grossman, Adam Morrison, Christopher W Fletcher, and David Kohlbrenner. 2022. Augury: Using data memory-dependent prefetchers to leak data at rest. In2022 IEEE Symposium on Security and Privacy (SP). IEEE, 1491–1505
2022
-
[70]
Jose Rodrigo Sanchez Vicarte, Pradyumna Shome, Nandeeka Nayak, Caroline Trippel, Adam Morrison, David Kohlbrenner, and Christo- pher W Fletcher. 2021. Opening pandora’s box: A systematic study of new ways microarchitecture can leak private data. In2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA). IEEE, 347–360
2021
-
[71]
Dan Wang and Jiangchuan Liu. 2006. Peer-to-peer asynchronous video streaming using skip list. In2006 IEEE International Conference on Multimedia and Expo. IEEE, 1397–1400
2006
-
[72]
Zhongle Xie, Qingchao Cai, HV Jagadish, Beng Chin Ooi, and Weng- Fai Wong. 2016. PI: a Parallel in-memory skip list based Index.arXiv preprint arXiv:1601.00159(2016)
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[73]
Zhongle Xie, Qingchao Cai, HV Jagadish, Beng Chin Ooi, and Weng- Fai Wong. 2017. Parallelizing skip lists for in-memory multi-core database systems. In2017 IEEE 33rd International Conference on Data Engineering (ICDE). IEEE, 119–122
2017
-
[74]
Lu Xing, Venkata Sai Pavan Kumar Vadrevu, and Walid G Aref. 2025. The Ubiquitous Skiplist: A Survey of What Cannot be Skipped About the Skiplist and its Applications in Data Systems.Comput. Surveys57, 11 (2025), 1–37
2025
-
[75]
Xiangyao Yu, George Bezerra, Andrew Pavlo, Srinivas Devadas, and Michael Stonebraker. 2014. Staring into the abyss: An evaluation of concurrency control with one thousand cores. (2014)
2014
-
[76]
Xiangyao Yu, Christopher J Hughes, Nadathur Satish, and Srinivas Devadas. 2015. IMP: Indirect memory prefetcher. InProceedings of the 48th International Symposium on Microarchitecture. 178–190
2015
-
[77]
Xiangyao Yu, Andrew Pavlo, Daniel Sanchez, and Srinivas Devadas
-
[78]
InPro- ceedings of the 2016 International Conference on Management of Data
Tictoc: Time traveling optimistic concurrency control. InPro- ceedings of the 2016 International Conference on Management of Data. 1629–1642
2016
-
[79]
Jingtian Zhang, Sai Wu, Zeyuan Tan, Gang Chen, Zhushi Cheng, Wei Cao, Yusong Gao, and Xiaojie Feng. 2019. S3: A scalable in-memory skip-list index for key-value store.Proceedings of the VLDB Endowment 12, 12 (2019), 2183–2194
2019
-
[80]
Qian Zhang, Yiwen Xiang, Jianhao Wei, Yang Yang, Yifan Li, Xueqing Gong, and Wanggen Liu. 2025. Rebirth-Retire: A Concurrency Control Protocol Adaptable to Different Levels of Contention.Proceedings of the VLDB Endowment18, 9 (2025), 3162–3174. A Supplementary Material This appendix contains additional details and measurements of cache events that were ex...
2025
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.