{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2023:WZB52G5RUP2SE7O7I7G7NEUPB2","short_pith_number":"pith:WZB52G5R","schema_version":"1.0","canonical_sha256":"b643dd1bb1a3f5227ddf47cdf6928f0eacb879d6a58663a287676dc0b401ac20","source":{"kind":"arxiv","id":"2303.17719","version":1},"attestation_state":"computed","paper":{"title":"Why is the winner the best?","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.LG"],"primary_cat":"cs.CV","authors_text":"Abdolrahim Kadkhodamohammadi, Adam Shephard, Adrian Galdran, Adrien Depeursinge, Alessa Hering, Alessandro Casella, Ali Emre Kavur, Alison Noble, \\'Alvaro Garc\\'ia Faura, Amine Yamlahi, Aneeq Zia, Annette Kopp-Schneider, Annika Reinke, Anubha Gupta, Arnaud Huaulm\\'e, Benedikt Wiestler, Binod Bhattarai, Bjoern Menze, Bruno Oliveira, Carlos Mart\\'in-Isla, Carole H. Sudre, Chanyeol Choi, Christoph M. Friedrich, Chun Yuan, Clifton Fuller, David G. Ellis, David Owen, David Zimmerer, Dejan \\v{S}tepec, Dogu Baran Aydogan, Donglai Wei, Elodie Puybareau, Fabian Isensee, Fangfang Xia, Florian Kofler, Gabriel Girard, Guillaume Tochon, Haojie Wang, Helena R. Torres, Helene Urien, Hongwei Li, Hugo Kuijf, Ikbeom Jang, Inha Kang, Ivan Ezhov, Jan Egger, Jiacheng Wang, Jianning Li, Jihoon Cho, Jinah Park, Jo\\~ao L. Vila\\c{c}a, Jonathan Rafael-Pati\\~no, Jorge Bernal, Juanying Xie, Jun Ma, Kanako Harada, Kanghyun Ryu, Kareem Abdul Wahid, Kelly Payette, Kimberlin Van Wijnen, Klaus Maier-Hein, Lasse Hansen, Lena Maier-Hein, Liansheng Wang, Louise Bloch, Marc Aubreville, Marek Wodzinski, Maria Grammatikopoulou, Marie Daum, Marleen de Bruijne, Martin Wagner, Matthias Eisenmann, Mattias Heinrich, Maximilian Zenk, Melanie Ganz, Michal Kozubek, Mingxing Li, Minh Huan Luu, Minu Dietlinde Tizabi, Mohamed A. Naser, Moi Hoon Yap, Mostafa Jahanifar, Nasir Rajpoot, Nicholas Heller, Nicolas Padoy, Niranjan Balu, Noha Ghatwary, Numan Saeed, Old\\v{r}ich Kodym, Patrick Godau, Paul F. J\\\"ager, Pedro Morais, Pengcheng Shi, Pierre Jannin, Qi Dou, Raphael Br\\\"ungel, Rebati Raman Gaire, Reuben Dorent, Ronast Subedi, Sandy Engelhardt, Sarthak Pati, Satoshi Kondo, Sebastian Bodenstedt, Sen Yang, SeulGi Hong, Sharib Ali, Sophia Bano, Spyridon Bakas, Stefanie Speidel, Subeen Pang, Sung-Hong Park, Szymon P{\\l}otka, Tim J. Adler, Tim R\\\"adsch, Toma\\v{z} Martin\\v{c}i\\v{c}, Ujjwal Baid, Valentin Oreiller, Veronika Cheplygina, Vincent Andrearczyk, Vivek Singh Bawa, Vivienn Weru, Xiyue Wang, Yanwu Yang, Zhiwei Xiong, Zixuan Zhao","submitted_at":"2023-03-30T21:41:42Z","abstract_excerpt":"International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multi-center study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on co"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2303.17719","kind":"arxiv","version":1},"metadata":{"license":"http://creativecommons.org/licenses/by/4.0/","primary_cat":"cs.CV","submitted_at":"2023-03-30T21:41:42Z","cross_cats_sorted":["cs.LG"],"title_canon_sha256":"886a17018ba55a9973b9bd36c312285dc4241b3a3f9898d0815e3b1480e63540","abstract_canon_sha256":"acc1cb90d77aa8225bc882174f81a7cace2bff5c359ff0c3c1b9477db1cbac5c"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T05:56:44.939117Z","signature_b64":"su5VY4+EppObz96jVU9ZWR43Ddh0gSRYQOOhKBhAZMKu1JY12ZMW5bZQ0tdCRCRqiTN1ktJB28H8aJE5jx8wAg==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"b643dd1bb1a3f5227ddf47cdf6928f0eacb879d6a58663a287676dc0b401ac20","last_reissued_at":"2026-07-05T05:56:44.938600Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T05:56:44.938600Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"Why is the winner the best?","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.LG"],"primary_cat":"cs.CV","authors_text":"Abdolrahim Kadkhodamohammadi, Adam Shephard, Adrian Galdran, Adrien Depeursinge, Alessa Hering, Alessandro Casella, Ali Emre Kavur, Alison Noble, \\'Alvaro Garc\\'ia Faura, Amine Yamlahi, Aneeq Zia, Annette Kopp-Schneider, Annika Reinke, Anubha Gupta, Arnaud Huaulm\\'e, Benedikt Wiestler, Binod Bhattarai, Bjoern Menze, Bruno Oliveira, Carlos Mart\\'in-Isla, Carole H. Sudre, Chanyeol Choi, Christoph M. Friedrich, Chun Yuan, Clifton Fuller, David G. Ellis, David Owen, David Zimmerer, Dejan \\v{S}tepec, Dogu Baran Aydogan, Donglai Wei, Elodie Puybareau, Fabian Isensee, Fangfang Xia, Florian Kofler, Gabriel Girard, Guillaume Tochon, Haojie Wang, Helena R. Torres, Helene Urien, Hongwei Li, Hugo Kuijf, Ikbeom Jang, Inha Kang, Ivan Ezhov, Jan Egger, Jiacheng Wang, Jianning Li, Jihoon Cho, Jinah Park, Jo\\~ao L. Vila\\c{c}a, Jonathan Rafael-Pati\\~no, Jorge Bernal, Juanying Xie, Jun Ma, Kanako Harada, Kanghyun Ryu, Kareem Abdul Wahid, Kelly Payette, Kimberlin Van Wijnen, Klaus Maier-Hein, Lasse Hansen, Lena Maier-Hein, Liansheng Wang, Louise Bloch, Marc Aubreville, Marek Wodzinski, Maria Grammatikopoulou, Marie Daum, Marleen de Bruijne, Martin Wagner, Matthias Eisenmann, Mattias Heinrich, Maximilian Zenk, Melanie Ganz, Michal Kozubek, Mingxing Li, Minh Huan Luu, Minu Dietlinde Tizabi, Mohamed A. Naser, Moi Hoon Yap, Mostafa Jahanifar, Nasir Rajpoot, Nicholas Heller, Nicolas Padoy, Niranjan Balu, Noha Ghatwary, Numan Saeed, Old\\v{r}ich Kodym, Patrick Godau, Paul F. J\\\"ager, Pedro Morais, Pengcheng Shi, Pierre Jannin, Qi Dou, Raphael Br\\\"ungel, Rebati Raman Gaire, Reuben Dorent, Ronast Subedi, Sandy Engelhardt, Sarthak Pati, Satoshi Kondo, Sebastian Bodenstedt, Sen Yang, SeulGi Hong, Sharib Ali, Sophia Bano, Spyridon Bakas, Stefanie Speidel, Subeen Pang, Sung-Hong Park, Szymon P{\\l}otka, Tim J. Adler, Tim R\\\"adsch, Toma\\v{z} Martin\\v{c}i\\v{c}, Ujjwal Baid, Valentin Oreiller, Veronika Cheplygina, Vincent Andrearczyk, Vivek Singh Bawa, Vivienn Weru, Xiyue Wang, Yanwu Yang, Zhiwei Xiong, Zixuan Zhao","submitted_at":"2023-03-30T21:41:42Z","abstract_excerpt":"International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multi-center study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on co"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2303.17719","kind":"arxiv","version":1},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2303.17719/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2303.17719","created_at":"2026-07-05T05:56:44.938663+00:00"},{"alias_kind":"arxiv_version","alias_value":"2303.17719v1","created_at":"2026-07-05T05:56:44.938663+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2303.17719","created_at":"2026-07-05T05:56:44.938663+00:00"},{"alias_kind":"pith_short_12","alias_value":"WZB52G5RUP2S","created_at":"2026-07-05T05:56:44.938663+00:00"},{"alias_kind":"pith_short_16","alias_value":"WZB52G5RUP2SE7O7","created_at":"2026-07-05T05:56:44.938663+00:00"},{"alias_kind":"pith_short_8","alias_value":"WZB52G5R","created_at":"2026-07-05T05:56:44.938663+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":2,"internal_anchor_count":0,"sample":[{"citing_arxiv_id":"2501.09209","citing_title":"Surgical Visual Understanding (SurgVU) Dataset","ref_index":7,"is_internal_anchor":false},{"citing_arxiv_id":"2605.05775","citing_title":"The autoPET3 Challenge: Automated Lesion Segmentation in Whole-Body PET/CT $\\unicode{x2013}$ Multitracer Multicenter Generalization","ref_index":33,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2","json":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2.json","graph_json":"https://pith.science/api/pith-number/WZB52G5RUP2SE7O7I7G7NEUPB2/graph.json","events_json":"https://pith.science/api/pith-number/WZB52G5RUP2SE7O7I7G7NEUPB2/events.json","paper":"https://pith.science/paper/WZB52G5R"},"agent_actions":{"view_html":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2","download_json":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2.json","view_paper":"https://pith.science/paper/WZB52G5R","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2303.17719&json=true","fetch_graph":"https://pith.science/api/pith-number/WZB52G5RUP2SE7O7I7G7NEUPB2/graph.json","fetch_events":"https://pith.science/api/pith-number/WZB52G5RUP2SE7O7I7G7NEUPB2/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2/action/timestamp_anchor","attest_storage":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2/action/storage_attestation","attest_author":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2/action/author_attestation","sign_citation":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2/action/citation_signature","submit_replication":"https://pith.science/pith/WZB52G5RUP2SE7O7I7G7NEUPB2/action/replication_record"}},"created_at":"2026-07-05T05:56:44.938663+00:00","updated_at":"2026-07-05T05:56:44.938663+00:00"}