Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge

Maximilian Zenk, Ujjwal Baid, Sarthak Pati, Akis Linardos, Brandon Edwards, Micah Sheller, Patrick Foley, Alejandro Aristizabal, David Zimmerer, Alexey Gruzdev, Jason Martin, Russell T. Shinohara, Annika Reinke, Fabian Isensee, Santhosh Parampottupadam, Kaushal Parekh, Ralf Floca, Hasan Kassem, Bhakti Baheti, Siddhesh Thakur, Verena Chung, Kaisar Kushibar, Karim Lekadir, Meirui Jiang, Youtan Yin, Hongzheng Yang, Quande Liu, Cheng Chen, Qi Dou, Pheng-Ann Heng, Xiaofan Zhang, Shaoting Zhang, Muhammad Irfan Khan, Mohammad Ayyaz Azeem, Mojtaba Jafaritadi, Esa Alhoniemi, Elina Kontio, Suleiman A. Khan, Leon Mächler, Ivan Ezhov, Florian Kofler, Suprosanna Shit, Johannes C. Paetzold, Timo Loehr, Benedikt Wiestler, Himashi Peiris, Kamlesh Pawar, Shenjun Zhong, Zhaolin Chen, Munawar Hayat, Gary Egan, Mehrtash Harandi, Ece Isik Polat, Gorkem Polat, Altan Kocyigit, Alptekin Temizel, Anup Tuladhar, Lakshay Tyagi, Raissa Souza, Nils D. Forkert, Pauline Mouches, Matthias Wilms, Vishruth Shambhat, Akansh Maurya, Shubham Subhas Danannavar, Rohit Kalla, Vikas Kumar Anand, Ganapathy Krishnamurthi, Sahil Nalawade, Chandan Ganesh, Ben Wagner, Divya Reddy, Yudhajit Das, Fang F. Yu, Baowei Fei, Ananth J. Madhuranthakam, Joseph Maldjian, Gaurav Singh, Jianxun Ren, Wei Zhang, Ning An, Qingyu Hu, Youjia Zhang, Ying Zhou, Vasilis Siomos, Giacomo Tarroni, Jonathan Passerrat-Palmbach, Ambrish Rawat, Giulio Zizzo, Swanand Ravindra Kadhe, Jonathan P. Epperlein, Stefano Braghin, Yuan Wang, Renuga Kanagavelu, Qingsong Wei, Yechao Yang, Yong Liu, Krzysztof Kotowski, Szymon Adamski, Bartosz Machura, Wojciech Malara, Lukasz Zarudzki, Jakub Nalepa, Yaying Shi, Hongjian Gao, Salman Avestimehr, Yonghong Yan, Agus S. Akbar, Ekaterina Kondrateva, Hua Yang, Zhaopei Li, Hung-Yu Wu, Johannes Roth, Camillo Saueressig, Alexandre Milesi, Quoc D. Nguyen, Nathan J. Gruenhagen, Tsung-Ming Huang, Jun Ma, Har Shwinder H. Singh, Nai-Yu Pan, Dingwen Zhang, Ramy A. Zeineldin, Michal Futrega, Yading Yuan, Gian Marco Conte, Xue Feng, Quan D. Pham, Yong Xia, Zhifan Jiang, Huan Minh Luu, Mariia Dobko, Alexandre Carré, Bair Tuchinov, Hassan Mohy-ud-Din, Saruar Alam, Anup Singh, Nameeta Shah, Weichung Wang, Chiharu Sako, Michel Bilello, Satyam Ghodasara, Suyash Mohan, Christos Davatzikos, Evan Calabrese, Jeffrey Rudie, Javier Villanueva-Meyer, Soonmee Cha, Christopher Hess, John Mongan, Madhura Ingalhalikar, Manali Jadhav, Umang Pandey, Jitender Saini, Raymond Y. Huang, Ken Chang, Minh-Son To, Sargam Bhardwaj, Chee Chong, Marc Agzarian, Michal Kozubek, Filip Lux, Jan Michálek, Petr Matula, Miloš Ker^kovský, Tereza Kopr^ivová, Marek Dostál, Václav Vybíhal, Marco C. Pinho, James Holcomb, Marie Metz, Rajan Jain, Matthew D. Lee, Yvonne W. Lui, Pallavi Tiwari, Ruchika Verma, Rohan Bareja, Ipsa Yadav, Jonathan Chen, Neeraj Kumar, Yuriy Gusev, Krithika Bhuvaneshwar, Anousheh Sayah, Camelia Bencheqroun, Anas Belouali, Subha Madhavan, Rivka R. Colen, Aikaterini Kotrotsou, Philipp Vollmuth, Gianluca Brugnara, Chandrakanth J. Preetha, Felix Sahm, Martin Bendszus, Wolfgang Wick, Abhishek Mahajan, Carmen Balaña, Jaume Capellades, Josep Puig, Yoon Seong Choi, Seung-Koo Lee, Jong Hee Chang, Sung Soo Ahn, Hassan F. Shaykh, Alejandro Herrera-Trujillo, Maria Trujillo, William Escobar, Ana Abello, Jose Bernal, Jhon Gómez, Pamela LaMontagne, Daniel S. Marcus, Mikhail Milchenko, Arash Nazeri, Bennett Landman, Karthik Ramadass, Kaiwen Xu, Silky Chotai, Lola B. Chambless, Akshitkumar Mistry, Reid C. Thompson, Ashok Srinivasan, J. Rajiv Bapuraj, Arvind Rao, Nicholas Wang, Ota Yoshiaki, Toshio Moritani, Sevcan Turk, Joonsang Lee, Snehal Prabhudesai, John Garrett, Matthew Larson, Robert Jeraj, Hongwei Li, Tobias Weiss, Michael Weller, Andrea Bink, Bertrand Pouymayou, Sonam Sharma, Tzu-Chi Tseng, Saba Adabi, Alexandre Xavier Falcão, Samuel B. Martins, Bernardo C. A. Teixeira, Flávia Sprenger, David Menotti, Diego R. Lucio, Simone P. Niclou, Olivier Keunen, Ann-Christin Hau, Enrique Pelaez, Heydy Franco-Maldonado, Francis Loayza, Sebastian Quevedo, Richard McKinley, Johannes Slotboom, Piotr Radojewski, Raphael Meier, Roland Wiest, Johannes Trenkler, Josef Pichler, Georg Necker, Andreas Haunschmidt, Stephan Meckel, Pamela Guevara, Esteban Torche, Cristobal Mendoza, Franco Vera, Elvis Ríos, Eduardo López, Sergio A. Velastin, Joseph Choi, Stephen Baek, Yusung Kim, Heba Ismael, Bryan Allen, John M. Buatti, Peter Zampakis, Vasileios Panagiotopoulos, Panagiotis Tsiganos, Sotiris Alexiou, Ilias Haliassos, Evangelia I. Zacharaki, Konstantinos Moustakas, Christina Kalogeropoulou, Dimitrios M. Kardamakis, Bing Luo, Laila M. Poisson, Ning Wen, Martin Vallières, Mahdi Ait Lhaj Loutfi, David Fortin, Martin Lepage, Fanny Morón, Jacob Mandel, Gaurav Shukla, Spencer Liem, Gregory S. Alexandre, Joseph Lombardo, Joshua D. Palmer, Adam E. Flanders, Adam P. Dicker, Godwin Ogbole, Dotun Oyekunle, Olubunmi Odafe-Oyibotha, Babatunde Osobu, Mustapha Shu’aibu Hikima, Mayowa Soneye, Farouk Dako, Adeleye Dorcas, Derrick Murcia, Eric Fu, Rourke Haas, John A. Thompson, David Ryan Ormond, Stuart Currie, Kavi Fatania, Russell Frood, Amber L. Simpson, Jacob J. Peoples, Ricky Hu, Danielle Cutler, Fabio Y. Moraes, Anh Tran, Mohammad Hamghalam, Michael A. Boss, James Gimpel, Deepak Kattil Veettil, Kendall Schmidt, Lisa Cimino, Cynthia Price, Brian Bialecki, Sailaja Marella, Charles Apgar, Andras Jakab, Marc-André Weber, Errol Colak, Jens Kleesiek, John B. Freymann, Justin S. Kirby, Lena Maier-Hein, Jake Albrecht, Peter Mattson, Alexandros Karargyris, Prashant Shah, Bjoern Menze, Klaus Maier-Hein and Spyridon Bakas ()
Additional contact information
Maximilian Zenk: Division of Medical Image Computing
Ujjwal Baid: Indiana University
Sarthak Pati: Indiana University
Akis Linardos: Indiana University
Brandon Edwards: Intel Corporation
Micah Sheller: MLCommons
Patrick Foley: Intel Corporation
Alejandro Aristizabal: MLCommons
David Zimmerer: Division of Medical Image Computing
Alexey Gruzdev: Intel Corporation
Jason Martin: Intel Corporation
Russell T. Shinohara: University of Pennsylvania
Annika Reinke: Division of Intelligent Medical Systems
Fabian Isensee: Division of Medical Image Computing
Santhosh Parampottupadam: Division of Medical Image Computing
Kaushal Parekh: Division of Medical Image Computing
Ralf Floca: Division of Medical Image Computing
Hasan Kassem: MLCommons
Bhakti Baheti: Indiana University School of Medicine
Siddhesh Thakur: Indiana University School of Medicine
Verena Chung: Sage Bionetworks
Kaisar Kushibar: Universitat de Barcelona
Karim Lekadir: Universitat de Barcelona, Artificial Intelligence in Medicine Lab (BCN-AIM)
Meirui Jiang: The Chinese University of Hong Kong
Youtan Yin: Zhejiang University
Hongzheng Yang: Beihang University
Quande Liu: The Chinese University of Hong Kong
Cheng Chen: The Chinese University of Hong Kong
Qi Dou: The Chinese University of Hong Kong
Pheng-Ann Heng: The Chinese University of Hong Kong
Xiaofan Zhang: Shanghai Jiao Tong University
Shaoting Zhang: Shanghai Artificial Intelligence Laboratory
Muhammad Irfan Khan: Turku University of Applied Sciences
Mohammad Ayyaz Azeem: Riphah International University
Mojtaba Jafaritadi: Turku University of Applied Sciences
Esa Alhoniemi: Turku University of Applied Sciences
Elina Kontio: Turku University of Applied Sciences
Suleiman A. Khan: University of Helsinki
Leon Mächler: École Normale Supérieure
Ivan Ezhov: Technical University of Munich
Florian Kofler: Technical University of Munich
Suprosanna Shit: Technical University of Munich
Johannes C. Paetzold: ITERM Institute Helmholtz Zentrum Muenchen
Timo Loehr: Technical University of Munich
Benedikt Wiestler: Technical University of Munich
Himashi Peiris: Monash University
Kamlesh Pawar: Monash University
Shenjun Zhong: Monash University
Zhaolin Chen: Monash University
Munawar Hayat: Monash University
Gary Egan: Monash University
Mehrtash Harandi: Monash University
Ece Isik Polat: Middle East Technical University
Gorkem Polat: Middle East Technical University
Altan Kocyigit: Middle East Technical University
Alptekin Temizel: Middle East Technical University
Anup Tuladhar: University of Calgary
Lakshay Tyagi: Indian Institute of Technology Kanpur
Raissa Souza: University of Calgary
Nils D. Forkert: University of Calgary
Pauline Mouches: University of Calgary
Matthias Wilms: University of Calgary
Vishruth Shambhat: IIT Madras
Akansh Maurya: IIT Madras
Shubham Subhas Danannavar: IIT Madras
Rohit Kalla: IIT Madras
Vikas Kumar Anand: IIT Madras
Ganapathy Krishnamurthi: IIT Madras
Sahil Nalawade: University of Texas Southwestern Medical Center
Chandan Ganesh: University of Texas Southwestern Medical Center
Ben Wagner: University of Texas Southwestern Medical Center
Divya Reddy: University of Texas Southwestern Medical Center
Yudhajit Das: University of Texas Southwestern Medical Center
Fang F. Yu: University of Texas Southwestern Medical Center
Baowei Fei: University of Texas at Dallas
Ananth J. Madhuranthakam: University of Texas Southwestern Medical Center
Joseph Maldjian: University of Texas Southwestern Medical Center
Gaurav Singh: Indian Institute of Information Technology Vadodara
Jianxun Ren: Changping Laboratory
Wei Zhang: Changping Laboratory
Ning An: Changping Laboratory
Qingyu Hu: Cornell University
Youjia Zhang: Changping Laboratory
Ying Zhou: Changping Laboratory
Vasilis Siomos: University of London
Giacomo Tarroni: University of London
Jonathan Passerrat-Palmbach: University of London
Ambrish Rawat: IBM Research
Giulio Zizzo: IBM Research
Swanand Ravindra Kadhe: IBM Research
Jonathan P. Epperlein: IBM Research
Stefano Braghin: IBM Research
Yuan Wang: Technology and Research (A*STAR)
Renuga Kanagavelu: Technology and Research (A*STAR)
Qingsong Wei: Technology and Research (A*STAR)
Yechao Yang: Technology and Research (A*STAR)
Yong Liu: Technology and Research (A*STAR)
Krzysztof Kotowski: Graylight Imaging
Szymon Adamski: Graylight Imaging
Bartosz Machura: Graylight Imaging
Wojciech Malara: Graylight Imaging
Lukasz Zarudzki: Maria Sklodowska-Curie Memorial Cancer Center and Institute of Oncology
Jakub Nalepa: Graylight Imaging
Yaying Shi: University of North Carolina at Charlotte
Hongjian Gao: University of Southern California
Salman Avestimehr: University of Southern California
Yonghong Yan: University of North Carolina at Charlotte
Agus S. Akbar: Universitas Islam Nahdlatul Ulama Jepara
Ekaterina Kondrateva: Skolkovo Institute of Science and Technology
Hua Yang: Fujian Normal University
Zhaopei Li: Fuzhou University
Hung-Yu Wu: National Tsing Hua University
Johannes Roth: ScaDS.AI
Camillo Saueressig: Brown University
Alexandre Milesi: NVIDIA
Quoc D. Nguyen: EPITA
Nathan J. Gruenhagen: Medical College of Wiconsin
Tsung-Ming Huang: National Taiwan Normal University
Jun Ma: Nanjing University of Science and Technology
Har Shwinder H. Singh: Hong Kong University of Science and Technology
Nai-Yu Pan: National Taiwan University of Science and Technology
Dingwen Zhang: Northwestern Polytechnical University
Ramy A. Zeineldin: Karlsruhe Institute of Technology
Michal Futrega: NVIDIA
Yading Yuan: Columbia University Irving Medical Center
Gian Marco Conte: Mayo Clinic
Xue Feng: University of Virginia
Quan D. Pham: VinBrain
Yong Xia: Northwestern Polytechnical University
Zhifan Jiang: Children’s National Hospital
Huan Minh Luu: KAIST
Mariia Dobko: Ukrainian Catholic University
Alexandre Carré: Gustave Roussy Cancer Campus
Bair Tuchinov: Novosibirsk State University
Hassan Mohy-ud-Din: LUMS
Saruar Alam: University of Bergen
Anup Singh: Indian Institute of Technology
Nameeta Shah: Mazumdar Shaw Medical Foundation
Weichung Wang: National Taiwan University
Chiharu Sako: University of Pennsylvania
Michel Bilello: University of Pennsylvania
Satyam Ghodasara: Perelman School of Medicine at the University of Pennsylvania
Suyash Mohan: University of Pennsylvania
Christos Davatzikos: University of Pennsylvania
Evan Calabrese: University of California San Francisco
Jeffrey Rudie: University of California San Francisco
Javier Villanueva-Meyer: University of California San Francisco
Soonmee Cha: University of California San Francisco
Christopher Hess: University of California San Francisco
John Mongan: University of California San Francisco
Madhura Ingalhalikar: Symbiosis International University
Manali Jadhav: Symbiosis International University
Umang Pandey: Symbiosis International University
Jitender Saini: National Institute of Mental Health and Neurosciences
Raymond Y. Huang: Harvard Medical School
Ken Chang: Massachusetts General Hospital
Minh-Son To: Flinders University
Sargam Bhardwaj: Flinders University
Chee Chong: Flinders Medical Centre
Marc Agzarian: Flinders University
Michal Kozubek: Masaryk University
Filip Lux: Masaryk University
Jan Michálek: Masaryk University
Petr Matula: Masaryk University
Miloš Ker^kovský: University Hospital Brno and Faculty of Medicine, Masaryk University
Tereza Kopr^ivová: University Hospital Brno and Faculty of Medicine, Masaryk University
Marek Dostál: University Hospital Brno and Faculty of Medicine, Masaryk University
Václav Vybíhal: University Hospital Brno and Faculty of Medicine, Masaryk University
Marco C. Pinho: University of Texas Southwestern Medical Center
James Holcomb: University of Texas Southwestern Medical Center
Marie Metz: Klinikum rechts der Isar
Rajan Jain: NYU Grossman School of Medicine
Matthew D. Lee: NYU Grossman School of Medicine
Yvonne W. Lui: NYU Grossman School of Medicine
Pallavi Tiwari: University of Wisconsin School of Medicine & Public Health
Ruchika Verma: Case Western Reserve University
Rohan Bareja: Case Western Reserve University
Ipsa Yadav: Case Western Reserve University
Jonathan Chen: Case Western Reserve University
Neeraj Kumar: University of Alberta
Yuriy Gusev: Georgetown University
Krithika Bhuvaneshwar: Georgetown University
Anousheh Sayah: Department of Radiology
Camelia Bencheqroun: Georgetown University
Anas Belouali: Georgetown University
Subha Madhavan: Georgetown University
Rivka R. Colen: University of Pittsburgh
Aikaterini Kotrotsou: University of Texas MD Anderson Cancer Center
Philipp Vollmuth: Division of Medical Image Computing
Gianluca Brugnara: Heidelberg University Hospital
Chandrakanth J. Preetha: Heidelberg University Hospital
Felix Sahm: Heidelberg University Hospital
Martin Bendszus: Heidelberg University Hospital
Wolfgang Wick: Heidelberg University
Abhishek Mahajan: HBNI
Carmen Balaña: Catalan Institute of Oncology
Jaume Capellades: Consorci MAR Parc de Salut de Barcelona
Josep Puig: Hospital Clinic of Barcelona
Yoon Seong Choi: Yong Loo Lin School of Medicine
Seung-Koo Lee: Yonsei University College of Medicine
Jong Hee Chang: Yonsei University College of Medicine
Sung Soo Ahn: Yonsei University College of Medicine
Hassan F. Shaykh: University of Alabama in Birmingham
Alejandro Herrera-Trujillo: Clínica Imbanaco QuirónSalud
Maria Trujillo: Universidad del Valle
William Escobar: Clínica Imbanaco QuirónSalud
Ana Abello: Universidad del Valle
Jose Bernal: The University of Edinburgh
Jhon Gómez: Universidad del Valle
Pamela LaMontagne: Washington University in St. Louis
Daniel S. Marcus: Washington University in St. Louis
Mikhail Milchenko: Washington University in St. Louis
Arash Nazeri: Washington University in St. Louis
Bennett Landman: Vanderbilt University
Karthik Ramadass: Vanderbilt University
Kaiwen Xu: Vanderbilt University
Silky Chotai: Vanderbilt University Medical Center
Lola B. Chambless: Vanderbilt University Medical Center
Akshitkumar Mistry: Vanderbilt University Medical Center
Reid C. Thompson: Vanderbilt University Medical Center
Ashok Srinivasan: University of Michigan
J. Rajiv Bapuraj: University of Michigan
Arvind Rao: University of Michigan
Nicholas Wang: University of Michigan
Ota Yoshiaki: University of Michigan
Toshio Moritani: University of Michigan
Sevcan Turk: University of Michigan
Joonsang Lee: University of Michigan
Snehal Prabhudesai: University of Michigan
John Garrett: University of Wisconsin
Matthew Larson: University of Wisconsin
Robert Jeraj: University of Wisconsin
Hongwei Li: University of Zurich
Tobias Weiss: University Hospital Zurich and University of Zurich
Michael Weller: University Hospital Zurich and University of Zurich
Andrea Bink: University Hospital Zurich and University of Zurich
Bertrand Pouymayou: University Hospital Zurich and University of Zurich
Sonam Sharma: Icahn School of Medicine at Mount Sinai
Tzu-Chi Tseng: Icahn School of Medicine at Mount Sinai
Saba Adabi: Icahn School of Medicine at Mount Sinai
Alexandre Xavier Falcão: University of Campinas
Samuel B. Martins: and Technology of São Paulo
Bernardo C. A. Teixeira: Instituto de Neurologia de Curitiba
Flávia Sprenger: Federal University of Parana
David Menotti: Federal University of Parana
Diego R. Lucio: Federal University of Parana
Simone P. Niclou: Luxembourg Institute of Health
Olivier Keunen: Luxembourg Institute of Health
Ann-Christin Hau: Luxembourg Institute of Health
Enrique Pelaez: Escuela Superior Politecnica del Litoral
Heydy Franco-Maldonado: Sociedad de Lucha Contral el Cancer - SOLCA
Francis Loayza: Escuela Superior Politecnica del Litoral
Sebastian Quevedo: Universidad Católica de Cuenca
Richard McKinley: University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern
Johannes Slotboom: University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern
Piotr Radojewski: University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern
Raphael Meier: University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern
Roland Wiest: University Institute of Diagnostic and Interventional Neuroradiology, University Hospital Bern, Inselspital, University of Bern
Johannes Trenkler: Kepler University Hospital Linz
Josef Pichler: Kepler University Hospital Linz
Georg Necker: Kepler University Hospital Linz
Andreas Haunschmidt: Kepler University Hospital Linz
Stephan Meckel: Kepler University Hospital Linz
Pamela Guevara: Universidad de Concepción
Esteban Torche: Universidad de Concepción
Cristobal Mendoza: Universidad de Concepción
Franco Vera: Universidad de Concepción
Elvis Ríos: Universidad de Concepción
Eduardo López: Universidad de Concepción
Sergio A. Velastin: Queen Mary University of London
Joseph Choi: University of Iowa
Stephen Baek: University of Iowa
Yusung Kim: University of Iowa
Heba Ismael: University of Iowa
Bryan Allen: University of Iowa
John M. Buatti: University of Iowa
Peter Zampakis: University of Patras
Vasileios Panagiotopoulos: University of Patras
Panagiotis Tsiganos: University of Patras
Sotiris Alexiou: University of Patras
Ilias Haliassos: University of Patras
Evangelia I. Zacharaki: University of Patras
Konstantinos Moustakas: University of Patras
Christina Kalogeropoulou: University of Patras
Dimitrios M. Kardamakis: University of Patras
Bing Luo: Henry Ford Health
Laila M. Poisson: Henry Ford Health
Ning Wen: Henry Ford Health
Martin Vallières: Université de Sherbrooke
Mahdi Ait Lhaj Loutfi: Université de Sherbrooke
David Fortin: Université de Sherbrooke
Martin Lepage: Université de Sherbrooke
Fanny Morón: Baylor College of Medicine
Jacob Mandel: Baylor College of Medicine
Gaurav Shukla: University of Pennsylvania
Spencer Liem: Thomas Jefferson University
Gregory S. Alexandre: Thomas Jefferson University
Joseph Lombardo: Thomas Jefferson University
Joshua D. Palmer: The Ohio State University
Adam E. Flanders: Thomas Jefferson University
Adam P. Dicker: Thomas Jefferson University
Godwin Ogbole: University College Hospital Ibadan
Dotun Oyekunle: University College Hospital Ibadan
Olubunmi Odafe-Oyibotha: Clinix Healthcare
Babatunde Osobu: University College Hospital Ibadan
Mustapha Shu’aibu Hikima: Muhammad Abdullahi Wase Teaching Hospital
Mayowa Soneye: University College Hospital Ibadan
Farouk Dako: Perelman School of Medicine at the University of Pennsylvania
Adeleye Dorcas: Obafemi Awolowo University Ile-Ife
Derrick Murcia: University of Colorado Anschutz Medical Campus
Eric Fu: University of Colorado Anschutz Medical Campus
Rourke Haas: University of Colorado Anschutz Medical Campus
John A. Thompson: University of Colorado Anschutz Medical Campus
David Ryan Ormond: University of Colorado Anschutz Medical Campus
Stuart Currie: Leeds Teaching Hospitals Trust
Kavi Fatania: Leeds Teaching Hospitals Trust
Russell Frood: Leeds Teaching Hospitals Trust
Amber L. Simpson: Queen’s University
Jacob J. Peoples: Queen’s University
Ricky Hu: Queen’s University
Danielle Cutler: Queen’s University
Fabio Y. Moraes: Queen’s University
Anh Tran: Queen’s University
Mohammad Hamghalam: Queen’s University
Michael A. Boss: American College of Radiology
James Gimpel: American College of Radiology
Deepak Kattil Veettil: American College of Radiology (ACR)
Kendall Schmidt: American College of Radiology (ACR)
Lisa Cimino: American College of Radiology (ACR)
Cynthia Price: American College of Radiology (ACR)
Brian Bialecki: American College of Radiology (ACR)
Sailaja Marella: American College of Radiology (ACR)
Charles Apgar: American College of Radiology
Andras Jakab: University Children’s Hospital Zurich
Marc-André Weber: University Medical Center Rostock
Errol Colak: University of Toronto
Jens Kleesiek: University Hospital Essen
John B. Freymann: Frederick National Laboratory for Cancer Research
Justin S. Kirby: Frederick National Laboratory for Cancer Research
Lena Maier-Hein: Division of Intelligent Medical Systems
Jake Albrecht: Sage Bionetworks
Peter Mattson: MLCommons
Alexandros Karargyris: MLCommons
Prashant Shah: Intel Corporation
Bjoern Menze: Technical University of Munich
Klaus Maier-Hein: Division of Medical Image Computing
Spyridon Bakas: Indiana University

Nature Communications, 2025, vol. 16, issue 1, 1-20

Abstract: Abstract Computational competitions are the standard for benchmarking medical image analysis algorithms, but they typically use small curated test datasets acquired at a few centers, leaving a gap to the reality of diverse multicentric patient data. To this end, the Federated Tumor Segmentation (FeTS) Challenge represents the paradigm for real-world algorithmic performance evaluation. The FeTS challenge is a competition to benchmark (i) federated learning aggregation algorithms and (ii) state-of-the-art segmentation algorithms, across multiple international sites. Weight aggregation and client selection techniques were compared using a multicentric brain tumor dataset in realistic federated learning simulations, yielding benefits for adaptive weight aggregation, and efficiency gains through client sampling. Quantitative performance evaluation of state-of-the-art segmentation algorithms on data distributed internationally across 32 institutions yielded good generalization on average, albeit the worst-case performance revealed data-specific modes of failure. Similar multi-site setups can help validate the real-world utility of healthcare AI algorithms in the future.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.nature.com/articles/s41467-025-60466-1 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:natcom:v:16:y:2025:i:1:d:10.1038_s41467-025-60466-1

Ordering information: This journal article can be ordered from
https://www.nature.com/ncomms/

DOI: 10.1038/s41467-025-60466-1

Access Statistics for this article

Nature Communications is currently edited by Nathalie Le Bot, Enda Bergin and Fiona Gillespie

More articles in Nature Communications from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().