DRAC 2022: A public benchmark for diabetic retinopathy analysis on ultra-wide optical coherence tomography angiography images

Bo Qian; Hao Chen; Xiangning Wang; Zhouyu Guan; Tingyao Li; Yixiao Jin; Yilan Wu; Yang Wen; Haoxuan Che; Gitaek Kwon; Jaeyoung Kim; Sungjin Choi; Seoyoung Shin; Felix Krause; Markus Unterdechler; Junlin Hou; Rui Feng; Yihao Li; Mostafa El Habib Daho; Dawei Yang; Qiang Wu; Ping Zhang; Xiaokang Yang; Yiyu Cai; Gavin Siew Wei Tan; Carol Y Cheung; Weiping Jia; Huating Li; Yih Chung Tham; Tien Yin Wong; Bin Sheng

doi:10.1016/j.patter.2024.100929

DRAC 2022: A public benchmark for diabetic retinopathy analysis on ultra-wide optical coherence tomography angiography images

Patterns (N Y). 2024 Feb 8;5(3):100929. doi: 10.1016/j.patter.2024.100929. eCollection 2024 Mar 8.

Authors

Bo Qian^{1

2}, Hao Chen^{3

4}, Xiangning Wang^{1

5}, Zhouyu Guan¹, Tingyao Li^{1

2}, Yixiao Jin⁶, Yilan Wu⁶, Yang Wen⁷, Haoxuan Che³, Gitaek Kwon⁸, Jaeyoung Kim⁸, Sungjin Choi⁹, Seoyoung Shin⁹, Felix Krause¹⁰, Markus Unterdechler¹⁰, Junlin Hou¹¹, Rui Feng^{11

12}, Yihao Li^{13

14}, Mostafa El Habib Daho^{13

14}, Dawei Yang¹⁵, Qiang Wu⁵, Ping Zhang^{16

17

18}, Xiaokang Yang², Yiyu Cai¹⁹, Gavin Siew Wei Tan²⁰, Carol Y Cheung¹⁵, Weiping Jia¹, Huating Li¹, Yih Chung Tham^{20

21

22}, Tien Yin Wong^{6

20

23}, Bin Sheng^{1

2}

Affiliations

¹ Shanghai Belt and Road International Joint Laboratory for Intelligent Prevention and Treatment of Metabolic Disorders, Department of Computer Science and Engineering, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Center for Diabetes, Shanghai 200240, China.
² MOE Key Laboratory of AI, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
³ Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong 999077, China.
⁴ Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong 999077, China.
⁵ Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai 200233, China.
⁶ Tsinghua Medicine, Tsinghua University, Beijing 100084, China.
⁷ School of Electronic and Information Engineering, Shenzhen University, Shenzhen 518060, China.
⁸ VUNO, Inc., Seoul 06536, Korea.
⁹ AI/DX Convergence Business Group, KT, Seongnam 13606, Korea.
¹⁰ Johannes Kepler University Linz, Linz 4040, Austria.
¹¹ School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai 200433, China.
¹² Academy for Engineering and Technology, Fudan University, Shanghai 200433, China.
¹³ LaTIM UMR 1101, INSERM, 29609 Brest, France.
¹⁴ University of Western Brittany, 29238 Brest, France.
¹⁵ Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong 999077, China.
¹⁶ Department of Computer Science and Engineering, The Ohio State University, Columbus, OH 43210, USA.
¹⁷ Department of Biomedical Informatics, The Ohio State University, Columbus, OH 43210, USA.
¹⁸ Translational Data Analytics Institute, The Ohio State University, Columbus, OH 43210, USA.
¹⁹ School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore.
²⁰ Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 168751, Singapore.
²¹ Centre for Innovation and Precision Eye Health; and Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore.
²² Ophthalmology and Visual Sciences Academic Clinical Program, Duke-NUS Medical School, Singapore 169857, Singapore.
²³ School of Clinical Medicine, Beijing Tsinghua Changgung Hospital, Beijing 102218, China.

Abstract

We described a challenge named "DRAC - Diabetic Retinopathy Analysis Challenge" in conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022). Within this challenge, we provided the DRAC datset, an ultra-wide optical coherence tomography angiography (UW-OCTA) dataset (1,103 images), addressing three primary clinical tasks: diabetic retinopathy (DR) lesion segmentation, image quality assessment, and DR grading. The scientific community responded positively to the challenge, with 11, 12, and 13 teams submitting different solutions for these three tasks, respectively. This paper presents a concise summary and analysis of the top-performing solutions and results across all challenge tasks. These solutions could provide practical guidance for developing accurate classification and segmentation models for image quality assessment and DR diagnosis using UW-OCTA images, potentially improving the diagnostic capabilities of healthcare professionals. The dataset has been released to support the development of computer-aided diagnostic systems for DR evaluation.