Vision transformer architecture and applications in digital health:a tutorial and survey
作者机构:Electrical and Computer EngineeringUniversity of VictoriaVictoria V8W 2Y2Canada Computer EngineeringPrincess Sumaya University for TechnologyAmman 11941Jordan
出 版 物:《Visual Computing for Industry,Biomedicine,and Art》 (工医艺的可视计算(英文))
年 卷 期:2023年第6卷第1期
页 面:171-198页
核心收录:
学科分类:08[工学] 0812[工学-计算机科学与技术(可授工学、理学学位)]
主 题:Vision transformer Digital health Telehealth Artificial intelligence Medical imaging
摘 要:The vision transformer (ViT) is a state-of-the-art architecture for image recognition tasks that plays an important role in digital health applications. Medical images account for 90% of the data in digital medicine applications. This article discusses the core foundations of the ViT architecture and its digital health applications. These applications include image segmentation, classification, detection, prediction, reconstruction, synthesis, and telehealth such as report generation and security. This article also presents a roadmap for implementing the ViT in digital health systems and discusses its limitations and challenges.