Medical Image Analysis with Large Language Model and Deep Learning

About the Project

This PhD project will investigate how large language models can enhance deep learning for medical image analysis. The research will develop methods that combine imaging data with clinical text, radiology reports, and diagnostic guidelines to improve disease detection, segmentation, and prognosis. A central aim is to build trustworthy multimodal models that provide accurate predictions together with interpretable clinical explanations. The project will focus on robustness, bias awareness, and privacy-preserving learning in sensitive healthcare settings. Applications may include cancer imaging, surgical planning, and longitudinal patient monitoring. The outcome will be scalable AI tools that support clinicians in making safer, faster, and more informed decisions.

How to Apply

Please send an email with your resume, transcripts, thesis, and any supporting documents to Prof. Hubert Shum hubert.shum@durham.ac.uk for an initial assessment.

Supervision

You will be supervised by Prof. Hubert Shum (http://hubertshum.com/), who is a Professor of Visual Computing and the Director of Research of the Department of Computer Science at Durham University, specialising in modelling spatio-temporal information with responsible AI. He has authored over 200 research publications in the fields of Computer Vision, Computer Graphics and AI in Healthcare, underpinned by Responsible AI designs and algorithms. His work has been featured in leading venues such as CVPR, ICCV, ECCV, SIGGRAPH, MICCAI, IEEE TVCG and IEEE TIP. He is a Co-Founder and the Co-Director (Research) of Durham University Space Research Centre. He has led multiple research projects funded by the UK government, the charity and industry, providing him with the experience of supervising over 30 PhDs and many post-doctoral researchers. He hosts international conferences such as BMVC, ACM SIGGRAPH/Eurographics SCA and ACM SIGGRAPH MIG.

During the PhD study, you will receive comprehensive training and research coaching through regular one-to-one meetings with Prof. Shum to develop your strengths and consolidate your research knowledge. Prof. Shum’s research team has a supportive culture and provides assistance and collaboration opportunities. His past PhDs have had great success in developing their professional research profiles, as well as securing promising careers after graduation.

Our Resources

Durham University hosts the UK regional supercomputer, Bede, with 128 NVIDIA V100 GPUs. On top of that, our Department hosts an NVIDIA CUDA Centre that caters to the increasing GPU demands for research purposes.

Our laboratories have an array of computer science equipment and sensors, including sensor-mounted vehicles, LiDAR, RADAR, EEG, drones, robots, cameras and more.

Durham University

Durham University is a world top-100 university and is ranked top-5 in the UK. As a member university of the elite Russell Group, Durham University focuses on research excellence delivered by world-leading academics. It is the third oldest university in England, following Oxford and Cambridge, with the campus's Cathedral and Castle being a UNESCO World Heritage Site. It is located in Durham at North East England – one of the safest cities in the UK with an affordable living cost.

Entry Requirements

• A relevant undergraduate or master's degree with good scores.
• Knowledge of modern programming languages.
• Meet Durham's English requirements (https://www.dur.ac.uk/study/international/entry-requirements/english-language-requirements/).