GenAI for Human Emotion Synthesis

About the Project

Generative AI (GenAI) offers powerful new tools for synthesizing facial expressions and creating photorealistic 3D human avatars. These synthetic humans are increasingly used in virtual production, social media, marketing, and misinformation campaigns. However, current GenAI methods face significant challenges in convincingly rendering complex human emotions. In 2D image and video synthesis (e.g., using platforms like Runway), rendering subtle emotions like contempt and accurate micro-expressions remains difficult. In 3D model manipulation, capturing the true intensity and realistic dynamics of potent emotions, such as profound grief or intense surprise, is a major hurdle. This highlights the inherent difficulties in replicating the full psycho-physiological manifestation of affect.

Recent research advancements, such as Wan [2] and MoCha [3], present opportunities to enhance the generation of expressive humans driven by multimodal inputs like natural language prompts, audio, and reference images. The novelty of this project lies in bridging these state-of-the-art GenAI capabilities with psychological understanding to evaluate and improve how affective states are generated. The project will involve developing and evaluating methods—from Text-to-Image (T2I) and Image-to-Video (I2V) to Audio-Driven models—focusing on qualitative attributes related to facial expressivity, gestural realism, and narrative believability. The aim is to develop a robust framework that synthesizes controllable, high-fidelity human avatars while fostering a reflective approach to the inherent complexities of emotions in synthetic media.

University of Reading: The University of Reading, located west of London, England. 98% of research at the University is of international standing (REF 2021, combining the University’s world leading, internationally excellent and internationally recognised submissions). The University’s main Whiteknights Campus is set in 130 hectares of beautiful, award-winning parkland, less than a 30-minute train ride to London Paddington and is approximately 30 miles from London Heathrow airport.

During your PhD at the University of Reading, you will expand your research knowledge and skills, receiving supervision and training in a number of different forms. We also provide dedicated training in important transferable skills that will support your career aspirations. If you need to develop your academic English skills before you start your studies, then the University has an excellent International Study and Language Institute which can help with this.

Eligibility:

• Applicants should have a good bachelor’s degree (minimum of a UK Upper Second (2:1) or equivalent)/master’s degree in Computer Science or a strongly-related discipline.
• International applicants will also need to meet the University’s English Language requirements. We offer pre-sessional English courses that can help with meeting these requirements.

The University of Reading is committed to a policy of equal opportunities and non-discriminatory treatment for all members of its community.

How to apply:

Submit an application for a PhD in Computer Science via our online application system.

Further information:

PhD study in the Department of Computer Science

Enquiries:

Dr. Alan Guedes, email: a.guedes@reading.ac.uk

Funding Notes

We welcome applications from self-funded students worldwide for this project.

If you are applying to an international funding scheme, we encourage you to get in contact as we may be able to support you in your application.