Research Fellow (HCI, Generative AI)

Job Description

NUS Immersive Reality Lab is hiring a Research Fellow with expertise in HCI and Generative AI/ML to design, develop, and evaluate AI-assisted exhibition tools and immersive heritage applications.

You will collaborate with curators, designers, and heritage professionals to translate AI capabilities into usable, impactful systems for exhibition planning and public engagement.

Key Responsibilities

1. HCI Research & Design
   • Design user-centered interaction systems
   • Develop interfaces for multimodal prompting (voice and text)
   • Enable intuitive control of spatial layouts, narrative flow, and iteration
   • Conduct prototyping, user studies, and usability evaluation
2. Generative AI & System Development
   • Develop pipelines for prompt-driven 3D scene and gallery generation
   • Integrate diffusion models for visualisation and content generation
   • Support text-to-scene and voice-to-scene workflows
   • Implement in real-time engines (e.g., Unity/Unreal)
3. Platform & Workflow Development
   • Build AI-assisted exhibition prototyping and visualisation platforms
   • Develop and document end-to-end workflows, including:
     • Prompt engineering
     • Model fine-tuning and iteration
     • Asset management and versioning
     • Spatial generation and annotation

About NUS Immersive Reality Lab

The Immersive Reality Lab at the College of Design and Engineering, National University of Singapore (NUS), conducts cutting-edge research at the intersection of Augmented, Virtual, and Mixed Reality (AR/VR/MR), Artificial Intelligence (AI), and Human-Computer Interaction (HCI). The lab has a strong track record in translational research, collaborating with industry and public sector partners across healthcare, aviation, and cultural heritage.

Qualifications

• PhD (Research Fellow) in HCI, Computer Science, Engineering, AI or related field
• Strong expertise in at least one:
  1. HCI (user studies, UX, interaction design)
  2. Generative AI (diffusion models) and 3D reconstruction and rendering technique (Gaussian Splatting, NERF)
  3. Immersive systems (AR/VR/MR)
• Demonstrated research capability, with publications or strong project/portfolio experience (e.g., CHI, SIGGRAPH, NeurIPS, TVCG, IEEE VR)
• Open to Fixed Term Contract

Apply now