Guiding & Evaluating Conversational AI in LLMs using Formal Dialogue Models

About the Project

Formal dialogue models have been developed over the last several decades to shed light on the conversational practises of people in a wide range of communicative contexts. More recently conversational AI has made rapid progress in generating plausible content for human-machine dialogue. Generally, formal approaches to dialogue can be less flexible than ML based-approaches, however, ML-based approaches can easily go off piste and diverge from human expectations. The goal of this project is to bring together the advantages of each approach, by using formal models of various types of dialogue to plan, guide, manage, and self-evaluate utterances emitted from the conversational AI.

This project will involve a detailed study of both existing formal dialogue systems as well as state of the art conversational AI. The novel contribution will be a theoretical and applied model that brings together useful elements of formal and ML based approaches to conversational AI.

Prospective applicants are encouraged to contact the Supervisor before submitting their applications. Applications should make it clear the project you are applying for and the name of the supervisor(s).

Academic qualifications

A first degree (at least a 2.2) ideally in Computer Science with a good fundamental knowledge of Machine Learning, Argumentation Theory and Computational Linguistics.

English language requirement

IELTS score must be at least 6.5 (with not less than 6.0 in each of the four components). Other, equivalent qualifications will be accepted.

Essential attributes:

• Experience of fundamental Machine Learning techniques
• Competence in ML toolkits, e.g. Scikit-learn, Tensorflow, PyTorch, etc.
• Knowledge of Argumentation Theory
• Good written and oral communication skills
• Strong motivation, with evidence of independent research skills relevant to the project
• Good time management

APPLICATION CHECKLIST

• Completed application form
• CV
• 2 academic references, using the Postgraduate Educational Reference Form (download)
• Research project outline of 2 pages (list of references excluded). The outline may provide details about:
  1. Background and motivation of the project. The motivation, explaining the importance of the project, should be supported also by relevant literature. You can also discuss the applications you expect for the project results.
  2. Research questions or objectives.
  3. Methodology: types of data to be used, approach to data collection, and data analysis methods.
  4. List of references.
• Statement no longer than 1 page describing your motivations and fit with the project.
• Evidence of proficiency in English (if appropriate)

To be considered, the application must use

• the advertised title as project title

For informal enquiries about this PhD project, please contact Dr Simon Wells - s.wells@napier.ac.uk