Multimodal Applications for Cognitive Differences

Dr John McGowan, Dr I McGregor

Applications accepted all year round
Self-Funded PhD Students Only

About the Project

Technological interventions have been created to attempt to counter symptoms of stress, through improving cognition and functioning of target users. Mobile devices, virtual reality (VR) and augmented reality (AR) applications have demonstrated the ability to support and improve clinical practices through sensory based technologies. The aim of the proposed research is to develop an assistive application for high functioning autistic (HFA) adults, by managing levels of stress in a variety of daily scenarios. This will lead to a further participatory design process, where the data will be used as a basis to develop and facilitate the initial designs of an application to test audio-visual entrainment, with the aim of helping to manage stress in autistic people in their chosen environments. Previous studies 1,2 have demonstrated physiological as well as psychological benefits of interactive multimodal systems. Further development of accessible applications for people with cognitive differences could encourage experiences with friends and family, increasing their effective therapeutic capabilities, whilst helping to manage stress. This PhD project will employ a User Experience, Interaction Design and Grounded approach to investigate, develop, and evaluate interactive multi-modal applications, including vocalisation and gestural parameters. This work aims to build on the expertise of staff at ENU School of Computing, Engineering, and the Built Environment. Qualitative and quantitative approaches to capturing data will be employed. This may include participatory design with the target population, single case study design, semi-structured interviews, surveys, and questionnaires. Observational approaches using appropriate design methods may also be employed to gather participant data. Candidate knowledge and application of ethical processes will be required throughout the PhD. Analysis of requirements analysis data will lead to the development of a series of multi-modal prototype applications. Audio, visual, and haptic development may include exploration of different metrics. For example, heartbeat, breathing, head movement, eye movement, use of recorded imagery, colour choice, and animation. Platform development and testing aims to employ mobile and wearable devices. Potential software could include the use of game engine technologies, scripting languages, and audio middleware. Evaluation methods will include using a Ground Theory approach, where appropriate software (for example, NVivo) will be used to code and analyse qualitative data. Statistical methods and related software (for example, SPSS) may also be employed to analyse quantitative data to be presented in appropriate formats for publication.

Prospective applicants are encouraged to contact the Supervisor before submitting their applications. Applications should make it clear the project you are applying for and the name of the supervisors.

Academic qualifications

Have, or expect to achieve by the time of start of the studentship a first-class honours degree, or a distinction at master level, ideally in Computer Science or equivalent with a good fundamental knowledge of Interaction Design.

English language requirement

IELTS score must be at least 6.5 (with not less than 6.0 in each of the four components). Other, equivalent qualifications will be accepted. Full details of the University’s policy are available online.

Essential attributes:

• Experience of fundamental computing.
• Competent in Multi-Modal Interaction Design and User Experience.
• Knowledge of working with groups with additional support needs.
• Good written and oral communication skills.
• Strong motivation, with evidence of independent research skills relevant to the project.
• Good time management.
• Only a first-class honours degree, or a distinction at master level in a subject relevant to the PhD project will be considered, or equivalent achievements.

Desirable attributes:

• Knowledge of Game Engine technology.
• Mixed-Reality.
• Max or Pure Data.
• Prior research experience.
• Practical experience in research or industry will be considered an advantage.

When applying click here

APPLICATION CHECKLIST

• Completed application form
• CV
• 2 academic references, using the Postgraduate Educational Reference Form (download)
• Research project outline of 2 pages (list of references excluded). The outline may provide details about:

1. Background and motivation of the project. The motivation, explaining the importance of the project, should be supported also by relevant literature. You can also discuss the applications you expect for the project results.
2. Research questions or objectives.
3. Methodology: types of data to be used, approach to data collection, and data analysis methods.
4. List of references.

The outline must be created solely by the applicant. Supervisors can only offer general discussions about the project idea without providing any additional support.

• Statement no longer than 1 page describing your motivations and fit with the project.
• Evidence of proficiency in English (if appropriate)

To be considered, the application must use

• the advertised title as project title

For informal enquiries about this PhD project, please contact Dr John McGowan email J.McGowan@napier.ac.uk

Funding Notes