SHARE

Germany, Innovation, 2018

Therapy Lens hologram app for dementia patients available for download

16th July 2019

Demo for Microsoft HoloLens shows how augmented reality can help patients living at home

The demo version of an app that was produced by the EIT Health Therapy Lens project and uses augmented reality to assist patients with dementia is now available for download on the Microsoft HoloLens App Store.

Therapy Lens, an EIT Health Innovation Project in 2017, produced an augmented reality application for the Microsoft HoloLens head-mounted display. The patient wears the HoloLens over their eyes and can have an unobtrusive view of their real world. But when needed, the app also places holograms in the patient’s field of view, transposing augmented reality onto the patient’s real environment.

A sample of the software can be downloaded here, and can also be found in the Microsoft HoloLens app store.

Dementia patients typically struggle with activities of daily living, such as cooking, cleaning and taking medication, at home. Existing support solutions are limited, and mainly rely on ambulant caregivers with a majority of the burden placed on the family. To help ease the burden of these informal caregivers, and to provide dementia patients with an additional form of support at home, the Therapy Lens project explored the ways in which AR technology could be used as an innovative solution to these problems.

Five Partners involved

The Partners in the EIT Health Innovation Project are: Technical University Munich, RWTH Aachen, MADoPA, Imec and CapDigital.

The Partners worked closely with dementia patients, informal caregivers and clinicians, to co-design an AR application that would address the specific needs of dementia patients. The involvement of the key stakeholders in the design and development process helped to ensure that the AR app stayed on target for addressing the unmet needs of dementia patients.

They are currently exploring opportunities for expanding the work of Therapy Lens with the aim of further developing this approach. The project has also developed a separate stream of research on the use of AR to support the elderly and people suffering from dementia. These ongoing research projects continue to build on the work of Therapy Lens through Master and PhD students at RWTH Aachen, Imec/VUB and TUM.

Features of the app

The Therapy Lens app provides patients with seven support features. The app has three orientation games, designed to familiarize patients with the AR device and to explore how they can interact with the Holograms. Two AR games focusing on short-term memory and tea making are designed to stimulate patients in a fun environment while also providing the potential for assessing these basic skills at home. A tagging feature allows dementia patients to place an AR visual tag in important locations around their home. This provides patients with clickable AR tags that reveal context specific visual reminders that can support them in their daily routine at home. The app also supports dementia patients during the performance of real daily activities at home. Currently, the app supports patients in preparing a cup of tea using AR animated cues designed to guide patients through each step of this daily activity.

Contact: Dr. Alan Armstrong, Technical University Munich, alan.armstrong@tum.de

Website: www.therapylens.com

AI tool for COVID-19 produces significant results

AI tool for COVID-19 produces significant results

EIT Health project aids personalised medicine

Find out more

EIT Health helps Tubulis secure €10.7M in funding

EIT Health helps Tubulis secure €10.7M in funding

Investor Network aids firm doing antibody work

Find out more

EIT Health-backed start-ups garner big investments

EIT Health-backed start-ups garner big investments

A million each for iLoF and Restorative Neurotechnologies

Find out more