Lenovo Unveils AI Avatar for Dementia Care

Photorealistic 3D avatar Liv aims to assist individuals with dementia through real-time conversations.

Lenovo, in collaboration with Innovations in Dementia, has introduced a proof-of-concept project called Alzheimer's Intelligence, featuring an AI-enabled 3D avatar named Liv. 

This photorealistic avatar is designed to engage in real-time conversations with dementia and Alzheimer’s patients, providing tailored advice and support based on lived experiences.

The AI technology behind Liv is unique in its ability to offer unscripted, natural dialogues with users, providing a sense of personalized care. 

The responses are drawn from an extensive database built with insights from hundreds of people living with dementia. Lenovo’s approach aggregates experiences into a conversational tool that can assist patients in managing their condition.

Liv, developed using composite images from ten individuals with Alzheimer’s and dementia, can generate thousands of facial expressions and angles. The AI synthesizes data from the Innovations in Dementia's Dementia Diaries project, which involves interviews and direct inputs from individuals living with the condition. The goal is to create a relatable avatar that provides relevant support to users.

When users interact with Liv, a large language model (LLM) retrieves responses from the dataset. The answers are then expressed through a vocal synthesizer miming a voice designed for the project. 

Lenovo said, “Sentiment analysis is used to detect the underlying emotions behind the response, which is reflected in Liv’s facial expressions as she speaks.” 

The 4K visual AI allows these interactions to happen in real time, giving the illusion of natural speech.

Future Availability

Although still undergoing trials, Lenovo aims to make Liv publicly available. The company hopes this technology will serve as an additional resource for families and healthcare providers dealing with the challenges of dementia care.

Doug Fisher, Chief Security and AI Officer at Lenovo, stated, “We recognize the importance of giving everyone a voice in innovation. With huge advancements in AI and smarter technologies, now is the time to explore and pilot creative new ways to use technology like AI thoughtfully and responsibly for the greater good. Ultimately, it’s about re-imagining a future where technology is for – and from – all, giving everyone a voice in what they want from the most transformative technology of our generation.”

The use of avatars in healthcare is not entirely new but continues to expand. Liv's development highlights AI's increasing role in caring for dementia and Alzheimer’s patients. Its potential extends beyond simple conversation, with real-world implications for technology integration into long-term care settings.

The Larger Healthcare Trend

AI and avatars in healthcare are attracting significant interest, with several companies exploring their use for various applications, including patient engagement and caregiver training. 

A study from last year found that a nurse-like avatar integrated into a telemedicine application was well received by heart failure patients. While further research is needed, these results suggest avatars could improve accessibility for patients with limited health literacy.

Additionally, discussions surrounding the use of hologram technology in healthcare have pointed toward its potential in caregiver training, virtual interactions, and patient engagement. This wider trend of AI-driven healthcare tools signals a shift in care delivery.