Artwork for podcast Dementia Researcher Vodcast
Reimagining Dementia with XR and Digital Therapeutics
Episode 33625th April 2026 • Dementia Researcher Vodcast • Dementia Researcher
00:00:00 00:39:18

Share Episode

Shownotes

Extended reality is starting to find a real place in dementia research and care. In this episode, host Dr Byron Creese is joined by David de Jong-Bambagioni, Dr Emilie Brotherhood, and Alice Rowe to explore how virtual, augmented, and mixed reality tools are being used in practice.

Together, they discuss how XR is helping to standardise cognitive assessments, simulate clinical environments, and support earlier and more accurate diagnosis. The conversation also looks at how immersive tools are being used to build empathy, giving clinicians and carers a better sense of what it might feel like to live with dementia.

The panel share examples from their own work, including virtual simulations to distinguish delirium from dementia, and digital environments designed to capture subtle behavioural changes in conditions like frontotemporal dementia. These approaches are opening up new ways to study cognition, behaviour, and patient experience in more realistic and scalable settings.

This episode offers a practical look at where XR is already making a difference, and where it might go next.

In this episode:

  • How XR is being used in dementia research and care
  • Using immersive environments for assessment and empathy
  • Why co design and lived experience matter
  • Virtual, augmented, and mixed reality explained simply
  • Ethical risks and safeguards in vulnerable groups
  • How researchers are moving into digital health
  • Getting started with XR and finding collaborators
  • Inclusion, global perspectives, and reducing bias

A transcript of this show, links and show notes and profile on all our guests are available on our website at https://www.dementiaresearcher.nihr.ac.uk.

If you prefer to watch rather than listen, you will find a video version of this podcast on YouTube, on our website, and in selected podcast platforms.

Leave us a tip:

https://dementia-researcher.captivate.fm/support

Follow us on social media:

Download and Register with our Community App:

https://www.onelink.to/dementiaresearcher

We gratefully acknowledge the support of our funders: Alzheimer’s Association, Race Against Dementia, Alzheimer’s Research UK, Alzheimer’s Society, and the National Institute for Health and Care Research.

The views and opinions expressed by guests in this podcast are their own and do not necessarily reflect those of the producers, funders, or sponsors.

Subscribe to our sister show 'Dementia Researcher The Blogs':

https://podfollow.com/dementia-researcher-blogs

Transcripts

Speaker:

The Dementia Researcher podcast,

Speaker:

talking careers, research,

conference highlights,

Speaker:

and so much more.

Speaker:

- Hello and welcome to the

Dementia Researcher Podcast.

Speaker:

Today we are exploring

XR, spatial computing

Speaker:

and digital approaches

to understanding life

Speaker:

beyond memory in dementia.

Speaker:

My name is Dr. Byron Creese,

Speaker:

I'm a senior lecturer in psychology

Speaker:

at Brunell University of London,

Speaker:

and I'm delighted to be

hosting today's show.

Speaker:

Extended reality, spatial computing

Speaker:

and sensor-based systems

are moving from gaming,

Speaker:

creative practise, and

industry into health

Speaker:

and care settings.

Speaker:

These tools allow researchers

Speaker:

to study how people interact

with environments, objects,

Speaker:

and routines in a more

natural and responsive way

Speaker:

than traditional clinic rooms.

Speaker:

With us today are three people

working at the forefront

Speaker:

of this area.

Speaker:

We've got David De Jong-Bambagioni,

Speaker:

who works with healthcare organisations

Speaker:

to tackle efficiency

challenges and bring insights

Speaker:

from gaming, spatial computing

Speaker:

and XR into clinical practise.

Speaker:

Dr. Emilie Brotherhood,

Speaker:

who explores psychophysiological

responses captured

Speaker:

through sensor platforms

Speaker:

and investigates health spatial computing

Speaker:

can support digital markers,

and assessment for people

Speaker:

with non-memory led dementias.

Speaker:

And Alice Wroe, XR lead

at the Atlantic Institute

Speaker:

where she supports a global fellowship,

Speaker:

and explores how extended realities

Speaker:

can advance social equity

Speaker:

and what it means to be

human in digital spaces.

Speaker:

Hello everyone.

Speaker:

- Hi.

- It's great

Speaker:

to have you with us.

Speaker:

To start us off, can I ask each of you

Speaker:

to introduce yourselves?

Speaker:

Let's start with Emilie.

Speaker:

- Hi, thank you. So I'm Emilie.

Speaker:

I'm a senior research

fellow in Neuropsychology,

Speaker:

and I'm based at the

Institute of Neurology,

Speaker:

Queen Square University College of London.

Speaker:

- Thank you. And Alice?

Speaker:

- Hello. I'm delighted to be here.

Speaker:

Yeah, my name's Alice Wroe,

Speaker:

and I'm the extended realities lead

Speaker:

at the Atlantic Institute.

Speaker:

And so we think about

how emerging technologies

Speaker:

can enable our community of fellows,

Speaker:

and our partners to be on the front foot

Speaker:

with emerging technologies.

Speaker:

So it's not something that happens to us,

Speaker:

but it's something that

we can kind of engage with

Speaker:

to think about how we can build fairer,

Speaker:

more inclusive societies using

this sort of emerging tech.

Speaker:

David is a fellow actually.

Speaker:

- Ah, okay.

- Nicely to David. Yeah.

Speaker:

- Brilliant. So you're teeing up David.

Speaker:

- Yeah, so David De Jong-Bambagioni

from the Netherlands

Speaker:

and I'm a social entrepreneur

in the Netherlands,

Speaker:

and we work with XR to improve

process in hospital care,

Speaker:

and dementia care, psychiatric care.

Speaker:

So very broad, but we use the technology,

Speaker:

how can we improve healthcare yesterday.

Speaker:

- Brilliant. Thank you all.

Speaker:

So I've actually work in dementia care,

Speaker:

but much more on, I guess more

Speaker:

typical psychology background.

Speaker:

So this is really exciting for me.

Speaker:

Let's get going.

Speaker:

(bright music)

Speaker:

So let's begin with your individual work.

Speaker:

David, could you tell us

about the work you're doing

Speaker:

with extended reality

and spatial computing,

Speaker:

and what you're trying to

understand or change through it?

Speaker:

- Yeah, so my company,

Speaker:

they're health and facing

in the Netherlands,

Speaker:

we work on (indistinct),

educational technology

Speaker:

and MedTech and medical technology.

Speaker:

And what we do with the (indistinct) part

Speaker:

is change the way we

train nurses, caregivers,

Speaker:

give them information in a different way.

Speaker:

We use 360 video for that.

Speaker:

And what we do is like empathy

VR, so you can experience

Speaker:

how it is to go through the

four phases of dementia,

Speaker:

or how it is to have a psychosis,

Speaker:

just to step in somebody else's shoes

Speaker:

to empathise with the other person.

Speaker:

We also do virtual excursion.

Speaker:

So if you are living with dementia,

Speaker:

or laying in the hospital and

you can travel around anymore,

Speaker:

we have beautiful beaches,

forests, even train stations.

Speaker:

Some people like to be on a train station.

Speaker:

And also we do social skills training,

Speaker:

so improve the way you

interact with medical staff,

Speaker:

patients, that kind of stuff.

Speaker:

And also like movements, so

like body movement in 360

Speaker:

and with a med tech, what we

do is we optimise processes

Speaker:

around medical devices.

Speaker:

Think about track and tracing

like your Apple Air tag

Speaker:

that you know, where your bag is,

Speaker:

where your bike, but then

in a medical setting,

Speaker:

in a hospital, we do warehouse management.

Speaker:

So where are all these devices?

Speaker:

It's a big challenge, like

where are the medical devices

Speaker:

and dashboarding with AI agents.

Speaker:

So that's like smart

assistance that can help you

Speaker:

to find the right medical device.

Speaker:

So you go to a patient,

what does the patient need?

Speaker:

And in that way you find

the right medical device,

Speaker:

and the information part

for the carrier like is done

Speaker:

with augmented reality.

Speaker:

So you can see the medical

device in the space.

Speaker:

So if you want to troubleshoot,

Speaker:

then you can see the medical

device in front of you

Speaker:

on your desk and then you can say,

Speaker:

oh, how does this button work?

Speaker:

Or that kind of thing.

Speaker:

So that's what we do with XR.

Speaker:

- Great, thank you.

Speaker:

And Emilie, your research

spans spatial computing,

Speaker:

digital signals and psychophysiology.

Speaker:

So could you briefly describe

Speaker:

what projects you've

worked with in this area?

Speaker:

What questions are you hoping to answer?

Speaker:

- Yeah, sure.

Speaker:

So my PhD was looking

Speaker:

at the sort of in the digital signal space

Speaker:

in a more dementia care context.

Speaker:

So Byron kind of aligning with your work.

Speaker:

And that was really about

using kind of infrared cameras

Speaker:

to pick up signals, like

changes in pupil responses

Speaker:

as people listen to familiar

and unfamiliar music,

Speaker:

and those populations and people

Speaker:

with different types

of Alzheimer's disease.

Speaker:

And that was really to

answer research questions

Speaker:

like how can we augment

Speaker:

and improve personalised

(indistinct) interventions

Speaker:

in dementia care?

Speaker:

But while that was going on,

Speaker:

I was also collecting pilot data

Speaker:

that was looking at innovative ways

Speaker:

that we could use extended reality

Speaker:

in the field of dementia assessments.

Speaker:

So moving sort of from a care

Speaker:

to actually diagnostic capacity.

Speaker:

And this would particularly address things

Speaker:

like how we detect changes

Speaker:

in competitive domains aside

from the memory challenges

Speaker:

that we tend to see in more typical forms

Speaker:

of Alzheimer's disease are

moving towards detecting subtle

Speaker:

behaviour and social personality changes

Speaker:

in the, for example, the

ability to exhibit empathy

Speaker:

that are often observed in people

Speaker:

with frontotemporal dementia.

Speaker:

- Great, thank you.

Speaker:

So you're working in,

Speaker:

I guess the less common dementias then.

Speaker:

So taking in FTD as well

as Alzheimer's. Great.

Speaker:

Alice, you approach XR from a creative

Speaker:

and equity centred perspective,

Speaker:

could you share what you

are working on at the moment

Speaker:

and how you think extended realities

Speaker:

will help people and society?

Speaker:

- Yeah, and it's so brilliant

Speaker:

to hear David and Emilie's work

Speaker:

because with extended realities,

Speaker:

the vast majority of this

tech is used for military,

Speaker:

and for gaming and it's

just like mega dominated.

Speaker:

It's then when you hear

about work like this,

Speaker:

it's just twinkling for this

new kind of thoughtful future

Speaker:

with this technology, that's so exciting.

Speaker:

Yeah, so I work, as I've mentioned

at the Atlantic Institute

Speaker:

and we believe that this type

of technology is gonna change

Speaker:

the way that we all navigate our futures

Speaker:

in terms of our work lives,

our professional lives,

Speaker:

and we wanna make sure that

our fellows, our partners,

Speaker:

our community at large are

people that feel confident

Speaker:

and safe to be critical

to champion this tech,

Speaker:

to kind of creating it,

collaborate through it.

Speaker:

So we put a real strategic

focus on this particular area,

Speaker:

and so we've been working

in three main areas.

Speaker:

So we're thinking about co-presence,

Speaker:

how can our global and

growing community be together

Speaker:

whilst we're physically apart?

Speaker:

We've been thinking about

how can this technology lift

Speaker:

the equity work of the fellows?

Speaker:

So projects like Emilie's and David's,

Speaker:

it just kind of sings to our hymn sheet.

Speaker:

It's about taking people that

may not ordinarily have access

Speaker:

to this sort of tech,

bring their expertise

Speaker:

and just lift it into their work

Speaker:

and raise their equity work.

Speaker:

And then the third one is

around thought leadership.

Speaker:

So this tech space is so often

dominated by the same voices

Speaker:

with the same kind of backgrounds.

Speaker:

And we actually think that

through interdisciplinary

Speaker:

engagement, that is how

we're gonna make progress,

Speaker:

social beautiful progress in this space.

Speaker:

So it's bringing fellows

together, our partners together,

Speaker:

our communities together to

gather around this technology

Speaker:

and dream with it fundamentally.

Speaker:

And so we are raising the

tech literacy as well.

Speaker:

And so finally, I'll

just give you one example

Speaker:

of an actual piece that we're working on.

Speaker:

So one of our fellows at the

moment is creating a piece

Speaker:

with our lab in Oxford, in Rhodes house.

Speaker:

We've got a brilliant XR

specialist, Richard Smith,

Speaker:

and they're making a 360

film about climate anxiety

Speaker:

called "Living in Water" in collaboration

Speaker:

with the equity initiative

in Southeast Asia.

Speaker:

So we're thinking about

climate anxiety globally,

Speaker:

and how it lives differently

depending on where you are.

Speaker:

And so we're making work like that,

Speaker:

but for me it's the tech

literacy and the raising

Speaker:

of who is in the room

talking about this stuff

Speaker:

that really makes me sing.

Speaker:

- That's great. Thank you.

Speaker:

Such enthusiasm from all three of you.

Speaker:

Can I ask about your backgrounds.

Speaker:

Are you a health scientist,

Speaker:

psychologist who've moved into tech?

Speaker:

Or are you tech people who've moved

Speaker:

into applying your skills to healthcare?

Speaker:

- I've lived in academia for a decade

Speaker:

as a neuropsychology researcher.

Speaker:

That's very much where I've stayed.

Speaker:

- Yeah.

Speaker:

- By origin, I'm a social worker,

Speaker:

so I rolled into this technology.

Speaker:

- Oh great.

- Oh, I love that.

Speaker:

Rolled into technology.

Speaker:

There's an artist called Stephanie Dinkins

Speaker:

who works a lot in tech,

Speaker:

and she calls herself an

accidental technologist,

Speaker:

which is what I relate to as well.

Speaker:

So my background was in creative direction

Speaker:

and then I was kind of picked

out of it by an amazing CEO

Speaker:

of a spatial computing

company, Magic Leap.

Speaker:

And he just knew that if you

get people whose background

Speaker:

isn't tech, actually, that's

where you can kind of dream

Speaker:

the biggest things when

you bring them together

Speaker:

with tech people.

Speaker:

And we all kind of merge and become one.

Speaker:

So I ascribe to the

accidental technologists.

Speaker:

- Let's move on then to, I

guess talk about that tech,

Speaker:

XR, an immersive environment.

Speaker:

So extended reality would include things

Speaker:

like virtual reality, augmented

reality, and mixed reality.

Speaker:

And these tools can produce naturalistic,

Speaker:

and responsive environments

for assessment and support.

Speaker:

I mean, that's as far as

my understanding would go.

Speaker:

So what I need is for

you to help me out a bit.

Speaker:

So perhaps Alice, can I start with you?

Speaker:

For those unfamiliar,

can I ask you to tell us

Speaker:

the difference between extended reality,

Speaker:

virtual reality, augmented

and mixed reality?

Speaker:

- It would be my pleasure, Byron.

Speaker:

So fundamentally, XR is this

kind of big umbrella term

Speaker:

that encompasses a load of

different immersive technologies.

Speaker:

So please don't feel

intimidated by that term.

Speaker:

If it seems interchangeable,

Speaker:

or there's lots of different things,

Speaker:

it's because there are loads of words

Speaker:

that kind of mean similar things.

Speaker:

So VR as you said, virtual reality

Speaker:

as if you put a headset on,

Speaker:

all you will see is the

digital world in front of you.

Speaker:

So if you're wearing a

virtual reality headset,

Speaker:

you might actually just

like walk into a chair,

Speaker:

or like stub your toe

'cause all you can see

Speaker:

is that virtual world.

Speaker:

And then you've got augmented reality,

Speaker:

and mixed reality where the digital

Speaker:

and the physical worlds

come together as one.

Speaker:

So actually as you put

those sort of headsets on

Speaker:

or you kind of bring

them up using your phone,

Speaker:

you'll see your world around you,

Speaker:

but you'll have digital content

that is kind of engaging

Speaker:

with quite poetically that the worlds

Speaker:

that you have around you.

Speaker:

So I think those are the

two big ones to understand.

Speaker:

Some people call it spatial computing

Speaker:

or the metaverse, the embodied internet,

Speaker:

all these different terms.

Speaker:

But fundamentally it's everything

Speaker:

that like bursts out of your screen

Speaker:

and into your environment

in different ways.

Speaker:

- Great. And David then,

Speaker:

how do you see XR helping

clinicians understand

Speaker:

the day-to-day challenges and other things

Speaker:

that might be missed in clinics,

specifically as it pertains

Speaker:

to dementia would be really interesting?

Speaker:

- Because of what we do is like...

Speaker:

So what we do is community driven VR.

Speaker:

So together with like clinicians,

Speaker:

we try to figure out what

are the challenges clinicians

Speaker:

are facing in the day-to-day

clinic that they could miss.

Speaker:

And then you just like, you

kind of create like a sandbox,

Speaker:

like a safe space where

people can experiment.

Speaker:

So like for example, we have one training,

Speaker:

and it's regarding seeing the

difference between a delirium

Speaker:

or like symptoms of dementia.

Speaker:

So we try to like simulate environments

Speaker:

where like you can make

decisions and choices

Speaker:

that maybe you would not

do in a clinical setting

Speaker:

to like empathise, look at the...

Speaker:

Like how do you communicate,

what is the workflow,

Speaker:

what are the processes, how

can we optimise those to train

Speaker:

in a safe environment?

Speaker:

And what I said before,

I think the empathy part,

Speaker:

like the empathy trainings we create

Speaker:

I think are very powerful,

even though you're a clinician,

Speaker:

even though you study the

subject or a certain disease,

Speaker:

like the moment a patient's

sitting in front of you ,

Speaker:

how do you know how their world is?

Speaker:

How do they view you sitting

on the other side of the table,

Speaker:

you know, with the white

coat effect, of course.

Speaker:

So stepping in the other person's shoes

Speaker:

and experience from the

other way is really helpful.

Speaker:

So, and that's the kind of

sense we try to optimise

Speaker:

the day-to-day clinic to, you know,

Speaker:

step in somebody else's shoes and

Speaker:

just get out of your own bubble.

Speaker:

- Yeah. Does it extend as well

Speaker:

to, like the room I'm sitting in right now

Speaker:

is work you can see

'cause it's really bland.

Speaker:

- I thought that was just your

taste, Byron, minimal man.

Speaker:

- Your virtual backgrounds,

Speaker:

we thought you're in a metaverse.

Speaker:

- Yeah. But so would it

extend to like doctors,

Speaker:

or other healthcare

professionals consulting

Speaker:

in a very sterile environment,

Speaker:

does it extend to helping them understand

Speaker:

how someone operates in

the real world at home?

Speaker:

So almost simulating if you were to go,

Speaker:

and watch someone in their own house

Speaker:

and draw insights that way.

Speaker:

- Yeah, yeah, exactly. Yeah.

- Oh, brilliant.

Speaker:

And Emilie, how does spatial

computing use these realities

Speaker:

then and what do they offer

when measuring subtle changes

Speaker:

in how people interact

with their surroundings?

Speaker:

- So it's really interesting, David

Speaker:

to, you know, hear about your

work using VR as a, or XR

Speaker:

as a vehicle for empathy because

this is exactly the reason

Speaker:

for a very different motivation.

Speaker:

But it's exactly the reason

I want to incorporate it

Speaker:

in my research in the

pilot data we collected.

Speaker:

And that's because in

the diagnostic criteria

Speaker:

for a particular type

Speaker:

of this sort of frontotemporal

dementia that I'm interested

Speaker:

in, one of the diagnostic criteria

Speaker:

is a mark change in empathy.

Speaker:

And for a clinician and for a caregiver,

Speaker:

that can be incredibly

obvious when you're sitting

Speaker:

in the room and a carer is

relaying a story, for example,

Speaker:

about how some, you know,

they injure themselves.

Speaker:

And it was so strange the

reaction of the patient

Speaker:

because they thought it was hilarious,

Speaker:

which obviously isn't a normal response

Speaker:

and very different usually from hopefully

Speaker:

what their kind of pre dementia

empathic response would be.

Speaker:

So I'm taking sort of the same,

Speaker:

a principle that VR

could be used for empathy

Speaker:

and trying to use that in

an assessment capacity.

Speaker:

But the beauty of these,

all of these environments

Speaker:

and in a virtual world

is that for a researcher

Speaker:

and scientist, I want to

be able to standardise

Speaker:

that experience and exposure,

Speaker:

and create a virtual environment

Speaker:

that would be almost

impossible to replicate

Speaker:

in a standardised way

in any clinical setting,

Speaker:

unless you had at your

disposal these technologies.

Speaker:

- Are you designing the

technologies Emilie,

Speaker:

or someone else?

Speaker:

- That is somebody else.

- So you're deploying them?

Speaker:

- Yeah, so it would be

sort of co-developing

Speaker:

and perhaps we move on this later,

Speaker:

but you know, the kind of

co-design process with people

Speaker:

with lived experiences,

so central in order

Speaker:

to kind of hear the stories

Speaker:

of what sounded like an empathy

change for their loved one

Speaker:

from a carer's perspective, you know,

Speaker:

those kind of, we use for the

pilot work that we've done,

Speaker:

they have helped develop

and develop the story

Speaker:

that then when we've

collaborated with engineers,

Speaker:

and computer scientists to

develop these virtual worlds,

Speaker:

they're the stories that we've taken.

Speaker:

And then really I'm looking

at the kind of clinical angles

Speaker:

of how good this assessment could be.

Speaker:

- Yeah, yeah. So co-design is

a part of the front end of it.

Speaker:

So the sort of, yeah. Okay. Yeah.

Speaker:

And then so you are involved

in that and then Alice,

Speaker:

and I think David, I'll

bring you in on this as well.

Speaker:

I guess that leads in

nicely to how we ensure

Speaker:

that these various tools

are shaped by the people

Speaker:

that they're supposed to serve.

Speaker:

Emilie's just given an example there,

Speaker:

is there anything that

further back in the process,

Speaker:

I dunno what the tech term is

for earlier in the development

Speaker:

that...

- Yeah.

Speaker:

- That we need

Speaker:

to think about?

- I mean, I think Emilie

Speaker:

is just completely nailed

it in that, that is how...

Speaker:

If we are gonna create

meaningful experiences

Speaker:

that will create impactful

change, they have to be designed

Speaker:

by the people that they seek to serve,

Speaker:

and kind of have that lived

experience embedded into it.

Speaker:

We have a fellow, Miriam Hernandez

Speaker:

that has written a really brilliant paper

Speaker:

on community led storytelling in VR

Speaker:

because even more so than

other media, virtual reality,

Speaker:

you know, it takes everything

and particularly 360 films,

Speaker:

it can be extremely exposing.

Speaker:

And so the risk to...

Speaker:

There's all sorts of risks

Speaker:

in terms of telling other people's stories

Speaker:

using this technology.

Speaker:

And so I think that

absolutely what Emilie said

Speaker:

is the way forward and

the only way actually

Speaker:

to create these ethical kind of pieces.

Speaker:

In terms of, I think your

question around the actual

Speaker:

of technical development of it,

Speaker:

I mean that is always a

win if you can bring people

Speaker:

into the process as much as possible.

Speaker:

So Richard Smith, the Excel specialist

Speaker:

that we have at the lab, well

when he's doing 360 filming,

Speaker:

he is always explaining to the community

Speaker:

exactly this is what the camera's doing,

Speaker:

this is why I'm putting it here,

Speaker:

do you want to, you

know, press this button,

Speaker:

where do you want to place the camera?

Speaker:

It's about always asking those questions.

Speaker:

And then certain people might

just rise to the occasion,

Speaker:

and want to do more training themselves

Speaker:

and we would love to

support 'em to do that.

Speaker:

But it's about bringing people in,

Speaker:

and demystifying this process

Speaker:

that can often feel

exceptionally kind of dense

Speaker:

and just kind of making clear,

this is what we're doing,

Speaker:

this is why we're doing it,

Speaker:

how do you wanna do it

differently or with us.

Speaker:

- And David, have you got

some examples from your work

Speaker:

to add?

- Yeah, no, I would say,

Speaker:

this is a bit weird saying that XR tech...

Speaker:

XR is not about the tech,

it's about the people.

Speaker:

So, and that's like, we

started already with...

Speaker:

We talked about gaming.

Speaker:

So even in gaming, if you don't

make a game for the gamers,

Speaker:

still not gonna play the game.

Speaker:

So if you don't make

experiences or XR applications

Speaker:

that like really solve real

world problems for clinicians

Speaker:

or people living with dementia,

Speaker:

then you're doing the

wrong thing, I think.

Speaker:

So I would say like...

Speaker:

And it never starts with the tech,

Speaker:

so that's I think also the big challenge

Speaker:

in the field we're in.

Speaker:

So like there every few months now,

Speaker:

luckily new spatial computers

Speaker:

and headsets are coming

out, which is amazing,

Speaker:

but never start, like, I

never start with a tech.

Speaker:

In general, when we have

co-creation sessions,

Speaker:

we never bring the tech in the space,

Speaker:

we bring pencils, we draw, we

start in a creative setting

Speaker:

to understand like what is

it, like, peel off the onion,

Speaker:

what is the real challenge you're facing?

Speaker:

And then maybe the tech can be a solution.

Speaker:

So sometimes we do a session,

Speaker:

and then the XR is not a solution

Speaker:

and something completely out.

Speaker:

So never start with the tech,

start with like the problem,

Speaker:

the challenge that people are facing

Speaker:

and then you can build up towards XR.

Speaker:

So I think that's how you

should look at this technology.

Speaker:

- And so in the...

Speaker:

So thinking about dementia specifically,

Speaker:

then it's sort of the...

Speaker:

If we're extending what

you said into dementia,

Speaker:

you'd be thinking about

what problems are people

Speaker:

with dementia facing?

Speaker:

What do they tell us that they need?

Speaker:

And then is this type of tech a solution?

Speaker:

- Or even carers, Byron.

- Right.

Speaker:

- I've seen an amazing

piece in terms of the people

Speaker:

that are living with, caring for,

Speaker:

and exactly what both

Emilie and David said,

Speaker:

that XR is an empathy machine.

Speaker:

You know, if you can experience something

Speaker:

of what it might be like

to live with dementia

Speaker:

through the headset, you can then care

Speaker:

from a completely different

angle than you would

Speaker:

if you're living with

your own kind of biases,

Speaker:

frustrations, overwhelm.

Speaker:

It can kind of take you

into a different space

Speaker:

to love and care for somebody

that has dementia as well.

Speaker:

- That's a great point, yeah.

Speaker:

I think we never mustn't forget carers.

Speaker:

Do people like it this technology,

Speaker:

people with dementia, carers,

what's the uptake like?

Speaker:

- Yeah, so the experience of caregivers,

Speaker:

like we have a lot of like,

so these 360 experience,

Speaker:

we have like very emotional

sessions sometimes

Speaker:

with family members that as Alice said,

Speaker:

like you're in your day-to-day,

Speaker:

you're caring for your partner,

Speaker:

you have to get your

kids from school at four,

Speaker:

you know, there's a lot

going on in your life.

Speaker:

And then like you get to the (indistinct),

Speaker:

especially caregivers, a

lot of burden on caregivers

Speaker:

and things in global north and the south.

Speaker:

And we're facing in the global

north a specific challenge

Speaker:

with ageing population.

Speaker:

And so there's a lot

of burden on caregivers

Speaker:

and like sometimes we forget, so like,

Speaker:

but to understand like a grandson,

Speaker:

so my grandmother has dementia,

Speaker:

doesn't really understand what that is.

Speaker:

And when we give them this experience,

Speaker:

like they're really like that in a sense.

Speaker:

Like to understand like, what is it then?

Speaker:

And of course it's not perfect, you know,

Speaker:

I'm not gonna say our training is perfect,

Speaker:

but we try to get as close

to reality as possible.

Speaker:

And people living with dementia,

like, yeah, surprisingly,

Speaker:

like there's like...

Speaker:

Some people like to watch (indistinct),

Speaker:

some people don't like it,

Speaker:

some people like to read newspapers,

Speaker:

so it's not for everybody, but

the people who are into it.

Speaker:

I had like 102 year old ladies

Speaker:

that like were in a rollercoaster

Speaker:

and said like, give me another spin.

Speaker:

But the thing is like if I

give a first demo to somebody,

Speaker:

I would never give a

rollercoaster experience

Speaker:

as it's like really can

make you really sick.

Speaker:

But she always went with

her kids to a theme park,

Speaker:

but now being in a

wheelchair, half paralysed,

Speaker:

living with dementia,

like, I can't go anymore.

Speaker:

So for her it was like, it was perfect.

Speaker:

So it's not for everybody,

Speaker:

but I think sometimes

people are very hesitant

Speaker:

to offer XR to people

living with dementia.

Speaker:

And of course there's like

some design principles

Speaker:

and you have to do an ethical way.

Speaker:

So like, I'm not saying like

give them any experience,

Speaker:

but people are open to it,

Speaker:

they really love it and

they like the renascence,

Speaker:

like going back in their

childhood for example,

Speaker:

had one lady base jump

in VR, so base jumping

Speaker:

and like afterwards, like

if you looked at experience,

Speaker:

the gaming experience, like

we said, wow, I don't know.

Speaker:

But then the things she

came out, so like to...

Speaker:

With my husband when we were together,

Speaker:

we'd go on a holiday to this island.

Speaker:

We saw people jump out there.

Speaker:

So like she started about her

husband, her family, her past.

Speaker:

So it's like, it's also

this reminiscence therapy,

Speaker:

like it brings like emotions

up that like are so hidden,

Speaker:

but a moment you're like, you

have an embodied experience

Speaker:

like you're sharing that and then yeah,

Speaker:

these memories pop up

Speaker:

and then you have really

beautiful experiences.

Speaker:

And then nurse is saying like

normally she never speaks,

Speaker:

and now she has this whole conversation

Speaker:

of 20 minutes about her past,

Speaker:

so yeah.

- And that's...

Speaker:

I think David's touched on

something beautiful there

Speaker:

because so often people think

Speaker:

with this technology it isolates us,

Speaker:

it takes us away from each other.

Speaker:

It's all about being on your

own with a computer screen.

Speaker:

But like David, you lit

up when you talked about

Speaker:

what she said, the story she was telling,

Speaker:

it's a conversation starter

doesn't quite do it justice,

Speaker:

but it enables people

to tap into something

Speaker:

that a part of themselves

that they want to share,

Speaker:

which is really special.

Speaker:

(bright music)

Speaker:

- So I think David, what

you were saying just now,

Speaker:

I think reminds us as well

that we shouldn't ever forget

Speaker:

those basic person centred principles

Speaker:

that we, you know, we're all used to

Speaker:

whatever part of research

or dementia care we're into,

Speaker:

it's really important.

Speaker:

The content you deliver

is relevant to the person.

Speaker:

I mean that be fair.

Speaker:

- Yeah. That's for sure.

Speaker:

And especially in, I think especially

Speaker:

in the technology space, I

think it's very important.

Speaker:

It doesn't matter if it's

XR or it's smartphones,

Speaker:

whatever it is.

Speaker:

- And Emilie, how do your

participants like the technology

Speaker:

or perhaps more

interestingly or as relevant,

Speaker:

have you had any experiences

where people just hate it

Speaker:

and what have you done then, and?

Speaker:

- So, no, it's a great question

Speaker:

and I think it...

Speaker:

You know, we had, as with

every research approach,

Speaker:

we went through a very stringent

ethical review, rightly so.

Speaker:

It was, you know, our

protocol for this essentially

Speaker:

what was a feasibility in

pilot study in this area,

Speaker:

'cause it was very novel, was, you know,

Speaker:

obviously very heavily scrutinised

Speaker:

and you know, a lot of...

Speaker:

We answered lots of the

ethics committees queries,

Speaker:

which really centred around

an interesting philosophical

Speaker:

discussion around the almost

philosophical in itself

Speaker:

of immersing people, you

know, vulnerable older adults

Speaker:

who perhaps potentially are

unsure of what reality is,

Speaker:

or unscented in reality as it is.

Speaker:

How ethical is that to centre somebody

Speaker:

in essentially something

that we all know is virtual

Speaker:

or essentially fake.

Speaker:

And so I think it was for our populations

Speaker:

that we were interested

in, it was really...

Speaker:

It was very important

that we kind of emphasise

Speaker:

that this isn't the type of confusion

Speaker:

that tends to be seen in these patients.

Speaker:

It's not really challenges with memory,

Speaker:

it was more to do with these

kind of behavioural changes,

Speaker:

which many of these individuals

don't have a lot of insight

Speaker:

into having and that's why

this tool is so important.

Speaker:

So we were able to sort of

navigate that ethical process,

Speaker:

which obviously had to be, you know,

Speaker:

completely rightly done.

Speaker:

And when we sort of got to the other side,

Speaker:

and started looking and

collecting the data,

Speaker:

you know, people tolerated it really well.

Speaker:

We made sure we had pre and

post kind of sickness simulation

Speaker:

questionnaires to establish

how they were feeling,

Speaker:

if they were dizzy, if they, you know,

Speaker:

had any kind of adverse physical effects

Speaker:

and we were videoing

the whole interaction,

Speaker:

so we could really hear obviously,

Speaker:

and I was observing the whole time

Speaker:

and we had lots of kind of

safeguarding things in place

Speaker:

if anyone did struggle or were distressed

Speaker:

by the environment.

Speaker:

But we didn't in my experience,

Speaker:

no we didn't encounter any of

those, which was encouraging.

Speaker:

- Yeah, that's great.

Speaker:

But you obviously went through

a really thorough process

Speaker:

to ensure that the technology

would suitable for people,

Speaker:

and that obviously operating

Speaker:

in sort of proper

Speaker:

ethical frameworks.

- Of course.

Speaker:

- Which is good, yeah. Or important.

Speaker:

So I guess, yes, thinking about ethics,

Speaker:

thinking about research,

Speaker:

then there's probably a lot

of researchers listening,

Speaker:

they might be thinking this is great,

Speaker:

this is super interesting.

Speaker:

I'm not a coder or a tech designer,

Speaker:

or have a computing background at all,

Speaker:

how do I begin?

Speaker:

How would you answer that question?

Speaker:

What advice would you have? Alice?

Speaker:

- Yeah, I mean it links back, doesn't it

Speaker:

to what we're talking about earlier

Speaker:

in terms of how we all

came into this space

Speaker:

with the accidental technologist thing.

Speaker:

The brilliant thing about the

Atlantic Fellowship for me

Speaker:

is the interdisciplinary nest of it.

Speaker:

You bring together poets, doctors,

Speaker:

activists, community leaders.

Speaker:

And when I spoke earlier about

raising that tech literacy,

Speaker:

all I'm really saying is

about raising the confidence,

Speaker:

so that when you are in a space

Speaker:

that is discussing this

type of technology,

Speaker:

you feel able to bring your

own real life expertise,

Speaker:

your own lived experience into that space

Speaker:

to have an opinion.

Speaker:

So for me, I think what

I would say to people

Speaker:

that are interested in this

space is trust your interest

Speaker:

and start being interested

and talking about it,

Speaker:

and having opinions on things

and researching and thinking.

Speaker:

And then in terms of if you

actually want to create a piece,

Speaker:

then there's all sorts of

quite interesting grants

Speaker:

where you can be paired with somebody

Speaker:

with a more kind of tech

technical specialism

Speaker:

as Emilie was mentioning.

Speaker:

And there are loads of

brilliant technologists

Speaker:

who are excited to

collaborate with organisation,

Speaker:

and institutes and bring those expertise

Speaker:

into the technical space.

Speaker:

So for me it's around confidence,

Speaker:

and it's not actually only for

the benefit of that person,

Speaker:

this is for the benefit,

without sounding too overblown

Speaker:

of humanity, like technology

Speaker:

is how we are all moving forward

Speaker:

in terms of navigating our lives.

Speaker:

It is absolutely imperative

that we are all invested,

Speaker:

and all feel able to be part of it.

Speaker:

So it's a kind of political act I think.

Speaker:

So if you feel interested

or completely scared

Speaker:

about where the world is going with tech,

Speaker:

listen, pay attention

and bring your beliefs

Speaker:

and what you have

expertise in to that table.

Speaker:

- So that applies not just to end users

Speaker:

of the technology people...

- No.

Speaker:

- With mentoring carers,

Speaker:

but actually as researchers, people who...

Speaker:

- Absolutely, yeah...

- Moving into that.

Speaker:

- I mean, to be honest,

Speaker:

like exactly what Emilie

has done, you know,

Speaker:

like Emilie was saying, her

background has been in academia

Speaker:

the whole way through

and she works with teams

Speaker:

to kind of lift up her

work into this space.

Speaker:

Like that's what we should

all be doing with tech.

Speaker:

It's like thinking about

how we can weave it

Speaker:

into our own lives so that we

can build just kind technology

Speaker:

that creates just kind

futures fundamentally.

Speaker:

So I think Emilie's a great

example as is David actually,

Speaker:

in terms of social workers.

Speaker:

So what a brilliant group

of people you have here

Speaker:

in terms of showcasing, you

don't need to go to kind of MIT

Speaker:

and have a hundred degrees,

you bring what you have

Speaker:

and it meets you where

you are and that's vital.

Speaker:

- So on that then, David and Emilie,

Speaker:

can I ask how you ended

up in this field then

Speaker:

from your respective earlier disciplines,

Speaker:

perhaps David.

Speaker:

- So in 2013, my brother and

I, especially my brother,

Speaker:

he backed the Oculus DK1.

Speaker:

So was like long time ago,

Speaker:

and he started to make

YouTube videos with that.

Speaker:

And I can tell you the first experience

Speaker:

I had was like in a little rollercoaster

Speaker:

with a ball rolling behind me.

Speaker:

And then you...

Speaker:

So anyway, not great

experiences in the beginning.

Speaker:

And in the beginning I didn't

think it would revolutionise

Speaker:

healthcare in a different way.

Speaker:

But then exposed therapy

came from the U.S.

Speaker:

and then I did...

Speaker:

During my bachelor's, I

did some research like, oh,

Speaker:

and then it clicked for

me when I saw the effect

Speaker:

of it was really simple with

like 3D spider on a table.

Speaker:

It was like really simple,

but effect it had on people

Speaker:

how realistic it was for

somebody with a phobia

Speaker:

and how you could trick somebody

Speaker:

with a spider not having a real spider.

Speaker:

So that really clicked for me.

Speaker:

And then yeah, it kind

of snowballed from there.

Speaker:

And everything I did in

my social work career,

Speaker:

every time I linked it on

VR, what can the stack do?

Speaker:

How can we change?

Speaker:

And then in 2018 when the Oculus Go came,

Speaker:

so it's like a standalone headset.

Speaker:

That was a moment I was like,

oh, now we can implement this

Speaker:

in healthcare and have

it in a scalable way

Speaker:

before you were connected

to computer and cables,

Speaker:

and it's great for research and

really like point solutions,

Speaker:

but like scalable, training

people, taking people.

Speaker:

That was a moment I was like, okay,

Speaker:

now we can do it at scale.

Speaker:

So yeah, and he has a very

successful YouTube channel now

Speaker:

where he reviews VR

headsets and XR experiences.

Speaker:

So yeah, so it came in from

the gaming entertainment side

Speaker:

and now we're here.

Speaker:

- Great. That's amazing. Emilie.

Speaker:

- So my, I mean to all credit

to the PI I've worked with

Speaker:

for many years, so professor

(indistinct) at UCL,

Speaker:

this was really a grant that I joined

Speaker:

as a junior researcher.

Speaker:

And this pilot, this was sort

of more the very kind of...

Speaker:

As part of a programme grant,

this was the kind of high risk

Speaker:

but high impact bit which was

a bit lot more exploratory.

Speaker:

And so that's...

Speaker:

I mean, I was very lucky

to have joined somebody

Speaker:

who had the vision to incorporate this,

Speaker:

but this was a number of years ago.

Speaker:

And I think for us,

Speaker:

while the pilot data was really exciting,

Speaker:

the kind of barriers at the time

Speaker:

was that it wasn't going to

be as accessible as, you know,

Speaker:

the tech kind of almost

hadn't caught up to the idea

Speaker:

of, oh this has to be

deployable in clinical settings.

Speaker:

And you know, at UCL we were very lucky

Speaker:

to have a very high resourced

virtual reality environment

Speaker:

that just wasn't going to be

accessible in clinical context.

Speaker:

So it kind of you know...

Speaker:

And then other research projects came up

Speaker:

and I continued in a sort

of digital signals avenue,

Speaker:

but then I was reinvigorated

by this actually, Alice

Speaker:

to say about, you know,

be a part of the story

Speaker:

is from lived experience

of a close family member

Speaker:

who they didn't have FTD but

after stroke had exhibited

Speaker:

like these March behavioural

changes that were very similar

Speaker:

and luckily for that family

member that was transient.

Speaker:

But for me it was very frustrating

that even at that point

Speaker:

and knowing that this, you know,

Speaker:

this is kind of down to

a neurological change,

Speaker:

There was no standardised

assessment that could show

Speaker:

a clinician or that they could track

Speaker:

if he was getting better,

or he was getting worse

Speaker:

or that, that was different

to what was expected

Speaker:

and that he had been his whole life prior.

Speaker:

And I think for me it really...

Speaker:

That lived experience kind

of reinvigorated the interest

Speaker:

and made me wanna pick this back up

Speaker:

and extend that pilot work.

Speaker:

And that's kind of why I am

talking about this again now

Speaker:

after all these years.

Speaker:

- Fantastic, thank you.

Speaker:

I think that you've all spoken

constantly about keeping

Speaker:

the human experience central,

Speaker:

without, I don't want

to sound too cynical,

Speaker:

but you could envisage a way,

Speaker:

a scenario in a particular situation

Speaker:

where it might be really

tempting to just pop a headset

Speaker:

on someone and leave them to it.

Speaker:

And as the technology

becomes more advanced,

Speaker:

it might be easy to lose sight

of the person at the centre.

Speaker:

So to all of you, where do

we really need to be careful

Speaker:

and reflective as we develop

and deploy these technologies?

Speaker:

Perhaps I'll start with Alice.

Speaker:

- Yeah, absolutely, everywhere.

Speaker:

We need to be keeping our

eyes open at all points.

Speaker:

With this technology, with

all emerging technology,

Speaker:

there is exceptional potential,

Speaker:

which we have beautifully

revelled in today.

Speaker:

But there is as critical risk,

Speaker:

there is so much risk

with this technologies.

Speaker:

It's also a kind of perpetuation

of the world we live in.

Speaker:

Like technology is not this separate thing

Speaker:

happening over there.

Speaker:

The biases, the prejudices,

the kind of entrenched racism,

Speaker:

sexism, homophobia that kind

of lives through our society

Speaker:

is replicated in lots

of these digital spaces.

Speaker:

So it's about recognising that we are

Speaker:

at a really exciting moment,

especially when you think

Speaker:

about kind of artificial intelligence

Speaker:

and immersive environments

and kind of the co-presence

Speaker:

that I mentioned.

Speaker:

But we are also at a tipping point

Speaker:

where we've got an opportunity

here not to perpetuate

Speaker:

the pains and the harms of the past,

Speaker:

and the present into the future.

Speaker:

And actually I'm fearful,

definitely fearful

Speaker:

that, that is exactly what we're doing.

Speaker:

That they're baked into the new systems

Speaker:

that are gonna kind of

affect all of our futures.

Speaker:

So I think it's vital that we

talk about this more widely

Speaker:

than just in tech spaces

at this tipping point

Speaker:

that we are in.

Speaker:

So that we can be very

deliberate about the spaces,

Speaker:

about the data, about the kind of ways

Speaker:

in which we are deciding

to commune with each other

Speaker:

in these new spaces.

Speaker:

Because deliberation, we

have to be deliberate,

Speaker:

or we're just gonna end up

with an even worse situation

Speaker:

than we have now.

Speaker:

- Thank you. And then Emilie and David,

Speaker:

just specifics about your areas

Speaker:

where you are most reflective and careful

Speaker:

in your particular cases. Emilie.

Speaker:

- I think it always comes

down to patient safety

Speaker:

and I know that's sort of a

kind of nuts and bolts answer,

Speaker:

but to speak to any other parts

Speaker:

I'd just be repeating

Alice's very sentiments,

Speaker:

which I really echo strongly.

Speaker:

So for me in a clinical research setting,

Speaker:

it has to be

Speaker:

about that kind of more...

- Sure.

Speaker:

- You know, a very kind

of pragmatic answer

Speaker:

to keep it short...

- No, that is, yeah,

Speaker:

important though.

Speaker:

And David, anything

specific from your area?

Speaker:

- I think most have been said,

Speaker:

but I think especially like incorporating

Speaker:

because like this technology is like,

Speaker:

I don't wanna say it's a

global north technology,

Speaker:

but it is like predominantly

in a certain field,

Speaker:

certain people, can all think

Speaker:

who those kinds of people are.

Speaker:

And I think like the challenges

we've been facing now

Speaker:

that have happened a hundred years ago,

Speaker:

which like inequalities

we're still facing,

Speaker:

I think with technology,

for me being in the space,

Speaker:

looking around who's in the

space, being in the tech space

Speaker:

with XR, like seeing like

the digital literacy,

Speaker:

like if we don't design the right way

Speaker:

and we don't incorporate the global south,

Speaker:

I think we're gonna have a big challenge

Speaker:

of like in a hundred years from now,

Speaker:

looking back at this time

that we didn't incorporate

Speaker:

the global south or certain

people with certain backgrounds

Speaker:

to make this an inclusive technology.

Speaker:

And then a hundred years from now,

Speaker:

we'll just like try to solve the problems

Speaker:

that we start here.

Speaker:

So like looking at the

past, looking into future,

Speaker:

then that's something

Speaker:

that I think we should be really aware of.

Speaker:

- Thank you. Thank you very much.

Speaker:

Really important point everyone.

Speaker:

(bright music)

Speaker:

So we're almost out of

time, but before we finish,

Speaker:

I'd like to end on something a bit fun.

Speaker:

A lot of what we've talked about today

Speaker:

would've seemed like science

fiction just a few years ago.

Speaker:

So I'd like you to tell me,

Speaker:

if you could bring one

thing from science fiction

Speaker:

into reality, what would it be?

Speaker:

David.

- Something from science

Speaker:

into reality.

Speaker:

I feel like we could have a time machine.

Speaker:

- Time machine...

- Would be great.

Speaker:

- Alice.

Speaker:

- Oh, I've seen it happen too many times.

Speaker:

People are looking through science fiction

Speaker:

and making it real.

Speaker:

So I would just say I

would like those tech bros

Speaker:

to start reading (indistinct)

Speaker:

rather than the other science fiction

Speaker:

that they seem too well versed in.

Speaker:

- And Emilie.

Speaker:

- I'd go for the Star

Trek universal translator

Speaker:

and if I could extend

it to animals as well,

Speaker:

I think that would just...

- Oh.

Speaker:

- Fascinating.

- That's so nice.

Speaker:

- So if you're listening to this,

Speaker:

we'd love to hear your own

science fiction wishes.

Speaker:

You can add that to the comments.

Speaker:

I'd really like to thank David, Emilie,

Speaker:

and Alice so much for joining me today.

Speaker:

And thank you very much for listening.

Speaker:

You can find out more information

Speaker:

and links to resources at our website,

Speaker:

which is DementiaResearcher.NIHR.AC.UK,

Speaker:

and do also visit our community app

Speaker:

where we continue these conversations

Speaker:

and share new events, blogs, and podcasts.

Speaker:

So my name is Byron,

Speaker:

and you've been listening to

the Dementia Researcher podcast

Speaker:

and from all of our guests, goodbye.

Speaker:

- [Narrator] The Dementia

Researcher Podcast was brought

Speaker:

to you by University College

London with generous funding

Speaker:

from the UK National

Institute for Health Research,

Speaker:

Alzheimer's Research UK,

Speaker:

Alzheimer's Society,

Alzheimer's Association,

Speaker:

and Race Against Dementia.

Speaker:

Please subscribe, leave us a review

Speaker:

and register on our

website for full access

Speaker:

to all our great resources.

Speaker:

DementiaResearcher.NIHR.AC.UK.

Chapters

Video

More from YouTube