Extended reality is starting to find a real place in dementia research and care. In this episode, host Dr Byron Creese is joined by David de Jong-Bambagioni, Dr Emilie Brotherhood, and Alice Rowe to explore how virtual, augmented, and mixed reality tools are being used in practice.
Together, they discuss how XR is helping to standardise cognitive assessments, simulate clinical environments, and support earlier and more accurate diagnosis. The conversation also looks at how immersive tools are being used to build empathy, giving clinicians and carers a better sense of what it might feel like to live with dementia.
The panel share examples from their own work, including virtual simulations to distinguish delirium from dementia, and digital environments designed to capture subtle behavioural changes in conditions like frontotemporal dementia. These approaches are opening up new ways to study cognition, behaviour, and patient experience in more realistic and scalable settings.
This episode offers a practical look at where XR is already making a difference, and where it might go next.
In this episode:
A transcript of this show, links and show notes and profile on all our guests are available on our website at https://www.dementiaresearcher.nihr.ac.uk.
If you prefer to watch rather than listen, you will find a video version of this podcast on YouTube, on our website, and in selected podcast platforms.
Leave us a tip:
https://dementia-researcher.captivate.fm/support
Follow us on social media:
Download and Register with our Community App:
https://www.onelink.to/dementiaresearcher
We gratefully acknowledge the support of our funders: Alzheimer’s Association, Race Against Dementia, Alzheimer’s Research UK, Alzheimer’s Society, and the National Institute for Health and Care Research.
The views and opinions expressed by guests in this podcast are their own and do not necessarily reflect those of the producers, funders, or sponsors.
Subscribe to our sister show 'Dementia Researcher The Blogs':
The Dementia Researcher podcast,
Speaker:talking careers, research,
conference highlights,
Speaker:and so much more.
Speaker:- Hello and welcome to the
Dementia Researcher Podcast.
Speaker:Today we are exploring
XR, spatial computing
Speaker:and digital approaches
to understanding life
Speaker:beyond memory in dementia.
Speaker:My name is Dr. Byron Creese,
Speaker:I'm a senior lecturer in psychology
Speaker:at Brunell University of London,
Speaker:and I'm delighted to be
hosting today's show.
Speaker:Extended reality, spatial computing
Speaker:and sensor-based systems
are moving from gaming,
Speaker:creative practise, and
industry into health
Speaker:and care settings.
Speaker:These tools allow researchers
Speaker:to study how people interact
with environments, objects,
Speaker:and routines in a more
natural and responsive way
Speaker:than traditional clinic rooms.
Speaker:With us today are three people
working at the forefront
Speaker:of this area.
Speaker:We've got David De Jong-Bambagioni,
Speaker:who works with healthcare organisations
Speaker:to tackle efficiency
challenges and bring insights
Speaker:from gaming, spatial computing
Speaker:and XR into clinical practise.
Speaker:Dr. Emilie Brotherhood,
Speaker:who explores psychophysiological
responses captured
Speaker:through sensor platforms
Speaker:and investigates health spatial computing
Speaker:can support digital markers,
and assessment for people
Speaker:with non-memory led dementias.
Speaker:And Alice Wroe, XR lead
at the Atlantic Institute
Speaker:where she supports a global fellowship,
Speaker:and explores how extended realities
Speaker:can advance social equity
Speaker:and what it means to be
human in digital spaces.
Speaker:Hello everyone.
Speaker:- Hi.
- It's great
Speaker:to have you with us.
Speaker:To start us off, can I ask each of you
Speaker:to introduce yourselves?
Speaker:Let's start with Emilie.
Speaker:- Hi, thank you. So I'm Emilie.
Speaker:I'm a senior research
fellow in Neuropsychology,
Speaker:and I'm based at the
Institute of Neurology,
Speaker:Queen Square University College of London.
Speaker:- Thank you. And Alice?
Speaker:- Hello. I'm delighted to be here.
Speaker:Yeah, my name's Alice Wroe,
Speaker:and I'm the extended realities lead
Speaker:at the Atlantic Institute.
Speaker:And so we think about
how emerging technologies
Speaker:can enable our community of fellows,
Speaker:and our partners to be on the front foot
Speaker:with emerging technologies.
Speaker:So it's not something that happens to us,
Speaker:but it's something that
we can kind of engage with
Speaker:to think about how we can build fairer,
Speaker:more inclusive societies using
this sort of emerging tech.
Speaker:David is a fellow actually.
Speaker:- Ah, okay.
- Nicely to David. Yeah.
Speaker:- Brilliant. So you're teeing up David.
Speaker:- Yeah, so David De Jong-Bambagioni
from the Netherlands
Speaker:and I'm a social entrepreneur
in the Netherlands,
Speaker:and we work with XR to improve
process in hospital care,
Speaker:and dementia care, psychiatric care.
Speaker:So very broad, but we use the technology,
Speaker:how can we improve healthcare yesterday.
Speaker:- Brilliant. Thank you all.
Speaker:So I've actually work in dementia care,
Speaker:but much more on, I guess more
Speaker:typical psychology background.
Speaker:So this is really exciting for me.
Speaker:Let's get going.
Speaker:(bright music)
Speaker:So let's begin with your individual work.
Speaker:David, could you tell us
about the work you're doing
Speaker:with extended reality
and spatial computing,
Speaker:and what you're trying to
understand or change through it?
Speaker:- Yeah, so my company,
Speaker:they're health and facing
in the Netherlands,
Speaker:we work on (indistinct),
educational technology
Speaker:and MedTech and medical technology.
Speaker:And what we do with the (indistinct) part
Speaker:is change the way we
train nurses, caregivers,
Speaker:give them information in a different way.
Speaker:We use 360 video for that.
Speaker:And what we do is like empathy
VR, so you can experience
Speaker:how it is to go through the
four phases of dementia,
Speaker:or how it is to have a psychosis,
Speaker:just to step in somebody else's shoes
Speaker:to empathise with the other person.
Speaker:We also do virtual excursion.
Speaker:So if you are living with dementia,
Speaker:or laying in the hospital and
you can travel around anymore,
Speaker:we have beautiful beaches,
forests, even train stations.
Speaker:Some people like to be on a train station.
Speaker:And also we do social skills training,
Speaker:so improve the way you
interact with medical staff,
Speaker:patients, that kind of stuff.
Speaker:And also like movements, so
like body movement in 360
Speaker:and with a med tech, what we
do is we optimise processes
Speaker:around medical devices.
Speaker:Think about track and tracing
like your Apple Air tag
Speaker:that you know, where your bag is,
Speaker:where your bike, but then
in a medical setting,
Speaker:in a hospital, we do warehouse management.
Speaker:So where are all these devices?
Speaker:It's a big challenge, like
where are the medical devices
Speaker:and dashboarding with AI agents.
Speaker:So that's like smart
assistance that can help you
Speaker:to find the right medical device.
Speaker:So you go to a patient,
what does the patient need?
Speaker:And in that way you find
the right medical device,
Speaker:and the information part
for the carrier like is done
Speaker:with augmented reality.
Speaker:So you can see the medical
device in the space.
Speaker:So if you want to troubleshoot,
Speaker:then you can see the medical
device in front of you
Speaker:on your desk and then you can say,
Speaker:oh, how does this button work?
Speaker:Or that kind of thing.
Speaker:So that's what we do with XR.
Speaker:- Great, thank you.
Speaker:And Emilie, your research
spans spatial computing,
Speaker:digital signals and psychophysiology.
Speaker:So could you briefly describe
Speaker:what projects you've
worked with in this area?
Speaker:What questions are you hoping to answer?
Speaker:- Yeah, sure.
Speaker:So my PhD was looking
Speaker:at the sort of in the digital signal space
Speaker:in a more dementia care context.
Speaker:So Byron kind of aligning with your work.
Speaker:And that was really about
using kind of infrared cameras
Speaker:to pick up signals, like
changes in pupil responses
Speaker:as people listen to familiar
and unfamiliar music,
Speaker:and those populations and people
Speaker:with different types
of Alzheimer's disease.
Speaker:And that was really to
answer research questions
Speaker:like how can we augment
Speaker:and improve personalised
(indistinct) interventions
Speaker:in dementia care?
Speaker:But while that was going on,
Speaker:I was also collecting pilot data
Speaker:that was looking at innovative ways
Speaker:that we could use extended reality
Speaker:in the field of dementia assessments.
Speaker:So moving sort of from a care
Speaker:to actually diagnostic capacity.
Speaker:And this would particularly address things
Speaker:like how we detect changes
Speaker:in competitive domains aside
from the memory challenges
Speaker:that we tend to see in more typical forms
Speaker:of Alzheimer's disease are
moving towards detecting subtle
Speaker:behaviour and social personality changes
Speaker:in the, for example, the
ability to exhibit empathy
Speaker:that are often observed in people
Speaker:with frontotemporal dementia.
Speaker:- Great, thank you.
Speaker:So you're working in,
Speaker:I guess the less common dementias then.
Speaker:So taking in FTD as well
as Alzheimer's. Great.
Speaker:Alice, you approach XR from a creative
Speaker:and equity centred perspective,
Speaker:could you share what you
are working on at the moment
Speaker:and how you think extended realities
Speaker:will help people and society?
Speaker:- Yeah, and it's so brilliant
Speaker:to hear David and Emilie's work
Speaker:because with extended realities,
Speaker:the vast majority of this
tech is used for military,
Speaker:and for gaming and it's
just like mega dominated.
Speaker:It's then when you hear
about work like this,
Speaker:it's just twinkling for this
new kind of thoughtful future
Speaker:with this technology, that's so exciting.
Speaker:Yeah, so I work, as I've mentioned
at the Atlantic Institute
Speaker:and we believe that this type
of technology is gonna change
Speaker:the way that we all navigate our futures
Speaker:in terms of our work lives,
our professional lives,
Speaker:and we wanna make sure that
our fellows, our partners,
Speaker:our community at large are
people that feel confident
Speaker:and safe to be critical
to champion this tech,
Speaker:to kind of creating it,
collaborate through it.
Speaker:So we put a real strategic
focus on this particular area,
Speaker:and so we've been working
in three main areas.
Speaker:So we're thinking about co-presence,
Speaker:how can our global and
growing community be together
Speaker:whilst we're physically apart?
Speaker:We've been thinking about
how can this technology lift
Speaker:the equity work of the fellows?
Speaker:So projects like Emilie's and David's,
Speaker:it just kind of sings to our hymn sheet.
Speaker:It's about taking people that
may not ordinarily have access
Speaker:to this sort of tech,
bring their expertise
Speaker:and just lift it into their work
Speaker:and raise their equity work.
Speaker:And then the third one is
around thought leadership.
Speaker:So this tech space is so often
dominated by the same voices
Speaker:with the same kind of backgrounds.
Speaker:And we actually think that
through interdisciplinary
Speaker:engagement, that is how
we're gonna make progress,
Speaker:social beautiful progress in this space.
Speaker:So it's bringing fellows
together, our partners together,
Speaker:our communities together to
gather around this technology
Speaker:and dream with it fundamentally.
Speaker:And so we are raising the
tech literacy as well.
Speaker:And so finally, I'll
just give you one example
Speaker:of an actual piece that we're working on.
Speaker:So one of our fellows at the
moment is creating a piece
Speaker:with our lab in Oxford, in Rhodes house.
Speaker:We've got a brilliant XR
specialist, Richard Smith,
Speaker:and they're making a 360
film about climate anxiety
Speaker:called "Living in Water" in collaboration
Speaker:with the equity initiative
in Southeast Asia.
Speaker:So we're thinking about
climate anxiety globally,
Speaker:and how it lives differently
depending on where you are.
Speaker:And so we're making work like that,
Speaker:but for me it's the tech
literacy and the raising
Speaker:of who is in the room
talking about this stuff
Speaker:that really makes me sing.
Speaker:- That's great. Thank you.
Speaker:Such enthusiasm from all three of you.
Speaker:Can I ask about your backgrounds.
Speaker:Are you a health scientist,
Speaker:psychologist who've moved into tech?
Speaker:Or are you tech people who've moved
Speaker:into applying your skills to healthcare?
Speaker:- I've lived in academia for a decade
Speaker:as a neuropsychology researcher.
Speaker:That's very much where I've stayed.
Speaker:- Yeah.
Speaker:- By origin, I'm a social worker,
Speaker:so I rolled into this technology.
Speaker:- Oh great.
- Oh, I love that.
Speaker:Rolled into technology.
Speaker:There's an artist called Stephanie Dinkins
Speaker:who works a lot in tech,
Speaker:and she calls herself an
accidental technologist,
Speaker:which is what I relate to as well.
Speaker:So my background was in creative direction
Speaker:and then I was kind of picked
out of it by an amazing CEO
Speaker:of a spatial computing
company, Magic Leap.
Speaker:And he just knew that if you
get people whose background
Speaker:isn't tech, actually, that's
where you can kind of dream
Speaker:the biggest things when
you bring them together
Speaker:with tech people.
Speaker:And we all kind of merge and become one.
Speaker:So I ascribe to the
accidental technologists.
Speaker:- Let's move on then to, I
guess talk about that tech,
Speaker:XR, an immersive environment.
Speaker:So extended reality would include things
Speaker:like virtual reality, augmented
reality, and mixed reality.
Speaker:And these tools can produce naturalistic,
Speaker:and responsive environments
for assessment and support.
Speaker:I mean, that's as far as
my understanding would go.
Speaker:So what I need is for
you to help me out a bit.
Speaker:So perhaps Alice, can I start with you?
Speaker:For those unfamiliar,
can I ask you to tell us
Speaker:the difference between extended reality,
Speaker:virtual reality, augmented
and mixed reality?
Speaker:- It would be my pleasure, Byron.
Speaker:So fundamentally, XR is this
kind of big umbrella term
Speaker:that encompasses a load of
different immersive technologies.
Speaker:So please don't feel
intimidated by that term.
Speaker:If it seems interchangeable,
Speaker:or there's lots of different things,
Speaker:it's because there are loads of words
Speaker:that kind of mean similar things.
Speaker:So VR as you said, virtual reality
Speaker:as if you put a headset on,
Speaker:all you will see is the
digital world in front of you.
Speaker:So if you're wearing a
virtual reality headset,
Speaker:you might actually just
like walk into a chair,
Speaker:or like stub your toe
'cause all you can see
Speaker:is that virtual world.
Speaker:And then you've got augmented reality,
Speaker:and mixed reality where the digital
Speaker:and the physical worlds
come together as one.
Speaker:So actually as you put
those sort of headsets on
Speaker:or you kind of bring
them up using your phone,
Speaker:you'll see your world around you,
Speaker:but you'll have digital content
that is kind of engaging
Speaker:with quite poetically that the worlds
Speaker:that you have around you.
Speaker:So I think those are the
two big ones to understand.
Speaker:Some people call it spatial computing
Speaker:or the metaverse, the embodied internet,
Speaker:all these different terms.
Speaker:But fundamentally it's everything
Speaker:that like bursts out of your screen
Speaker:and into your environment
in different ways.
Speaker:- Great. And David then,
Speaker:how do you see XR helping
clinicians understand
Speaker:the day-to-day challenges and other things
Speaker:that might be missed in clinics,
specifically as it pertains
Speaker:to dementia would be really interesting?
Speaker:- Because of what we do is like...
Speaker:So what we do is community driven VR.
Speaker:So together with like clinicians,
Speaker:we try to figure out what
are the challenges clinicians
Speaker:are facing in the day-to-day
clinic that they could miss.
Speaker:And then you just like, you
kind of create like a sandbox,
Speaker:like a safe space where
people can experiment.
Speaker:So like for example, we have one training,
Speaker:and it's regarding seeing the
difference between a delirium
Speaker:or like symptoms of dementia.
Speaker:So we try to like simulate environments
Speaker:where like you can make
decisions and choices
Speaker:that maybe you would not
do in a clinical setting
Speaker:to like empathise, look at the...
Speaker:Like how do you communicate,
what is the workflow,
Speaker:what are the processes, how
can we optimise those to train
Speaker:in a safe environment?
Speaker:And what I said before,
I think the empathy part,
Speaker:like the empathy trainings we create
Speaker:I think are very powerful,
even though you're a clinician,
Speaker:even though you study the
subject or a certain disease,
Speaker:like the moment a patient's
sitting in front of you ,
Speaker:how do you know how their world is?
Speaker:How do they view you sitting
on the other side of the table,
Speaker:you know, with the white
coat effect, of course.
Speaker:So stepping in the other person's shoes
Speaker:and experience from the
other way is really helpful.
Speaker:So, and that's the kind of
sense we try to optimise
Speaker:the day-to-day clinic to, you know,
Speaker:step in somebody else's shoes and
Speaker:just get out of your own bubble.
Speaker:- Yeah. Does it extend as well
Speaker:to, like the room I'm sitting in right now
Speaker:is work you can see
'cause it's really bland.
Speaker:- I thought that was just your
taste, Byron, minimal man.
Speaker:- Your virtual backgrounds,
Speaker:we thought you're in a metaverse.
Speaker:- Yeah. But so would it
extend to like doctors,
Speaker:or other healthcare
professionals consulting
Speaker:in a very sterile environment,
Speaker:does it extend to helping them understand
Speaker:how someone operates in
the real world at home?
Speaker:So almost simulating if you were to go,
Speaker:and watch someone in their own house
Speaker:and draw insights that way.
Speaker:- Yeah, yeah, exactly. Yeah.
- Oh, brilliant.
Speaker:And Emilie, how does spatial
computing use these realities
Speaker:then and what do they offer
when measuring subtle changes
Speaker:in how people interact
with their surroundings?
Speaker:- So it's really interesting, David
Speaker:to, you know, hear about your
work using VR as a, or XR
Speaker:as a vehicle for empathy because
this is exactly the reason
Speaker:for a very different motivation.
Speaker:But it's exactly the reason
I want to incorporate it
Speaker:in my research in the
pilot data we collected.
Speaker:And that's because in
the diagnostic criteria
Speaker:for a particular type
Speaker:of this sort of frontotemporal
dementia that I'm interested
Speaker:in, one of the diagnostic criteria
Speaker:is a mark change in empathy.
Speaker:And for a clinician and for a caregiver,
Speaker:that can be incredibly
obvious when you're sitting
Speaker:in the room and a carer is
relaying a story, for example,
Speaker:about how some, you know,
they injure themselves.
Speaker:And it was so strange the
reaction of the patient
Speaker:because they thought it was hilarious,
Speaker:which obviously isn't a normal response
Speaker:and very different usually from hopefully
Speaker:what their kind of pre dementia
empathic response would be.
Speaker:So I'm taking sort of the same,
Speaker:a principle that VR
could be used for empathy
Speaker:and trying to use that in
an assessment capacity.
Speaker:But the beauty of these,
all of these environments
Speaker:and in a virtual world
is that for a researcher
Speaker:and scientist, I want to
be able to standardise
Speaker:that experience and exposure,
Speaker:and create a virtual environment
Speaker:that would be almost
impossible to replicate
Speaker:in a standardised way
in any clinical setting,
Speaker:unless you had at your
disposal these technologies.
Speaker:- Are you designing the
technologies Emilie,
Speaker:or someone else?
Speaker:- That is somebody else.
- So you're deploying them?
Speaker:- Yeah, so it would be
sort of co-developing
Speaker:and perhaps we move on this later,
Speaker:but you know, the kind of
co-design process with people
Speaker:with lived experiences,
so central in order
Speaker:to kind of hear the stories
Speaker:of what sounded like an empathy
change for their loved one
Speaker:from a carer's perspective, you know,
Speaker:those kind of, we use for the
pilot work that we've done,
Speaker:they have helped develop
and develop the story
Speaker:that then when we've
collaborated with engineers,
Speaker:and computer scientists to
develop these virtual worlds,
Speaker:they're the stories that we've taken.
Speaker:And then really I'm looking
at the kind of clinical angles
Speaker:of how good this assessment could be.
Speaker:- Yeah, yeah. So co-design is
a part of the front end of it.
Speaker:So the sort of, yeah. Okay. Yeah.
Speaker:And then so you are involved
in that and then Alice,
Speaker:and I think David, I'll
bring you in on this as well.
Speaker:I guess that leads in
nicely to how we ensure
Speaker:that these various tools
are shaped by the people
Speaker:that they're supposed to serve.
Speaker:Emilie's just given an example there,
Speaker:is there anything that
further back in the process,
Speaker:I dunno what the tech term is
for earlier in the development
Speaker:that...
- Yeah.
Speaker:- That we need
Speaker:to think about?
- I mean, I think Emilie
Speaker:is just completely nailed
it in that, that is how...
Speaker:If we are gonna create
meaningful experiences
Speaker:that will create impactful
change, they have to be designed
Speaker:by the people that they seek to serve,
Speaker:and kind of have that lived
experience embedded into it.
Speaker:We have a fellow, Miriam Hernandez
Speaker:that has written a really brilliant paper
Speaker:on community led storytelling in VR
Speaker:because even more so than
other media, virtual reality,
Speaker:you know, it takes everything
and particularly 360 films,
Speaker:it can be extremely exposing.
Speaker:And so the risk to...
Speaker:There's all sorts of risks
Speaker:in terms of telling other people's stories
Speaker:using this technology.
Speaker:And so I think that
absolutely what Emilie said
Speaker:is the way forward and
the only way actually
Speaker:to create these ethical kind of pieces.
Speaker:In terms of, I think your
question around the actual
Speaker:of technical development of it,
Speaker:I mean that is always a
win if you can bring people
Speaker:into the process as much as possible.
Speaker:So Richard Smith, the Excel specialist
Speaker:that we have at the lab, well
when he's doing 360 filming,
Speaker:he is always explaining to the community
Speaker:exactly this is what the camera's doing,
Speaker:this is why I'm putting it here,
Speaker:do you want to, you
know, press this button,
Speaker:where do you want to place the camera?
Speaker:It's about always asking those questions.
Speaker:And then certain people might
just rise to the occasion,
Speaker:and want to do more training themselves
Speaker:and we would love to
support 'em to do that.
Speaker:But it's about bringing people in,
Speaker:and demystifying this process
Speaker:that can often feel
exceptionally kind of dense
Speaker:and just kind of making clear,
this is what we're doing,
Speaker:this is why we're doing it,
Speaker:how do you wanna do it
differently or with us.
Speaker:- And David, have you got
some examples from your work
Speaker:to add?
- Yeah, no, I would say,
Speaker:this is a bit weird saying that XR tech...
Speaker:XR is not about the tech,
it's about the people.
Speaker:So, and that's like, we
started already with...
Speaker:We talked about gaming.
Speaker:So even in gaming, if you don't
make a game for the gamers,
Speaker:still not gonna play the game.
Speaker:So if you don't make
experiences or XR applications
Speaker:that like really solve real
world problems for clinicians
Speaker:or people living with dementia,
Speaker:then you're doing the
wrong thing, I think.
Speaker:So I would say like...
Speaker:And it never starts with the tech,
Speaker:so that's I think also the big challenge
Speaker:in the field we're in.
Speaker:So like there every few months now,
Speaker:luckily new spatial computers
Speaker:and headsets are coming
out, which is amazing,
Speaker:but never start, like, I
never start with a tech.
Speaker:In general, when we have
co-creation sessions,
Speaker:we never bring the tech in the space,
Speaker:we bring pencils, we draw, we
start in a creative setting
Speaker:to understand like what is
it, like, peel off the onion,
Speaker:what is the real challenge you're facing?
Speaker:And then maybe the tech can be a solution.
Speaker:So sometimes we do a session,
Speaker:and then the XR is not a solution
Speaker:and something completely out.
Speaker:So never start with the tech,
start with like the problem,
Speaker:the challenge that people are facing
Speaker:and then you can build up towards XR.
Speaker:So I think that's how you
should look at this technology.
Speaker:- And so in the...
Speaker:So thinking about dementia specifically,
Speaker:then it's sort of the...
Speaker:If we're extending what
you said into dementia,
Speaker:you'd be thinking about
what problems are people
Speaker:with dementia facing?
Speaker:What do they tell us that they need?
Speaker:And then is this type of tech a solution?
Speaker:- Or even carers, Byron.
- Right.
Speaker:- I've seen an amazing
piece in terms of the people
Speaker:that are living with, caring for,
Speaker:and exactly what both
Emilie and David said,
Speaker:that XR is an empathy machine.
Speaker:You know, if you can experience something
Speaker:of what it might be like
to live with dementia
Speaker:through the headset, you can then care
Speaker:from a completely different
angle than you would
Speaker:if you're living with
your own kind of biases,
Speaker:frustrations, overwhelm.
Speaker:It can kind of take you
into a different space
Speaker:to love and care for somebody
that has dementia as well.
Speaker:- That's a great point, yeah.
Speaker:I think we never mustn't forget carers.
Speaker:Do people like it this technology,
Speaker:people with dementia, carers,
what's the uptake like?
Speaker:- Yeah, so the experience of caregivers,
Speaker:like we have a lot of like,
so these 360 experience,
Speaker:we have like very emotional
sessions sometimes
Speaker:with family members that as Alice said,
Speaker:like you're in your day-to-day,
Speaker:you're caring for your partner,
Speaker:you have to get your
kids from school at four,
Speaker:you know, there's a lot
going on in your life.
Speaker:And then like you get to the (indistinct),
Speaker:especially caregivers, a
lot of burden on caregivers
Speaker:and things in global north and the south.
Speaker:And we're facing in the global
north a specific challenge
Speaker:with ageing population.
Speaker:And so there's a lot
of burden on caregivers
Speaker:and like sometimes we forget, so like,
Speaker:but to understand like a grandson,
Speaker:so my grandmother has dementia,
Speaker:doesn't really understand what that is.
Speaker:And when we give them this experience,
Speaker:like they're really like that in a sense.
Speaker:Like to understand like, what is it then?
Speaker:And of course it's not perfect, you know,
Speaker:I'm not gonna say our training is perfect,
Speaker:but we try to get as close
to reality as possible.
Speaker:And people living with dementia,
like, yeah, surprisingly,
Speaker:like there's like...
Speaker:Some people like to watch (indistinct),
Speaker:some people don't like it,
Speaker:some people like to read newspapers,
Speaker:so it's not for everybody, but
the people who are into it.
Speaker:I had like 102 year old ladies
Speaker:that like were in a rollercoaster
Speaker:and said like, give me another spin.
Speaker:But the thing is like if I
give a first demo to somebody,
Speaker:I would never give a
rollercoaster experience
Speaker:as it's like really can
make you really sick.
Speaker:But she always went with
her kids to a theme park,
Speaker:but now being in a
wheelchair, half paralysed,
Speaker:living with dementia,
like, I can't go anymore.
Speaker:So for her it was like, it was perfect.
Speaker:So it's not for everybody,
Speaker:but I think sometimes
people are very hesitant
Speaker:to offer XR to people
living with dementia.
Speaker:And of course there's like
some design principles
Speaker:and you have to do an ethical way.
Speaker:So like, I'm not saying like
give them any experience,
Speaker:but people are open to it,
Speaker:they really love it and
they like the renascence,
Speaker:like going back in their
childhood for example,
Speaker:had one lady base jump
in VR, so base jumping
Speaker:and like afterwards, like
if you looked at experience,
Speaker:the gaming experience, like
we said, wow, I don't know.
Speaker:But then the things she
came out, so like to...
Speaker:With my husband when we were together,
Speaker:we'd go on a holiday to this island.
Speaker:We saw people jump out there.
Speaker:So like she started about her
husband, her family, her past.
Speaker:So it's like, it's also
this reminiscence therapy,
Speaker:like it brings like emotions
up that like are so hidden,
Speaker:but a moment you're like, you
have an embodied experience
Speaker:like you're sharing that and then yeah,
Speaker:these memories pop up
Speaker:and then you have really
beautiful experiences.
Speaker:And then nurse is saying like
normally she never speaks,
Speaker:and now she has this whole conversation
Speaker:of 20 minutes about her past,
Speaker:so yeah.
- And that's...
Speaker:I think David's touched on
something beautiful there
Speaker:because so often people think
Speaker:with this technology it isolates us,
Speaker:it takes us away from each other.
Speaker:It's all about being on your
own with a computer screen.
Speaker:But like David, you lit
up when you talked about
Speaker:what she said, the story she was telling,
Speaker:it's a conversation starter
doesn't quite do it justice,
Speaker:but it enables people
to tap into something
Speaker:that a part of themselves
that they want to share,
Speaker:which is really special.
Speaker:(bright music)
Speaker:- So I think David, what
you were saying just now,
Speaker:I think reminds us as well
that we shouldn't ever forget
Speaker:those basic person centred principles
Speaker:that we, you know, we're all used to
Speaker:whatever part of research
or dementia care we're into,
Speaker:it's really important.
Speaker:The content you deliver
is relevant to the person.
Speaker:I mean that be fair.
Speaker:- Yeah. That's for sure.
Speaker:And especially in, I think especially
Speaker:in the technology space, I
think it's very important.
Speaker:It doesn't matter if it's
XR or it's smartphones,
Speaker:whatever it is.
Speaker:- And Emilie, how do your
participants like the technology
Speaker:or perhaps more
interestingly or as relevant,
Speaker:have you had any experiences
where people just hate it
Speaker:and what have you done then, and?
Speaker:- So, no, it's a great question
Speaker:and I think it...
Speaker:You know, we had, as with
every research approach,
Speaker:we went through a very stringent
ethical review, rightly so.
Speaker:It was, you know, our
protocol for this essentially
Speaker:what was a feasibility in
pilot study in this area,
Speaker:'cause it was very novel, was, you know,
Speaker:obviously very heavily scrutinised
Speaker:and you know, a lot of...
Speaker:We answered lots of the
ethics committees queries,
Speaker:which really centred around
an interesting philosophical
Speaker:discussion around the almost
philosophical in itself
Speaker:of immersing people, you
know, vulnerable older adults
Speaker:who perhaps potentially are
unsure of what reality is,
Speaker:or unscented in reality as it is.
Speaker:How ethical is that to centre somebody
Speaker:in essentially something
that we all know is virtual
Speaker:or essentially fake.
Speaker:And so I think it was for our populations
Speaker:that we were interested
in, it was really...
Speaker:It was very important
that we kind of emphasise
Speaker:that this isn't the type of confusion
Speaker:that tends to be seen in these patients.
Speaker:It's not really challenges with memory,
Speaker:it was more to do with these
kind of behavioural changes,
Speaker:which many of these individuals
don't have a lot of insight
Speaker:into having and that's why
this tool is so important.
Speaker:So we were able to sort of
navigate that ethical process,
Speaker:which obviously had to be, you know,
Speaker:completely rightly done.
Speaker:And when we sort of got to the other side,
Speaker:and started looking and
collecting the data,
Speaker:you know, people tolerated it really well.
Speaker:We made sure we had pre and
post kind of sickness simulation
Speaker:questionnaires to establish
how they were feeling,
Speaker:if they were dizzy, if they, you know,
Speaker:had any kind of adverse physical effects
Speaker:and we were videoing
the whole interaction,
Speaker:so we could really hear obviously,
Speaker:and I was observing the whole time
Speaker:and we had lots of kind of
safeguarding things in place
Speaker:if anyone did struggle or were distressed
Speaker:by the environment.
Speaker:But we didn't in my experience,
Speaker:no we didn't encounter any of
those, which was encouraging.
Speaker:- Yeah, that's great.
Speaker:But you obviously went through
a really thorough process
Speaker:to ensure that the technology
would suitable for people,
Speaker:and that obviously operating
Speaker:in sort of proper
Speaker:ethical frameworks.
- Of course.
Speaker:- Which is good, yeah. Or important.
Speaker:So I guess, yes, thinking about ethics,
Speaker:thinking about research,
Speaker:then there's probably a lot
of researchers listening,
Speaker:they might be thinking this is great,
Speaker:this is super interesting.
Speaker:I'm not a coder or a tech designer,
Speaker:or have a computing background at all,
Speaker:how do I begin?
Speaker:How would you answer that question?
Speaker:What advice would you have? Alice?
Speaker:- Yeah, I mean it links back, doesn't it
Speaker:to what we're talking about earlier
Speaker:in terms of how we all
came into this space
Speaker:with the accidental technologist thing.
Speaker:The brilliant thing about the
Atlantic Fellowship for me
Speaker:is the interdisciplinary nest of it.
Speaker:You bring together poets, doctors,
Speaker:activists, community leaders.
Speaker:And when I spoke earlier about
raising that tech literacy,
Speaker:all I'm really saying is
about raising the confidence,
Speaker:so that when you are in a space
Speaker:that is discussing this
type of technology,
Speaker:you feel able to bring your
own real life expertise,
Speaker:your own lived experience into that space
Speaker:to have an opinion.
Speaker:So for me, I think what
I would say to people
Speaker:that are interested in this
space is trust your interest
Speaker:and start being interested
and talking about it,
Speaker:and having opinions on things
and researching and thinking.
Speaker:And then in terms of if you
actually want to create a piece,
Speaker:then there's all sorts of
quite interesting grants
Speaker:where you can be paired with somebody
Speaker:with a more kind of tech
technical specialism
Speaker:as Emilie was mentioning.
Speaker:And there are loads of
brilliant technologists
Speaker:who are excited to
collaborate with organisation,
Speaker:and institutes and bring those expertise
Speaker:into the technical space.
Speaker:So for me it's around confidence,
Speaker:and it's not actually only for
the benefit of that person,
Speaker:this is for the benefit,
without sounding too overblown
Speaker:of humanity, like technology
Speaker:is how we are all moving forward
Speaker:in terms of navigating our lives.
Speaker:It is absolutely imperative
that we are all invested,
Speaker:and all feel able to be part of it.
Speaker:So it's a kind of political act I think.
Speaker:So if you feel interested
or completely scared
Speaker:about where the world is going with tech,
Speaker:listen, pay attention
and bring your beliefs
Speaker:and what you have
expertise in to that table.
Speaker:- So that applies not just to end users
Speaker:of the technology people...
- No.
Speaker:- With mentoring carers,
Speaker:but actually as researchers, people who...
Speaker:- Absolutely, yeah...
- Moving into that.
Speaker:- I mean, to be honest,
Speaker:like exactly what Emilie
has done, you know,
Speaker:like Emilie was saying, her
background has been in academia
Speaker:the whole way through
and she works with teams
Speaker:to kind of lift up her
work into this space.
Speaker:Like that's what we should
all be doing with tech.
Speaker:It's like thinking about
how we can weave it
Speaker:into our own lives so that we
can build just kind technology
Speaker:that creates just kind
futures fundamentally.
Speaker:So I think Emilie's a great
example as is David actually,
Speaker:in terms of social workers.
Speaker:So what a brilliant group
of people you have here
Speaker:in terms of showcasing, you
don't need to go to kind of MIT
Speaker:and have a hundred degrees,
you bring what you have
Speaker:and it meets you where
you are and that's vital.
Speaker:- So on that then, David and Emilie,
Speaker:can I ask how you ended
up in this field then
Speaker:from your respective earlier disciplines,
Speaker:perhaps David.
Speaker:- So in 2013, my brother and
I, especially my brother,
Speaker:he backed the Oculus DK1.
Speaker:So was like long time ago,
Speaker:and he started to make
YouTube videos with that.
Speaker:And I can tell you the first experience
Speaker:I had was like in a little rollercoaster
Speaker:with a ball rolling behind me.
Speaker:And then you...
Speaker:So anyway, not great
experiences in the beginning.
Speaker:And in the beginning I didn't
think it would revolutionise
Speaker:healthcare in a different way.
Speaker:But then exposed therapy
came from the U.S.
Speaker:and then I did...
Speaker:During my bachelor's, I
did some research like, oh,
Speaker:and then it clicked for
me when I saw the effect
Speaker:of it was really simple with
like 3D spider on a table.
Speaker:It was like really simple,
but effect it had on people
Speaker:how realistic it was for
somebody with a phobia
Speaker:and how you could trick somebody
Speaker:with a spider not having a real spider.
Speaker:So that really clicked for me.
Speaker:And then yeah, it kind
of snowballed from there.
Speaker:And everything I did in
my social work career,
Speaker:every time I linked it on
VR, what can the stack do?
Speaker:How can we change?
Speaker:And then in 2018 when the Oculus Go came,
Speaker:so it's like a standalone headset.
Speaker:That was a moment I was like,
oh, now we can implement this
Speaker:in healthcare and have
it in a scalable way
Speaker:before you were connected
to computer and cables,
Speaker:and it's great for research and
really like point solutions,
Speaker:but like scalable, training
people, taking people.
Speaker:That was a moment I was like, okay,
Speaker:now we can do it at scale.
Speaker:So yeah, and he has a very
successful YouTube channel now
Speaker:where he reviews VR
headsets and XR experiences.
Speaker:So yeah, so it came in from
the gaming entertainment side
Speaker:and now we're here.
Speaker:- Great. That's amazing. Emilie.
Speaker:- So my, I mean to all credit
to the PI I've worked with
Speaker:for many years, so professor
(indistinct) at UCL,
Speaker:this was really a grant that I joined
Speaker:as a junior researcher.
Speaker:And this pilot, this was sort
of more the very kind of...
Speaker:As part of a programme grant,
this was the kind of high risk
Speaker:but high impact bit which was
a bit lot more exploratory.
Speaker:And so that's...
Speaker:I mean, I was very lucky
to have joined somebody
Speaker:who had the vision to incorporate this,
Speaker:but this was a number of years ago.
Speaker:And I think for us,
Speaker:while the pilot data was really exciting,
Speaker:the kind of barriers at the time
Speaker:was that it wasn't going to
be as accessible as, you know,
Speaker:the tech kind of almost
hadn't caught up to the idea
Speaker:of, oh this has to be
deployable in clinical settings.
Speaker:And you know, at UCL we were very lucky
Speaker:to have a very high resourced
virtual reality environment
Speaker:that just wasn't going to be
accessible in clinical context.
Speaker:So it kind of you know...
Speaker:And then other research projects came up
Speaker:and I continued in a sort
of digital signals avenue,
Speaker:but then I was reinvigorated
by this actually, Alice
Speaker:to say about, you know,
be a part of the story
Speaker:is from lived experience
of a close family member
Speaker:who they didn't have FTD but
after stroke had exhibited
Speaker:like these March behavioural
changes that were very similar
Speaker:and luckily for that family
member that was transient.
Speaker:But for me it was very frustrating
that even at that point
Speaker:and knowing that this, you know,
Speaker:this is kind of down to
a neurological change,
Speaker:There was no standardised
assessment that could show
Speaker:a clinician or that they could track
Speaker:if he was getting better,
or he was getting worse
Speaker:or that, that was different
to what was expected
Speaker:and that he had been his whole life prior.
Speaker:And I think for me it really...
Speaker:That lived experience kind
of reinvigorated the interest
Speaker:and made me wanna pick this back up
Speaker:and extend that pilot work.
Speaker:And that's kind of why I am
talking about this again now
Speaker:after all these years.
Speaker:- Fantastic, thank you.
Speaker:I think that you've all spoken
constantly about keeping
Speaker:the human experience central,
Speaker:without, I don't want
to sound too cynical,
Speaker:but you could envisage a way,
Speaker:a scenario in a particular situation
Speaker:where it might be really
tempting to just pop a headset
Speaker:on someone and leave them to it.
Speaker:And as the technology
becomes more advanced,
Speaker:it might be easy to lose sight
of the person at the centre.
Speaker:So to all of you, where do
we really need to be careful
Speaker:and reflective as we develop
and deploy these technologies?
Speaker:Perhaps I'll start with Alice.
Speaker:- Yeah, absolutely, everywhere.
Speaker:We need to be keeping our
eyes open at all points.
Speaker:With this technology, with
all emerging technology,
Speaker:there is exceptional potential,
Speaker:which we have beautifully
revelled in today.
Speaker:But there is as critical risk,
Speaker:there is so much risk
with this technologies.
Speaker:It's also a kind of perpetuation
of the world we live in.
Speaker:Like technology is not this separate thing
Speaker:happening over there.
Speaker:The biases, the prejudices,
the kind of entrenched racism,
Speaker:sexism, homophobia that kind
of lives through our society
Speaker:is replicated in lots
of these digital spaces.
Speaker:So it's about recognising that we are
Speaker:at a really exciting moment,
especially when you think
Speaker:about kind of artificial intelligence
Speaker:and immersive environments
and kind of the co-presence
Speaker:that I mentioned.
Speaker:But we are also at a tipping point
Speaker:where we've got an opportunity
here not to perpetuate
Speaker:the pains and the harms of the past,
Speaker:and the present into the future.
Speaker:And actually I'm fearful,
definitely fearful
Speaker:that, that is exactly what we're doing.
Speaker:That they're baked into the new systems
Speaker:that are gonna kind of
affect all of our futures.
Speaker:So I think it's vital that we
talk about this more widely
Speaker:than just in tech spaces
at this tipping point
Speaker:that we are in.
Speaker:So that we can be very
deliberate about the spaces,
Speaker:about the data, about the kind of ways
Speaker:in which we are deciding
to commune with each other
Speaker:in these new spaces.
Speaker:Because deliberation, we
have to be deliberate,
Speaker:or we're just gonna end up
with an even worse situation
Speaker:than we have now.
Speaker:- Thank you. And then Emilie and David,
Speaker:just specifics about your areas
Speaker:where you are most reflective and careful
Speaker:in your particular cases. Emilie.
Speaker:- I think it always comes
down to patient safety
Speaker:and I know that's sort of a
kind of nuts and bolts answer,
Speaker:but to speak to any other parts
Speaker:I'd just be repeating
Alice's very sentiments,
Speaker:which I really echo strongly.
Speaker:So for me in a clinical research setting,
Speaker:it has to be
Speaker:about that kind of more...
- Sure.
Speaker:- You know, a very kind
of pragmatic answer
Speaker:to keep it short...
- No, that is, yeah,
Speaker:important though.
Speaker:And David, anything
specific from your area?
Speaker:- I think most have been said,
Speaker:but I think especially like incorporating
Speaker:because like this technology is like,
Speaker:I don't wanna say it's a
global north technology,
Speaker:but it is like predominantly
in a certain field,
Speaker:certain people, can all think
Speaker:who those kinds of people are.
Speaker:And I think like the challenges
we've been facing now
Speaker:that have happened a hundred years ago,
Speaker:which like inequalities
we're still facing,
Speaker:I think with technology,
for me being in the space,
Speaker:looking around who's in the
space, being in the tech space
Speaker:with XR, like seeing like
the digital literacy,
Speaker:like if we don't design the right way
Speaker:and we don't incorporate the global south,
Speaker:I think we're gonna have a big challenge
Speaker:of like in a hundred years from now,
Speaker:looking back at this time
that we didn't incorporate
Speaker:the global south or certain
people with certain backgrounds
Speaker:to make this an inclusive technology.
Speaker:And then a hundred years from now,
Speaker:we'll just like try to solve the problems
Speaker:that we start here.
Speaker:So like looking at the
past, looking into future,
Speaker:then that's something
Speaker:that I think we should be really aware of.
Speaker:- Thank you. Thank you very much.
Speaker:Really important point everyone.
Speaker:(bright music)
Speaker:So we're almost out of
time, but before we finish,
Speaker:I'd like to end on something a bit fun.
Speaker:A lot of what we've talked about today
Speaker:would've seemed like science
fiction just a few years ago.
Speaker:So I'd like you to tell me,
Speaker:if you could bring one
thing from science fiction
Speaker:into reality, what would it be?
Speaker:David.
- Something from science
Speaker:into reality.
Speaker:I feel like we could have a time machine.
Speaker:- Time machine...
- Would be great.
Speaker:- Alice.
Speaker:- Oh, I've seen it happen too many times.
Speaker:People are looking through science fiction
Speaker:and making it real.
Speaker:So I would just say I
would like those tech bros
Speaker:to start reading (indistinct)
Speaker:rather than the other science fiction
Speaker:that they seem too well versed in.
Speaker:- And Emilie.
Speaker:- I'd go for the Star
Trek universal translator
Speaker:and if I could extend
it to animals as well,
Speaker:I think that would just...
- Oh.
Speaker:- Fascinating.
- That's so nice.
Speaker:- So if you're listening to this,
Speaker:we'd love to hear your own
science fiction wishes.
Speaker:You can add that to the comments.
Speaker:I'd really like to thank David, Emilie,
Speaker:and Alice so much for joining me today.
Speaker:And thank you very much for listening.
Speaker:You can find out more information
Speaker:and links to resources at our website,
Speaker:which is DementiaResearcher.NIHR.AC.UK,
Speaker:and do also visit our community app
Speaker:where we continue these conversations
Speaker:and share new events, blogs, and podcasts.
Speaker:So my name is Byron,
Speaker:and you've been listening to
the Dementia Researcher podcast
Speaker:and from all of our guests, goodbye.
Speaker:- [Narrator] The Dementia
Researcher Podcast was brought
Speaker:to you by University College
London with generous funding
Speaker:from the UK National
Institute for Health Research,
Speaker:Alzheimer's Research UK,
Speaker:Alzheimer's Society,
Alzheimer's Association,
Speaker:and Race Against Dementia.
Speaker:Please subscribe, leave us a review
Speaker:and register on our
website for full access
Speaker:to all our great resources.
Speaker:DementiaResearcher.NIHR.AC.UK.