Artwork for podcast MSP [] MATTSPLAINED [] MSPx
Computers Are Useless: The Problem With Answers
Episode 19217th January 2022 • MSP [] MATTSPLAINED [] MSPx • KULTURPOP
00:00:00 00:27:05

Share Episode

Shownotes

Is it too late to contain the spread of AI? As experts debate the development of truly super intelligent machines, the next generation of machine intelligence is already creating answers to questions we can only guess at. 

Hosts: Matt Armitage & Richard Bradbury 

Produced: Richard Bradbury for BFM89.9

Episode Sources: 

www.descript.com

https://www.youtube.com/watch?v=bHIhgxav9LY&t=585s

https://www.newscientist.com/article/mg25233651-900-2021-in-review-ai-firm-deepmind-solves-human-protein-structures/

https://www.theguardian.com/technology/2022/jan/09/are-we-witnessing-the-dawn-of-post-theory-science

Listen:

The music that made this episode: https://open.spotify.com/playlist/5o85xTNsPrQ2PWH8n2RanP?si=211f46a9cef846e9

Follow us:

www.kulturpop.com

https://www.instagram.com/kulturpop/ 

https://twitter.com/kulturmatt

Transcripts

Matt:

Cyber attackers.

Matt:

Aren't a priority until your company is number one on their head list.

Matt:

Vulnerabilities can be ignored until one makes your business.

Matt:

The front page news, secure your business digital future with silk on

Matt:

cyber threat by Telefonica tech, the complete cybersecurity service with

Matt:

round the clock monitoring and detection.

Matt:

Get serious about cyber security.

Matt:

Find out how only at Cellcom business.

Matt:

This is a download from BFM 89.9.

Matt:

The business station.

Rich:

Eight to 9.9, the business station.

Rich:

My name is rich, Brad Bri.

Rich:

And, uh, this is Matt explained, is it too late to contain the spread of

Rich:

AI as experts debate the development of truly superintelligent machines

Rich:

and the role that they should take in our societies, algorithms are already

Rich:

controlling and influencing our presence.

Rich:

The next generation of machines is poised to take scientific discovery

Rich:

beyond the point where we can do anything, but accept its conclusions.

Rich:

But all those predictions as diet as they sound AI.

Rich:

One of the things we come back to most often on this show

Rich:

was 20, 21, a big year for AI.

Rich:

Hey,

Matt:

rich.

Matt:

It's a difficult question to answer.

Matt:

Not because there hadn't been huge advances in the field, but because of the

Matt:

way we think about it, we tend to think of AI as this standalone discipline, which.

Matt:

But it's also part of so much of our daily lives to one of the biggest smartphone

Matt:

developments in recent years has been embedding AI into our devices, which

Matt:

means that for all kinds of services, from photo processing to digital assistance, to

Matt:

voice transcription, the devices no longer have to send the files to the cloud to

Matt:

process you don't need a data connection.

Matt:

It's all done on your own.

Matt:

But that isn't something you really notice unless you notice the speed

Matt:

jumping processing it provides.

Matt:

And that's quite common with a lot of AI applications.

Matt:

They aren't, things we're aware of.

Matt:

They happen in the background.

Matt:

We see the big stories about the AI that is teaching itself to design or program.

Matt:

Or beating chess masters.

Matt:

What we don't notice are the chat bots that take our initial

Matt:

queries and seamlessly pass them onto a human operator.

Matt:

If our request exceeds its program parameters and the numerous other

Matt:

incremental advances that blur the lines between machine and human.

Matt:

Has there been something that's particularly notable for you?

Matt:

Of course it's long been my dream to create a synthetic version of

Matt:

myself that can exist in the cloud.

Matt:

My ultimate aim would be to do these shows with no human input whatsoever.

Matt:

This year.

Matt:

I've tried out a few of those AI story and text generators with mixed results.

Matt:

A lot of the time, the text they generated was too generic and repetitive.

Matt:

It didn't really save time or effort as to be useful.

Matt:

They had to be extensively replaced or rewritten in terms of

Matt:

my voice and personality though, the results have been better.

Matt:

It helps that my personality is rather mechanical at the best of times.

Matt:

Some listeners may remember that rich and I did an AI voice test.

Matt:

Last year, we uploaded our voice prints to a service called a script, and we

Matt:

recorded a segment of the show using those synthetic versions of our voices.

Matt:

Their app has made enormous developments over the last 12 months.

Matt:

In fact, What you are listening to now.

Matt:

And what you've been listening to for the past few minutes has been

Matt:

machine generated from texts that the frankly inferior human version

Matt:

of Matt has forced me to read.

Matt:

Okay, this is me again, by the way, uh, the mat, rather than the, uh, the map

Matt:

bot or rather, this is actually me for the first time today, which may be a

Matt:

disappointment for those of you who were enjoying that robot voice doppelganger.

Matt:

Uh, so I sent Richard A.

Matt:

Short clip using this new voice model.

Matt:

I think a few weeks before Christmas.

Rich:

Yeah.

Rich:

Uh, and when you sent the, I, I was in the studio, I'm doing a live show,

Rich:

uh, and I, I was between talk sets and I, I played it whilst Christine

Rich:

was in the show at the studio.

Rich:

Uh, and she was like, are you speaking to Matt right now?

Rich:

That's how scary it was.

Matt:

I really, I didn't realize that Christine actually thought it was me.

Matt:

Um, but no, I mean, that is impressive.

Matt:

And, and the same with the same with, you know, elements of the, uh,

Matt:

The voice that you've just heard.

Matt:

Some of it sounds very natural, very realistic, and other points

Matt:

you can tell it it's treated.

Matt:

But on our last episode, I think somewhere back in December, uh, we

Matt:

talked about blockchain technologies in terms of the way that they've become

Matt:

this enormous hype machine, you know, Linked to wild financial speculation.

Matt:

And that has been one of the more dominant tech stories, I think over

Matt:

the past 12 months, uh, coupled of course, with the, the misdirection,

Matt:

I guess, of the metaverse both of which as the map bought helpfully

Matt:

points out, have rather drowned out.

Matt:

What's been happening in terms of artificial intelligence is

Matt:

especially as we got to the latter part of the year where we started

Matt:

to see these stories coming out.

Matt:

Well, once again, predicting all of the dangers of super smart AI.

Matt:

So anyone wanting to go into sort of more detail about that and with the speaker a

Matt:

lot more learned and informed than I am.

Matt:

Uh, I direct them to the BBC's rife lectures.

Matt:

I think I've said that right.

Matt:

Brief or rife, R E I T H, which you can find online there.

Matt:

Podcast stream, but they're also on the BBC website this year, Stewart

Matt:

Russell, who is a professor of computer science and the founder of the center

Matt:

for human compatible, artificial intelligence at the university of

Matt:

California, Barkley academics are terrible at coming up with names for that.

Matt:

Yeah, right?

Matt:

Yeah.

Matt:

He gives four lectures around the theme of living with AI.

Matt:

He talks about AI and the fears that we have, uh, he talks about it and the.

Matt:

Influencing economic activity, but he also talks about its increasing

Matt:

military and policing roles.

Matt:

And I think the final one is about how we can actually find ways

Matt:

to coexist with these systems.

Rich:

Uh, and, and Ukraine, we, we, we still have nothing.

Matt:

I don't know if it's so much that we have nothing to fear.

Matt:

It's just about how we shape those decisions.

Matt:

You know what AI does, what we allow it to become.

Matt:

So it's also a bit like those metaverse conversations that we had last year

Matt:

at the moment, there is no metaverse, uh, we can have those discussions.

Matt:

We can try and define it, but companies like Facebook, sorry.

Matt:

Metta are jumping into that conversation.

Matt:

Now they're telling us.

Matt:

What they want it to be.

Matt:

So we need to have those conversations around, I guess,

Matt:

big AI for want of a better term.

Matt:

What we aren't having, uh, are those conversations about the, uh, the

Matt:

algorithms and how those dumb AI systems are sweeping through our

Matt:

world and the uses that companies and governments are actually putting them to.

Matt:

And as I just demonstrated with.

Matt:

My voice clips, it's perfectly possible to create a reasonably convincing deep, fake

Matt:

voice and direct it to say what you want, because all I did was type those words in,

Matt:

but are there enough safeguards in terms of what those systems can actually do?

Rich:

Um, are you referring to the, uh, Alexa challenge story?

Matt:

Well, yeah, that one's specifically.

Matt:

So in case you haven't heard of this story, it was a report from

Matt:

the BBC in late December that a 10 year old child had been at home.

Matt:

She'd been doing some physical education challenges on YouTube because you know,

Matt:

it's Britain, the weather was bad, so she couldn't go and play outside.

Matt:

When she asked her Amazon echo speaker to give her another

Matt:

challenge, it told her to try pulling.

Matt:

An electric socket, the plugs slightly out of the wall and

Matt:

touch a coin to one of the prongs.

Matt:

Now in case.

Matt:

I need to say it.

Matt:

That is a potentially lethal activity.

Matt:

Nobody should ever try that.

Matt:

It can give you a massive electric shock.

Matt:

And it was a trend that surfaced briefly on social media and was

Matt:

quickly removed about a year ago.

Matt:

But somehow the girl's Alexa assistant reference those reports about the

Matt:

challenge and her echo speaker.

Matt:

Happily told her to try it.

Matt:

Thankfully, her mother was with her at the time.

Matt:

And her mother also added in the report that her daughter is too

Matt:

sensible to do anything that daft.

Matt:

And of course, Amazon quickly patched the issue once they were made aware.

Matt:

But that's kind of the problem it's that the users have to tell the owner

Matt:

of the technology in this case, Amazon, that something has gone wrong with the

Matt:

information that the AI is actually.

Rich:

Isn't that normal though.

Rich:

I mean, we buy something, it doesn't work.

Rich:

And we tell the retailer or manufacturer that there's something wrong with it.

Rich:

Um, can't we put that down to something like a faulted device or a system error.

Matt:

Well, I think that's really the crux here because the AI didn't malfunction,

Matt:

there was nothing faulty about it.

Matt:

What the algorithm lacked was the ability to contextualize it.

Matt:

You know, it was asked and it was answered.

Matt:

It found a challenge, it delivered it.

Matt:

So as far as the Alexa was concerned task done.

Matt:

Right.

Matt:

So as I said, the AI didn't malfunction.

Matt:

It wasn't faulty.

Matt:

It was that ability to contextualize.

Matt:

But what was lucky was that this happened to a relatively sensible young girl

Matt:

and there was the double protection that her mother was actually present.

Matt:

What

Rich:

we're seeing is that AI is still very much an

Rich:

experimental and developmental.

Matt:

Well, yes, to the machine.

Matt:

The experience with the girl is an exercise, a driving assistance software.

Matt:

For example, that causes an accident, uh, causes harm, or even death to

Matt:

the cars, occupants or road users will learn from that experience so

Matt:

that it hopefully won't be repeated.

Matt:

You know, there are all sorts of ways to train artificial intelligence.

Matt:

Adversarial networks where two or more versions of the

Matt:

software challenge, each other.

Matt:

That's one, uh, neuron networks where no implicit instructions are given.

Matt:

That's another very often.

Matt:

And in the real world, at least AI learns from its experiences

Matt:

and interactions with us.

Matt:

And it's interesting because one of the backdrops to the last 12

Matt:

months has been the development of new vaccines for COVID, which many

Matt:

people are unwilling to take before.

Matt:

Of the fact that they are new and to their minds, new equates to

Matt:

experimental and experimental.

Matt:

In their minds means not safe yet.

Matt:

We embrace these truly experimental machine tools, these artificial

Matt:

intelligence and put them to work in our everyday lives.

Matt:

But what safety tests have they been put through what government bodies,

Matt:

what organizations have approved these machines as being fit for purpose?

Rich:

So, um, is there a frame of reference off kilter then when it

Matt:

comes to that?

Matt:

Well, I think that's where the vaccine analogy is actually quite useful.

Matt:

If you flip the narrative a little, it would be easy to frame artificial

Matt:

intelligence in terms of a global pandemic in the Terminator movies.

Matt:

We believe that Skynet is a threat because it's self aware, but really

Matt:

that's not the biggest problem.

Matt:

Skynet is a threat because it's everywhere.

Matt:

It's.

Matt:

Every system, it is an infection.

Matt:

And that's the situation that we approach today.

Matt:

These little bits of code are everywhere.

Matt:

Uh, having said that I don't believe AI is a pandemic.

Matt:

I'm just trying to make that point.

Matt:

You know, these are complex machines and the majority of

Matt:

people don't understand that.

Matt:

In any real or kind of coherent way.

Matt:

And because of that lack of understanding, we often miss the point that though they

Matt:

are assisting us, they're incapable of understanding us machine intelligence

Matt:

can be guided by human responses.

Matt:

You know, it can be guided by how many people react in a certain way to a

Matt:

certain set of actions or circumstances.

Matt:

Something we'll talk about more after the break, but it doesn't

Matt:

ascribe an immoral weight to it.

Matt:

You know, it looks at murder as being bad because one of its parameters

Matt:

says it is, or because it finds it's relatively uncommon in terms of frequency.

Matt:

Yet these are still the tools that we allow to sit.

Matt:

Unsupervised in a smart speaker in a kid's bedroom, but these machines

Matt:

are choosing what news we see.

Matt:

They guide our purchasing decisions.

Matt:

They help to manage investment portfolios.

Matt:

Yet we haven't the slightest idea why these very stupid and limited pieces

Matt:

of code actually do what they do.

Rich:

After the break artificial intelligence and the end of all things you

Rich:

tune into mansplained here on BFM 89.9.

Rich:

The business station.

Matt:

Stay tuned to tech top brought to you by Cellcom the stairs.

Matt:

Be financially minded BFM 89.9.

Matt:

Tech-Talk brought to you by Cellcom business.

Matt:

Uh,

Rich:

BFM 89.9.

Rich:

The business station.

Rich:

My name is rich bribery.

Rich:

Welcome back.

Rich:

Mansplained if 2021 was a year that we started to reconsider our relationship

Rich:

with AI could 2020 to be the year that AI makes knowledge irrelevant.

Matt:

Well, you know, one of the best things about this digital world is the

Matt:

amount of knowledge that we all have.

Matt:

You know, with a few clicks, we can find out pretty much.

Matt:

Anything, you know, you can find out how to drill a hole in

Matt:

a world without electrocuting yourself or flooding your home.

Matt:

That probably tells you a lot about me.

Matt:

Uh, you can find out why cold fusion just won't work and you can research how

Matt:

aerosol particles disperse by watching some Australians drop paint field exercise

Matt:

balls off a giant tower onto a giant ax.

Matt:

But one of the drawbacks is that we have developed this

Matt:

tendency to treat information.

Matt:

A bit like a pub quiz.

Matt:

We can reel off these impressive lists of facts without necessarily

Matt:

having developed a corresponding sense of understanding to accompany them.

Rich:

These shows certainly wouldn't be possible without the internet.

Matt:

Well, as it's the first show of the year, um, Take that as any kind of

Matt:

insult and it's true and not just for me, but I imagine BFM would need an enormous

Matt:

staff, producers and researchers, and fact checkers without the internet.

Matt:

You know, it's hard to think back to that old world of just a couple of

Matt:

decades ago, where you had to go to libraries, you have to order books,

Matt:

you had to painstakingly troll through.

Matt:

Physical copies of newspapers and old publications, just to find something

Matt:

that might make, you know, a sentence or two or a quick aside, w which isn't

Rich:

to say that you can't find in-depth information

Matt:

online?

Matt:

No, of course not.

Matt:

You know, the ability to publish all kinds of research online has enabled us

Matt:

to create this vast commons of knowledge.

Matt:

And sure, not all of it is free.

Matt:

You might find papers and journals behind paywalls, but there is usually a synopsis.

Matt:

And very often you'll find that there's someone somewhere who's done an

Matt:

explainer video or written an article.

Matt:

I mean, I don't know how many of our listeners follow the YouTube

Matt:

channels, like, uh, very Tassian where you'll find really complex physics

Matt:

and maths and computational science.

Matt:

So.

Matt:

AI explained, but done in really engaging ways, including using rented helicopters.

Matt:

You know, one of the great mysteries of the modern age is how electricity works by

Matt:

which, I mean, how does the power that's generated, you know, dozens of kilometers

Matt:

away, turn on lights and make devices.

Matt:

In our homes and I'm not shown to stay, uh, that when I watched a very Tassian

Matt:

video about electricity, there was lots of stuff in there that I didn't

Matt:

know, particularly when it comes to the idea of why as being stuffed with

Matt:

electricity, they aren't, it's about the magnetic, the electromagnetic fields.

Matt:

They create.

Matt:

So we have this weird combination of being able to learn the answers

Matt:

without knowing the, working this out or having that deeper understanding

Matt:

of what the answer actually means.

Matt:

And that takes me to my favorite Hitchhiker's guide analogy,

Matt:

the supercomputer deep thought.

Matt:

Which determines that the answer to life, the universe and

Matt:

everything is 42, of course, which is a completely useless answer.

Matt:

So it designs another far more complex computer to determine

Matt:

what the question actually is.

Matt:

Okay.

Matt:

Kind of the stage that we're getting to with AI right now.

Matt:

Yeah.

Matt:

We're using it to compute more and more complex ideas to run simulations

Matt:

and experiments at speeds, that human researchers simply can't.

Matt:

And we saw that with the development of the COVID vaccines

Matt:

with AI being used to do.

Matt:

Potential candidates, which shortcut a lot of the trial and error work that using

Matt:

traditional methods could have led us to spend weeks or months or even years doing.

Matt:

And we're also seeing it in one of 20, 20 ones, most remarkable AI breakthroughs.

Matt:

And again, you know, Lincoln.

Matt:

You might have missed it.

Matt:

A deep minds, alpha fold network, which mapped all the proteins in the human body.

Matt:

Something human researchers have spent decades doing, and they managed to

Matt:

identify less than 20% of those profiles.

Matt:

Those proteins, uh, alpha fold, I think brought it up to about 98.5%.

Matt:

So the hope is that, um, machines that are four-fold will enable us to develop

Matt:

personalized medicines, treatments that bind to specific parts of molecules

Matt:

to, to quote the new scientist.

Matt:

But we largely in the dark as to why machines like alpha

Matt:

fault, make the predictions.

Matt:

They do a to quote a guardian article by.

Matt:

Laura Spinney called, are we witnessing the Dawn of posts, theory science.

Matt:

You can't lift a curtain and peer into the mechanism because there

Matt:

isn't a set of workings out that you can extract and look at.

Matt:

Is this

Rich:

partly a data?

Matt:

Of course, I mean, otherwise, you know, why talk about it on a tech show,

Matt:

but, um, you know, machine learning can, uh, both generate an output, you

Matt:

know, vast tranches of data and that changes theories or at least the shape

Matt:

of the theories at a conceptual level.

Matt:

Uh, Laura Spinney quotes, Tom Griffiths, a psychologist at Princeton

Matt:

university who says, you know, these theories, uh, that make sense.

Matt:

When you have huge amounts of data, look very different from the ones that make

Matt:

sense when you only have small amounts.

Matt:

So you're back to that deep thought problem.

Matt:

The issue isn't the answer.

Matt:

The machines can give us the answer in ways that are easy for

Matt:

us to digest, but we no longer truly understand the question.

Matt:

I

Rich:

mean, it's always a dangerous question to ask though.

Rich:

Does it matter?

Matt:

Well on one level, no, you know, perhaps we're getting to

Matt:

that stage in our development as a species where we don't need to know

Matt:

the questions behind the answers.

Matt:

Uh, science fiction is full of stories about machine dependent species that

Matt:

suddenly adrift when that machinery fails and they realize, you know, they don't

Matt:

really have any basic life skills anymore.

Matt:

You know, they don't know how the lights work.

Matt:

They don't know.

Matt:

I mean, You know, they simply can't do anything, but at the same time,

Matt:

you can argue that as a species, we can only progress so far.

Matt:

If we insist on controlling all of the processes by which we get information,

Matt:

you know, we, we can't really talk about the superintelligence of the future

Matt:

at this point, at least in terms of.

Matt:

Abilities, but we can talk about machines.

Matt:

We have now, especially in terms of the data that we feed it.

Matt:

And that data is often a weakness.

Matt:

We've talked so often on the show about how data sets and AI can lead

Matt:

to unusual and unpleasant outcomes.

Matt:

And there was that example of course, of the coin and the plug

Matt:

in the first half of the show,

Rich:

those larger issues of distortions as a result of, uh, bias

Matt:

datasets.

Matt:

Certainly, you know, we've seen racial profiling and bias being baked into data.

Matt:

AI concluding that it's better to hire men in senior positions because most

Matt:

senior positions are occupied by men.

Matt:

Uh, in medicine, this is particularly important because women are non-European.

Matt:

Under represented in a lot of medical tests.

Matt:

And there's the classic case of medications being developed for

Matt:

women being tested entirely on men, because it was thought that

Matt:

menstruation would affect the testing.

Rich:

Are we seeing.

Rich:

Same course to limit how involved AI becomes in the

Rich:

process of, uh, discovering the,

Matt:

I mean, I don't think so.

Matt:

As we've noted before, uh, AI, as it currently stands is usually an assistive

Matt:

tool rather than a truly independent one.

Matt:

And what's exciting in some researchers is the ability of the machines.

Matt:

Demonstrate when the theories that we have are too simple.

Matt:

When we talk about machines, looking at things in different ways, you

Matt:

know, it's often said with the implicit assumption, that our way,

Matt:

the human way is the right way.

Matt:

And there are often limitations in terms of the way that we formulate ideas and

Matt:

theories, uh, quoting Tom Griffiths again, uh, his team did a piece of research

Matt:

on risky behavior, taking the new.

Matt:

The Princeton team used predicted the outcomes that people would

Matt:

choose in various scenarios with quite a lot of accuracy.

Matt:

But it also helped highlight where the initial theory broke down or where

Matt:

it was insufficient, which was the point where we become overwhelmed by

Matt:

possibilities and switch to simpler or competing strategies to make decisions.

Matt:

So these larger data sets allow the machine to come up with much more

Matt:

complex strings of possibility.

Matt:

You know, we tend to look at things in terms of if this, then that.

Matt:

But we can only hold those in our heads up to a certain point.

Matt:

The machine can calculate these strings almost indefinitely and

Matt:

produce likely outcomes for situations that we can't even conceive.

Rich:

Is that enough for as though.

Rich:

Do you think humans can, can live in a world of correlations

Rich:

rather than knowledge?

Matt:

Well, that certainly is the bigger question.

Matt:

You know, we can improve an enlarge datasets to overcome

Matt:

some of those implicit biases.

Matt:

We may be able to accept that.

Matt:

Certainly in terms of medicines, it's more important to have the.

Matt:

But to know how we reach them, but whether it's enough for us just to have

Matt:

the answers, that's difficult to answer, you know, that's a much more metaphysical

Matt:

issue, human history, human development.

Matt:

It's about that search for information.

Matt:

It's part of that obsession that people like Elon Musk have with pursuing the

Matt:

question of whether humankind can live and settle and thrive on other planets.

Matt:

You know, and turning that into a reality.

Matt:

It's why we have all those concepts in mathematics that most of us

Matt:

thought were useless and we'd never use in our daily lives.

Matt:

So perhaps we can develop machines.

Matt:

Better at informing us how they arrived at those answers or machines that are

Matt:

better at framing them in ways that are familiar to us and more comfortable.

Matt:

But there's also the argument that humans are needed for that spark of

Matt:

creativity and for their intuition.

Matt:

But machines like DeepMind have started to make their own intuitive

Matt:

leaps machines are also creating.

Matt:

Writing stories, poems and articles, making videos.

Matt:

They're not always coherent, but it is going to be interesting to see

Matt:

the DeepMind equivalent of the apple falling on Newton's head and finding

Matt:

out where that process takes us.

Matt:

Um, Laura spinny.

Matt:

Picasso, who said, I think in the 1960s, computers are useless.

Matt:

They can only give you answers.

Matt:

And while there is a truth to that, that I think people like Douglas

Matt:

Adams and of course deep thought would appreciate we can apply the ingenuity

Matt:

and creativity that characterize humans to those machine derived answers.

Rich:

Fantastic.

Rich:

Thanks for that, Matt.

Matt:

Thanks, Richard.

Matt:

Uh, it's been a while since I've been on actually.

Matt:

Yeah, it

Rich:

has now.

Rich:

Um, you can find me on Instagram and Twitter at culture mat.

Rich:

You can also head over to culture, pop.com for transcripts of these

Rich:

shows and information about culture pop and it's consulting services.

Rich:

If you missed any part of this show, don't forget.

Rich:

You can download the podcast wherever you normally download it from.

Rich:

We recommend the BFM app it's available from the apple app store.

Rich:

I'm rich, Brad Bri for BFM 89.9.

Matt:

Tank top was brought to you by SOCOM business.

Matt:

Get serious about cybersecurity and secure your businesses.

Matt:

Digital future at dot dot com.my thank you for listening to this podcast.

Matt:

To find more great interviews, go to BFM dot mine or find us on iTunes BFM 89.9.

Links

Chapters

Video

More from YouTube