Artwork for podcast HockeyStick Show
HockeyStick #4 - The Complete Obsolete Guide to Generative AI
Episode 422nd April 2024 • HockeyStick Show • Miko Pawlikowski
00:00:00 01:05:45

Share Episode

Shownotes

The Future of Generative AI: Insights with David Clinton

Miko Pawlikowski hosts an engaging conversation with David Clinton, author of 'The Complete Obsolete Guide to Generative AI' and numerous technical books. They delve into the significance of generative AI, its current impact, and its potential to revolutionize various fields. Clinton shares his extensive experience as an author, discussing the rapid evolution of AI and its implications for traditional publishing, technical writing, and more. The discussion also explores broader topics, including AI's role in content creation, potential effects on industries like accounting and publishing, and the future of AI technology. Throughout, there's a focus on the blend of technology and creativity, the importance of adaptation, and contemplation on what the widespread adoption of AI means for society at large.

00:00 Welcome to Hockey Stick: The Generative AI Revolution

00:22 Meet David Clinton: A Serial Author in the Tech World

00:41 The Impact of Generative AI on Technology and Life

00:58 David Clinton's Prolific Writing Career and AI's Role

05:13 Generative AI: Transforming Industries and Professions

09:11 The Future of AI: Opportunities, Challenges, and Predictions

24:08 Generative AI vs. Traditional Technologies: A Comparative Analysis

26:36 Exploring Alternatives in AI and the Future of Search Engines

29:55 Elon Musk's Ventures and the Future of AI

32:18 Exploring the Timeliness of Technological Predictions

32:33 Why Now? The Sudden Surge in AI and Technology

33:18 The Integration Revolution: From Discrete Tools to AI Agents

35:05 The Role of Data Availability in AI Advancements

36:26 The Legal and Ethical Quandaries of AI Development

43:29 The Practical Uses and Limitations of Generative AI

52:51 The Future of AI: AGI, Quantum Computing, and Regulation

57:05 Reflecting on the Journey: AI's Impact on Content Creation

01:00:49 Navigating the New Era: AI's Role in Writing and Publishing

Transcripts

Speaker:

I'm Miko Pawlikowski, and this is Hockey Stick.

Speaker:

Generative AI is eating the world just like software and

Speaker:

the internet did before it.

Speaker:

Probably everything you read and see today is at least in part

Speaker:

generated or touched up by AI models.

Speaker:

Revolutions tend to happen fast, but this one feels faster

Speaker:

than anything I've seen before.

Speaker:

Today, I'm joined by David Clinton, the author of the playfully named book" The

Speaker:

Complete Obsolete Guide to Generative AI".

Speaker:

He's a serial author of technical books, including titles like

Speaker:

"Linux in Action", "Linux Security Fundamentals", "Ubuntu Linux Bible",

Speaker:

"AWS Study Guides", and more.

Speaker:

When interrogated, he admitted to a dozen titles.

Speaker:

In this conversation, we'll cover why Gen AI, not to be confused with

Speaker:

Gen X, is such a big deal, why it's happening right now, what breakthroughs

Speaker:

made it possible, and how you too can incorporate it in your life right now.

Speaker:

And become more productive right away.

Speaker:

Welcome to this episode and please enjoy.

Speaker:

David, before I even met you, you've already given me a lot of trouble, because

Speaker:

for most of my guests I can more or less describe them in three sentences.

Speaker:

With you, on the other hand, I started looking up the books that you

Speaker:

wrote, and I can't even count them.

Speaker:

And, spoiler alert, David, I'm not sure he knows himself, because in one of

Speaker:

the chapters of his book, we're going to talk about, "The complete obsolete

Speaker:

guide to generative AI", he's asking ChatGPT to count the books that he's

Speaker:

written and ChatGPT doesn't know either.

Speaker:

So David, how many books have you written at this stage?

Speaker:

it depends.

Speaker:

Are you talking about the books under this name or under other names?

Speaker:

wow.

Speaker:

Okay.

Speaker:

Including your all other alter egos.

Speaker:

Yeah, but at least the ones with my own name, David Clinton,

Speaker:

various editions, maybe a dozen.

Speaker:

"Linux in action".

Speaker:

"Linux security fundamentals", Ubuntu Linux Bible".

Speaker:

I think you co-authored that one.

Speaker:

And there's a lot of study guides as well.

Speaker:

the Wiley study guides.

Speaker:

By the way, being a Wiley author, makes me a colleague of Herman

Speaker:

Melville, the author of "Moby Dick", because Herman Melville's publisher

Speaker:

was John Wiley himself 200 years ago.

Speaker:

The company somehow has survived 200 years.

Speaker:

And the chairman is still a Wiley.

Speaker:

It's Jesse Wiley now it's absolutely amazing how they've

Speaker:

survived and managed to adjust.

Speaker:

There wasn't a lot of AWS, training content necessary, required back

Speaker:

in the 1820, but, they seem to have adjusted and found new places.

Speaker:

However, maybe near the end of this run, because one of the, niches,

Speaker:

that generative AI is already eating is, technology training books wide

Speaker:

by a technology training book.

Speaker:

if, GPT can tell you exactly what you want to know right now.

Speaker:

Wow.

Speaker:

So that's reason enough to go via Wiley.

Speaker:

Did you prefer Wiley to Manning?

Speaker:

What's your favorite publisher at this stage?

Speaker:

They're very different.

Speaker:

and I like them both, each in their own way.

Speaker:

Manning is very demanding from an editorial process perspective.

Speaker:

And they take a long time on everything.

Speaker:

A long time.

Speaker:

That's why the book is called "Obsolete...".

Speaker:

they're good.

Speaker:

They put out a great product.

Speaker:

Wiley has a much lighter hand from an editorial perspective.

Speaker:

and, they have, excellent connections in the industry as much as possible

Speaker:

to move books in large numbers, and they're a solid, reliable company.

Speaker:

But they each have their value and each have the things they do best.

Speaker:

before I even opened the book, from the title I got the hint that it was going

Speaker:

to be a fan book, "The ,Obsolete Guide".

Speaker:

by the way, I'm still not sure how you passed that by the Manning

Speaker:

editorial team and how did they

Speaker:

too, they loved it right away, actually, I was really surprised I

Speaker:

threw that out I was angry with them.

Speaker:

They were taking so long.

Speaker:

So I just threw that title out and they actually bought it and they went with it.

Speaker:

that's remarkable.

Speaker:

So why did you write this book?

Speaker:

I read the book and, you basically put in there a legend slash myth, about

Speaker:

how they effectively told you to stop pestering them about using generative AI

Speaker:

and just write a book about it already.

Speaker:

is that the short version of what happened?

Speaker:

it's close enough, as far as I can remember.

Speaker:

we've had a good relationship for many years and, they've sometimes

Speaker:

asked me to do things I didn't want to do, and sometimes I've pitched

Speaker:

ideas to them they didn't want.

Speaker:

this one we were talking about on and off over a year, we were talking

Speaker:

about generative AI in different contexts, and then, they wanted to

Speaker:

invest heavily in generative AI as far as their books and other content.

Speaker:

They didn't want to get left behind, which is a very smart decision.

Speaker:

So a year ago, they were looking at publishing 10, 15, 20 books in

Speaker:

general topic of generative AI.

Speaker:

And they knew I was someone who thought a lot about it, so they

Speaker:

were pushing me to do something.

Speaker:

and I was pushing them to go away because I didn't think they could move

Speaker:

fast enough for this particular market.

Speaker:

somehow, I don't remember exactly how, but we latched on to this

Speaker:

project and, so far it's sold relatively well in its pre-MEAP sales.

Speaker:

sold about 1100 copies, so far.

Speaker:

And this is, before it's published and before it hits Amazon.

Speaker:

we can always, we can always hope.

Speaker:

And, but I'm not disappointed.

Speaker:

The process, has been reasonable, if way too long.

Speaker:

let's jump to the main question then.

Speaker:

why is generative AI such a big deal at the moment?

Speaker:

It's upending everything.

Speaker:

almost everything.

Speaker:

There are people who do things with their hands, who build the world

Speaker:

and keep the world going, they're in an excellent position and they're

Speaker:

still keeping the world going.

Speaker:

But everybody else is at risk.

Speaker:

but then again, 200 years ago, in the Industrial Revolution, we had the

Speaker:

same fears that there were certain mechanical tools and processes were

Speaker:

genuinely predicted and incorrectly predicted to be about to replace

Speaker:

the vast majority of labor.

Speaker:

And what would all those laborers do?

Speaker:

But it actually worked out quite well.

Speaker:

there wasn't mass starvation as a result of the industrial revolution.

Speaker:

There are other issues, political issues, but not the industrial revolution issues.

Speaker:

And, the economy and the market somehow reached an equilibrium and settled.

Speaker:

and as, progress has been significant in the last 200 years, probably

Speaker:

we're going to see something similar.

Speaker:

There's going to be huge upheaval.

Speaker:

Generative AI can do things that highly skilled people were necessary for 5

Speaker:

years ago, and are no longer necessary.

Speaker:

the things I do, I never truly understood why people bought my books.

Speaker:

like "AWS Solutions Architect Study Guide".

Speaker:

where did they think I got my information for writing the book?

Speaker:

I got it from the internet, right?

Speaker:

Like everybody else.

Speaker:

And if I could have gotten it from the internet, why doesn't everybody else?

Speaker:

I'm not saying you shouldn't buy the book, of course you should.

Speaker:

But, I just don't understand why.

Speaker:

if you're just willing to invest a little bit of research time,

Speaker:

you can get everything I got.

Speaker:

I'm gonna be replaced.

Speaker:

At least that part of what I do.

Speaker:

And, it's scary.

Speaker:

For good reason.

Speaker:

And it's, exciting.

Speaker:

And it is a big deal.

Speaker:

I don't think much of the hype is oversold.

Speaker:

This really is a big change.

Speaker:

When you were talking about construction site, I just remembered, I saw the

Speaker:

video on the internet and hopefully it's true and not AI-generated, but it

Speaker:

was basically a construction site with the scaffolding with a big banner on it

Speaker:

saying "ChatGPT finish this building".

Speaker:

they have experimented, I think, successfully already

Speaker:

with, print-on-demand houses.

Speaker:

where they can actually layer, a layer after layer of a construction material to

Speaker:

build the walls and even the ducting and some of the wiring for a house in a day.

Speaker:

it's interesting that you should mention that, because I think 3D printing, and I

Speaker:

will include the housing printing in that category, held such a premise not that

Speaker:

long ago, maybe a decade and a half ago when we were picturing everybody printing

Speaker:

anything, like in the sci-fi movies, when you just download something and then

Speaker:

you click it and a minute later you get an object, physical object, people were

Speaker:

talking about how It's going to be so dangerous because people can just download

Speaker:

a plan for a gun and print it at home, or they can do, replicas of things that

Speaker:

will be indistinguishable from truth.

Speaker:

But somehow that didn't really happen.

Speaker:

what I actually see people printing is parts for their, drones when they have

Speaker:

to go through quite a lot of propellers when they're racing them and, the

Speaker:

mandatory figurines that everybody prints when they actually buy a 3D printer

Speaker:

initially, and not an awful lot more.

Speaker:

So how do we know that?

Speaker:

Why are we so sure?

Speaker:

And that seems to be prevailing that the AI revolution that we're

Speaker:

seeing is different from that.

Speaker:

first I wouldn't say that, that, 3d printing is dead.

Speaker:

You're right.

Speaker:

it's, dormant.

Speaker:

but I think it is happening probably in niche areas where

Speaker:

it's making a difference.

Speaker:

they are printing, 3D guns, they're just not advertising it because in

Speaker:

many jurisdictions it's illegal.

Speaker:

I think that's happening probably more than we'd like.

Speaker:

so it's there and it'll find a niche, it'll probably find a market somehow.

Speaker:

However, AI I think is different, that's not to say that it's going to play out

Speaker:

exactly the way we think it will now.

Speaker:

but markets will discover, the value of AI in ways that

Speaker:

probably we haven't anticipated.

Speaker:

it's so broad and potentially complex, it won't be ignored.

Speaker:

There are too many creative people and imaginative people

Speaker:

who are focused on it now, that I can't imagine that substantially

Speaker:

transformative things won't happen.

Speaker:

I can't tell you what they'll be necessarily, I can guess.

Speaker:

but I can't believe that it won't happen.

Speaker:

This is a tool that's far too valuable to be ignored.

Speaker:

But, hey, I've been wrong before.

Speaker:

In fact, if you ever want to know how to anticipate the results of an election,

Speaker:

just ask me what I think, who I think is gonna win, and go the other way.

Speaker:

Because I'm always wrong in my predictions.

Speaker:

So you hinted a little bit at one group of people that you expect

Speaker:

to be particularly affected.

Speaker:

And you included yourself in the technical writing.

Speaker:

And I think to a certain extent I'm ready to agree with you.

Speaker:

Probably the ChatGPT version of, technical documentation is going to

Speaker:

be equally dry as the majority of the documentation that I come across myself.

Speaker:

Who do you think, who else, is at the highest, end of the possible, affection

Speaker:

of, their livelihoods effectively.

Speaker:

I wouldn't want to be a young accountant.

Speaker:

what accountants do is easily replicable by AI right now, and certainly in

Speaker:

the next few years, they, mentally process a lot of numbers and trends.

Speaker:

And of course there are a lot of accountants, different

Speaker:

accountants do different things.

Speaker:

They have different tasks.

Speaker:

But at core, they're processing data, whether it's financial data, or sales

Speaker:

data, and they're trying to, number one, organize it, so that they can

Speaker:

file their quarterly filings and their tax filings and everything, so they're

Speaker:

trying to organize the information, but also the higher level accountants

Speaker:

are anticipating where are these trends are going to affect their company,

Speaker:

the company they're working for.

Speaker:

And those are things that AI does exceptionally well already, and

Speaker:

it's only going to get better.

Speaker:

And when the time comes that they'll be integrating, accounting

Speaker:

processes into AI systems.

Speaker:

I think accountants will be looking for new work.

Speaker:

Another thing, I read an article last week by, the owner of a small

Speaker:

Canadian publisher, Sutherland House.

Speaker:

He wrote about a conference of publishers he was at sometime before, and they

Speaker:

had an AI specialist, whatever that is.

Speaker:

I guess that's me, I don't know.

Speaker:

And talking about how their industry was going to be changed.

Speaker:

And they spoke about things like, AI translation.

Speaker:

this publisher likes the idea of taking excellent European books or

Speaker:

books from all over the world that aren't written in English and have

Speaker:

proven themselves as popular and successful books in their languages.

Speaker:

But he said that translating them is expensive.

Speaker:

hiring a good literary translator Is not cheap and it's not cost

Speaker:

effective in his publishing model.

Speaker:

But, feeding the manuscript to an AI translator will get

Speaker:

you 80% of the way there.

Speaker:

And then you hire a genuine human translator to fix it, to get the last

Speaker:

20%, but it's gonna be much cheaper.

Speaker:

So those are things that are changing, but the AI specialist at this conference

Speaker:

then said, one thing, he said, you can say goodbye to all your interns.

Speaker:

And then the crowd, apparently the audience started screaming and shouting.

Speaker:

that upset a lot of people.

Speaker:

But it's probably true.

Speaker:

An intern at a publishing company, their job is to make all the

Speaker:

connections and do all the grunt work that the executives don't want

Speaker:

to do or haven't got the time to do.

Speaker:

And that's exactly the type of work, the moving information, making appointments,

Speaker:

making connections - that's exactly the sort of work that an AI can do well,

Speaker:

or will be able to do well soon enough.

Speaker:

So that junior knowledge worker is at risk.

Speaker:

And of course the problem there is that they, the new talent comes into the

Speaker:

publishing world through the interns.

Speaker:

They get interns fresh out of college and they train them up.

Speaker:

they get them to the point where they're.

Speaker:

capable of doing bigger things.

Speaker:

And if you wipe out the intern program, then you're wiping

Speaker:

out your feed of new talent.

Speaker:

That's disruptive.

Speaker:

But, how we got a publishing company justify or a government for that

Speaker:

matter, justify hiring hundreds of thousands of junior managers, if that

Speaker:

can all be replaced with software.

Speaker:

Let me challenge you a little bit on two aspects of that.

Speaker:

First of all, it's not particularly difficult to get any of these models

Speaker:

really to trip on basic arithmetics.

Speaker:

Like it's gotten a little bit better now GPT-4 that actually uses a calculator

Speaker:

instead of trying to, do the arithmetics in it's head, but it's still not

Speaker:

particularly hard to formulate it in a way that it doesn't trigger that and

Speaker:

gives you a demonstrably false answer.

Speaker:

I think you gave a few examples of that, from prior versions in the

Speaker:

book as well when you were asking about, a population, that's the

Speaker:

closest to the median in the list

Speaker:

can't remember.

Speaker:

Yeah, it's been a long time since I wrote it, but you're right,

Speaker:

definitely there have been problems.

Speaker:

Yeah,

Speaker:

So that makes me think that this is still better suited for situations

Speaker:

where you've got a lot of groundwork.

Speaker:

Like you said, the translation, for example, you can get it to be 90% good

Speaker:

and then get someone to do the last 10% and you save yourself 90%of the cost.

Speaker:

Great.

Speaker:

but is that going to work the same way with the accounting?

Speaker:

Can you get the accounts to be 90% good and then get

Speaker:

someone to check the last 10%?

Speaker:

Possibly.

Speaker:

I don't see why not.

Speaker:

they do have auditors for a reason, and they can just, adjust the role

Speaker:

of your company auditor to be looking over the shoulder of the AI rather than

Speaker:

all the, junior accountants possibly, it's hard to know how it'll play out.

Speaker:

But also as far as the errors go,

Speaker:

GPT and other AIs are prone to certain types of errors and they're working on

Speaker:

them, but, my experience with, let's say, I feed now, really large spreadsheets

Speaker:

and 400 page, corporate filings.

Speaker:

I'll feed them to GPT and, I'll get into look for anomalies and add up all the line

Speaker:

items related to this issue or that issue.

Speaker:

Basically doing SQL, requests on it.

Speaker:

it's very good and then I'll usually check it up.

Speaker:

I'll usually confirm, I'll load it up into, into Python and

Speaker:

Pandas and do my own searches.

Speaker:

and recently it's been pretty much always right.

Speaker:

I think the hallucinations are disappearing.

Speaker:

They've probably not gone completely.

Speaker:

And, we're gonna have fun still.

Speaker:

But I think they've turned a corner, I think, in that field.

Speaker:

With the exception, of course, of Google Gemini, which is a complete

Speaker:

and utter disaster, because they knew what they were doing.

Speaker:

everything I've read from insiders, they knew exactly what

Speaker:

they were building with Gemini.

Speaker:

It was a political indoctrination tool, and it was not there to

Speaker:

aid humans, but to guide humans.

Speaker:

Maybe they're right, maybe they're wrong, but it wasn't what they advertised it as.

Speaker:

And, I think at this point still Gemini is pretty much

Speaker:

unreliable for anything serious.

Speaker:

But, we've discovered that.

Speaker:

Maybe it would be true of other engines also.

Speaker:

And maybe in time we'll show that we were too harsh on Gemini, but at least

Speaker:

at this point, if I could back up a bit, 10 years ago, I was working for

Speaker:

some, I was involved with some startups and there's something about the startup

Speaker:

culture that I really appreciated.

Speaker:

I thought was very positive: when a customer would leave, an

Speaker:

angry customer would leave or an angry employee would leave.

Speaker:

Very often the startup culture meant that they would beg the customer or the

Speaker:

employee, tell us what we did wrong.

Speaker:

you're leaving, fine, we're sorry to see you go, wish you the best,

Speaker:

but just tell us what we did wrong.

Speaker:

We want to improve.

Speaker:

And I saw this more than once.

Speaker:

CEOs would send email blasts to the whole company.

Speaker:

"This is a problem somebody just reported.

Speaker:

I want it fixed in 48 hours".

Speaker:

They love to hear criticism, they wanted to improve.

Speaker:

It was a culture of openness and it's all about money, of course, but okay.

Speaker:

What's wrong with incentives?

Speaker:

there was a real culture of change.

Speaker:

I think a lot of startups from 20 years ago, like Google, have lost that.

Speaker:

Whether they want it or not, they can't do it.

Speaker:

They're so ossified.

Speaker:

They're so big.

Speaker:

They're so impenetrable.

Speaker:

And they're so enslaved to processes that they can't change even if they wanted to.

Speaker:

And they couldn't really genuinely hear criticism, even if they wanted to.

Speaker:

It's just, it's a shame.

Speaker:

I think it's probably a natural process of all organizations.

Speaker:

we know how governments work.

Speaker:

The large organizations are very hard to improve when things go wrong.

Speaker:

but it's a shame that to some degree we've lost that culture.

Speaker:

And I think, that leads to huge mistakes like Gemini.

Speaker:

there will be a shaking out of the industry that some

Speaker:

will do better than others.

Speaker:

So some AIs are going to improve and probably become steadily more

Speaker:

and more astounding and some aren't.

Speaker:

And, it'd be interesting to see which.

Speaker:

Google is such an interesting topic, and you're obviously not

Speaker:

the only one person saying that.

Speaker:

I've read, at this stage, dozens of former employees, or even current employees,

Speaker:

complaining about the same thing, that it's by no means anymore a startup.

Speaker:

And, that's, to a certain extent, normal.

Speaker:

Their size, their influence, people complain about the same things

Speaker:

like them killing projects and replacing them with the same thing

Speaker:

and renaming and rebranding and, completely not listening to customers.

Speaker:

But I think that Gemini, or in general, the AI, situation at

Speaker:

Google is, So interesting because they were at the forefront of that.

Speaker:

They spent a lot of money acquiring researchers, acquiring assets,

Speaker:

they were there from the ground up

Speaker:

It's wild.

Speaker:

And it reminds me of Kodak.

Speaker:

Kodak owned photography for almost a century, I don't know, 60, 70 years.

Speaker:

And they worked on digital photography.

Speaker:

They didn't ignore it.

Speaker:

I think they built one of the first digital cameras.

Speaker:

They were certainly in the first few.

Speaker:

And they did not ignore the technology.

Speaker:

But somehow, they couldn't pivot.

Speaker:

And they just didn't build a product that the market wanted.

Speaker:

And where's Kodak now?

Speaker:

So Google's sitting on a lot of cash right now, they invested probably

Speaker:

more than anyone in AI, and probably did ground breaking work which we're

Speaker:

using now, but, where are they?

Speaker:

there are other companies that are by no means startups and

Speaker:

they don't move very fast.

Speaker:

But for example, at this stage at least Microsoft's investments seem

Speaker:

so much better in that respect.

Speaker:

They basically more or less bought themselves OpenAI, by

Speaker:

the accounts of many people.

Speaker:

And they're integrating that like crazy into everything at the moment.

Speaker:

And where were they when Google was investing that, a decade ago?

Speaker:

There is, this document, internal memo that I don't think

Speaker:

we still know who wrote that.

Speaker:

It leaked about a year ago and it was called something around "We Have No Moat".

Speaker:

And neither does OpenAI, and I think the points that they were raising in

Speaker:

there, whoever wrote that, are, they basically materialized a hundred percent.

Speaker:

They were talking about how, all the things that Google is planning and hoping

Speaker:

to achieve, like running the LLMs, on your phone, that's already happening.

Speaker:

things like, scaling multimodality, today, this is all over the place, but the open

Speaker:

source picked it up and ran with it.

Speaker:

And obviously a big part of that is Facebook, leaking accidentally

Speaker:

their model, to, at least in my version of events to undermine a

Speaker:

little bit the hegemony potentially.

Speaker:

and give people alternative, but the open source models just run away

Speaker:

with that and there's no going back.

Speaker:

and then things like, cheap fine tuning with LoRA and later

Speaker:

QLoRA, all of those things are making it even more so than that.

Speaker:

Prophetic, memo, announced a year ago, And I just found it crazy that you can,

Speaker:

waste your initial advantage so badly.

Speaker:

Although it's interesting that I don't have the sense that there's a huge uptake

Speaker:

on truly open source and private LLMs.

Speaker:

I'm not sure how many people are doing it for themselves.

Speaker:

Yeah, of course, NVIDIA is selling a lot of GPUs to the people who

Speaker:

are doing this in their houses.

Speaker:

But I still see OpenAI and perhaps Anthropic.

Speaker:

Are still attracting a lot of customers.

Speaker:

And I have no numbers, but I suspect they have a large majority of the

Speaker:

market, for generative AI is going through those portals rather than

Speaker:

people doing it on their own.

Speaker:

So while it is available, there are LLMs you can build on your own.

Speaker:

I'm not sure how popular it is.

Speaker:

I remember a study, that was querying people about how

Speaker:

many models they're using.

Speaker:

And I think the most popular answer was either two or three different models.

Speaker:

And one of them was OpenAI, and one of them was local.

Speaker:

And I think the local It's easy to picture people hacking away in their

Speaker:

garages and, kind of movie-style Hollywood hacker, kind of thing, but what

Speaker:

I think is actually happening is that, In addition to using, OpenAI's models

Speaker:

primarily because they still got the biggest, chunk of the market, to do the

Speaker:

kind of workhorse thing and get projects started to get something off the ground

Speaker:

quickly, people are at least looking and investing into getting something that

Speaker:

they have some kind of control over.

Speaker:

And you can pick like a Mixtral you can pick, even a LLAMA, and if you're

Speaker:

using that for a particular use case that you can test, to an extent that

Speaker:

is actually feasible at the moment.

Speaker:

and you can look into how it's, behaving on your data in your, on your hardware

Speaker:

That gives you.

Speaker:

A massive advantage, like nobody can pull a rag from under you.

Speaker:

You download that, and initially the licenses were a little bit funny, and

Speaker:

you had to apply and do things like that, but now a lot of those models

Speaker:

are Apache 2.0, I think it's not necessarily a question of either/or,

Speaker:

it's more of a different use cases, make some of those options preferable.

Speaker:

If I was starting a startup and I wanted to get something

Speaker:

off the line very quickly.

Speaker:

It's like an obvious choice to get one of the APIs pay a few cents

Speaker:

per thousand tokens and get it off.

Speaker:

But as soon as you would like to make it, a permanent feature, and have any

Speaker:

control, I think, the local models really help hold a lot of progress.

Speaker:

We'll see obviously where it goes, but, I think that's how

Speaker:

I would describe it today.

Speaker:

jumping back to, my second challenge to you, I wanted to compare, the

Speaker:

generative AI that we're seeing today to self driving cars.

Speaker:

And, I think I remember the self driving wars of, what was it, mid 2010s,

Speaker:

when they were offering, researchers, multimillion dollar packages and

Speaker:

stealing research from each other and Waymo and Uber and everybody.

Speaker:

they got it to a point where it was, like, 90-something percent

Speaker:

good, but that wasn't enough, right?

Speaker:

It has to be effectively superhuman quality for people to get over the fact

Speaker:

that there's no one behind the wheel.

Speaker:

Why do we think that generative AI is not going to suffer from the same problem?

Speaker:

First of all, sometimes the stakes aren't as high with a self driving car.

Speaker:

You could be killing people if you make a mistake.

Speaker:

And that's definitely a threshold.

Speaker:

You don't want to slip underneath.

Speaker:

whereas generative AI, a lot of it, maybe most of it is just, 'okay,

Speaker:

so it gets a little math wrong'.

Speaker:

It's not going to kill anyone.

Speaker:

that may be part of it.

Speaker:

the second thing is that, generative AI is coming at us

Speaker:

from so many different directions.

Speaker:

And only one has to succeed and become the next, killer app or whatever.

Speaker:

whereas, self driving cars are self driving cars.

Speaker:

That's all they do.

Speaker:

And you either succeed as a self driving car or you don't.

Speaker:

by the way, I think self driving cars are probably gonna make it.

Speaker:

And they are still making progress.

Speaker:

I think in Las Vegas, they now have the Waymo taxis are actually on the

Speaker:

street running in real time, I think.

Speaker:

so that is eventually going to happen.

Speaker:

of course, 6-7 years ago, they were predicting that all transport

Speaker:

trucks would be, driverless by the year 2020, or whatever.

Speaker:

but then again, having said that, when I was in high school, my

Speaker:

geography teacher told us about the Club of Rome predictions.

Speaker:

This is, by the way, back in the, late 70s.

Speaker:

So the Club of Rome predicted that the world would run out of gold and platinum

Speaker:

by the late 1980s and would run out of, petroleum by like a 1990 or so, and

Speaker:

would run out of food by about 1995.

Speaker:

I guess that didn't happen.

Speaker:

maybe some of these predictions aren't to be taken that seriously either.

Speaker:

I do think that generative AI has a much better chance of pushing

Speaker:

through obstacles simply because There's so many ways it could go.

Speaker:

And there's so many, so many possible happy endings.

Speaker:

would you venture your best bet of what's going to be the

Speaker:

real killer app coming first?

Speaker:

I would say that Google with their their lack of a moat is a good target

Speaker:

in the sense that internet search, may disappear as a business model and as a

Speaker:

use case, simply because, augmented AI search is probably going to be better.

Speaker:

The, last three, four months, I think I've had a, ChatGPT+ subscription.

Speaker:

I bit the bullet and did it.

Speaker:

And I'm happy I did because it's pretty amazing.

Speaker:

So when I ask, ChatGPT+ to find some current information, it'll

Speaker:

activate Bing and go search.

Speaker:

So that's only going to get better.

Speaker:

And with the power of AI itself, married to the ability to search

Speaker:

under the hood, the entire internet.

Speaker:

Why do I need, Google search anymore?

Speaker:

A search engine has been the way we organize the world for the last,

Speaker:

15 years, 20 years, I don't know.

Speaker:

Okay.

Speaker:

And it's the way we think.

Speaker:

When you go to the internet, your thought was "let's go to a search

Speaker:

engine and get there that way".

Speaker:

It may not be rational to use that in a year or so.

Speaker:

so I would say that would be a big upheaval.

Speaker:

Because it's not just Google that's gonna be a victim of this.

Speaker:

Every person who's ever optimized his website for SEO,

Speaker:

that advantage will disappear.

Speaker:

That'll be hugely disrupting.

Speaker:

certainly.

Speaker:

wouldn't even know how to approach building a website anymore.

Speaker:

Because, your mind is set.

Speaker:

you optimize for SEO.

Speaker:

But, maybe not.

Speaker:

Yeah, it's crazy to think how much we rely on Google, so many people rely

Speaker:

on their SEO for their livelihoods.

Speaker:

And like you said, obviously you have to optimize for SEO,

Speaker:

otherwise nobody will find you.

Speaker:

So you have no traffic, so you earn no money.

Speaker:

but Last time I checked, or I vaguely remember, I think about 80% of Google's

Speaker:

income was still coming from ads, and lately, I don't know if it's just me

Speaker:

thinking about it more than before, but I started noticing that most of, my first

Speaker:

page, it's basically ads at this moment, so I do wonder, in the back of my head,

Speaker:

if they just assumed that was gonna die.

Speaker:

So they have to like ramp up and make as much money as possible right now

Speaker:

Squeeze whatever they can out.

Speaker:

Maybe.

Speaker:

Have you, have you tried?

Speaker:

Yeah.

Speaker:

Yeah.

Speaker:

for them, and it's scary for everyone who relied on ads.

Speaker:

Yes.

Speaker:

the rudimentary version of that you can use like GPT or premium or whatever.

Speaker:

There is a thing I've tried called Perplexity, full disclosure, no,

Speaker:

connection to them whatsoever.

Speaker:

How did you find that?

Speaker:

as far as, simple questions, code, if I asked for code or if I, asked for,

Speaker:

a thinking question, it's been close.

Speaker:

It was close to GPT.

Speaker:

I haven't used it for a couple of months regularly, but, I was impressed.

Speaker:

It didn't have the extra functionality of GPT+, So you couldn't upload a document

Speaker:

and have it analyze the document, but as far as just talking with it, it was

Speaker:

fairly close, as is Claude by Anthropic.

Speaker:

for some reason in Canada, they didn't fully release it even yet completely,

Speaker:

but that much Claude I'm allowed to use in Canada, I found it to be,

Speaker:

definitely comparable to, to GPT.

Speaker:

I don't know how you feel about Elon Musk, but have you tried Grok and the X AI

Speaker:

No, I haven't tried it yet.

Speaker:

by the way, I love watching Elon Musk.

Speaker:

He's so much fun.

Speaker:

and the guy is, controversial, he's crazy.

Speaker:

but that's all part of the fun, right?

Speaker:

he's done things with SpaceX that are just so exciting.

Speaker:

what every nerdy kid would have wanted to become.

Speaker:

He's doing it.

Speaker:

He's living the life.

Speaker:

Yeah.

Speaker:

so now when I test a new chatbot, I'm bored very quickly because I've,

Speaker:

talked to them to death before, but Grok is differentiated by being,

Speaker:

the opposite of safe and boring.

Speaker:

So you can get it to say a lot of things very easily and, Even when

Speaker:

you try, it's not gonna give you like this boring, dry, answer.

Speaker:

Which is, at the very minimum, refreshing.

Speaker:

And they actually open sourced, the model, recently.

Speaker:

On what seemed like Elon Musk's complete whim, one day, to look better than OpenAI.

Speaker:

Alright.

Speaker:

a surprise, who saw that coming?

Speaker:

That Elon Musk would have a whim?

Speaker:

from what I remember, it's a mixture of experts architecture that was 300 and I

Speaker:

want to say 20 or 40 billion, parameters.

Speaker:

So despite being only 25 percent weights active at a time, you're

Speaker:

still not going to be able to run it on anything anybody has at home.

Speaker:

but you can talk to that if you've got, X premium or whatever, if you give Elon Musk

Speaker:

money, which is an interesting sidequest.

Speaker:

Which also reminds me, speaking of Elon Musk, I think another

Speaker:

whim, on the 8th of August, we're supposed to see the Robotaxi.

Speaker:

the speculation is that he was, working on, Model 2, or whatever the cheapest

Speaker:

version of Tesla is supposed to be.

Speaker:

And, he internally killed it to push for the self driving taxi

Speaker:

that doesn't even have a steering wheel or anything like that.

Speaker:

And then Reuters wrote something about how, the, that model was dead

Speaker:

based on people's, leaked opinions.

Speaker:

He called them liars.

Speaker:

Something happened.

Speaker:

And the next day it's Oh, we're going to unveil Robotaxi in a couple of months.

Speaker:

So trademark, Musk, PR, version, but I am curious whether it's going to

Speaker:

be svaporware or whether we're going to see anything substantial on that.

Speaker:

with his track record, the odds are pretty good.

Speaker:

Of course, you have to be careful where you tell it to take you, because

Speaker:

you may end up on Mars or something.

Speaker:

I guess the caveat to that is that the track record of delivery.

Speaker:

Yes.

Speaker:

But the track record of timelines, is usually a few

Speaker:

years skewed, but, we'll see.

Speaker:

Anyway, Before I get asked to go on a grand tour of the different, use

Speaker:

cases that you discuss in your book, and I think a lot of people might

Speaker:

find it valuable, and, they'll just go and buy your book right away,

Speaker:

I wanted to also touch base very quickly on Why it's all happening now?

Speaker:

Because a lot of these ideas, if not all of them, are decades old.

Speaker:

what happened?

Speaker:

Why is it happening now?

Speaker:

Is it all thanks to gamers and crypto miners?

Speaker:

partly, it's certainly technology, gains have been significant

Speaker:

in the last five years.

Speaker:

and, Moore's Law is always shaky, it's about to break,

Speaker:

because we're moving too fast.

Speaker:

But, I think the big thing is integration.

Speaker:

Whereas 3-4 years ago, you could do, image segmentation, let's

Speaker:

say, using a deep learning model.

Speaker:

You could do it three years ago, five years ago, ten years ago,

Speaker:

probably, but it was a discrete tool.

Speaker:

You could use it for that and only that, and don't try to

Speaker:

integrate it with anything else.

Speaker:

what's happened now is that we can integrate, let's say, the entire

Speaker:

internet with the generative AI model and an engine and then integrate

Speaker:

that with the way you work and think.

Speaker:

So I can talk to it.

Speaker:

I can type to it.

Speaker:

I could plug it into my company is and its workflow and have it manage things for me.

Speaker:

I think that's a big deal.

Speaker:

We're starting to see, I guess, the first stages of AI agents, which is, it's going

Speaker:

to push us a lot further I would imagine.

Speaker:

I ask an AI a question, I don't know, about my business, I want to launch

Speaker:

a Twitter campaign to promote my new product, and so it'll tell me how to

Speaker:

do it, but I say, be my agent, now go do it, and, people have done this

Speaker:

already, actually, people have connected Twitter accounts to a GPT and actually

Speaker:

had it manage their social media.

Speaker:

probably a huge improvement in most cases over the real thing, but I don't

Speaker:

know there's an accident, you make a claim to your car insurance company.

Speaker:

the AI could manage the insurance processing, it'll contact the underwriter.

Speaker:

And it'll collect all the details of the accident and what the insured property

Speaker:

was and send those to the underwriter and the underwriter will send back

Speaker:

an answer and it'll go to the bank and it could actually handle complex

Speaker:

processes, independently and reliably, at some point reliably at any rate.

Speaker:

So this integration and then the next step integration with creating agents,

Speaker:

I think has been a big game changer.

Speaker:

it's taken a lot of discrete technologies and brought them together

Speaker:

into something a whole lot bigger.

Speaker:

Would you say that the datasets available also played a role?

Speaker:

I

Speaker:

yeah, and not only, have they been getting, oh, taken as one of the

Speaker:

projects I'm involved it would seem on the surface to be really unrelated

Speaker:

to anything I've done before.

Speaker:

I have a, substack called the Audit, where I write about, policy

Speaker:

analysis in Canadian politics.

Speaker:

It's not something most people even in Canada are interested in, and

Speaker:

certainly not outside Canada, but, the underlying premise of the site and of

Speaker:

almost everything I write there, is that governments and institutions make

Speaker:

an amazing amount of that data freely available, so almost everything that goes

Speaker:

on in Canada's parliament has always been recorded in a document called Hansard,

Speaker:

but now it's all available, and not only available online in, digital format,

Speaker:

but it's now, sadly JSON rather than CSV mostly, but it's available in a format

Speaker:

that you can actually work with, and you could do a deep data analysis with it.

Speaker:

So governments on all levels, all over the world, almost,

Speaker:

are producing a ton of data.

Speaker:

As are various types of institutions.

Speaker:

And that data is all becoming available.

Speaker:

It's all becoming available, through APIs and, in automated context.

Speaker:

So yes, that has made a huge difference and it's going to make

Speaker:

a much, much bigger difference.

Speaker:

the further we go on this line.

Speaker:

think there is also a slightly more nefarious, or I guess, gray area

Speaker:

to that, which is, exemplified in this massive lawsuit against OpenAI

Speaker:

from, the New York Times, I think.

Speaker:

That alleges that they should, be compensated for the demonstrable

Speaker:

fact that their model that's bringing them billions of dollars was actually

Speaker:

trained on, the body of work that they've accumulated over decades.

Speaker:

it's interesting because it seems to be very divisive.

Speaker:

A lot of people say, 'oh, If I read the articles and I write something, you're

Speaker:

not going to chase me', which is fair.

Speaker:

A lot of them say that, if we allow OpenAI to go with that, and then the next ones

Speaker:

can't do that, they get unfair advantage.

Speaker:

There's a lot of facets to that, and I'm curious, personally,

Speaker:

which way it's going to sway.

Speaker:

A lot of people don't like the copyright law right away,

Speaker:

which is also understandable.

Speaker:

but I am curious, how that's going to play out, whether going forward,

Speaker:

things will continue getting more open or whether it's going to be the

Speaker:

opposite, because even before the ChatGPT revolution, I want to say.

Speaker:

places like Reddit, for example, were guarding what effectively is their IP from

Speaker:

Google, because they don't want Google to serve you ads and get paid for that.

Speaker:

They'd rather you came onto their platform and clicked on their

Speaker:

ads, to prop their business.

Speaker:

do you have a firm opinion whether, which way you expect this to go?

Speaker:

These are tough questions, obviously.

Speaker:

I appreciate copyright protections.

Speaker:

I'm a writer.

Speaker:

And I create courses, and I create books and content, and

Speaker:

I appreciate being protected.

Speaker:

And if I wasn't protected, arguably, I wouldn't be able to

Speaker:

write and create this content.

Speaker:

In my particular case, that probably wouldn't be true, because thousands of

Speaker:

people have copies of my books illegally.

Speaker:

on the dark web and it doesn't really hurt my business that much because my customers

Speaker:

buy through normal channels and, it's really hard to market my stuff illegally.

Speaker:

but nonetheless, creators should be protected because they have

Speaker:

to be incentivized to create.

Speaker:

On the other hand, there's only a certain distance you can push that.

Speaker:

I've heard the argument in the New York Times case that New York

Speaker:

Times authors Generally learn to write by reading Ernest Hemingway.

Speaker:

Does that mean that the Ernest Hemingway estate has a claim against

Speaker:

the New York Times writers for a portion of their intellectual property.

Speaker:

no one's going to say that when it's a question of training.

Speaker:

If it was taking content or taking ideas, okay, that's would seem to be a clear

Speaker:

copyright violation, but when it's a question of training, I've heard the

Speaker:

argument that, that's not a violation.

Speaker:

everybody trains on something, the whole purpose of content is to train people,

Speaker:

how to read and write and think And of course we want people to learn from us.

Speaker:

And of course you expect that and you can't prevent that.

Speaker:

If you're going to put something in the public domain, you have to expect

Speaker:

that people are going to use it.

Speaker:

so these are tough questions.

Speaker:

it's, going to be hard to find a balance.

Speaker:

I don't know, how it's going to play out.

Speaker:

The odds are, technology will probably win.

Speaker:

I have never seen technology lose for better, for worse.

Speaker:

I guess we have seen technology lose.

Speaker:

And you think of.

Speaker:

the, nuclear energy industry, it lost in a lot of countries, like Germany.

Speaker:

the, nuclear energy genuinely has produced, the carbon neutral

Speaker:

energy, expensive but clean energy for decades and decades.

Speaker:

There have been a few accidents, tragically, but, by and large, the

Speaker:

energy has been clean, relatively affordable, and has many upsides and no

Speaker:

downsides, and yet, the technology has been rejected in certain jurisdictions.

Speaker:

so I guess technology can lose, but by and large it doesn't.

Speaker:

So if I would have to bet money, I would bet against the New York Times, I

Speaker:

would bet, with technology, prevailing.

Speaker:

in other words, the use of, of AI expanding.

Speaker:

I like both your example and your counterexample and it's probably because

Speaker:

I've been watching, on Netflix, Lincoln Lawyer for last couple of evenings.

Speaker:

so I want to say it also has to win in the court of public opinion.

Speaker:

and that might actually be more tricky than, anything else.

Speaker:

The point that you make in your book about open research on that and how that

Speaker:

accelerated this, there's been obviously open research by some people who strongly

Speaker:

believe that in that there was a research behind a cluster, but would you like to

Speaker:

describe briefly what you meant in the book when you said that this, Cambrian

Speaker:

explosion of generative AI that we're looking at right now is in part made

Speaker:

possible by the open nature of research.

Speaker:

as I think Linus Torvald said in the context of open source software,

Speaker:

many eyes make problems lighter.

Speaker:

That is, the more people who are reviewing your research and trying to replicate

Speaker:

your research, the greater the chance you're going to find problems faster

Speaker:

and improve things better and faster.

Speaker:

that was the premise of peer reviewed medical studies, which, of course,

Speaker:

is apparently how it's collapsed and is in complete shambles now.

Speaker:

But, in the open source world, and, particularly in a lot of

Speaker:

the early research into AI, there was a spirit of collaboration.

Speaker:

And much of what was created was put into the public domain and was shared and

Speaker:

commented on and, improved as a result, and there was a lot of money invested.

Speaker:

but there were an awful lot of people involved in the research.

Speaker:

And they're, as far as I understand, I have to be careful what I say.

Speaker:

I can't talk about too many details.

Speaker:

One, because I'm ignorant.

Speaker:

And two, because someone, actual pioneer in the AI research world, read my book,

Speaker:

"the, obsolete guide to, generative AI", Manning thought it was a good idea to send

Speaker:

it to him, just to see what he thought.

Speaker:

And, the appendix at the end, which also includes a brief history of

Speaker:

the AI developments, he really didn't like, and he felt that I

Speaker:

had misrepresented, a lot of the pioneers and the specific, processes

Speaker:

in advancing various AI technologies.

Speaker:

One step at a time, he felt got it all wrong.

Speaker:

He was an insider.

Speaker:

He was involved in a lot of the original research.

Speaker:

So the problem is, he's probably right.

Speaker:

Yeah, he's probably more, a lot more accurate than I am.

Speaker:

I'm not 100 percent sure how to take it though.

Speaker:

this was a complex history with personalities, and sometimes

Speaker:

personalities that didn't get along well with each other.

Speaker:

This is the academic world, after all, where you can't become a

Speaker:

great academic unless you don't get along well with people, it seems.

Speaker:

so I'm not going to go into any detail about, how exactly it happened, and

Speaker:

who were the big movers and shakers, but it did happen, and a lot of it was

Speaker:

done in an open, collaborative format.

Speaker:

So are you going to keep the brief history in the appendix, or are you going to

Speaker:

we are updating it.

Speaker:

because again, he has a lot of credibility.

Speaker:

from your description, there's probably about five people, that

Speaker:

said that I could place in that role.

Speaker:

I'm curious.

Speaker:

But let's leave it at that.

Speaker:

I promised, people a little bit earlier that we'd go through a little,

Speaker:

tour of the different use cases.

Speaker:

for anybody who's going to now go and put the money on Manning's website

Speaker:

to receive goods in exchange, the book is very hands-on, it doesn't

Speaker:

waste too much time, explaining how these things work under the hood.

Speaker:

It goes more into "oh, here's how you play with it, here's what you can do,

Speaker:

let your imagination run, go crazy.

Speaker:

it will help you become more productive, the way that it did, to the author".

Speaker:

If we were to pick maybe three or five most favorite examples of you that

Speaker:

you covered there and that you think, provide the best bang for your buck

Speaker:

experience, which ones would you go with?

Speaker:

I'd say the one that excited me the most when I did it was

Speaker:

using the tool called AutoGPT.

Speaker:

That was an API tool you have the open ai, API tool, key.

Speaker:

And you would feed.

Speaker:

the tool with a set of detailed instructions.

Speaker:

I want you to go out, research this on the internet, then take the outcome

Speaker:

and, distill it this way, and then I want you to draw a conclusion

Speaker:

about this and calculate that.

Speaker:

You get the detailed instructions, it will go out and search the

Speaker:

internet, get information, gather it, come back and iterate over

Speaker:

many steps, give you an answer.

Speaker:

That was really exciting.

Speaker:

The downside is it was a complete failure.

Speaker:

the technology, as far as I know, more often than not, it just

Speaker:

goes into these, death spirals.

Speaker:

It loops over and over again, the same iteration over and over, it never stops,

Speaker:

just keeps costing you more money.

Speaker:

however, the few times I actually did get it to work, I was considering

Speaker:

whether to create a course on Udemy on a particular, LPI, Linux Professional

Speaker:

Institute, certification that was relatively new, and I wanted to know

Speaker:

how popular is that certification?

Speaker:

How likely is it that users are going to want to buy my course,

Speaker:

and then take that certification?

Speaker:

So I had it, go out and research the popularity based on social media posts

Speaker:

and based on Internet evidence, assess the popularity of this technology

Speaker:

versus three other technologies, which I knew how popular they were.

Speaker:

I had a good sense of how effective they were.

Speaker:

and it spent, 45 minutes or so and about, $2 of my money or something

Speaker:

like that, and, came back with a coherent and a numeric answer.

Speaker:

I said, "you're on a scale of one to a hundred.

Speaker:

How would you rate the popularity of each of these four technologies,

Speaker:

or these four certifications?"

Speaker:

And it came back with a good answer.

Speaker:

May even have been correct.

Speaker:

So I thought that was fantastic.

Speaker:

that's going to change the world.

Speaker:

it may change the world, but it won't be AutoGPT that does it.

Speaker:

But yes, that's a type of agent that I think has a lot of potential.

Speaker:

I'm not sure exactly whether they'll get it right, but it'll,

Speaker:

someone's going to get that right.

Speaker:

I have to say I'm not impressed with the AI music and video yet.

Speaker:

everyone else seems to be, but, we have 300 years of all the world's

Speaker:

music on Spotify available 24/7, right?

Speaker:

Do you really think that AI is going to make something better?

Speaker:

it may make good stuff, but there are millions of pieces of music that I've

Speaker:

never listened to that are probably excellent, probably outstanding,

Speaker:

but I just don't need enough time.

Speaker:

So do we really need more music, even if it is good?

Speaker:

and what makes good music?

Speaker:

I don't know.

Speaker:

So AI music, I'm absolutely not impressed with yet.

Speaker:

Okay, everybody skip the music chapter.

Speaker:

It was just a music paragraph, actually, if I remember correctly,

Speaker:

there's this one paragraph, AI video.

Speaker:

the OpenAI tool SORA.

Speaker:

which is producing these 30 second clips of video.

Speaker:

Also, it's ho hum.

Speaker:

I don't know.

Speaker:

they're obviously AI.

Speaker:

They're nice.

Speaker:

They're visually attractive.

Speaker:

But, show me something with a little more substance.

Speaker:

I'm really not there yet.

Speaker:

but, who knows?

Speaker:

Things change.

Speaker:

AI voices, by the way.

Speaker:

Voice cloning.

Speaker:

is something that a number of companies have been offering for quite some time,

Speaker:

and OpenAI just announced they have their new voice cloning tool, from 10 seconds

Speaker:

of your recorded voice, they can then reproduce your voice reading anything.

Speaker:

No one's shown it to me yet.

Speaker:

I'll believe it when I see it.

Speaker:

In other words, can they produce voice that won't be recognizably machine?

Speaker:

I think that's very high bar because so much goes into this little

Speaker:

hints and the tempo and everything.

Speaker:

But I do think that there's been a massive improvement in

Speaker:

that you can listen to that.

Speaker:

you're not going to be fooled into thinking that it's a real person.

Speaker:

but your ears are not going to fall off after at the end of it, there's

Speaker:

a lot of websites that integrate that to, have the audio instead of

Speaker:

reading through a longer article.

Speaker:

And I find myself using that a little bit more than I did before.

Speaker:

for example, if I need to do something else, I can just put it down and

Speaker:

listen to the article a little bit, if it was a podcast episode.

Speaker:

However.

Speaker:

That's not gonna fool me.

Speaker:

I think that transcription, on the other hand, is getting closer to

Speaker:

basically as good as it's gonna get.

Speaker:

because, we're using that in a couple of projects.

Speaker:

For example, my brother and I, we run a series of technical conferences.

Speaker:

And people submit their talks, and it's a lot of, subscriptions to make.

Speaker:

We initially tried to get them done by hand, and that was just not gonna happen.

Speaker:

we integrated that with Assembly AI right now, and it's about 90, I

Speaker:

don't know, maybe 5 percent good?

Speaker:

To the point that, the things that it doesn't get very well sometimes

Speaker:

is things like names of things.

Speaker:

But it's good enough that mostly you can ignore the mistakes at this stage.

Speaker:

So I think that's going pretty good.

Speaker:

on the image and video thing, I think I would agree that people started

Speaker:

talking about how Hollywood was going to fall because SORA could generate

Speaker:

30 seconds of a coherent image.

Speaker:

There was a lot of excitement about that.

Speaker:

There was a project called Pika Labs, I think, before that,

Speaker:

and that also could generate 30 seconds or something like that.

Speaker:

Some of them looked funny.

Speaker:

Some of them looked like a very low budget animation from the 2000s, and

Speaker:

some of them just looked rubbish.

Speaker:

but the one, one exception to that, I think is I remember when I went

Speaker:

back to using midjourney after I initially tried it and wasn't

Speaker:

impressed and it just started.

Speaker:

lIke 'killing it'.

Speaker:

I think it might have been about a year ago or something like that.

Speaker:

I went back and I started generating some images.

Speaker:

I was just so impressed how good they were.

Speaker:

they had all the fingers and no additional

Speaker:

right number of fingers,

Speaker:

Yeah, and the faces and, and people started coming up with this tricks on

Speaker:

how to generate like consistent faces.

Speaker:

If you wanted to generate multiple pictures of your character, I think

Speaker:

it comes out of the box with that now.

Speaker:

for everybody I talked to replaced stock images.

Speaker:

Instead of going and paying for a stock image, you can get a custom one and you

Speaker:

can ask it to tweak it until you like it.

Speaker:

And so for this like going back to what you said, generative AI versus,

Speaker:

self driving cars, when the stakes are lower and you can accept some

Speaker:

problems, it's working well enough that it's just replacing that.

Speaker:

In terms of music, that's a little awkward.

Speaker:

All of the music, for this podcast is AI generated.

Speaker:

It can be good, I probably won't listen to the music of

Speaker:

this podcast hours and hours on

Speaker:

Oh yeah.

Speaker:

It's about 15 seconds, so it should be okay.

Speaker:

But

Speaker:

for that purpose it's great, but I don't think it's going

Speaker:

to replace people's playlists,

Speaker:

no, I don't think so.

Speaker:

Unless you're talking about the actual playlist, algorithm, because I think

Speaker:

Spotify has been very loud about how they're going to replace your playlist

Speaker:

and basically get AI to find the songs that you, they think you're going to like.

Speaker:

Facebook or whatever social media is keeping you

Speaker:

algorithmically, hooked to that.

Speaker:

And that, I believe they might be onto something.

Speaker:

There's probably, an optimal algorithm that can get you hooked and, addicted,

Speaker:

to as many songs as possible.

Speaker:

there's also that.

Speaker:

for anybody else who wants to, get the nitty gritty of how to,

Speaker:

actually play with all these things and test it for yourselves, there

Speaker:

is a sequence of chapters on all of these things and more, including

Speaker:

as well as what we covered, things like code and, talking to documents.

Speaker:

I think there is a little example where David is getting some kind

Speaker:

of AI to talk to a PDF containing Tesla's financial statement and

Speaker:

it's actually working very well.

Speaker:

So there's that.

Speaker:

it's gotten a lot better since, especially with the GPT+, a lot of barriers

Speaker:

have fallen, with my writing from the audit side, I'm able to do things.

Speaker:

in an hour that a traditional journalist would have taken a week

Speaker:

or two if you could do it at all.

Speaker:

But I'm doing it because of AI's, and GPT's incredible processing powers.

Speaker:

yeah, thank you gamers.

Speaker:

If it wasn't for you, we have never gotten Nvidia to make all those GPUs.

Speaker:

as you can probably imagine, I'm not going to let you off the hook before I

Speaker:

try to squeeze your wild prediction about things like AGI and things like regulation

Speaker:

and things like quantum computing and where you think that is going.

Speaker:

So maybe let's just bite the bullet and go there.

Speaker:

AGI.

Speaker:

I'm not sure exactly how we'll measure it, because there's so many

Speaker:

things that GPT, for instance, does so much better than I could ever do.

Speaker:

and faster.

Speaker:

Big Blue, beat Kasparov in chess, right?

Speaker:

So that was one discrete task, which is a very complicated task.

Speaker:

That's already 20 years old or something in that area.

Speaker:

but there are many things that GPT can do infinitely faster than I can.

Speaker:

is that AGI yet?

Speaker:

I'm not sure how we define it.

Speaker:

I think it's, inevitable.

Speaker:

My humble opinion is that AGI, if not now, certainly in the next couple of

Speaker:

years, I would imagine is inevitable.

Speaker:

Is it a good thing or a bad thing?

Speaker:

Personally, I don't stay up at night worrying about the AGI apocalypse.

Speaker:

that the, AI is going to, push off the shackles of humanity and

Speaker:

take over and destroy us all.

Speaker:

But, hey, who knows?

Speaker:

In any case, betting against it's not going to make any money because

Speaker:

you won't be here to collect.

Speaker:

so as far as AGI, I think it's inevitable, if not now, soon.

Speaker:

as far as, quantum computing, I don't, I've read a lot about, I've

Speaker:

read some about quantum computing.

Speaker:

I know that, I have a very vague understanding of what makes it different,

Speaker:

and how it'll be so compute intensive.

Speaker:

it could be that quantum computing will solve the energy

Speaker:

problem that AI is facing.

Speaker:

Maybe.

Speaker:

That is, Platforms, like OpenAI, require thousands of CPUs chugging

Speaker:

away in data centers, and some of them require their own nuclear energy

Speaker:

generators just to keep them alive.

Speaker:

There isn't enough electricity in the world being generated

Speaker:

to keep this stuff running.

Speaker:

And, of course, they're adding on, the electric cars, that are all supposed

Speaker:

to be fed from the electrical grid.

Speaker:

And there isn't enough electricity.

Speaker:

And the chairman of Toyota and Elon Musk also both warned that if every car sold

Speaker:

in 2030 is an EV, we are not going to have enough electricity to run it and to

Speaker:

power your shaver, there isn't enough, so we're coming to a crisis probably soon.

Speaker:

quantum computing, if it scales up fast enough, might be more efficient

Speaker:

from an energy perspective and might head off that crisis that they'll

Speaker:

still be able to exponentially grow the compute base of these platforms

Speaker:

and have enough energy to feed them.

Speaker:

Possibly.

Speaker:

That's, it's a complete guess and don't take it all seriously, but it's possible.

Speaker:

the downside, the real downside of quantum computing, of course, is that all our

Speaker:

passwords will be assumed to be broken.

Speaker:

Because the, the RSA algorithm will probably be cracked fairly quickly once

Speaker:

quantum computing becomes commercial.

Speaker:

if someone had, penetrated your, private website or your private, data, 2-3 years

Speaker:

ago and saved the data archives, unable to get to it because it's encrypted

Speaker:

because of course you use good passwords.

Speaker:

but once the quantum computing allows us to crack the RSA algorithm, they can

Speaker:

retroactively access everything that they've saved, because it's all behind

Speaker:

a, an encryption that can be broken that it has or will have been broken.

Speaker:

Okay, that's a possibility.

Speaker:

As far as regulation goes, as I wrote in the book, I believe,

Speaker:

this can't be regulated.

Speaker:

governments can jump up and down and kick and, scream as they always do.

Speaker:

and pass legislation that, severely restricts the, developments in AI.

Speaker:

It's not gonna change much, because it's out in the open.

Speaker:

It's out in the wild.

Speaker:

People will do with it what they want.

Speaker:

The market will do with it what it wants.

Speaker:

some have argued, as you probably read, OpenAI's requests for government

Speaker:

regulation might just be, a subtle attempt at, at locking in the market.

Speaker:

since it's on top, once the market is regulated, no one else will

Speaker:

be able to enter the market once they're, on top, they'll stay on top.

Speaker:

So some have interpreted it that way, as I'm sure you probably read.

Speaker:

but I don't think it's practical.

Speaker:

Some things can't be regulated.

Speaker:

it wouldn't be the first time.

Speaker:

I remember a certain Zuckerberg, pleading a very similar case

Speaker:

Fai enough.

Speaker:

I wanted to do one more thing before I let you off the hook.

Speaker:

I found your chapter, I think it was chapter 11 where you presumably

Speaker:

got some friends, who happened to be experts in, in AI and you asked them

Speaker:

a series of interesting questions like, "what were the problems", "what

Speaker:

were the biggest surprises", what do you actually use the most, and

Speaker:

all of that, what were the biggest unexpected items that you sell them?

Speaker:

you know, you obviously went with some presumptions of what

Speaker:

you were going to see there.

Speaker:

I'm curious what you got that you didn't sign up for.

Speaker:

That's an interesting question.

Speaker:

And sadly, I can't remember the details well enough.

Speaker:

I appreciate it.

Speaker:

I do.

Speaker:

The answers were great.

Speaker:

And I was, it added a lot to the book, I think.

Speaker:

But sadly, I can't remember them in detail.

Speaker:

I didn't, it was, I have to say that I was expecting some more embarrassing,

Speaker:

step on a rake incidents than I got.

Speaker:

Cause I've had plenty of step on a rake incidents myself.

Speaker:

I'll tell you an example.

Speaker:

I'll come out in the open and tell you one of my, I guess you can call it

Speaker:

a failure, but it was an experiment.

Speaker:

Early on when possibly before GPT-3 came out, I I started with OpenAI.

Speaker:

I believe it was still GPT-2.

Speaker:

I'm not sure they called it that, but I don't remember

Speaker:

now, but it was before GPT-3.

Speaker:

right at the very beginning, I I experimented to see how it would, generate

Speaker:

written content, technology content.

Speaker:

So I I conversed with it back and forth and got from it,

Speaker:

the content for five books.

Speaker:

One was on, low code.

Speaker:

another was on, a couple of security topics.

Speaker:

I don't even remember.

Speaker:

And I assembled all the content and I edited it to, to give it some

Speaker:

coherence and give it a narrative and a flow and I published them.

Speaker:

And I, I just want to see what would happen.

Speaker:

Can I effectively in two hours, I went from zero to up on Amazon Kindle.

Speaker:

I wanted to see if there was a business model.

Speaker:

so first of all, I'm not the only one who had that thought, right?

Speaker:

So Amazon is now flooded with literally millions of such books

Speaker:

and most of them are trash, and most of them you can tell pretty quickly

Speaker:

are trash and people avoid them and the market is correcting for that.

Speaker:

Amazon asks you now, whenever you upload a new book to Kindle,

Speaker:

they ask you, was this, or.

Speaker:

was all or most of this book generated by, an AI.

Speaker:

So they want to know.

Speaker:

They're not penalizing you yet, but they want to know, and it's a fair question.

Speaker:

these four or five books, I did publish them.

Speaker:

I'm not embarrassed by them, because I think the content is useful and helpful.

Speaker:

I think it's genuinely helpful content.

Speaker:

I read through it all, and I don't think there are any mistakes there.

Speaker:

I don't think there's anything misleading there.

Speaker:

But it's cheap.

Speaker:

It's not something I'm particularly proud of.

Speaker:

But I did it, it was an experiment, and I, I think the whole thing

Speaker:

took me two weeks, all five books.

Speaker:

Tempting and interesting.

Speaker:

So they ask whether 50% or more of the book was generated.

Speaker:

Something like that, it was a substantial amount of the book

Speaker:

generated by AI, maybe the word they use is substantial, I don't remember.

Speaker:

they're facing this problem, they have to figure out a way to deal with it.

Speaker:

Their platform is being flooded with this garbage.

Speaker:

Yeah.

Speaker:

Although even with, legitimate books, I would expect that very

Speaker:

close to 100% has some percentage that was at least rephrased

Speaker:

You have to be crazy not to.

Speaker:

it can make you so much more efficient and more accurate, as

Speaker:

long as you use it carefully, and as long as you don't abuse it.

Speaker:

The sum of my book, "the, obsolete guide to generative AI", 10% maybe?

Speaker:

20%?

Speaker:

I don't know.

Speaker:

is, is AI generated?

Speaker:

I

Speaker:

a good, path to do a newer revisions.

Speaker:

You just, regenerate the book with a newer AI.

Speaker:

that's possible.

Speaker:

actually, Manning and I were talking about that, a lot of their authors

Speaker:

are not English as a first language.

Speaker:

There are foreign language speakers, primarily great technologists,

Speaker:

good authors, but English is not their first language.

Speaker:

So they have a lot of problems sometimes getting a manuscript from,

Speaker:

the author's computer to a publishable state in English, and they'll invest

Speaker:

a lot of money in that sometimes.

Speaker:

So they wondered, and we were playing around with the idea

Speaker:

of feeding chapter by chapter.

Speaker:

Into, GPT and then getting it to revise the book, to rewrite the chapter,

Speaker:

I don't know if they ever used it.

Speaker:

I gave them a couple of, proof of concept experiments.

Speaker:

I'm not sure they ever actually applied it or not, but it's an

Speaker:

interesting idea, certainly.

Speaker:

at this rate, we're just going to end up with, everything touched or rephrased or

Speaker:

rewritten by AI, Going back to what you said about SEO, there are so many people

Speaker:

really banking on spitting out so much content, generating entire websites just

Speaker:

to capture some of the traffic with AI, which sadly means that the era of someone

Speaker:

having a website about something that they're interested in and that being,

Speaker:

found is just gone by now, I think.

Speaker:

how that's going to fall out.

Speaker:

I don't know what's going to happen To the accessibility of the internet,

Speaker:

that I don't want to predict.

Speaker:

yeah, it's weird, when I speak to different people, I feel very different.

Speaker:

for example, I was speaking to a friend and, about how people rewrite their

Speaker:

text with ChatGPT and technically they wrote it, but not really.

Speaker:

yeah, it's generated by AI.

Speaker:

Almost exactly what you were describing about getting a chapter and getting

Speaker:

it to be more English first language.

Speaker:

and, the argument was, would you also tell me to not use

Speaker:

autocorrect or like a dictionary

Speaker:

that's cheating, which kind of shut me up.

Speaker:

And I've used that argument since on the other side, and that made me feel, "okay,

Speaker:

that's, that's probably a silly argument.

Speaker:

But then on the other hand.

Speaker:

I wonder if people who sell cars and they were like, Oh, no, we

Speaker:

like our horses and what's going to happen to all these horses.

Speaker:

And no, this is cheating.

Speaker:

It runs on petrol.

Speaker:

It doesn't even have to stop and drink water.

Speaker:

Whether I'm one of those people, sometimes when I speak to my friends,

Speaker:

it's weird times we're in, isn't it?

Speaker:

Yeah.

Speaker:

thinking back, 10 years to how workday went and the tools I'd use and my

Speaker:

first book I wrote, 35 years ago.

Speaker:

was, probably before you were born, possibly.

Speaker:

I wrote it as I mentioned somewhere, I wrote it on paper with a pen.

Speaker:

And, you write differently.

Speaker:

When I wrote, on a typewriter, you write differently, cause there's

Speaker:

no correct, now forget about autocorrect, there's no correct at all.

Speaker:

See you're stuck with the version you have, okay, you could

Speaker:

use that, what was it called?

Speaker:

you probably don't remember.

Speaker:

They used to have this.

Speaker:

Correcto type, I think it was called a little tool.

Speaker:

You could add a little white ink over a mistake in a typewriter.

Speaker:

it was kludgy and you just had to get it right the first time.

Speaker:

I've seen it round the time that word processes became popular 25 years ago,

Speaker:

some editors, one editor in particular said that she can always tell a

Speaker:

manuscript that was written on a computer.

Speaker:

Because there'll be far more stupid mistakes.

Speaker:

On a typewriter, when you're nervous and you can't correct it, you think

Speaker:

about it very carefully before you type.

Speaker:

On a computer, you, nah, just go back and get it later.

Speaker:

And you usually don't.

Speaker:

that's from the typewriter to the, word processor stage.

Speaker:

But from the word processor stage to, AI, the changes are going to be, are

Speaker:

going to be fundamental and remarkable.

Speaker:

Heh

Speaker:

who, wants to go and jump the book, once again, it's called "the complete obsolete

Speaker:

guide to generative AI", it's available at manning.com and it's got a lot of humor.

Speaker:

And if you don't mind, I'm just going to quote you on what you just described.

Speaker:

The book says.

Speaker:

Let me give you some context: I'm a lot older than you might think.

Speaker:

I wrote my first book on sheets of paper using a pen.

Speaker:

It may have been a very old technology, but it was solar-powered.

Translation:

it was only useful when I opened the window or turned the lights on.

Translation:

That's the kind of humor that you're going to get in droves, when you read through,

Translation:

David's book, David, thank you so much.

Translation:

This was absolute pleasure.

Translation:

Hopefully, next time we speak, we are both not replaced by AIs, or

Translation:

maybe we are, and it's actually going to be a better conversation.

Translation:

Or maybe we are already.

Translation:

How do you know that these aren't, avatars, and deep fakes?

Translation:

But, I think you're real, and I'm fairly confident I'm real.

Translation:

and I, as a real person, I enjoyed this, this conversation, and I'm

Translation:

looking forward to seeing where it goes.

Translation:

and so did I, at least in this version of the simulation.

Translation:

Thank you.

Translation:

See you next time.

Translation:

Take care.

Translation:

Thanks a lot.

Translation:

Thanks.

Links

Chapters

Video

More from YouTube