180: The 10 MOST CLUTCH Quarterbacks in NFL History (Backed by Data Science)

Speaker: 00:00:00

everyone thinks

2

: 00:00:01

they know who the most clutch quarterback in NFL

3

: 00:00:04

history is Tom Brady with his Super Bowl comebacks

4

: 00:00:07

Josh Allen in the playoffs

5

: 00:00:08

or Aaron Rodgers with impossible throws

6

: 00:00:11

everyone has opinions but what does the data say

7

: 00:00:14

well I'm a data scientist

8

: 00:00:15

so I fed Python every play from the last 25 years

9

: 00:00:19

over 1 million plays every pressure moment

10

: 00:00:22

every game winning drive and then

11

: 00:00:24

I let math and statistics decide

12

: 00:00:27

who really performs the most

13

: 00:00:29

when it matters the most and the most statistically

14

: 00:00:32

clutch quarterback in NFL history is

15

: 00:00:35

someone you definitely weren't expecting

16

: 00:00:38

now analyzing

17

: 00:00:39

patterns across 1 million football plays is not easy

18

: 00:00:43

even with Python so I use today's sponsor

19

: 00:00:46

Sphinx

20

: 00:00:46

to help me process this massive dataset in Python

21

: 00:00:50

to identify these statistical patterns that reveal

22

: 00:00:52

who is the most clutch quarterback of all time

23

: 00:00:55

more on Sphinx in a bit but before I reveal

24

: 00:00:58

the most clutch quarterback of all time

25

: 00:01:00

which I promise I will get to very soon

26

: 00:01:02

let's start a timer for 30 seconds

27

: 00:01:04

we have a huge problem what even is clutch

28

: 00:01:07

it's pretty hard to define

29

: 00:01:08

but we know it happens during crunch time right

30

: 00:01:11

and that we can basically say

31

: 00:01:12

is when the game is almost over and the score is close

32

: 00:01:16

for now we'll say that

33

: 00:01:17

clutch time is when the score is within one touchdown

34

: 00:01:20

so that's like Seven Points

35

: 00:01:21

and it's in the last eighth of the game

36

: 00:01:23

or the last 7:30 of the fourth quarter

37

: 00:01:26

or it's in overtime but even then

38

: 00:01:28

how do we quantify clutch

39

: 00:01:29

like numerically well

40

: 00:01:31

we'll use two different definitions today

41

: 00:01:33

No. 1 TV clutch and No. 2

42

: 00:01:35

advanced analytics clutch

43

: 00:01:37

let's go ahead and start with TV clutch

44

: 00:01:39

coming in at No. 10 on TV Clutch is Josh Freeman

45

: 00:01:44

surprisingly now

46

: 00:01:45

I know he didn't have an incredible career

47

: 00:01:47

but he definitely has some highlight moments

48

: 00:01:50

now this one kind of surprised me

49

: 00:01:51

I did not see Josh Freeman being on this list

50

: 00:01:54

but he did have one really good season

51

: 00:01:56

so maybe that's playing a big factor

52

: 00:01:58

No.9 is the controversial Aaron Rodgers

53

: 00:02:01

and this shouldn't be a huge surprise

54

: 00:02:02

as Aaron has had a ton of clutch plays

55

: 00:02:05

throughout his entire career

56

: 00:02:07

specifically with the Green Bay Packers

57

: 00:02:09

No.8 is Tony Romo yes

58

: 00:02:11

that is the now lead NFL analyst for CBS

59

: 00:02:14

who makes some very strange noises sometimes

60

: 00:02:16

but he had some very clutch plays for the Cowboys

61

: 00:02:19

back in the day coming in at No. 7 is Rich Gannon

62

: 00:02:22

I'm going to be honest I had to look him up

63

: 00:02:24

he's a little bit before my time

64

: 00:02:26

but it looks like he had a little bit of a late

65

: 00:02:28

career resurgence with the Oakland Raiders

66

: 00:02:30

and ultimately

67

: 00:02:31

won the league MVP and took them to the Super Bowl

68

: 00:02:34

No.6 is disappointingly Deshaun Watson

69

: 00:02:37

not much to say here so moving on to No. 5

70

: 00:02:40

and it's the Greatest Show on Turf

71

: 00:02:42

Mr Kurt Warner fantastic story of going undrafted

72

: 00:02:46

to almost getting kicked out of the NFL

73

: 00:02:48

two league MVP and Super Bowl champion

74

: 00:02:51

No.4 is Jake Delhomme his season in 2,003

75

: 00:02:55

LED the Carolina Panthers to the Super Bowl

76

: 00:02:58

earning the team the nickname the Cardiac Cats

77

: 00:03:00

due to the numerous

78

: 00:03:01

game winning drives in the fourth quarter

79

: 00:03:03

or overtime and those are all really things to Delhomme

80

: 00:03:07

he set a franchise record

81

: 00:03:08

with seven game winning drives

82

: 00:03:10

in that 2003 season alone

83

: 00:03:12

No. 3 is Andrew Luck and man

84

: 00:03:14

I totally get why he retired early

85

: 00:03:17

like I I make sense

86

: 00:03:18

but I would have loved to see the rest of his career

87

: 00:03:20

because he was absolutely incredible

88

: 00:03:22

and was a very clutch coming in at No. 2

89

: 00:03:25

it should really surprise no one

90

: 00:03:26

it's Patrick Mahomes don't need to say much here

91

: 00:03:29

he is very clutch

92

: 00:03:30

he's been on an incredible run the last eight years

93

: 00:03:32

leading to three Super Bowl wins

94

: 00:03:34

in five Super Bowl appearances

95

: 00:03:36

the only surprise here is he wasn't No. 1

96

: 00:03:38

and lastly at No. 1

97

: 00:03:40

the most clutch quarterback via TV is Tom Tua

98

: 00:03:44

Tonga Vaiaoloa yes

99

: 00:03:46

somehow Tua is the most clutch quarterback of all time

100

: 00:03:49

it's not Tom Brady question Mark

101

: 00:03:51

I don't get it if you know much about the NFL

102

: 00:03:53

you'll know that this result

103

: 00:03:54

it's kind of crazy

104

: 00:03:55

Tua isn't exactly known as a clutch quarterback

105

: 00:03:58

and honestly kind of has a reputation of being

106

: 00:04:01

maybe the opposite of clutch

107

: 00:04:02

so with that

108

: 00:04:03

let's talk about how he came up with his top 10

109

: 00:04:05

and the analytics that LED us to this point

110

: 00:04:08

so what is TV clutch well

111

: 00:04:10

it's a term that our AI data science co pilot

112

: 00:04:13

Sphinx created for us

113

: 00:04:14

it combines things that we can easily see on TV

114

: 00:04:17

in terms of clutchness touchdowns

115

: 00:04:18

interceptions completion percentages

116

: 00:04:20

those types of things

117

: 00:04:21

as well as how often they were in clutch situations

118

: 00:04:24

so let's rewind for a second here

119

: 00:04:25

and I'll tell you how we got this top 10

120

: 00:04:27

and how you can replicate this exact same analysis

121

: 00:04:30

on your own even if you're not a programmer

122

: 00:04:32

you're not very technical at all

123

: 00:04:33

and you don't know Python

124

: 00:04:34

so I start out by using NFL versus

125

: 00:04:38

Python package called NFL Data

126

: 00:04:40

Pie to download the last 25 years of play by play data

127

: 00:04:45

but instead of taking hours to understand how this API

128

: 00:04:47

works and write all the code myself

129

: 00:04:49

I just asked Sphinx to get the data for me

130

: 00:04:51

in plain English

131

: 00:04:53

Sphinx then went and read all of the API docs

132

: 00:04:55

to understand how the API works

133

: 00:04:57

and automatically wrote the code

134

: 00:04:59

for me to get all that play by play data

135

: 00:05:01

now could I have done that all on my own

136

: 00:05:03

absolutely it just would have taken me a lot of time

137

: 00:05:06

and I'm trying to pump out

138

: 00:05:06

really high quality episodes

139

: 00:05:08

for you guys

140

: 00:05:08

so it was really nice to have a little bit of a co

141

: 00:05:10

pilot to write this code for me

142

: 00:05:11

it ended up retrieving the last 25 seasons

143

: 00:05:14

which averages to around 45,000 plays per season

144

: 00:05:18

which is a total of 1.18 million rows of data

145

: 00:05:22

and it has 300 columns that let us know who is playing

146

: 00:05:25

where the ball is what the result of the play and a lot

147

: 00:05:28

lot more pretty sweet right

148

: 00:05:29

awesome dataset well

149

: 00:05:30

of course we actually aren't interested

150

: 00:05:32

in all 1.18 million plays

151

: 00:05:35

only the plays that fit the clutch criteria

152

: 00:05:37

that we stated earlier

153

: 00:05:38

which is basically the last 1/8 of a one score game

154

: 00:05:42

and so all I needed to do was tell Sphinx that

155

: 00:05:44

that's what I'm interested in doing

156

: 00:05:45

and it will create this filter for me on my data

157

: 00:05:48

so you notice I just spell it out in plain English

158

: 00:05:51

and tell exactly what I want

159

: 00:05:52

and the cool part is

160

: 00:05:53

it's actually smart enough to find the right column

161

: 00:05:55

names to do this filter

162

: 00:05:57

as well as do things like check for missing data

163

: 00:05:59

without me explicitly telling it to do so

164

: 00:06:01

and finally it writes the code to do the filter

165

: 00:06:04

and now we have a Python data frame

166

: 00:06:06

with only the plays that fall into our clutch category

167

: 00:06:09

: 00:06:10

we want to analyze the quarterback part of our data

169

: 00:06:12

because this is play by play data

170

: 00:06:14

which has data about

171

: 00:06:15

everyone and everything that's going on

172

: 00:06:17

but we're really only interested

173

: 00:06:18

in clutch quarterback performance

174

: 00:06:20

and you'll see in the data

175

: 00:06:21

that we definitely

176

: 00:06:21

have a lot of quarterback names going on

177

: 00:06:23

as well as whether it was a completed pass

178

: 00:06:25

whether it was a touchdown

179

: 00:06:26

or whether was an interception

180

: 00:06:28

yards completed all that good stuff

181

: 00:06:29

now this is where we can ask our co pilot

182

: 00:06:31

Sphinx to analyze all the existing plays

183

: 00:06:34

and using only touchdowns

184

: 00:06:35

interceptions completion percentage

185

: 00:06:37

yards and clutch attempts

186

: 00:06:39

we can tell it to create a TV Clutch Factor score

187

: 00:06:43

and ask it to rank by the most clutch quarterbacks

188

: 00:06:46

based upon that score now Sphinx

189

: 00:06:48

our copilot gets to work

190

: 00:06:49

and first it does the aggregation

191

: 00:06:51

for all of the quarterback pass plays

192

: 00:06:53

and calculates all of the completions and touchdowns

193

: 00:06:55

interceptions and the yards gained

194

: 00:06:58

as a reminder our data was the play by play data

195

: 00:07:01

not quarterback clutch season stats

196

: 00:07:03

so this step is absolutely necessary

197

: 00:07:05

to kind of clean the data

198

: 00:07:06

aggregate it

199

: 00:07:07

manipulate it in a way that makes it usable for us

200

: 00:07:10

then this code calculates what's called a Z score

201

: 00:07:12

for each one of those different metrics

202

: 00:07:14

if you're unfamiliar with the Z score

203

: 00:07:15

it's basically a measure

204

: 00:07:17

of how many standard deviations

205

: 00:07:19

a specific data point is

206

: 00:07:21

away from the mean of that data set

207

: 00:07:23

indicating its position within a distribution

208

: 00:07:26

which is basically in layman's terms

209

: 00:07:28

how much better or worse is a quarterback

210

: 00:07:31

from the average quarterback

211

: 00:07:32

based on these stats basically

212

: 00:07:33

this is what you need to know

213

: 00:07:34

a Z score of 0 means you're very average quarterback

214

: 00:07:38

a Z score of 1 means you're above average

215

: 00:07:40

and a Z score of negative 1 means you're below average

216

: 00:07:43

for that particular stat

217

: 00:07:45

our python code then creates a formula

218

: 00:07:47

where the touchdown Z scores

219

: 00:07:48

the yard Z scores

220

: 00:07:49

and the completion percentage scores are all good

221

: 00:07:52

and interceptions the scores are bad

222

: 00:07:54

and out of the other end of this formula

223

: 00:07:56

comes our top 10 list from earlier

224

: 00:07:59

with the most clutch quarterbacks

225

: 00:08:00

where Tua Tonga by Lowa

226

: 00:08:01

somehow is the most clutch quarterback of all time

227

: 00:08:04

now if this is your first time seeing Sphinx

228

: 00:08:06

hopefully you realize how cool it is

229

: 00:08:07

and how useful it can be

230

: 00:08:09

it's basically a co pilot for anyone working with data

231

: 00:08:12

it currently ships as a VS code extension

232

: 00:08:15

that interfaces with Jupiter

233

: 00:08:16

and other compatible notebooks

234

: 00:08:18

it runs in your environments alongside you

235

: 00:08:21

which first makes it safe and second

236

: 00:08:23

makes it easy to use

237

: 00:08:24

and it can access data through Python APIs

238

: 00:08:27

or it even has MCP

239

: 00:08:28

capabilities with things like snowflake

240

: 00:08:30

or Databricks or Big Query or Salesforce

241

: 00:08:32

whatever you're using

242

: 00:08:33

and you can learn more about Sphinx

243

: 00:08:35

and get started for free

244

: 00:08:36

using the link in the description down below

245

: 00:08:38

now once again if you know anything about football

246

: 00:08:40

you'd really question how on earth

247

: 00:08:43

can the current quarterback of the Miami Dolphins

248

: 00:08:46

Tua Tonga Vealua

249

: 00:08:47

be the most clutch quarterback of all time

250

: 00:08:49

and is it like

251

: 00:08:50

possible that Tony Romo can even be in the top 10

252

: 00:08:52

and the answer to that is I don't know

253

: 00:08:54

it's hard to know but we only really use basic stats

254

: 00:08:57

like touchdowns and completions and interceptions

255

: 00:08:59

earlier and that is a little bit basic

256

: 00:09:01

the good news is that the NFL stat heads

257

: 00:09:03

all of these NFL data analysts and data scientists

258

: 00:09:05

and all these smart people

259

: 00:09:07

have created other stats that are able to capture

260

: 00:09:09

how unique and how clutch a play is

261

: 00:09:12

and one of the things they created is called the win

262

: 00:09:14

probability added or WPA for short

263

: 00:09:17

and it's a bit hard to understand

264

: 00:09:19

and it would be an entirely

265

: 00:09:20

separate video to explain it in full

266

: 00:09:21

but basically every play in a football game changes

267

: 00:09:24

the chance that a team wins

268

: 00:09:25

or loses but specifically wins

269

: 00:09:27

WPA measures how much that play changes your odds

270

: 00:09:31

so for example in 2024 the Washington Commanders

271

: 00:09:34

were losing to the Chicago Bears

272

: 00:09:35

15 to 12

273

: 00:09:37

the commanders had the ball with two seconds left

274

: 00:09:39

on their own 48 yard line

275

: 00:09:41

they basically had a current chance of winning of 17%

276

: 00:09:45

Jaden Daniels is playing quarterback and as you can see

277

: 00:09:47

he drops back he's has to throw this

278

: 00:09:49

now basically they have to score a touchdown

279

: 00:09:51

so he has to throw it 60 yards 17% chance of winning

280

: 00:09:55

they score a touchdown

281

: 00:09:56

they win and you can kind of see that

282

: 00:09:58

he has to run away from all these guys

283

: 00:10:01

trying to sack him goes to the other side of the field

284

: 00:10:04

he's now look at this

285

: 00:10:05

he's at his 30 yard line he has to throw it 70 yards

286

: 00:10:09

there's the ball being thrown

287

: 00:10:11

it's in the air flies up

288

: 00:10:13

you'll see that

289

: 00:10:14

the ball pops out and is caught for a touchdown

290

: 00:10:17

and Washington wins the game

291

: 00:10:18

now

292

: 00:10:19

that is a very high WPA because the time has expired

293

: 00:10:23

there's no time left they'll now be at 18 points

294

: 00:10:25

and they have beaten the bears pretty much

295

: 00:10:27

no matter what happens cause there's no time left

296

: 00:10:29

so obviously that play was a very high WPA

297

: 00:10:33

now a WPA of 0

298

: 00:10:35

would be a play that does not change

299

: 00:10:37

the effect of the game at all

300

: 00:10:39

for example most kickoffs that result in a touchback

301

: 00:10:42

have a WPA of zero

302

: 00:10:44

cause it's a standard play that happens multiple times

303

: 00:10:46

the game and doesn't really affect what happens

304

: 00:10:48

it's really just like okay

305

: 00:10:49

the ball starts on

306

: 00:10:50

like the 30 yard line or whatever it is

307

: 00:10:52

a negative WPA

308

: 00:10:53

would be when the offense makes a really

309

: 00:10:56

costly mistake where they were going to win the game

310

: 00:10:58

but now they're probably not

311

: 00:11:00

for example this Josh Allen interception

312

: 00:11:03

in this situation it is overtime

313

: 00:11:05

the bills are playing the Minnesota Vikings

314

: 00:11:08

the Vikings are winning 33 to 30

315

: 00:11:10

but Buffalo the bills

316

: 00:11:12

have the ball with Josh Allen as quarterback there

317

: 00:11:15

is a minute left and they're on the 20 yard line

318

: 00:11:18

so all Josh Allen has to do is score a touchdown

319

: 00:11:21

and the game is over and the bills win

320

: 00:11:23

and Josh Allen's really good

321

: 00:11:24

so there is a current 74% chance of winning

322

: 00:11:28

when this ball is snapped

323

: 00:11:30

you'll see that Josh Allen gets the ball

324

: 00:11:32

he looks he looks pump fakes throws interception

325

: 00:11:36

the Vikings have the ball and they slide

326

: 00:11:39

and now Vikings end the game

327

: 00:11:42

because you only get one possession

328

: 00:11:43

I think at this time during the NFL

329

: 00:11:45

but even if that wasn't the case

330

: 00:11:46

they could just kneel and the game would be all over

331

: 00:11:47

so the game officially is over

332

: 00:11:49

Josh Allen has thrown a game losing interception

333

: 00:11:52

to make his team lose that would be extremely low

334

: 00:11:57

uh WPA

335

: 00:11:58

in fact they went from a 74% chance of winning to a 0%

336

: 00:12:01

so that's negative point seven four not good

337

: 00:12:04

now that we understand WPA

338

: 00:12:06

we know that a high positive value means you are clutch

339

: 00:12:08

and a low

340

: 00:12:09

negative value means you are the opposite of clutch

341

: 00:12:12

the play by play data that we actually downloaded

342

: 00:12:15

has WPA for every single play

343

: 00:12:18

which is really awesome for us

344

: 00:12:19

because that means that we can ask Sphinx

345

: 00:12:21

to find the 10 most clutch quarterbacks

346

: 00:12:24

based on WPA so we can literally ask Sphinx you know

347

: 00:12:27

find these 10 quarterbacks

348

: 00:12:29

give us a total WPA an average WPA and sort the table

349

: 00:12:33

descendingly by the total WPA

350

: 00:12:35

and Sphinx will create its game plan

351

: 00:12:37

over here on the left hand side

352

: 00:12:38

not a football game plan but a data science game plan

353

: 00:12:41

and then start writing the code itself to

354

: 00:12:43

to do this analysis

355

: 00:12:44

and finally it will give us our results

356

: 00:12:47

so starting at No. 10 we have Aaron Rodgers

357

: 00:12:50

once again he was No. 9 on our TV clutch list

358

: 00:12:53

so this is not a huge surprise here

359

: 00:12:55

anyway you slice it

360

: 00:12:56

Aaron Rodgers was a pretty clutch quarterback

361

: 00:12:58

is he now I don't know

362

: 00:12:59

but back in the day he was

363

: 00:13:01

No.9 is another current quarterback

364

: 00:13:03

and that is Mr Cool Joe Burrow

365

: 00:13:06

and there's a reason he has that name you guys

366

: 00:13:08

this guy performs when it means the most

367

: 00:13:10

and is able to make the big throws

368

: 00:13:12

when the game is in his hands

369

: 00:13:14

No.8

370

: 00:13:15

is a name that I hadn't heard of in a really long time

371

: 00:13:17

and it honestly really surprised me

372

: 00:13:19

Carson Palmer if you're anything like me

373

: 00:13:21

you haven't thought about that in a while

374

: 00:13:22

but while he was playing

375

: 00:13:23

he had some pretty clutch moments

376

: 00:13:25

No.7 was on our previous list as well

377

: 00:13:27

and it's Andrew Luck once again

378

: 00:13:29

this guy was on the trajectory of becoming

379

: 00:13:31

one of the best quarterbacks

380

: 00:13:32

of all time and it's a shame

381

: 00:13:33

we didn't get to watch the rest of his career

382

: 00:13:35

No. 6 is Matthew Stafford

383

: 00:13:37

also a current quarterback and it's well deserved

384

: 00:13:39

he is one of my favorite clutch plays ever

385

: 00:13:41

and he's really like

386

: 00:13:43

done a lot of clutch things in his career

387

: 00:13:45

both as the Lions quarterback

388

: 00:13:47

and now as the Rams quarterback

389

: 00:13:49

No. 5 is NFL legend Peyton Manning

390

: 00:13:52

yes before he did all the broadcasting stuff

391

: 00:13:54

he was a really good quarterback

392

: 00:13:55

and made some absolutely clutch plays

393

: 00:13:57

No. 4 is Patrick Mahomes

394

: 00:13:59

and I was honestly kind of like

395

: 00:14:01

I can't believe he's so low on this list

396

: 00:14:03

but once again very clutch quarterback

397

: 00:14:05

has been on an absolute tear with the Chiefs

398

: 00:14:07

and has made a lot of the biggest throws

399

: 00:14:09

in NFL history No.3 is Big Ben Roethlisberger

400

: 00:14:13

a Steelers legend was in it forever

401

: 00:14:15

made some great clutch plays

402

: 00:14:17

No. 2 on this list actually kind of surprised me

403

: 00:14:19

but it's kind of surprised

404

: 00:14:21

we haven't seen his name so much at all anymore

405

: 00:14:24

because he was such a good quarterback during his day

406

: 00:14:26

and that is Drew Brees

407

: 00:14:27

legend for the New Orleans Saints

408

: 00:14:29

always seems to make really good completions

409

: 00:14:33

like his percentage was always so high

410

: 00:14:34

wasn't doing anything fancy ever

411

: 00:14:36

but like pass after pass after pass

412

: 00:14:38

he just like charged down the field

413

: 00:14:40

and No. 1 the No. 1 clutch quarterback of all time

414

: 00:14:43

as defined by total WPA across his entire career is

415

: 00:14:49

drum roll please

416

: 00:14:51

the goat himself

417

: 00:14:53

Mister Tom Brady so in the end

418

: 00:14:57

data science

419

: 00:14:57

kind of already proved what we already knew

420

: 00:15:00

deep down right there you have it

421

: 00:15:02

the 10 most clutch quarterbacks

422

: 00:15:03

as proven by data science

423

: 00:15:05

now I challenge you to make your own clutch list

424

: 00:15:07

especially if you hate this clutch list

425

: 00:15:09

let me know in the comments down below if you hate it

426

: 00:15:12

and why you think I'm wrong

427

: 00:15:13

but you can create your own by downloading Sphinx

428

: 00:15:16

using the link below

429

: 00:15:17

and you can get my own Jupiter notebook

430

: 00:15:18

and play around with my code template

431

: 00:15:20

create something similar with football and actually

432

: 00:15:23

you know change the parameters of clutch

433

: 00:15:24

or use a different metric

434

: 00:15:25

instead of WPA you can use something called EPA

435

: 00:15:28

which is another one of those crazy NFL advanced stats

436

: 00:15:30

or you can do something totally different

437

: 00:15:32

and do it with the NBA or with soccer

438

: 00:15:34

or with cricket or you don't have to do sports at all

439

: 00:15:36

that is the beauty of something like Sphinx

440

: 00:15:38

is it helps you create awesome analysis

441

: 00:15:40

that would take you hours on your own

442

: 00:15:42

and probably will still take you hours with Sphinx

443

: 00:15:43

but a lot faster I'm excited to see what you make

444

: 00:15:46

and I'm excited to see you

445

: 00:15:47

hit the subscribe button as well right

446

: 00:15:50

see you in the next one

Share Episode

Shownotes

⏱️ TIMESTAMPS

🔗 RESOURCES & LINKS

📱 CONNECT WITH AVERY

📱 CONNECT WITH SPHINX

Transcripts

Follow

Links

Chapters

Video

More from YouTube