Artwork for podcast Digital Accessibility
How Often Do You Get a Chance to Make That Much of a Difference
Episode 618th September 2022 • Digital Accessibility • Joe Welinske
00:00:00 00:42:34

Share Episode

Shownotes

Rich Schwerdtfeger, Retired, IBM, Former Chief Technology Officer for Accessibility

Rich began his work in accessibility with the early development of a screen reader for Windows. He was a key member of the world-wide team that brought technologies like ARIA into mainstream use for accessibility. Rich chaired the board of Knowbility and currently is President and Creator at A Diver's Life YouTube Channel.

Mentioned in this episode:

Info about Accessibility at Blink

Transcripts

Speaker:

(dramatic music)

Speaker:

- Hello, this is Digital Accessibility

Speaker:

with The People Behind the Progress

Speaker:

I'm Joe Welinske, the creator and host of this series

Speaker:

and as an accessibility professional myself,

Speaker:

I find it very interesting

Speaker:

is how others have found their way into this profession.

Speaker:

So let's meet one of those people right now

Speaker:

and hear about their journey.

Speaker:

- All right, well, here we are again

Speaker:

with another episode where I have a great opportunity

Speaker:

to talk to an accessibility practitioner

Speaker:

and today I'm very pleased to be speaking

Speaker:

with Rich Schwerdtfeger.

Speaker:

Hello, Rich.

Speaker:

How are you today?

Speaker:

- Good Joe, how are you?

Speaker:

- Yeah, I'm good.

Speaker:

I'm as usual in ensconced in my Vatian Island office,

Speaker:

which is near Blink's Seattle headquarters.

Speaker:

Where are you located?

Speaker:

- I'm located near in Kralendijk

Speaker:

in Bonaire in the Southern Caribbean.

Speaker:

We retired here back in 2000-

Speaker:

To here in 2017 and we like scuba diving,

Speaker:

so that's what we do all the time here, yeah.

Speaker:

- Well, it sounds like a fabulous place to be.

Speaker:

And I mentioned before that it's an area I wanna visit.

Speaker:

So it's great to be talking to you

Speaker:

and you are retired now, but I definitely was happy

Speaker:

to be able to have this chat with you

Speaker:

because you've been involved in so much

Speaker:

within the accessibility profession

Speaker:

and helping to grow things for all of us.

Speaker:

So maybe a good place to start is kind of

Speaker:

what you've done most recently related to accessibility

Speaker:

and kind of the final things that you were doing

Speaker:

as your full-time activity and then we can go from there.

Speaker:

- Okay, well, as you said, I retired,

Speaker:

I did that at the end of 2016 and we moved down here.

Speaker:

I think some of the related to accessibility

Speaker:

that I've done is I chaired the Board of Nobility

Speaker:

for about two years after, I continued to chair

Speaker:

the Board of Nobility two years after I retired from IBM.

Speaker:

So when I was working at IBM,

Speaker:

I was the chief technology officer

Speaker:

for accessibility at IBM when I retired.

Speaker:

I also chaired the board of this nonprofit,

Speaker:

which does a lot to educate people on how to make

Speaker:

the web accessible and other things like that.

Speaker:

And did a lot in the last few years in training executives

Speaker:

and also students going to college,

Speaker:

just so that we would have people who basically

Speaker:

get ingrained accessibility in their working careers.

Speaker:

So I did that the last couple years I was here.

Speaker:

I actually had, in the middle of my retirement,

Speaker:

we were in Rajampet and I had actually

Speaker:

had a neat tendon rupture,

Speaker:

and I got to experience what it's like

Speaker:

to get around the island when you have a disability.

Speaker:

So I wrote an article for the local newspaper

Speaker:

saying how bad things were.

Speaker:

But so I did do that and not accessibility related,

Speaker:

but actually chaired the board of a nonprofit here

Speaker:

that was looking to preserve the monuments

Speaker:

on the island from development.

Speaker:

So I did some of those things.

Speaker:

And beyond that, like I said, I'm into the scuba diving

Speaker:

so I do a lot of volunteer work.

Speaker:

We restored the sponges on the famous

Speaker:

Salt Pier here in Bonaire.

Speaker:

They were refurbishing the pier and these sponges

Speaker:

had come off and there it's a big tourist attraction,

Speaker:

so we put 'em ball back on.

Speaker:

Clean up dives, we had when an oil spill hit here,

Speaker:

I was involved with, my wife and I

Speaker:

were both involved with doing the cleanup.

Speaker:

So that's what we've done since retirement.

Speaker:

And I've gone and I've given interviews

Speaker:

on how we did things back in the day with accessibility

Speaker:

and how that affected things going forward.

Speaker:

So that's basically the extent

Speaker:

of my accessibility work since retirement.

Speaker:

- Well, it sounds like retirement is kind of

Speaker:

in quotes for you because it sounds

Speaker:

like you've been really, keep yourself continually busy.

Speaker:

- Also, I mean, I have a YouTube channel,

Speaker:

so I do underwater cinema photography.

Speaker:

That's my, big passion of mine too.

Speaker:

Totally unrelated to what I did in the past, but yeah.

Speaker:

- But I think you said that your last position at IBM

Speaker:

was chief technology officer for accessibility.

Speaker:

I imagine that's a considerable amount of activities

Speaker:

and responsibility there.

Speaker:

Maybe before we go kind of delving into the past,

Speaker:

what were you involved with as the CTO of accessibility?

Speaker:

- Well, okay.

Speaker:

So let me just backtrack a little bit.

Speaker:

So I'm actually the very first distinguished engineer

Speaker:

at IBM on accessibility.

Speaker:

There had never been one before.

Speaker:

So, and I think that speaks a lot about what we were able

Speaker:

to achieve as a group at IBM and that, yes, I led things,

Speaker:

but big things are never done by one person.

Speaker:

And I'm, I think I was then also the first

Speaker:

chief technology officer for accessibility at the company.

Speaker:

So I dunno if they have one right now,

Speaker:

but I think a lot of that, I mean,

Speaker:

I can go into my career things,

Speaker:

but one of the big things was the ARIA work

Speaker:

and we can talk about that a little bit later if we-

Speaker:

Because that also, you know, some of the big things

Speaker:

that you achieve is when you tie accessibility

Speaker:

to a business case at the company.

Speaker:

And that's part of what you really need to do

Speaker:

as like an accessibility officer is you,

Speaker:

if you're gonna move, you basically as just as a CTO

Speaker:

or a distinguished engineer.

Speaker:

At IBM, that's kind of like the chiefs of the boat,

Speaker:

like on a submarine.

Speaker:

These are the guys that are usually, the buck stops here

Speaker:

when somebody is in hot water, maybe because didn't produce

Speaker:

something that's accessible, they call you in

Speaker:

and to clean up the mess, or if there's something

Speaker:

affecting the business on a big way.

Speaker:

I mean, the work that I did on ARIA,

Speaker:

I actually started out with, we had a $20 billion

Speaker:

software business that was at risk.

Speaker:

And I could talk about that if we have time.

Speaker:

The ARIA's has actually helped, not only just helped people

Speaker:

with disabilities, but also opened up the broader

Speaker:

open web and IBM software middleware business.

Speaker:

So all of that, I think, contributed

Speaker:

to my getting that position at the company.

Speaker:

But yes, it's a lot of experience,

Speaker:

a lot of responsibility with that job.

Speaker:

You really are responsible for your part

Speaker:

of this $20 billion software business at the company

Speaker:

at the time and so that included,

Speaker:

you have to build infrastructure to support your products.

Speaker:

You have to get tools to support it,

Speaker:

assist technology support.

Speaker:

You had to sell the rest of the world

Speaker:

on the the technology that you were...

Speaker:

You can't just invent stuff.

Speaker:

If you can't get other people to use it,

Speaker:

it's usually a failure.

Speaker:

So I'm not the type of guy who would go out

Speaker:

and just, okay, I'm gonna go, here's how you,

Speaker:

here's all the directions for making a product accessible.

Speaker:

Yeah, I contribute to that, but the whole infrastructure

Speaker:

to even make that possible is what I was involved.

Speaker:

- Well, I definitely wanna dig more into your ARIA work,

Speaker:

but one of the things I like to do in this series

Speaker:

is find out how people made their way

Speaker:

to where they are today.

Speaker:

Because for each of us, it tends to be

Speaker:

a winding, circuitous path to where we end up.

Speaker:

So kind of what would be a milestone for you?

Speaker:

What were the first glimmers of that.

Speaker:

- So that's a great way...

Speaker:

It's this winding path.

Speaker:

It's a really good way to describe it.

Speaker:

So I'm gonna take you back to, I wanna say 1990, all right?

Speaker:

This is about right before I started at IBM.

Speaker:

So I was working in the oil field business,

Speaker:

and nothing to do with accessibility,

Speaker:

had I had developed the technology that basically

Speaker:

recovered all their RC drilling operations,

Speaker:

which was the signal process simulated.

Speaker:

Actually nothing to do with accessibility.

Speaker:

And anyways, the company was restructuring.

Speaker:

The oil oil business had kind of tanked a bit.

Speaker:

And you know, what I was doing

Speaker:

was the next generation decoding system.

Speaker:

And it was around OS/2.

Speaker:

So Jim Thatcher, you may or may not know Jim Thatcher.

Speaker:

So Jim was looking for someone

Speaker:

who was an OS/2 internals expert.

Speaker:

And so I was looking for a job and this thing came up

Speaker:

at the IBM's Watson Research Lab

Speaker:

and I said, "I don't know what a screen reader is,

Speaker:

but this looks kind of interesting."

Speaker:

I always wanted to work for IBM when I was younger

Speaker:

and I said, "well, let's go give this a try."

Speaker:

So anyways, they accepted my resume.

Speaker:

And so, I still remember my first day

Speaker:

at IBM seeing Jim Thatcher.

Speaker:

I mean, this is, you know, he's not with us anymore,

Speaker:

but I remember, first, he was a lot older than me.

Speaker:

I think I was well back, this was back in 1990,

Speaker:

so its a number of years ago.

Speaker:

And so I come in, I'm waiting in the lobby

Speaker:

and this guy comes running down this,

Speaker:

I mean literally running down the stairs with a big grin.

Speaker:

It's like he just won the lottery.

Speaker:

Somebody's gonna solve this technical problem he had.

Speaker:

And what had happened at that time in 1990

Speaker:

is the world was moving from DOS,

Speaker:

which is a character-based system, to windows and OS/2.

Speaker:

So this graphical user interface

Speaker:

and it was completely inaccessible.

Speaker:

And so people were concerned

Speaker:

about losing access to the computer, I mean completely.

Speaker:

You would not be able to go to school anymore.

Speaker:

It's a little bit like how ARIA started too

Speaker:

because we were gonna, everything was going to the rich web

Speaker:

and we were gonna lose access to the computer.

Speaker:

So my job at that time was to figure out

Speaker:

how we could capture what was drawn on the screen

Speaker:

in real time and make it accessible to a screen reader.

Speaker:

So that meant I needed to capture text

Speaker:

when icons were drawn at a very low level.

Speaker:

And so I kind of leveraged my work in operating systems

Speaker:

and real time systems I used to work,

Speaker:

my first job outta school was the F-15 Weapons System,

Speaker:

which is a real-time system.

Speaker:

So all of this stuff came, and plus my OS/2 internal work,

Speaker:

which was kind of rare to have people

Speaker:

that would have those skills and it all kind of,

Speaker:

you know, just like you said,

Speaker:

you just kind of at the right place at the right time,

Speaker:

you had the right set of skills.

Speaker:

And so I didn't realize honestly how important this was

Speaker:

until I started doing the work and in,

Speaker:

I think it was, it was the summer of 1991,

Speaker:

an article came out in "BYTE Magazine."

Speaker:

Now back then, "BYTE Magazine..."

Speaker:

Do you remember "BYTE Magazine," Joe?

Speaker:

- Yeah, it was like that thick at one point.

Speaker:

- Well back then that an article by Joe Lazzaro came out,

Speaker:

talking about loss of the computer to the blind

Speaker:

and which highlighted the problems I was just talking about.

Speaker:

And I actually had managed to get some

Speaker:

working with the team in the lab.

Speaker:

So, you're reading this article.

Speaker:

You could just, you could cut the fear with a knife.

Speaker:

It was like nothing you've ever experienced before

Speaker:

that you can potentially make a difference in.

Speaker:

And so I read this "BYTE" article

Speaker:

and I contacted Jon Udell at "BYTE" and I said, "Jon,

Speaker:

we actually have a working prototype of this right now."

Speaker:

This is before Windows even, we couldn't,

Speaker:

we actually back then, we couldn't even

Speaker:

get Microsoft to look at this back then.

Speaker:

They weren't weren't interested.

Speaker:

So we were doing this on OS/2 to start.

Speaker:

And so I wrote this article that,

Speaker:

it's constantly referenced today,

Speaker:

it's called, "Making the GUI Talk" in December '91.

Speaker:

So this was big.

Speaker:

This, like a seminal article and what really hit me

Speaker:

is Jim who led the team, he went to Washington

Speaker:

to discuss loss of access to the computer by the blind.

Speaker:

And he went to this government building

Speaker:

on the second floor and outside the room,

Speaker:

there were tables lining the wall with stacks and stacks,

Speaker:

like maybe a hundred copies

Speaker:

of this "BYTE Magazine" article thing.

Speaker:

And to basically summarize it,

Speaker:

everybody thought IBM had solved this problem

Speaker:

and everything was gonna be okay.

Speaker:

That I really can't tell you how life transformational

Speaker:

something like that is for someone.

Speaker:

And to me it was, it was big.

Speaker:

So anyways, long story short,

Speaker:

I remember I went to my very first trip

Speaker:

to CSUN that year and I felt like I was Mick Jagger.

Speaker:

(Rich laughing)

Speaker:

'Cause everybody wanted to meet,

Speaker:

who's the guy who wrote this article?

Speaker:

And it's not about I did this, or I did that.

Speaker:

What mattered is we had actually made a difference.

Speaker:

That to me was more important than anything else.

Speaker:

And then I was actually the first person,

Speaker:

I took what I learned there, and I was the first person

Speaker:

to hear Windows talk for the first time.

Speaker:

I actually, Jim challenged me to figure out how,

Speaker:

you're never gonna solve that.

Speaker:

I hacked the Windows operating system.

Speaker:

I'm running an OS/2 to the display driver

Speaker:

and we had it and I got it working.

Speaker:

And I had undocumented calls into the operating system

Speaker:

to communicate between OS/2 screener and Windows.

Speaker:

And you know, it just, to make it fast, fast enough.

Speaker:

And so we would, I remember back in the day

Speaker:

we would go into,

Speaker:

I would go to a customer site

Speaker:

and they were having a problem.

Speaker:

Everybody was running Windows except for the one person who

Speaker:

could not see the screen was running OS/2

Speaker:

just because of our screen reader.

Speaker:

And also it was the first one that was programmable,

Speaker:

it had a programmable interface, user interface.

Speaker:

We actually, I don't know if it was me.

Speaker:

I think it were Jim.

Speaker:

We basically gave our documentation to PAL,

Speaker:

which is our program access language to Chuck Opperman

Speaker:

who's working at Headers Choice

Speaker:

and they used that as the basis

Speaker:

for their scripting language back then.

Speaker:

So, 'cause we weren't gonna build a native Window screener,

Speaker:

so we figured, well, okay, let's get 'em started.

Speaker:

So anyways, that's how it started.

Speaker:

And I guess after that, I mean I've done a number

Speaker:

of other things.

Speaker:

I've worked on Java accessibility.

Speaker:

I don't know if you remember Java?

Speaker:

I worked with Sun on the Java accessibility API.

Speaker:

We did the first talking screen reader for that.

Speaker:

We did some magnification software.

Speaker:

We did work for seniors that got deployed in Tokyo

Speaker:

because they have a huge aging population in Tokyo

Speaker:

and with a lot of cognitive impairments

Speaker:

and sight impairments and a whole range of things

Speaker:

and these CAS were deployed all over downtown

Speaker:

so that people could access information,

Speaker:

which was kind of cool too.

Speaker:

So we did a lot of that and I think,

Speaker:

so that's kinda like in the middle before,

Speaker:

I mean, Java was, at the time it was big,

Speaker:

but I would not call it transformational.

Speaker:

But what I found in your career is even though

Speaker:

you may not use it directly, may not be big,

Speaker:

what you learn from that is critical

Speaker:

for the next step that you have to take.

Speaker:

And so this gets into the whole thing with ARIA.

Speaker:

- Well, yeah, it's just, if I jump in before that.

Speaker:

Yeah, I mean, so you were involved

Speaker:

in some really foundational aspects of,

Speaker:

in a modern software and digital expression,

Speaker:

that audiblized information.

Speaker:

And so you definitely were in a unique situation.

Speaker:

You know, a lot of people become familiar with accessibility

Speaker:

because there's been building blocks there already,

Speaker:

but kind of when you came into it,

Speaker:

you were really at kind of that origin stage

Speaker:

of bootstrapping and building it.

Speaker:

And so, yeah, I think that's kind of

Speaker:

puts you in a very unique position.

Speaker:

But to get my question, there must have been something

Speaker:

in that first period when you're working with it

Speaker:

where you decided you wanted to continue in that area.

Speaker:

So maybe talk a little bit about that because you could have

Speaker:

obviously gone in a different direction.

Speaker:

You'd done different things before that.

Speaker:

So what was it that kind of kept you on that track?

Speaker:

- Well, okay.

Speaker:

So one of the things yet, I mean,

Speaker:

understand there's different types of people.

Speaker:

And there are people that need to have something

Speaker:

to start with and there are people that can start

Speaker:

with nothing and have to, and can make something happen.

Speaker:

I'm kind of that type of a person.

Speaker:

The other stuff doesn't float my boat that much.

Speaker:

And the fact that I could use that about me to...

Speaker:

Well, I mean, one of the things I should tell you is like,

Speaker:

when we were doing the screener,

Speaker:

IBM employed a lot of people with were disabled

Speaker:

and you work with these people

Speaker:

and they contribute to the design of the user experience

Speaker:

and when they're successful, you see it on a big scale.

Speaker:

I found that, working with Sun on Java accessibility

Speaker:

was also a great thing, you know.

Speaker:

Here's an example.

Speaker:

They had a Java accessibility.

Speaker:

I won't say this company, but we had somebody

Speaker:

that had an accessibility API infrastructure out there

Speaker:

that we had, Sun had a meeting with a whole bunch

Speaker:

of industry leaders and they said,

Speaker:

"okay, we wanna make this successful."

Speaker:

And the other company, actually we'll say it,

Speaker:

it was Microsoft at that time.

Speaker:

They said, "well, just use our API."

Speaker:

And I said, "but I knew, you know, from how to..."

Speaker:

'Cause under the covers to support the screen reader,

Speaker:

you had an API in what you needed,

Speaker:

what they needed to get information.

Speaker:

And so they didn't have what you needed.

Speaker:

They didn't have all of it.

Speaker:

And it also, it was very tied to it

Speaker:

as we needed something to be cross platform.

Speaker:

So I remember, this is the coolest thing.

Speaker:

So we got in there and with Java, you could do things

Speaker:

like 10 times faster than low-level operating systems.

Speaker:

And I remember, so this was like January or February

Speaker:

of, I forget what year it was.

Speaker:

I wanna say, 1987, something like that,

Speaker:

maybe year 1997, or '96.

Speaker:

But we anyways, long story short is we basically

Speaker:

worked together as a team, we created an API

Speaker:

and we got a working screener all in a matter of,

Speaker:

and I mean to talk through everything

Speaker:

you can think of, it did it, right?

Speaker:

It did it in about six months.

Speaker:

I mean, six months is incredible,

Speaker:

plus a reusable infrastructure.

Speaker:

And we went to, what's the conference they have

Speaker:

up in, Closing the Gap?

Speaker:

I think it is up there, they still have that.

Speaker:

- That still happens.

Speaker:

- Yeah, so we went there

Speaker:

'cause that was the first available conference.

Speaker:

And I remember 'cause I know Microsoft tried

Speaker:

to implement their API on two buttons at CSUN,

Speaker:

just two buttons.

Speaker:

We had it working list boxes, spreadsheets,

Speaker:

I mean everything, right?

Speaker:

Rich text editing.

Speaker:

And he came in and I remember his jaw dropped

Speaker:

and hit the, you know, at that time.

Speaker:

So, but the thing is, you know,

Speaker:

we all kind of, even Microsoft,

Speaker:

we all tend to work together

Speaker:

and I felt that was the most, that to me,

Speaker:

being able to have the impact,

Speaker:

I didn't really want to go back.

Speaker:

I mean, going back to what I did before,

Speaker:

it's just not the same.

Speaker:

You can't have an impact like that.

Speaker:

I mean, it's very rare.

Speaker:

So anyway, that's what it was.

Speaker:

That's why I stayed there.

Speaker:

- That's good.

Speaker:

That's great.

Speaker:

That's you a good part of the story to hear about.

Speaker:

And then, you know, definitely that next important part

Speaker:

of your career was surrounding the ARIA technology.

Speaker:

For people that aren't familiar with that,

Speaker:

the acronym I'm using is A R I A,

Speaker:

which actually was built on RIA,

Speaker:

which was rich internet applications,

Speaker:

which going back 20 years ago as there was the .com boom

Speaker:

and websites exploding, they weren't really as robust as

Speaker:

people were used to with applications

Speaker:

that they would have on their Windows

Speaker:

as Mac operating systems and so rich internet applications

Speaker:

started to come about,

Speaker:

and then there was accessible rich internet applications,

Speaker:

which is where you came into the picture.

Speaker:

So talk about a little bit about the evolution of that.

Speaker:

- Okay, so right around, this is around 2003.

Speaker:

So I was working in research

Speaker:

and the head of emerging technologies,

Speaker:

so I worked with on Java, comes to me,

Speaker:

he comes and he reaches out to me

Speaker:

and we had a good working relationship

Speaker:

for other reasons, not Java work.

Speaker:

He comes into my office, doesn't tell me why, he says,

Speaker:

"hey, Rich, you know, I'd like you to come over

Speaker:

and be the lead architect

Speaker:

for accessibility in our software group."

Speaker:

Which is, so lead research and then do whatever it is.

Speaker:

So he never told me why.

Speaker:

And I said, "well, that sounds exciting.

Speaker:

I get to do something different."

Speaker:

So I went over there and so I was working at Austin

Speaker:

and we got a call that we were gonna have

Speaker:

a team meeting in Cambridge, Mass.

Speaker:

And so we all fly up there and we spend the morning

Speaker:

and we're talking about odds and ends.

Speaker:

And after the meeting's over, he says,

Speaker:

"I need you to come with me."

Speaker:

So we go into this part of,

Speaker:

I mean, this was really super secret stuff at the time.

Speaker:

We go into this, all the way into the back area

Speaker:

of the floor in this like hidden cubicle, you know.

Speaker:

And he brings up, this is before Google Docs,

Speaker:

the very first working office suite

Speaker:

running in a web browser.

Speaker:

I mean, this is like, so you have to understand

Speaker:

why this would be so important

Speaker:

from a strategic perspective for the company.

Speaker:

So if you look back at that time, you had,

Speaker:

Microsoft owned nine over 90% of all the clients apps space.

Speaker:

And what they had done is they also owned

Speaker:

over 90% of the browser market

Speaker:

and what they had done is they had moved

Speaker:

their entire Internet Explorer team out to Beijing, China,

Speaker:

and they put it in maintenance mode.

Speaker:

And so the only thing they're willing to make changes

Speaker:

to that browser was to security fixes,

Speaker:

you know, things like that.

Speaker:

But, you know, and they had a lot of stuff

Speaker:

with actives back then that they had to deal with,

Speaker:

that was another programming model and they were push,

Speaker:

and so what they wanted to do is they wanted to use this

Speaker:

market position to basically tie the client desktop

Speaker:

to their middle, where you could only use their mode.

Speaker:

And so what they had done is they had said, okay,

Speaker:

we're gonna basically make the web kind of obsolete

Speaker:

because we're not gonna do anything.

Speaker:

And so for IBM, this for them

Speaker:

was a killer for their software business

Speaker:

because if Microsoft, if people aren't deploying to the web,

Speaker:

that's a big issue because what we had,

Speaker:

what they had come out with in the lab

Speaker:

with the, this came with a company acquisition

Speaker:

from a company called Alpha Blocks.

Speaker:

And they told why they bought this company,

Speaker:

but the real reason they bought the company

Speaker:

was for this technology.

Speaker:

And so if we,

Speaker:

the problem was to be able to make this consumable

Speaker:

is we had to get over two big accessibility

Speaker:

law restrictions that were in WIC AG 1.

Speaker:

and the two words you had to run with JavaScript

Speaker:

and CSS turned off because it wasn't accessible.

Speaker:

And the reason that was at that time was

Speaker:

because people that worked on web accessibility

Speaker:

didn't really know software accessibility

Speaker:

from a holistic internals level and having worked on Java

Speaker:

and having worked with, I actually provided feedback

Speaker:

on Microsoft's accessibility work,

Speaker:

we used to go to those meetings and work with their team.

Speaker:

You know, they didn't have the skillset.

Speaker:

So they looked at this as I don't know how to fix this,

Speaker:

so the first thing you do is you say, oh, we can't fix it,

Speaker:

so we're gonna make it inaccessible.

Speaker:

So it's basically, and what happened

Speaker:

is every major government organization

Speaker:

throughout the planet basically said,

Speaker:

you can't use these technologies and be accessible.

Speaker:

So, you know, what this means is companies

Speaker:

like Oracle, IBM, you know, all the big

Speaker:

middleware companies, they couldn't deploy their software.

Speaker:

So, and he said, do you know what the problem is?

Speaker:

And I said, yeah, you're using JavaScript and CSS

Speaker:

to create these user interfaces and they're not accessible.

Speaker:

Yeah, and this had been not been solved for six years.

Speaker:

He says, yeah.

Speaker:

And the whole $20 billion software business is riding on it.

Speaker:

We need you to figure it out.

Speaker:

So no pressure, Joe.

Speaker:

(Rich laughing)

Speaker:

So I went back to Austin and I started looking

Speaker:

at how these apps were constructed

Speaker:

and they had a document object model, which is like a tree

Speaker:

and the reason they have that model

Speaker:

is because it's modeled after the desktop Window hierarchy,

Speaker:

because that's how they propagate keyboard and mouse events.

Speaker:

So to tie it into the operating system,

Speaker:

they had to use the same infrastructure under the covers.

Speaker:

And so if you look about accessibility APIs on platforms,

Speaker:

they're based on, this object tells you what type

Speaker:

of object it is and what it is and what it's role is,

Speaker:

what's its states are,

Speaker:

and when things change, you get notified.

Speaker:

So if you go from checked to not checked,

Speaker:

a screen reader or some other's, maybe another type

Speaker:

of voice recognition system,

Speaker:

whatever gets notified when something gets changed

Speaker:

and then they respond, so that's how these systems worked.

Speaker:

And on the web, what was happening is,

Speaker:

so they would take these elements that they provided

Speaker:

for an HTML that had no semantics that matched

Speaker:

what you would use in conventional desktop platforms,

Speaker:

like menus and list boxes and all the other stuff.

Speaker:

And I thought, you know, and this only took me

Speaker:

about a month 'cause I just happened to be, like I said,

Speaker:

you're in the right place at the right time.

Speaker:

I had worked with all this stuff on Java,

Speaker:

I'd worked on screen readers,

Speaker:

I could see the whole thing in front of me

Speaker:

like it was clear as a bell.

Speaker:

And so what I, and I said, look, if we could add

Speaker:

these semantics on top of the HTML webpage

Speaker:

and say, well, I know this is what you think it is,

Speaker:

but it's really one of these.

Speaker:

And this is what's being change, is here, changes here,

Speaker:

care about all these things.

Speaker:

And if we could do that, then rich web applications

Speaker:

would behave excessively like desktop applications.

Speaker:

So, and like many things, Joe, in order to,

Speaker:

it solving the technical, the basic technical problem

Speaker:

is actually often the easiest part.

Speaker:

The hard part is making everybody, get 'em to adopt it.

Speaker:

So this means browser manufacturers,

Speaker:

assistant technology vendors and not just Windows,

Speaker:

you need to get a Mac, you need iPhones,

Speaker:

you need all, you know, over time,

Speaker:

all of these things had to get, Linux, right?

Speaker:

And so we had to pull a team together.

Speaker:

We had to put people in the web standards efforts

Speaker:

to create new standards for,

Speaker:

it was called DHTML accessibility early on

Speaker:

and we had to change WIC AG to remove the restrictions,

Speaker:

but you couldn't do it without something

Speaker:

that proved that it worked.

Speaker:

I mean, this literally took eight years

Speaker:

to make all this happen.

Speaker:

So then you have to change government policy, you know.

Speaker:

So these are all the things, and I didn't do this

Speaker:

all myself, I led a team that would do this and you know,

Speaker:

and they're not always direct reports to me.

Speaker:

And anyways, we had to get that done

Speaker:

and we also had to get IBM's

Speaker:

own product teams to support it.

Speaker:

And then we had to actually extend the APIs

Speaker:

on the operating system, so one of the fallouts

Speaker:

is we went Microsoft's UI automation at the time

Speaker:

was too slow and so what we, under the covers,

Speaker:

we have to map each operating system platform.

Speaker:

So we wrote an extension for active accessibility

Speaker:

and it's used today in Google Chrome,

Speaker:

it's used in Firefox, it's used, you know,

Speaker:

it's used in OpenOffice.

Speaker:

So not only was that used,

Speaker:

but also in the infrastructure,

Speaker:

and we also influenced the other platforms.

Speaker:

But more importantly, we got the other platforms

Speaker:

like Apple to join in and provide their side of the point,

Speaker:

how they worked and how we pulled it all together.

Speaker:

But anyways, and I actually didn't come up

Speaker:

with the name ARIA, I think that was Judy Brewer

Speaker:

that came up with that name.

Speaker:

So it kind of stuck.

Speaker:

So Judy, you know Judy.

Speaker:

So that gives you some idea of how I got

Speaker:

to where I am so, where I did.

Speaker:

- Yeah, but you know, going to your point of making sure

Speaker:

that everyone is willing to buy into an invented solution,

Speaker:

You did a lot of work with World Wide Web Consortium

Speaker:

and working group and W3C is all about collaboration

Speaker:

across all kinds of different levels, government,

Speaker:

academic, corporate, different international aspects to it.

Speaker:

So that was a big part of your work as well, wasn't it?

Speaker:

- Yeah, well, that's important points

Speaker:

that you've observed because I remember

Speaker:

having these discussions at IBM and I said,

Speaker:

you know, your first, 'cause I was also

Speaker:

on the patent board too at the time.

Speaker:

I said, they're your first blush is we need to patent this.

Speaker:

And I said, that's the last thing you need to do.

Speaker:

You need to be able to make this freely available

Speaker:

to everybody or else they'll run.

Speaker:

They won't do it.

Speaker:

They don't wanna be locked in.

Speaker:

So we did, everything was open.

Speaker:

We did open standards for W3C,

Speaker:

we did an open accessibility API for, IAccessible2.

Speaker:

I mean, everything was basically free.

Speaker:

And not only that, but if you could imagine

Speaker:

these companies wanted to solve this problem too

Speaker:

and they all got, including Microsoft.

Speaker:

Microsoft got in and they were a really

Speaker:

a huge contributor to ARIA as well.

Speaker:

So, you know, we had a good, really good

Speaker:

experience with all of it and if we had not done that,

Speaker:

then that would probably, then we would

Speaker:

have a different world today, I think, if we hadn't.

Speaker:

But as a result of that, I can tell you

Speaker:

that the proprietary platform of silver light

Speaker:

and their lock in, all that stuff,

Speaker:

you don't hear about it anymore.

Speaker:

You hear about the open web.

Speaker:

So we, but everybody benefited.

Speaker:

I remember that we had gained enough momentum

Speaker:

that we would go to CSUN.

Speaker:

We'd basically populate teams

Speaker:

all throughout the whole conference.

Speaker:

We worked with Missoula and whatnot,

Speaker:

saying about showing people what we were doing.

Speaker:

And I remember Cynthia Shelly coming up to me and asking me,

Speaker:

well, how do we get involved?

Speaker:

Because they're asking why Microsoft

Speaker:

at that time wasn't involved with it?

Speaker:

And I said, Cynthia, it's all open.

Speaker:

You just joined the W3C.

Speaker:

Anybody can use it.

Speaker:

There's no restrictions.

Speaker:

I'll work with your team.

Speaker:

So I think that what I, so this is interesting.

Speaker:

So I remember, so Cynthia went back and she got Microsoft,

Speaker:

'cause every time you join a W3C working group,

Speaker:

you have to get approval by your legal team

Speaker:

because it's, there's intellectual property involved

Speaker:

and all that stuff, so in the meantime,

Speaker:

what I started doing is I started having meetings

Speaker:

every Monday night with Linda Mau from the Microsoft team

Speaker:

working on Internet Explorer and sharing what we did,

Speaker:

getting input, bringing it back to the group while they,

Speaker:

so I was doing this on the back channel.

Speaker:

And the pivotal meeting for me was, 'cause we told you,

Speaker:

they had moved the whole browser team out to Beijing, China.

Speaker:

She said to, usually had these calls at 9:00 at night

Speaker:

and Linda said to me on call,

Speaker:

well, I'm not gonna be able to work with you anymore.

Speaker:

I said, really?

Speaker:

And I said, why is this?

Speaker:

We're moving the whole effort back to rep.

Speaker:

And I says, is it because of accessibility?

Speaker:

And she said, yes.

Speaker:

So people don't realize this, but accessibility

Speaker:

is the thing that basically broke open the web

Speaker:

because at that point, the biggest player

Speaker:

was still Microsoft, they had most of the market

Speaker:

and they got involved with this

Speaker:

and the fact that they got involved and started working

Speaker:

on it, whether they were at the same level or not,

Speaker:

you know, may have taken a while, but it's irrelevant.

Speaker:

I mean, they got involved and it also gave credits

Speaker:

for when Google came out with Chrome, they, you know,

Speaker:

this enabled their browser to take off and Firefox.

Speaker:

And I remember Firefox plus for performance reasons,

Speaker:

it started shooting up in market share,

Speaker:

Chrome took off later on.

Speaker:

So that was the pivotal moment

Speaker:

that people just don't know about.

Speaker:

It was, so you ask why you do this stuff?

Speaker:

How often do you get a chance

Speaker:

to make that much of a difference?

Speaker:

You really...

Speaker:

And yeah, it's for people with, and for me...

Speaker:

Okay, so yes, I did this for business reasons, but for me,

Speaker:

I always did it for the people with disabilities

Speaker:

'cause I always, to me that meant a lot.

Speaker:

When you see somebody...

Speaker:

I mean, I remember when Tom Watkowski,

Speaker:

he used to be a director for accessibility at AOL

Speaker:

and he went to the, company named,

Speaker:

this is getting older now.

Speaker:

One of the big companies or what,

Speaker:

broadcasting companies out of in Pennsylvania.

Speaker:

And so he, I sent him Greg Aaron Leventhal,

Speaker:

who worked on my team, he sent him a code example,

Speaker:

a first talking tree on a webpage.

Speaker:

And so Tom was blind and he literally cried.

Speaker:

When do you do that?

Speaker:

I mean, it's...

Speaker:

- Yeah.

Speaker:

- It's incredible.

Speaker:

So I'm really proud of the work that everybody did

Speaker:

and yes, I had to let a lot of stuff

Speaker:

and I don't make it sound like I did it all 'cause I didn't.

Speaker:

'Cause a lot of people were involved with it.

Speaker:

I mean Andy Weaver and Becky Gibson were working

Speaker:

on WIC AG, changing WIC AG.

Speaker:

Aaron basically wrote all the code in Firefox

Speaker:

that basically got it working in prototype in Firefox.

Speaker:

Then he shared this stuff with the Missoula team for Chrome

Speaker:

and on and on and on.

Speaker:

There's just a lot of, and great feedback from Microsoft,

Speaker:

great feedback from Apple.

Speaker:

And you know, you also get your fights too,

Speaker:

with any standards efforts, you have your technical battle,

Speaker:

but you know, overall it was pretty cool.

Speaker:

So all of that got me eventually got me

Speaker:

to get that position at the company.

Speaker:

So I'm very pleased with what everybody,

Speaker:

what everybody did at the time, so yeah.

Speaker:

- Well that's I think a great place to end it

Speaker:

with your personal reflections on there.

Speaker:

This has been a really interesting,

Speaker:

and illuminating journey through some of these

Speaker:

foundational technical building blocks

Speaker:

to the accessible web that we have today.

Speaker:

So I wanna thank you for taking the time

Speaker:

to share your stories and look forward

Speaker:

to maybe joining you for a dive sometime.

Speaker:

- That'd be great, that would be great.

Speaker:

The water's beautiful here, so yeah.

Speaker:

- All right. - All right.

Speaker:

- Thanks a lot, Rich. - You take care.

Speaker:

All right, thanks for having me.

Speaker:

And it's been an honor, thank you.

Chapters

Video

More from YouTube