Rich Schwerdtfeger, Retired, IBM, Former Chief Technology Officer for Accessibility
Rich began his work in accessibility with the early development of a screen reader for Windows. He was a key member of the world-wide team that brought technologies like ARIA into mainstream use for accessibility. Rich chaired the board of Knowbility and currently is President and Creator at A Diver's Life YouTube Channel.
Mentioned in this episode:
Info about Accessibility at Blink
(dramatic music)
Speaker:- Hello, this is Digital Accessibility
Speaker:with The People Behind the Progress
Speaker:I'm Joe Welinske, the creator and host of this series
Speaker:and as an accessibility professional myself,
Speaker:I find it very interesting
Speaker:is how others have found their way into this profession.
Speaker:So let's meet one of those people right now
Speaker:and hear about their journey.
Speaker:- All right, well, here we are again
Speaker:with another episode where I have a great opportunity
Speaker:to talk to an accessibility practitioner
Speaker:and today I'm very pleased to be speaking
Speaker:with Rich Schwerdtfeger.
Speaker:Hello, Rich.
Speaker:How are you today?
Speaker:- Good Joe, how are you?
Speaker:- Yeah, I'm good.
Speaker:I'm as usual in ensconced in my Vatian Island office,
Speaker:which is near Blink's Seattle headquarters.
Speaker:Where are you located?
Speaker:- I'm located near in Kralendijk
Speaker:in Bonaire in the Southern Caribbean.
Speaker:We retired here back in 2000-
Speaker:To here in 2017 and we like scuba diving,
Speaker:so that's what we do all the time here, yeah.
Speaker:- Well, it sounds like a fabulous place to be.
Speaker:And I mentioned before that it's an area I wanna visit.
Speaker:So it's great to be talking to you
Speaker:and you are retired now, but I definitely was happy
Speaker:to be able to have this chat with you
Speaker:because you've been involved in so much
Speaker:within the accessibility profession
Speaker:and helping to grow things for all of us.
Speaker:So maybe a good place to start is kind of
Speaker:what you've done most recently related to accessibility
Speaker:and kind of the final things that you were doing
Speaker:as your full-time activity and then we can go from there.
Speaker:- Okay, well, as you said, I retired,
Speaker:I did that at the end of 2016 and we moved down here.
Speaker:I think some of the related to accessibility
Speaker:that I've done is I chaired the Board of Nobility
Speaker:for about two years after, I continued to chair
Speaker:the Board of Nobility two years after I retired from IBM.
Speaker:So when I was working at IBM,
Speaker:I was the chief technology officer
Speaker:for accessibility at IBM when I retired.
Speaker:I also chaired the board of this nonprofit,
Speaker:which does a lot to educate people on how to make
Speaker:the web accessible and other things like that.
Speaker:And did a lot in the last few years in training executives
Speaker:and also students going to college,
Speaker:just so that we would have people who basically
Speaker:get ingrained accessibility in their working careers.
Speaker:So I did that the last couple years I was here.
Speaker:I actually had, in the middle of my retirement,
Speaker:we were in Rajampet and I had actually
Speaker:had a neat tendon rupture,
Speaker:and I got to experience what it's like
Speaker:to get around the island when you have a disability.
Speaker:So I wrote an article for the local newspaper
Speaker:saying how bad things were.
Speaker:But so I did do that and not accessibility related,
Speaker:but actually chaired the board of a nonprofit here
Speaker:that was looking to preserve the monuments
Speaker:on the island from development.
Speaker:So I did some of those things.
Speaker:And beyond that, like I said, I'm into the scuba diving
Speaker:so I do a lot of volunteer work.
Speaker:We restored the sponges on the famous
Speaker:Salt Pier here in Bonaire.
Speaker:They were refurbishing the pier and these sponges
Speaker:had come off and there it's a big tourist attraction,
Speaker:so we put 'em ball back on.
Speaker:Clean up dives, we had when an oil spill hit here,
Speaker:I was involved with, my wife and I
Speaker:were both involved with doing the cleanup.
Speaker:So that's what we've done since retirement.
Speaker:And I've gone and I've given interviews
Speaker:on how we did things back in the day with accessibility
Speaker:and how that affected things going forward.
Speaker:So that's basically the extent
Speaker:of my accessibility work since retirement.
Speaker:- Well, it sounds like retirement is kind of
Speaker:in quotes for you because it sounds
Speaker:like you've been really, keep yourself continually busy.
Speaker:- Also, I mean, I have a YouTube channel,
Speaker:so I do underwater cinema photography.
Speaker:That's my, big passion of mine too.
Speaker:Totally unrelated to what I did in the past, but yeah.
Speaker:- But I think you said that your last position at IBM
Speaker:was chief technology officer for accessibility.
Speaker:I imagine that's a considerable amount of activities
Speaker:and responsibility there.
Speaker:Maybe before we go kind of delving into the past,
Speaker:what were you involved with as the CTO of accessibility?
Speaker:- Well, okay.
Speaker:So let me just backtrack a little bit.
Speaker:So I'm actually the very first distinguished engineer
Speaker:at IBM on accessibility.
Speaker:There had never been one before.
Speaker:So, and I think that speaks a lot about what we were able
Speaker:to achieve as a group at IBM and that, yes, I led things,
Speaker:but big things are never done by one person.
Speaker:And I'm, I think I was then also the first
Speaker:chief technology officer for accessibility at the company.
Speaker:So I dunno if they have one right now,
Speaker:but I think a lot of that, I mean,
Speaker:I can go into my career things,
Speaker:but one of the big things was the ARIA work
Speaker:and we can talk about that a little bit later if we-
Speaker:Because that also, you know, some of the big things
Speaker:that you achieve is when you tie accessibility
Speaker:to a business case at the company.
Speaker:And that's part of what you really need to do
Speaker:as like an accessibility officer is you,
Speaker:if you're gonna move, you basically as just as a CTO
Speaker:or a distinguished engineer.
Speaker:At IBM, that's kind of like the chiefs of the boat,
Speaker:like on a submarine.
Speaker:These are the guys that are usually, the buck stops here
Speaker:when somebody is in hot water, maybe because didn't produce
Speaker:something that's accessible, they call you in
Speaker:and to clean up the mess, or if there's something
Speaker:affecting the business on a big way.
Speaker:I mean, the work that I did on ARIA,
Speaker:I actually started out with, we had a $20 billion
Speaker:software business that was at risk.
Speaker:And I could talk about that if we have time.
Speaker:The ARIA's has actually helped, not only just helped people
Speaker:with disabilities, but also opened up the broader
Speaker:open web and IBM software middleware business.
Speaker:So all of that, I think, contributed
Speaker:to my getting that position at the company.
Speaker:But yes, it's a lot of experience,
Speaker:a lot of responsibility with that job.
Speaker:You really are responsible for your part
Speaker:of this $20 billion software business at the company
Speaker:at the time and so that included,
Speaker:you have to build infrastructure to support your products.
Speaker:You have to get tools to support it,
Speaker:assist technology support.
Speaker:You had to sell the rest of the world
Speaker:on the the technology that you were...
Speaker:You can't just invent stuff.
Speaker:If you can't get other people to use it,
Speaker:it's usually a failure.
Speaker:So I'm not the type of guy who would go out
Speaker:and just, okay, I'm gonna go, here's how you,
Speaker:here's all the directions for making a product accessible.
Speaker:Yeah, I contribute to that, but the whole infrastructure
Speaker:to even make that possible is what I was involved.
Speaker:- Well, I definitely wanna dig more into your ARIA work,
Speaker:but one of the things I like to do in this series
Speaker:is find out how people made their way
Speaker:to where they are today.
Speaker:Because for each of us, it tends to be
Speaker:a winding, circuitous path to where we end up.
Speaker:So kind of what would be a milestone for you?
Speaker:What were the first glimmers of that.
Speaker:- So that's a great way...
Speaker:It's this winding path.
Speaker:It's a really good way to describe it.
Speaker:So I'm gonna take you back to, I wanna say 1990, all right?
Speaker:This is about right before I started at IBM.
Speaker:So I was working in the oil field business,
Speaker:and nothing to do with accessibility,
Speaker:had I had developed the technology that basically
Speaker:recovered all their RC drilling operations,
Speaker:which was the signal process simulated.
Speaker:Actually nothing to do with accessibility.
Speaker:And anyways, the company was restructuring.
Speaker:The oil oil business had kind of tanked a bit.
Speaker:And you know, what I was doing
Speaker:was the next generation decoding system.
Speaker:And it was around OS/2.
Speaker:So Jim Thatcher, you may or may not know Jim Thatcher.
Speaker:So Jim was looking for someone
Speaker:who was an OS/2 internals expert.
Speaker:And so I was looking for a job and this thing came up
Speaker:at the IBM's Watson Research Lab
Speaker:and I said, "I don't know what a screen reader is,
Speaker:but this looks kind of interesting."
Speaker:I always wanted to work for IBM when I was younger
Speaker:and I said, "well, let's go give this a try."
Speaker:So anyways, they accepted my resume.
Speaker:And so, I still remember my first day
Speaker:at IBM seeing Jim Thatcher.
Speaker:I mean, this is, you know, he's not with us anymore,
Speaker:but I remember, first, he was a lot older than me.
Speaker:I think I was well back, this was back in 1990,
Speaker:so its a number of years ago.
Speaker:And so I come in, I'm waiting in the lobby
Speaker:and this guy comes running down this,
Speaker:I mean literally running down the stairs with a big grin.
Speaker:It's like he just won the lottery.
Speaker:Somebody's gonna solve this technical problem he had.
Speaker:And what had happened at that time in 1990
Speaker:is the world was moving from DOS,
Speaker:which is a character-based system, to windows and OS/2.
Speaker:So this graphical user interface
Speaker:and it was completely inaccessible.
Speaker:And so people were concerned
Speaker:about losing access to the computer, I mean completely.
Speaker:You would not be able to go to school anymore.
Speaker:It's a little bit like how ARIA started too
Speaker:because we were gonna, everything was going to the rich web
Speaker:and we were gonna lose access to the computer.
Speaker:So my job at that time was to figure out
Speaker:how we could capture what was drawn on the screen
Speaker:in real time and make it accessible to a screen reader.
Speaker:So that meant I needed to capture text
Speaker:when icons were drawn at a very low level.
Speaker:And so I kind of leveraged my work in operating systems
Speaker:and real time systems I used to work,
Speaker:my first job outta school was the F-15 Weapons System,
Speaker:which is a real-time system.
Speaker:So all of this stuff came, and plus my OS/2 internal work,
Speaker:which was kind of rare to have people
Speaker:that would have those skills and it all kind of,
Speaker:you know, just like you said,
Speaker:you just kind of at the right place at the right time,
Speaker:you had the right set of skills.
Speaker:And so I didn't realize honestly how important this was
Speaker:until I started doing the work and in,
Speaker:I think it was, it was the summer of 1991,
Speaker:an article came out in "BYTE Magazine."
Speaker:Now back then, "BYTE Magazine..."
Speaker:Do you remember "BYTE Magazine," Joe?
Speaker:- Yeah, it was like that thick at one point.
Speaker:- Well back then that an article by Joe Lazzaro came out,
Speaker:talking about loss of the computer to the blind
Speaker:and which highlighted the problems I was just talking about.
Speaker:And I actually had managed to get some
Speaker:working with the team in the lab.
Speaker:So, you're reading this article.
Speaker:You could just, you could cut the fear with a knife.
Speaker:It was like nothing you've ever experienced before
Speaker:that you can potentially make a difference in.
Speaker:And so I read this "BYTE" article
Speaker:and I contacted Jon Udell at "BYTE" and I said, "Jon,
Speaker:we actually have a working prototype of this right now."
Speaker:This is before Windows even, we couldn't,
Speaker:we actually back then, we couldn't even
Speaker:get Microsoft to look at this back then.
Speaker:They weren't weren't interested.
Speaker:So we were doing this on OS/2 to start.
Speaker:And so I wrote this article that,
Speaker:it's constantly referenced today,
Speaker:it's called, "Making the GUI Talk" in December '91.
Speaker:So this was big.
Speaker:This, like a seminal article and what really hit me
Speaker:is Jim who led the team, he went to Washington
Speaker:to discuss loss of access to the computer by the blind.
Speaker:And he went to this government building
Speaker:on the second floor and outside the room,
Speaker:there were tables lining the wall with stacks and stacks,
Speaker:like maybe a hundred copies
Speaker:of this "BYTE Magazine" article thing.
Speaker:And to basically summarize it,
Speaker:everybody thought IBM had solved this problem
Speaker:and everything was gonna be okay.
Speaker:That I really can't tell you how life transformational
Speaker:something like that is for someone.
Speaker:And to me it was, it was big.
Speaker:So anyways, long story short,
Speaker:I remember I went to my very first trip
Speaker:to CSUN that year and I felt like I was Mick Jagger.
Speaker:(Rich laughing)
Speaker:'Cause everybody wanted to meet,
Speaker:who's the guy who wrote this article?
Speaker:And it's not about I did this, or I did that.
Speaker:What mattered is we had actually made a difference.
Speaker:That to me was more important than anything else.
Speaker:And then I was actually the first person,
Speaker:I took what I learned there, and I was the first person
Speaker:to hear Windows talk for the first time.
Speaker:I actually, Jim challenged me to figure out how,
Speaker:you're never gonna solve that.
Speaker:I hacked the Windows operating system.
Speaker:I'm running an OS/2 to the display driver
Speaker:and we had it and I got it working.
Speaker:And I had undocumented calls into the operating system
Speaker:to communicate between OS/2 screener and Windows.
Speaker:And you know, it just, to make it fast, fast enough.
Speaker:And so we would, I remember back in the day
Speaker:we would go into,
Speaker:I would go to a customer site
Speaker:and they were having a problem.
Speaker:Everybody was running Windows except for the one person who
Speaker:could not see the screen was running OS/2
Speaker:just because of our screen reader.
Speaker:And also it was the first one that was programmable,
Speaker:it had a programmable interface, user interface.
Speaker:We actually, I don't know if it was me.
Speaker:I think it were Jim.
Speaker:We basically gave our documentation to PAL,
Speaker:which is our program access language to Chuck Opperman
Speaker:who's working at Headers Choice
Speaker:and they used that as the basis
Speaker:for their scripting language back then.
Speaker:So, 'cause we weren't gonna build a native Window screener,
Speaker:so we figured, well, okay, let's get 'em started.
Speaker:So anyways, that's how it started.
Speaker:And I guess after that, I mean I've done a number
Speaker:of other things.
Speaker:I've worked on Java accessibility.
Speaker:I don't know if you remember Java?
Speaker:I worked with Sun on the Java accessibility API.
Speaker:We did the first talking screen reader for that.
Speaker:We did some magnification software.
Speaker:We did work for seniors that got deployed in Tokyo
Speaker:because they have a huge aging population in Tokyo
Speaker:and with a lot of cognitive impairments
Speaker:and sight impairments and a whole range of things
Speaker:and these CAS were deployed all over downtown
Speaker:so that people could access information,
Speaker:which was kind of cool too.
Speaker:So we did a lot of that and I think,
Speaker:so that's kinda like in the middle before,
Speaker:I mean, Java was, at the time it was big,
Speaker:but I would not call it transformational.
Speaker:But what I found in your career is even though
Speaker:you may not use it directly, may not be big,
Speaker:what you learn from that is critical
Speaker:for the next step that you have to take.
Speaker:And so this gets into the whole thing with ARIA.
Speaker:- Well, yeah, it's just, if I jump in before that.
Speaker:Yeah, I mean, so you were involved
Speaker:in some really foundational aspects of,
Speaker:in a modern software and digital expression,
Speaker:that audiblized information.
Speaker:And so you definitely were in a unique situation.
Speaker:You know, a lot of people become familiar with accessibility
Speaker:because there's been building blocks there already,
Speaker:but kind of when you came into it,
Speaker:you were really at kind of that origin stage
Speaker:of bootstrapping and building it.
Speaker:And so, yeah, I think that's kind of
Speaker:puts you in a very unique position.
Speaker:But to get my question, there must have been something
Speaker:in that first period when you're working with it
Speaker:where you decided you wanted to continue in that area.
Speaker:So maybe talk a little bit about that because you could have
Speaker:obviously gone in a different direction.
Speaker:You'd done different things before that.
Speaker:So what was it that kind of kept you on that track?
Speaker:- Well, okay.
Speaker:So one of the things yet, I mean,
Speaker:understand there's different types of people.
Speaker:And there are people that need to have something
Speaker:to start with and there are people that can start
Speaker:with nothing and have to, and can make something happen.
Speaker:I'm kind of that type of a person.
Speaker:The other stuff doesn't float my boat that much.
Speaker:And the fact that I could use that about me to...
Speaker:Well, I mean, one of the things I should tell you is like,
Speaker:when we were doing the screener,
Speaker:IBM employed a lot of people with were disabled
Speaker:and you work with these people
Speaker:and they contribute to the design of the user experience
Speaker:and when they're successful, you see it on a big scale.
Speaker:I found that, working with Sun on Java accessibility
Speaker:was also a great thing, you know.
Speaker:Here's an example.
Speaker:They had a Java accessibility.
Speaker:I won't say this company, but we had somebody
Speaker:that had an accessibility API infrastructure out there
Speaker:that we had, Sun had a meeting with a whole bunch
Speaker:of industry leaders and they said,
Speaker:"okay, we wanna make this successful."
Speaker:And the other company, actually we'll say it,
Speaker:it was Microsoft at that time.
Speaker:They said, "well, just use our API."
Speaker:And I said, "but I knew, you know, from how to..."
Speaker:'Cause under the covers to support the screen reader,
Speaker:you had an API in what you needed,
Speaker:what they needed to get information.
Speaker:And so they didn't have what you needed.
Speaker:They didn't have all of it.
Speaker:And it also, it was very tied to it
Speaker:as we needed something to be cross platform.
Speaker:So I remember, this is the coolest thing.
Speaker:So we got in there and with Java, you could do things
Speaker:like 10 times faster than low-level operating systems.
Speaker:And I remember, so this was like January or February
Speaker:of, I forget what year it was.
Speaker:I wanna say, 1987, something like that,
Speaker:maybe year 1997, or '96.
Speaker:But we anyways, long story short is we basically
Speaker:worked together as a team, we created an API
Speaker:and we got a working screener all in a matter of,
Speaker:and I mean to talk through everything
Speaker:you can think of, it did it, right?
Speaker:It did it in about six months.
Speaker:I mean, six months is incredible,
Speaker:plus a reusable infrastructure.
Speaker:And we went to, what's the conference they have
Speaker:up in, Closing the Gap?
Speaker:I think it is up there, they still have that.
Speaker:- That still happens.
Speaker:- Yeah, so we went there
Speaker:'cause that was the first available conference.
Speaker:And I remember 'cause I know Microsoft tried
Speaker:to implement their API on two buttons at CSUN,
Speaker:just two buttons.
Speaker:We had it working list boxes, spreadsheets,
Speaker:I mean everything, right?
Speaker:Rich text editing.
Speaker:And he came in and I remember his jaw dropped
Speaker:and hit the, you know, at that time.
Speaker:So, but the thing is, you know,
Speaker:we all kind of, even Microsoft,
Speaker:we all tend to work together
Speaker:and I felt that was the most, that to me,
Speaker:being able to have the impact,
Speaker:I didn't really want to go back.
Speaker:I mean, going back to what I did before,
Speaker:it's just not the same.
Speaker:You can't have an impact like that.
Speaker:I mean, it's very rare.
Speaker:So anyway, that's what it was.
Speaker:That's why I stayed there.
Speaker:- That's good.
Speaker:That's great.
Speaker:That's you a good part of the story to hear about.
Speaker:And then, you know, definitely that next important part
Speaker:of your career was surrounding the ARIA technology.
Speaker:For people that aren't familiar with that,
Speaker:the acronym I'm using is A R I A,
Speaker:which actually was built on RIA,
Speaker:which was rich internet applications,
Speaker:which going back 20 years ago as there was the .com boom
Speaker:and websites exploding, they weren't really as robust as
Speaker:people were used to with applications
Speaker:that they would have on their Windows
Speaker:as Mac operating systems and so rich internet applications
Speaker:started to come about,
Speaker:and then there was accessible rich internet applications,
Speaker:which is where you came into the picture.
Speaker:So talk about a little bit about the evolution of that.
Speaker:- Okay, so right around, this is around 2003.
Speaker:So I was working in research
Speaker:and the head of emerging technologies,
Speaker:so I worked with on Java, comes to me,
Speaker:he comes and he reaches out to me
Speaker:and we had a good working relationship
Speaker:for other reasons, not Java work.
Speaker:He comes into my office, doesn't tell me why, he says,
Speaker:"hey, Rich, you know, I'd like you to come over
Speaker:and be the lead architect
Speaker:for accessibility in our software group."
Speaker:Which is, so lead research and then do whatever it is.
Speaker:So he never told me why.
Speaker:And I said, "well, that sounds exciting.
Speaker:I get to do something different."
Speaker:So I went over there and so I was working at Austin
Speaker:and we got a call that we were gonna have
Speaker:a team meeting in Cambridge, Mass.
Speaker:And so we all fly up there and we spend the morning
Speaker:and we're talking about odds and ends.
Speaker:And after the meeting's over, he says,
Speaker:"I need you to come with me."
Speaker:So we go into this part of,
Speaker:I mean, this was really super secret stuff at the time.
Speaker:We go into this, all the way into the back area
Speaker:of the floor in this like hidden cubicle, you know.
Speaker:And he brings up, this is before Google Docs,
Speaker:the very first working office suite
Speaker:running in a web browser.
Speaker:I mean, this is like, so you have to understand
Speaker:why this would be so important
Speaker:from a strategic perspective for the company.
Speaker:So if you look back at that time, you had,
Speaker:Microsoft owned nine over 90% of all the clients apps space.
Speaker:And what they had done is they also owned
Speaker:over 90% of the browser market
Speaker:and what they had done is they had moved
Speaker:their entire Internet Explorer team out to Beijing, China,
Speaker:and they put it in maintenance mode.
Speaker:And so the only thing they're willing to make changes
Speaker:to that browser was to security fixes,
Speaker:you know, things like that.
Speaker:But, you know, and they had a lot of stuff
Speaker:with actives back then that they had to deal with,
Speaker:that was another programming model and they were push,
Speaker:and so what they wanted to do is they wanted to use this
Speaker:market position to basically tie the client desktop
Speaker:to their middle, where you could only use their mode.
Speaker:And so what they had done is they had said, okay,
Speaker:we're gonna basically make the web kind of obsolete
Speaker:because we're not gonna do anything.
Speaker:And so for IBM, this for them
Speaker:was a killer for their software business
Speaker:because if Microsoft, if people aren't deploying to the web,
Speaker:that's a big issue because what we had,
Speaker:what they had come out with in the lab
Speaker:with the, this came with a company acquisition
Speaker:from a company called Alpha Blocks.
Speaker:And they told why they bought this company,
Speaker:but the real reason they bought the company
Speaker:was for this technology.
Speaker:And so if we,
Speaker:the problem was to be able to make this consumable
Speaker:is we had to get over two big accessibility
Speaker:law restrictions that were in WIC AG 1.
Speaker:and the two words you had to run with JavaScript
Speaker:and CSS turned off because it wasn't accessible.
Speaker:And the reason that was at that time was
Speaker:because people that worked on web accessibility
Speaker:didn't really know software accessibility
Speaker:from a holistic internals level and having worked on Java
Speaker:and having worked with, I actually provided feedback
Speaker:on Microsoft's accessibility work,
Speaker:we used to go to those meetings and work with their team.
Speaker:You know, they didn't have the skillset.
Speaker:So they looked at this as I don't know how to fix this,
Speaker:so the first thing you do is you say, oh, we can't fix it,
Speaker:so we're gonna make it inaccessible.
Speaker:So it's basically, and what happened
Speaker:is every major government organization
Speaker:throughout the planet basically said,
Speaker:you can't use these technologies and be accessible.
Speaker:So, you know, what this means is companies
Speaker:like Oracle, IBM, you know, all the big
Speaker:middleware companies, they couldn't deploy their software.
Speaker:So, and he said, do you know what the problem is?
Speaker:And I said, yeah, you're using JavaScript and CSS
Speaker:to create these user interfaces and they're not accessible.
Speaker:Yeah, and this had been not been solved for six years.
Speaker:He says, yeah.
Speaker:And the whole $20 billion software business is riding on it.
Speaker:We need you to figure it out.
Speaker:So no pressure, Joe.
Speaker:(Rich laughing)
Speaker:So I went back to Austin and I started looking
Speaker:at how these apps were constructed
Speaker:and they had a document object model, which is like a tree
Speaker:and the reason they have that model
Speaker:is because it's modeled after the desktop Window hierarchy,
Speaker:because that's how they propagate keyboard and mouse events.
Speaker:So to tie it into the operating system,
Speaker:they had to use the same infrastructure under the covers.
Speaker:And so if you look about accessibility APIs on platforms,
Speaker:they're based on, this object tells you what type
Speaker:of object it is and what it is and what it's role is,
Speaker:what's its states are,
Speaker:and when things change, you get notified.
Speaker:So if you go from checked to not checked,
Speaker:a screen reader or some other's, maybe another type
Speaker:of voice recognition system,
Speaker:whatever gets notified when something gets changed
Speaker:and then they respond, so that's how these systems worked.
Speaker:And on the web, what was happening is,
Speaker:so they would take these elements that they provided
Speaker:for an HTML that had no semantics that matched
Speaker:what you would use in conventional desktop platforms,
Speaker:like menus and list boxes and all the other stuff.
Speaker:And I thought, you know, and this only took me
Speaker:about a month 'cause I just happened to be, like I said,
Speaker:you're in the right place at the right time.
Speaker:I had worked with all this stuff on Java,
Speaker:I'd worked on screen readers,
Speaker:I could see the whole thing in front of me
Speaker:like it was clear as a bell.
Speaker:And so what I, and I said, look, if we could add
Speaker:these semantics on top of the HTML webpage
Speaker:and say, well, I know this is what you think it is,
Speaker:but it's really one of these.
Speaker:And this is what's being change, is here, changes here,
Speaker:care about all these things.
Speaker:And if we could do that, then rich web applications
Speaker:would behave excessively like desktop applications.
Speaker:So, and like many things, Joe, in order to,
Speaker:it solving the technical, the basic technical problem
Speaker:is actually often the easiest part.
Speaker:The hard part is making everybody, get 'em to adopt it.
Speaker:So this means browser manufacturers,
Speaker:assistant technology vendors and not just Windows,
Speaker:you need to get a Mac, you need iPhones,
Speaker:you need all, you know, over time,
Speaker:all of these things had to get, Linux, right?
Speaker:And so we had to pull a team together.
Speaker:We had to put people in the web standards efforts
Speaker:to create new standards for,
Speaker:it was called DHTML accessibility early on
Speaker:and we had to change WIC AG to remove the restrictions,
Speaker:but you couldn't do it without something
Speaker:that proved that it worked.
Speaker:I mean, this literally took eight years
Speaker:to make all this happen.
Speaker:So then you have to change government policy, you know.
Speaker:So these are all the things, and I didn't do this
Speaker:all myself, I led a team that would do this and you know,
Speaker:and they're not always direct reports to me.
Speaker:And anyways, we had to get that done
Speaker:and we also had to get IBM's
Speaker:own product teams to support it.
Speaker:And then we had to actually extend the APIs
Speaker:on the operating system, so one of the fallouts
Speaker:is we went Microsoft's UI automation at the time
Speaker:was too slow and so what we, under the covers,
Speaker:we have to map each operating system platform.
Speaker:So we wrote an extension for active accessibility
Speaker:and it's used today in Google Chrome,
Speaker:it's used in Firefox, it's used, you know,
Speaker:it's used in OpenOffice.
Speaker:So not only was that used,
Speaker:but also in the infrastructure,
Speaker:and we also influenced the other platforms.
Speaker:But more importantly, we got the other platforms
Speaker:like Apple to join in and provide their side of the point,
Speaker:how they worked and how we pulled it all together.
Speaker:But anyways, and I actually didn't come up
Speaker:with the name ARIA, I think that was Judy Brewer
Speaker:that came up with that name.
Speaker:So it kind of stuck.
Speaker:So Judy, you know Judy.
Speaker:So that gives you some idea of how I got
Speaker:to where I am so, where I did.
Speaker:- Yeah, but you know, going to your point of making sure
Speaker:that everyone is willing to buy into an invented solution,
Speaker:You did a lot of work with World Wide Web Consortium
Speaker:and working group and W3C is all about collaboration
Speaker:across all kinds of different levels, government,
Speaker:academic, corporate, different international aspects to it.
Speaker:So that was a big part of your work as well, wasn't it?
Speaker:- Yeah, well, that's important points
Speaker:that you've observed because I remember
Speaker:having these discussions at IBM and I said,
Speaker:you know, your first, 'cause I was also
Speaker:on the patent board too at the time.
Speaker:I said, they're your first blush is we need to patent this.
Speaker:And I said, that's the last thing you need to do.
Speaker:You need to be able to make this freely available
Speaker:to everybody or else they'll run.
Speaker:They won't do it.
Speaker:They don't wanna be locked in.
Speaker:So we did, everything was open.
Speaker:We did open standards for W3C,
Speaker:we did an open accessibility API for, IAccessible2.
Speaker:I mean, everything was basically free.
Speaker:And not only that, but if you could imagine
Speaker:these companies wanted to solve this problem too
Speaker:and they all got, including Microsoft.
Speaker:Microsoft got in and they were a really
Speaker:a huge contributor to ARIA as well.
Speaker:So, you know, we had a good, really good
Speaker:experience with all of it and if we had not done that,
Speaker:then that would probably, then we would
Speaker:have a different world today, I think, if we hadn't.
Speaker:But as a result of that, I can tell you
Speaker:that the proprietary platform of silver light
Speaker:and their lock in, all that stuff,
Speaker:you don't hear about it anymore.
Speaker:You hear about the open web.
Speaker:So we, but everybody benefited.
Speaker:I remember that we had gained enough momentum
Speaker:that we would go to CSUN.
Speaker:We'd basically populate teams
Speaker:all throughout the whole conference.
Speaker:We worked with Missoula and whatnot,
Speaker:saying about showing people what we were doing.
Speaker:And I remember Cynthia Shelly coming up to me and asking me,
Speaker:well, how do we get involved?
Speaker:Because they're asking why Microsoft
Speaker:at that time wasn't involved with it?
Speaker:And I said, Cynthia, it's all open.
Speaker:You just joined the W3C.
Speaker:Anybody can use it.
Speaker:There's no restrictions.
Speaker:I'll work with your team.
Speaker:So I think that what I, so this is interesting.
Speaker:So I remember, so Cynthia went back and she got Microsoft,
Speaker:'cause every time you join a W3C working group,
Speaker:you have to get approval by your legal team
Speaker:because it's, there's intellectual property involved
Speaker:and all that stuff, so in the meantime,
Speaker:what I started doing is I started having meetings
Speaker:every Monday night with Linda Mau from the Microsoft team
Speaker:working on Internet Explorer and sharing what we did,
Speaker:getting input, bringing it back to the group while they,
Speaker:so I was doing this on the back channel.
Speaker:And the pivotal meeting for me was, 'cause we told you,
Speaker:they had moved the whole browser team out to Beijing, China.
Speaker:She said to, usually had these calls at 9:00 at night
Speaker:and Linda said to me on call,
Speaker:well, I'm not gonna be able to work with you anymore.
Speaker:I said, really?
Speaker:And I said, why is this?
Speaker:We're moving the whole effort back to rep.
Speaker:And I says, is it because of accessibility?
Speaker:And she said, yes.
Speaker:So people don't realize this, but accessibility
Speaker:is the thing that basically broke open the web
Speaker:because at that point, the biggest player
Speaker:was still Microsoft, they had most of the market
Speaker:and they got involved with this
Speaker:and the fact that they got involved and started working
Speaker:on it, whether they were at the same level or not,
Speaker:you know, may have taken a while, but it's irrelevant.
Speaker:I mean, they got involved and it also gave credits
Speaker:for when Google came out with Chrome, they, you know,
Speaker:this enabled their browser to take off and Firefox.
Speaker:And I remember Firefox plus for performance reasons,
Speaker:it started shooting up in market share,
Speaker:Chrome took off later on.
Speaker:So that was the pivotal moment
Speaker:that people just don't know about.
Speaker:It was, so you ask why you do this stuff?
Speaker:How often do you get a chance
Speaker:to make that much of a difference?
Speaker:You really...
Speaker:And yeah, it's for people with, and for me...
Speaker:Okay, so yes, I did this for business reasons, but for me,
Speaker:I always did it for the people with disabilities
Speaker:'cause I always, to me that meant a lot.
Speaker:When you see somebody...
Speaker:I mean, I remember when Tom Watkowski,
Speaker:he used to be a director for accessibility at AOL
Speaker:and he went to the, company named,
Speaker:this is getting older now.
Speaker:One of the big companies or what,
Speaker:broadcasting companies out of in Pennsylvania.
Speaker:And so he, I sent him Greg Aaron Leventhal,
Speaker:who worked on my team, he sent him a code example,
Speaker:a first talking tree on a webpage.
Speaker:And so Tom was blind and he literally cried.
Speaker:When do you do that?
Speaker:I mean, it's...
Speaker:- Yeah.
Speaker:- It's incredible.
Speaker:So I'm really proud of the work that everybody did
Speaker:and yes, I had to let a lot of stuff
Speaker:and I don't make it sound like I did it all 'cause I didn't.
Speaker:'Cause a lot of people were involved with it.
Speaker:I mean Andy Weaver and Becky Gibson were working
Speaker:on WIC AG, changing WIC AG.
Speaker:Aaron basically wrote all the code in Firefox
Speaker:that basically got it working in prototype in Firefox.
Speaker:Then he shared this stuff with the Missoula team for Chrome
Speaker:and on and on and on.
Speaker:There's just a lot of, and great feedback from Microsoft,
Speaker:great feedback from Apple.
Speaker:And you know, you also get your fights too,
Speaker:with any standards efforts, you have your technical battle,
Speaker:but you know, overall it was pretty cool.
Speaker:So all of that got me eventually got me
Speaker:to get that position at the company.
Speaker:So I'm very pleased with what everybody,
Speaker:what everybody did at the time, so yeah.
Speaker:- Well that's I think a great place to end it
Speaker:with your personal reflections on there.
Speaker:This has been a really interesting,
Speaker:and illuminating journey through some of these
Speaker:foundational technical building blocks
Speaker:to the accessible web that we have today.
Speaker:So I wanna thank you for taking the time
Speaker:to share your stories and look forward
Speaker:to maybe joining you for a dive sometime.
Speaker:- That'd be great, that would be great.
Speaker:The water's beautiful here, so yeah.
Speaker:- All right. - All right.
Speaker:- Thanks a lot, Rich. - You take care.
Speaker:All right, thanks for having me.
Speaker:And it's been an honor, thank you.