Kearney-Volpe: The typewriter, recorded sound,

speech recognition, all of these technologies were originally designed

or greatly improved on by pioneers in accessibility.

By finding solutions for people with unique abilities,

accessibility researchers often end up making technology work better

for everyone.

I'm Claire, and I'm a designer from the NYU Ability Project.

We've been collaborating with Google

and innovators from the disability community

on a project called Creatability.

It's a series of starter experiments

that explore ways we can make creative tools more accessible

using AI on the web.

Each experiment expands creative possibilities

by designing for all kinds of inputs, whatever works best for someone.

Fleet: My name is Chancey Fleet.

I am a technology educator and accessibility advocate.

Sound Canvas enables a non-visual user

to draw on the screen in a variety of ways,

including using a mouse, using a stylus, using arrow keys,

or even using body-tracking technology

and receive immediate real-time feedback about the drawing that they're doing

in the form of sound that is pitched higher on the vertical plane or lower,

and panned in stereo from left to right

so that the individual can develop a real sense

of where they are with their drawing in space.

woman: That is really cool.

[piano notes playing]

Zimmerman: My name is Jay Alan Zimmerman,

and I'm a composer who became deaf.

Seeing music is a way to experience music

through your eyes instead of your ears.

It is a series of tools

that will help you to understand music and musical sounds,

so you're gonna get a sense of volume, emotion, intensity.

I think it's really important that people have access to these tools

so they can start experimenting.

F6. woman: Okay.

Zimmerman: That-- no, you just did it right now.

You did F6.

woman: I can't hear it, but I can feel it.

Kearney-Volpe: We've also been exploring new ways

for people to create music using their head or body.

Farrimond: My name's Barry Farrimond.

I'm a co-founder of Open Up Music,

an organization that empowers young disabled people

to create inclusive youth orchestras.

So Clarion Lite is a introductory musical instrument

to get people started on their musical journey.

It opens up the opportunities to interact with a musical instrument.

It broadens it out from just ten fingers to any part of your body.

By putting that musical instrument online,

we're opening up access to people around the world.

[laughing] I mean, it's an amazing thing.

Phillips: One of the key things that makes all of this possible

is TensorFlow.js, making machine learning algorithms

more accessible to anyone, right in the web browser.

It's all happening on your computer,

so this allows us to not only give you a--

a faster frame rate to make this an enjoyable experience,

a fluid experience,

but it also makes it so that your data is completely private to you.

Kearney-Volpe: Anyone with access to the internet,

a browser, and a web cam

can just click and instantly try these experiments.

These collaborations are really just the beginning.

We're excited to see

how other developers will build on what we've started here.

Fleet: I think it's an-- an open invitation

to the community of developers

to engage with what's already available

and iterate and really move forward the state of the art.

This is a great beginning.

[piano notes playing]

[instrumental music]