Facebook Is Using AI to Describe Photos to Blind Users

Illustration for article titled Facebook Is Using AI to Describe Photos to Blind Users

Artificial intelligence is meant to be taking over the world, but along the way, it seems to be helping out humans from time to time. Today’s example: Facebook is using its artificial intelligence network to describe photos to the blind.

If your Facebook feed is anything like mine, the vast majority of my friends’ posts are either photos or links. Without being able to see photos, blind users are being left out of a huge chunk of the social interaction happening on Facebook.

The company’s answer is automatic alternative text: a neural network analyses photos, and if it’s at least 80 percent confident it understands what’s going on, the AI will describe the photo. It’s a big step forwards for blind users, although at launch, it only works in English, and with a limited number of concepts.


Of course, within the uplifting story is a more sinister reality: Facebook is all about collecting and quantifying user data and selling that to advertisers. So at some point in the future, you’ll probably upload a photo of a pizza, and then be inundated with Dominos ads.

If you want to see the technology in action for yourself, it’s now available for iOS users using iOS’s built-in screen reader—just head to Settings—>General—>Accessibility, and activate VoiceOver.


Contributing Editor

Share This Story

Get our `newsletter`


This sounds a lot like their recently displayed technology is being put into real world use already.