Seeing Al, an app that explains to blind people the world around them.

Seeing Al, an app that explains to blind people the world around them.

Microsoft

Seeing Al, an app that explains to blind people the world around them.

A free mobile application designed for people who are blind or visually impaired, based on Artificial Intelligence and Cognitive Services technologies, which facilitates the recognition of the environment and audio description of people, objects and texts.

Seeing Al has several channels, including the reading of short texts through the camera, document recognition, identification of products in packaging and access to information such as expiration date or processing through barcode scanning, as well as facial and environmental recognition.

Person recognition allows a refined description of space, where it not only describes in a simple way the elements of a room (such as a chair and three people), but is able to tell which people are involved (e.g. family or friends). In addition, it also identifies the people in the photographs.

The design is inclusive and the testing process has actively involved people with disabilities through non-profit organizations around the world. It is an example of the benefits of co-design.