If you get a document but can't read the print, using Seeing AI provides audio guidance for capturing the document and then spoken words reading the text to the app user.
Optimized for use with VoiceOver, the app enables you to recognize.
Microsoft is yet to confirm when this app is going to be released in other countries. As well as recognizing people it's seen before and guessing strangers' age and emotion, it can identify household products by scanning barcodes.
According to The Verge, the app operates using neural networks - a computer system modeled on the human brain and nervous system.
Microsoft's new Seeing AI app describes the world for the blind
The free Seeing AI app, available for iOS, can read out short snippets of text, describe people, identify products and currency denominations, and take a stab at identifying the objects in a person's surroundings.
For example, Microsoft brought its SQL Server database software to Linux, and it has ported Office apps to the iPad. It can also scan barcodes, read documents and recognize U.S. currency.
Microsoft also today announced at an AI event in London, a new program called AI for Earth. The app also has experimental features such as 'scene descriptions, ' which can describe scenes that fall into the camera's view. "As the research progresses, more channels may be added", the developers say via the app description. It hasn't said if and when the Android version is going to be out.
The most important difference between Seeing AI and other similar apps is that most functions, like face recognition, are carried out directly on the device, giving the app a significant speed advantage.