Here’s What Microsoft’s Seeing AI Can Do

Microsoft’s Seeing AI, an app that can narrate the world has introduced an update for recognising Indian currency.

AI bot learning through machine learning

(Photo: iStock)

Microsoft’s Seeing AI, an app that can narrate the world around you has introduced an additional update of recognising Indian currency denominations. A major drawback of this app is that it just caters to iOS users whereas India has a predominant Android user base.

This app is specifically designed for people with visual disorders. It functions by injecting Artificial Intelligence into your phone camera to open up the visual world and describe the nearby people, text and objects through voices on your phone’s loudspeaker.

This app describes people around you including their emotions and the age.

It read out the facial characteristics, approximate age, emotion.(Photo: The Quint)

It can scan faces when they appear in its frame, confirming a familiar one within the blink of an eye.

It’s easy, all you have to do is just add a new face, so that your app can recognize them later.(Photo: The Quint)

Perhaps the most immediately useful feature will be the “smart text selection,” which says that it will let you copy and paste any text you see in the real world and can also read text out loud from your books, documents and as it comes into view.

Converted the text from the image and made it ready for editing(Photo: The Quint)

It also identifies currencies, including Indian rupees.

In this case the text didn’t pop out but it conveys the messaage through your phone speaker.(Photo: The Quint)

Also, when looking for something in the store, it can also identify the product just by scanning the bar code.

(Photo: The Quint)When pointed at the bar-code it described the product in the blink of an eye

The most amazing experimental feature about this app is that it can describe any scene when you click an image in real time.

All you need to do is just click any random scene and then the app narrates the situation going on the picture.(Photo: The Quint)

Also, it can read your handwritten texts.

It understood my handwritten sentence and displayed it on screen.(Photo: The Quint)

Apart from this bunch of features, this app is available to iOS users only whereas in India, 90 percent of the smartphone users are active on android.

Recently, Google has also come up with its own AI camera app called ‘Google Lens’, which can also see things around you and provide contextual information about them. While Seeing AI is for the iOS users only, Google Lens is available for both the devices and unlike iPhone, it’s the talk-back feature of Seeing AI that takes over Google Lens and definitely is the best option for the visually impaired and blind people. The only downside being that it is available for iOS devices, which are usually costlier than Android devices.