bodyType

customContents

entityId

entityUuid

articlePageQuery

filter

article

articleBaseAdvertisingInfoArticle

articleListArticle

articleSeoArticle

helpersCheckIsPostiesArticle

hooksArticleAcknowledgementGateOverlayArticle

hooksTrackPageViewArticle

hooksContentInterestArticle

articleLinkingDataContent

hooksAmpRedirectArticle

articleSchemaContent

liveArticle

advertZone

sentiment

contentLock

topics

types

sections

moreOnThisArticles

urlAlias

commentCount

authorLocations

authors

corrections

sponsorType

displaySlideShow

multimediaEmbed

printHeadline

seriesContainer

socialHeadline

headline

flag

firstTopic

glossary

flattenTypeIds

publishedDate

additionalInfoBoxes

quizIds

images

image

relatedLinks

relatedNewsletters

__typename

createdDate

sponsor

paywallTypes

pdfFiles

seriesReverseOrder

series

disableOffPlatformContent

published

updatedDate

summary

subHeadline

body

keywords

readingTime

customTimezone

liveContents

Andrew Barclay

This article originally appeared on ABACUS
A small library in southwest China is offering classes that teach visually impaired people how to use a device that many of us take for granted: the smartphone.
Opened last October by a private bookstore in Yunnan province, it’s one of only a handful of Braille libraries catering to visually impaired people in China -- home to the world’s largest number of blind people.
 ​
Besides offering hundreds of Braille titles, the library also gives lessons on how to use screen-reading smartphone apps to make phone calls and send messages.
It may not be apparent to most, but both Apple and Google have included a number of assistive features in their operating systems to help people with vision problems.
Let’s take a look how they work.
Navigating a smartphone
Both companies have developed functions to help visually impaired people navigate their devices. Apple’s is called VoiceOver, while Android has TalkBack -- both read out what appears on the screen.
VoiceOver, which was first introduced to macOS and later made available on iOS, can tell the user information such as battery levels, or which app their finger is touching.
Communicating
The first step in sending a message or an email is to open an app -- something that is second nature to someone with full sight, but takes a little extra time for someone with impaired vision.
Fred Leung, an iPhone user and an advocate for visually impaired people in Hong Kong, explained; “For example if I want to open WhatsApp, I more or less know the app’s position. When I tap that area, the phone will tell me which app I’m touching -- but it won’t open that app unless I double tap.”
There are two ways to write a message.
The first is dictation, which types out what you say when tapping the microphone button on the keyboard. A visually impaired person can locate the button using VoiceOver or TalkBack.
“It’s actually very accurate, even in Chinese, which can be very difficult to differentiate between characters,” says Leung.
Then there’s typing, which also takes advantage of the screen-reading function. Simply place a finger over the keyboard and the phone will tell you which key you’re on, so you can double tap to select the right character.

Reading
Visually impaired people can also have their smartphones read out texts, emails, websites and e-books. Don’t like the voice you’re hearing? You can also adjust the dialect and speaking rate.
Taking photos
“Most people who aren’t VIP -- which is what I call visually impaired people -- don’t realize that we can even take photos,” said Leung.
Turns out, VoiceOver can describe to you what’s appearing in the phone camera.
“Even without a special app, the iPhone can tell me how many people are in the frame or if there is a face on the screen.”
What’s next?
As with other fields like self-driving cars, artificial intelligence is also promising new possibilities for visually impaired people.
Siri is already integrated with VoiceOver, which can describe what appears in a photo, like whether there’s a dog or a tree.
Microsoft recently launched its Seeing AI app -- a smartphone-based narrator that it says can describe what the smartphone is pointing at.
Discover Seeing AI, designed to support people who are blind or have low vision by narrating the world around them #MicrosoftAI #MSFTSummit https://t.co/8C7QmSJJV4 pic.twitter.com/Ok3pxXD6rZ
  — Microsoft Australia (@MicrosoftAU) November 16, 2017
Need to identify a product at the supermarket? It can read the barcode and tell you what it is.
And it claims to go a step further.  
“The Seeing AI means you can hold your phone up to a person and it can tell me what that person looks like, what their age is, the color of their hair, whether they're wearing glasses, whether they look happy or sad," Microsoft’s Dave Heiner told HuffPost Australia.
Facial recognition helps family find man missing for more than a year

For more insights into China tech, sign up for our tech newsletters, subscribe to our Inside China Tech podcast, and download the comprehensive 2019 China Internet Report. Also roam China Tech City, an award-winning interactive digital map at our sister site Abacus.



China can shrug off Trump’s bid for US-made iPhones

Trump threatens EU with 50% tariffs over breakdown in talks as Apple stares at 25%

Xiaomi flexes chip prowess as new XRing O1 bests Apple’s A18 Pro in certain tests

OpenAI buys iPhone designer Jony Ive’s start-up, teases ‘coolest piece of technology’

Smartphones

Chinese library teaches the blind how to use smartphones

Patrons of the library for the blind in Kunming using smartphones. (Picture: Chinanews.com).

Fred is using Apple’s VoiceOver feature here to listen to what character on the keyboard he is tapping while typing a message. (Picture: Abacus).


Chinese library teaches the blind how to use smartphones

How handset features help visually impaired people “see” the world