We need your help now
Support from readers like you keeps The Journal open.
You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.
If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.
Sign in. It’s quick, free and it’s up to you.
An account is an optional way to support the work we do. Find out more.
By continuing, you are indicating that you accept our Terms of Service and Privacy Policy.
SCIENTISTS AT THE Massachusetts Institute of Technology are developing an audio reading device to be worn on the index finger of people whose vision is impaired, giving them affordable and immediate access to printed words.
The so-called FingerReader, a prototype produced by a 3D printer, fits like a ring on the user’s finger, equipped with a small camera that scans text. A synthesised voice reads words aloud, quickly translating books, restaurant menus and other needed materials for daily living, especially away from home or office.
Reading is as easy as pointing the finger at text. Special software tracks the finger movement, identifies words and processes the information. The device has vibration motors that alert readers when they stray from the script, said Roy Shilkrot, who is developing the device at the MIT Media Lab.
For Jerry Berrier, 62, who was born blind, the promise of the FingerReader is its portability and offer of real-time functionality at school, a doctor’s office and restaurants.
“When I go to the doctor’s office, there may be forms that I wanna read before I sign them,” Berrier said.
He said there are other optical character recognition devices on the market for those with vision impairments, but none that he knows of that will read in real-time.
Berrier manages training and evaluation for a federal program that distributes technology to low-income people in Massachusetts and Rhode Island who have lost their sight and hearing. He works from the Perkins School for the Blind in Watertown, Massachusetts.
“Everywhere we go, for folks who are sighted, there are things that inform us about the products that we are about to interact with. I wanna be able to interact with those same products, regardless of how I have to do it,” Berrier said.
Pattie Maes, an MIT professor who founded and leads the Fluid Interfaces research group developing the prototype, says the FingerReader is like “reading with the tip of your finger and it’s a lot more flexible, a lot more immediate than any solution that they have right now.”
Developing the gizmo has taken three years of software coding, experimenting with various designs and working on feedback from a test group of visually impaired people. Much work remains before it is ready for the market, Shilkrot said, including making it work on cellphones.
Shilkrot said developers believe they will be able to affordably market the FingerReader but he could not yet estimate a price. The potential market includes some of the 11.2 million people in the United States with vision impairment, according to US Census Bureau estimates.
Current technology used in homes and offices offers cumbersome scanners that must process the desired script before it can be read aloud by character-recognition software installed on a computer or smartphone, Shilkrot said.
The FingerReader would not replace Braille – the system of raised dots that form words, interpreted by touch. Instead, Shilkrot said, the new device would enable users to access a vast number of books and other materials that are not currently available in Braille.
Developers had to overcome unusual challenges to help people with visual impairments move their reading fingers along a straight line of printed text that they could not see. Users also had to be alerted at the beginning and end of the reading material.
Their solutions? Audio cues in the software that processes information from the FingerReader and vibration motors in the ring.
The FingerReader can read papers, books, magazines, newspapers, computer screens and other devices, but it has problems with text on a touch screen, said Shilkrot.
That’s because touching the screen with the tip of the finger would move text around, producing unintended results. Disabling the touch-screen function eliminates the problem, he said.
Berrier said affordable pricing could make the FingerReader a key tool to help people with vision impairment integrate into the modern information economy.
“Any tool that we can get that gives us better access to printed material helps us to live fuller, richer, more productive lives, Berrier said.
To embed this post, copy the code below on your site
Without being funny, how do they point at the text in any way accurately?
This is a great piece of news…..the joy of reading brought back to the visually impaired. What a gift!
Great invention. Now if we could only find it.
Not just for people with vision impairment. I would think reading comprehension could be enhanced by hearing the words as they are being read. If the voice was natural this could be a fantastic device for a lot of people.
Yes , like dyslectic readers. A brilliant invention .
If that was an app that could have been sold to the masses like shazam ( same principal … kind of ) it would have been done years ago…. Well done anyway
Ok. If this is possible why not just take a hi-res photo of the page and have text-to-speech translate that without the need for anyone to point the finger?
The much greater potential now has arrived for language translation say from English to Irish and vice-versa thus eliminating expensive and unnecessary paper use.
What a great machine
Why not use a kindle reader with text to speech on?
Great news.
Would it work for foreign text? Nifty idea.
Use precise geolocation data. Actively scan device characteristics for identification. Store and/or access information on a device. Personalised advertising and content, advertising and content measurement, audience research and services development.
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.
These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then these services may not function properly.
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous. If you do not allow these cookies we will not be able to monitor our performance.
Cookies, device or similar online identifiers (e.g. login-based identifiers, randomly assigned identifiers, network based identifiers) together with other information (e.g. browser type and information, language, screen size, supported technologies etc.) can be stored or read on your device to recognise it each time it connects to an app or to a website, for one or several of the purposes presented here.
Advertising presented to you on this service can be based on limited data, such as the website or app you are using, your non-precise location, your device type or which content you are (or have been) interacting with (for example, to limit the number of times an ad is presented to you).
Information about your activity on this service (such as forms you submit, content you look at) can be stored and combined with other information about you (for example, information from your previous activity on this service and other websites or apps) or similar users. This is then used to build or improve a profile about you (that might include possible interests and personal aspects). Your profile can be used (also later) to present advertising that appears more relevant based on your possible interests by this and other entities.
Advertising presented to you on this service can be based on your advertising profiles, which can reflect your activity on this service or other websites or apps (like the forms you submit, content you look at), possible interests and personal aspects.
Information about your activity on this service (for instance, forms you submit, non-advertising content you look at) can be stored and combined with other information about you (such as your previous activity on this service or other websites or apps) or similar users. This is then used to build or improve a profile about you (which might for example include possible interests and personal aspects). Your profile can be used (also later) to present content that appears more relevant based on your possible interests, such as by adapting the order in which content is shown to you, so that it is even easier for you to find content that matches your interests.
Content presented to you on this service can be based on your content personalisation profiles, which can reflect your activity on this or other services (for instance, the forms you submit, content you look at), possible interests and personal aspects. This can for example be used to adapt the order in which content is shown to you, so that it is even easier for you to find (non-advertising) content that matches your interests.
Information regarding which advertising is presented to you and how you interact with it can be used to determine how well an advert has worked for you or other users and whether the goals of the advertising were reached. For instance, whether you saw an ad, whether you clicked on it, whether it led you to buy a product or visit a website, etc. This is very helpful to understand the relevance of advertising campaigns.
Information regarding which content is presented to you and how you interact with it can be used to determine whether the (non-advertising) content e.g. reached its intended audience and matched your interests. For instance, whether you read an article, watch a video, listen to a podcast or look at a product description, how long you spent on this service and the web pages you visit etc. This is very helpful to understand the relevance of (non-advertising) content that is shown to you.
Reports can be generated based on the combination of data sets (like user profiles, statistics, market research, analytics data) regarding your interactions and those of other users with advertising or (non-advertising) content to identify common characteristics (for instance, to determine which target audiences are more receptive to an ad campaign or to certain contents).
Information about your activity on this service, such as your interaction with ads or content, can be very helpful to improve products and services and to build new products and services based on user interactions, the type of audience, etc. This specific purpose does not include the development or improvement of user profiles and identifiers.
Content presented to you on this service can be based on limited data, such as the website or app you are using, your non-precise location, your device type, or which content you are (or have been) interacting with (for example, to limit the number of times a video or an article is presented to you).
With your acceptance, your precise location (within a radius of less than 500 metres) may be used in support of the purposes explained in this notice.
With your acceptance, certain characteristics specific to your device might be requested and used to distinguish it from other devices (such as the installed fonts or plugins, the resolution of your screen) in support of the purposes explained in this notice.
Your data can be used to monitor for and prevent unusual and possibly fraudulent activity (for example, regarding advertising, ad clicks by bots), and ensure systems and processes work properly and securely. It can also be used to correct any problems you, the publisher or the advertiser may encounter in the delivery of content and ads and in your interaction with them.
Certain information (like an IP address or device capabilities) is used to ensure the technical compatibility of the content or advertising, and to facilitate the transmission of the content or ad to your device.
Information about your activity on this service may be matched and combined with other information relating to you and originating from various sources (for instance your activity on a separate online service, your use of a loyalty card in-store, or your answers to a survey), in support of the purposes explained in this notice.
In support of the purposes explained in this notice, your device might be considered as likely linked to other devices that belong to you or your household (for instance because you are logged in to the same service on both your phone and your computer, or because you may use the same Internet connection on both devices).
Your device might be distinguished from other devices based on information it automatically sends when accessing the Internet (for instance, the IP address of your Internet connection or the type of browser you are using) in support of the purposes exposed in this notice.
The choices you make regarding the purposes and entities listed in this notice are saved and made available to those entities in the form of digital signals (such as a string of characters). This is necessary in order to enable both this service and those entities to respect such choices.
have your say