IBM®
Skip to main content
    United States change      Terms of use
 
 
      
     Home      Products      Services & industry solutions      Support & downloads      My IBM     
alphaWorks Services
Virtual Worlds User Interface for the Blind
A prototype user interface intended to enable blind users to participate in virtual world environments.
OVERVIEW FAQ FORUM RATE IT

Try It Now (Registration required.)

Important Note

The following application may not be bug-free because it is an
emerging technology prototype or proof of concept currently under
development in IBM research and development labs.   

What is Virtual Worlds User Interface for the Blind?

Virtual Worlds User Interface for the Blind is a prototype "accessible rich Internet application" (ARIA) that gives blind users the ability to participate in many virtual world activities. It provides basic navigation, communication, and perception functions using GUI (graphical user interface) elements that are familiar to blind computer users. As a way of enriching the virtual environment with descriptive semantic information, sighted users contribute annotations of virtual objects and places using a scripted gadget equipped by their avatar. These annotations are then made available to the blind users through the special user interface.

Although this interface for the blind is a GUI and can be used by sighted people, the virtual world space is not rendered pictorially. Instead, all information flowing to the user is text-based in order to allow compliance with ordinary screen-reading technology. Recorded verbal descriptions are also played for the user.

Currently, the application interfaces only with the Second Life platform; however, as a long-term goal, it might be possible to make this user interface portable to more than one virtual world implementation. If successful, that portability would enable blind users to learn only one client application that is specifically tailored for their needs rather than learning a separate new application for each virtual world.

How does it work?

The user interface is a Web application, a thin client running locally in the Firefox browser that communicates with Second Life through an agent on our server. The application is implemented partly with the JavaScript programming language, and it uses Dojo Toolkit widgets to provide a virtual world user interface that is entirely keyboard-navigable and screen reader-friendly. Nothing is permanently installed on the user's computer.

interface flowchart for virtual worlds

A key aspect of the project is a special annotation device equipped by the avatars of sighted users. This device allows the sighted users to select virtual world objects and locations to describe for the blind. A Web browser page is then triggered, and the sighted user is allowed to enter accessible attributes, such as a custom name and short and long descriptions of the item or location.

adding descriptive information to virtual worlds

It is also possible (and encouraged) for the user to record and upload a verbal description to the database. This data is later made available to the blind users through the user interface as they navigate into annotated areas.

screenshot of virtual worlds


About the technology authors

Bill Carter is a software developer and researcher working on the Advanced Technology team of the IBM Human Ability and Accessibility Center. He studies emerging human-to-computer interface technologies and tries to identify ways to make them available for people with disabilities.

Guido Corona is an accessibility consultant and is currently a member of the HA&AC Business Development team. His past areas of research included the design of automated response systems for non-visual interfaces as well as the semantic multiplexing of textual information through the alteration of text-to-speech parameters.


Date Posted: December 11, 2008

Related content


Get Adobe® Reader®

Share this service

Subscribe
Sign up to receive complimentary developer newsletters including alphaWorks Flash.
RSS Feeds
Subscribe to the alphaWorks RSS feeds or create your own custom feed.
Feedback
We want your feedback! Thoughts? Ideas? Comments? Tell us what you think.
News
Check out the latest news about alphaWorks Services.
    About IBM Privacy Contact