Deaf Sign Language Learning For the World

22 February 2015

Accessibility, deaf, sign languages, Indian Sign Language, Nepali Sign Language, ePub3, SAPPS

We were recently asked to design teaching tools to allow Indian Deaf Sign Language to be widely used in rural India. Here there is no Internet bandwidth, or it is just unaffordable for the target users. This is what we are doing.

We were recently asked to produce interactive tools to allow Indian Deaf Sign Language to be taught in rural India. In this environment there is no significant Internet bandwidth, or it is just unaffordable for the target users. A main objective was to be able to make an easily deliverable Sign Language learning application.

That means delivered and installed from any storage device, network or the Internet, to a computer or tablet. It has to be small and easy to transport and should have no installation dependencies. File size is incredibly important. While a set of YouTube videos is one useful teaching tool, it doesn't do the job in deeply rural environments.

We already have a number of tools addressing hand writing and light-weight interactive learning tools. We call these SAPPS (SVG Apps) as discussed in a previous post. A SAPP is a stand-alone SVG file that contains Javascript and CSS. We are also heavily into hand created or hand optimized SVG to get it to the smallest file size possible.

While we handle the "back-end" information accumulation problem we needed a warm up exercise to evaluate the technology and techniques to create great learning tools for the Indian Sign Language. 

The ASL Starter Kit

Unsurprisingly the American Sign Language (ACL) has the best available information on the Internet. For many countries information about their sign languages does not seem to have exploited the Internet so far. So here is our first pass.

Basic American Sign LanguageTutor

      

The interface is self-explanatory (we hope). Click on a letter to see it presented. Type a phrase into the text area and click go. Speed 1 is one letter/2 seconds, Speed 2 is a letter/one second, Speed 3 is two letters/second.

    

While the artwork is a little simple, the challenge was creating the simplest and smallest possible distribution file with the maximum interaction and learning tools.

While the SAPP was great, to keep the files small SVG animation is a significant accessibility requirement. We haven't included the animation here. For example both J and Z require motion to create the letters, while double-letters (ee, ll, oo, rr, zz) need motion between to show two signings for the one letter.

The Inner Mechanics

The trial ASL application is just 75 Kilobytes. Indian Sign Language learning apps will be larger  but we have already started work on reusable components that minimize the filesize. 

The one stunning technology that stands out to address this is SVG and SVG animation. We learned the following techniques created the target file sizes and performance required:

  • Paths are hand created using the minimum possible number of nodes to give a reasonable image appearance. We used Inkscape as the drawing tool; then to a text editor for clean-up.
  • Path statement coordinates use no or only one decimal place holder for line art. This significantly reduces the files sizes. (Easy to do with a Regular Expression). Out with all unrequired IDs and any other properties that were not needed.
  • ABC letters are converted to paths to eliminate the requirement for fonts. Text path nodes use three decimal points.
  • All styling is done with class statements and CSS. This eliminates repetitive and verbose SVG properties.
  • Group the linework with common classes for the lightest and simplest CSS styling. We used background, Digits, Details and Nails.
  • Letter presentation is Javascript triggered SVG letter graphics from <defs> into a <use> element. This reduces the rendering effort on loading. It also has a lot of potential for the next step.
  • Everything is a single file package. No distribution overheads. All that is required is an SVG aware browser at the point of delivery and that is pretty good now. The cost and effort for distribution is as minimal as it can get.

All Platforms and Formats Except ePub3. What!

It should of course work in packages like ePub3, but the IDPF have arbitrarily decided to allow SVG animation in ePub3. (Yes. The IDPF Troll returns). Their understanding of the need for SVG animation seems to be limited to Manga comics given the test cases I have been able to locate.

Fortunately we have both the production tools (IGP:Digital Publisher) and delivery tools (AZARDI:Content Fulfilment) and ePub3 reading systems for all platforms (Windows, Mac, Linux, Android and iOS) with AZARDI, so we can ignore these arbitrary rules and get on with the job of delivering sign language learning solutions in (custom) ePub3 to millions in South Asia in 2015.

This first ASL SAPP was a sign language foundation and learning experience to do more. The aim is to deliver the right tools make it easy for the deaf and the families and community members around hearing disabled people anywhere in the world to more easily learn some sign language; with just a little effort; and to learn that sign language is just another language.

In Summary

We are now starting working on the full two arm/hand/finger animatable libraries for the Indian and Nepali sign languages.

Thanks to Milan Bishwakarma (@milanbishwakarm) in Nepal for doing the programming for SAPPs and step one of our sign language solutions.

It's exciting that the Internet technology available today has the power to deliver a package that is relatively simple to create, works across multiple browsers and can be delivered pretty much anywhere. It's just attention to details.

The ASL SAPP is free and open source. We would love feedback and any suggestions on improvements that can be used for the next big step. If anyone is interested in working in their country/language sign language we are happy to hear from you, and work with you to further this accessibility and integration strategy.

 

Posted by: Richard Pipe

Links Releted to this Post

SVG Plus Javascript Plus Education Means SAPPs

     

comments powered by Disqus