PTP: Interactive Handwriting for the World

10 August 2013

Education, Interactive Content, Internationalization, ALL-IN Learning Objects, AZARDI, IGP:Digital Publisher

Handwriting instruction for every language on Earth. the Phonetic Training Program shows how and addresses this imbalance.

PTP Lives

In 1997 we developed a very interesting program to addresss illiteracy among Indian rural women in their languages. Then the primary objective was to teach them to write their name in their language. For various reasons it was never completed. With the changing dynamic of computers and devices, and interactive learning being the future for the world, it seemed the right time to breath some new javascript life into the old C++ code.

The application is artfully named the "Phonetic Training Program" (PTP).

Try it here

PTP is ubiquitous HTML5 interactive content. It can be used anywhere. Select a "language". Just click on a letter on the left, listen to it being pronounced and watch it being drawn. Here we have Latin/English, Hindi and Telugu to demonstrate the very different writing construction, stroke count and stroke approach used in (four) different languages, if you count Latin as English. This alphabet is of course used in dozens of languages.

The guidelines in this demonstration are a combination of the three-line Latin and five-line Indic scripts requirements.

There are now a number of handwriting programs available for touch screens and the like but they are a bit up-market and American English locale/language specific. We also have to recognize that compared to the simple construction of Latin characters, the challenges with many other languages is a both different and often has different writing motor-skill development requirements.

PTP also goes a little bit futher as it takes a shot at learning to associate phonetic sounds with character reading and writing skills for any purpose. This works better with many non-English languages because they are phonetically constructed (Eg: Indic languages are written as they are pronounced).

Because we are sure a very large part of the target user audience will be using pencil and paper (or writing with a stick in the dust) we have focused on paint strokes, aerial strokes and pen position clarity. This is relatively important with Indic and Asian languages. We have neglected touch screen cleverness at this stage, primarily because tracing a character on the screen doesn't probably help a lot in the development of real hand-writing motor skills.

Latin/English

Latin/English is essentially vertical strokes and loops. It tends to write forward with few aerial/paint strokes or backward strokes. It is used in dozens of languages around the world, many with the addition of diacritics.

Hindi/Marathi

Hindi and Marathi both use the Devenagari script. It is a vertical and horizontal language with loops. It is similar in stroke construction to English, but very different in reading because it is strictly phonetic.

Telugu

Telugu is a South Indian language. It has a strongly anti-clockwise writing structure with only a few vertical strokes. One reason for this writing style is puported to be for writing on palm leaves which have a very strong horizontal grain. The core alphabet phonetics are the same across Indic languages, but when spoken as words are very different.

Understanding Handwriting Nuance

Without delving into the mysterious world of graphology, or the artistry of calligraphy, handwriting is one of the worlds' bigger early learning challenges (or illiteracy challenges). It is a combination of training motor skills in conjunction with sound and shape recognition. That's a lot of senses working together.

A technical breakdown of "how handwriting happens" is essential when creating an application that allows the assembly of playable handwriting teaching components. Our list is: 

  • Paint strokes. A stroke that creates a mark on the writing surface.
  • Aerial Strokes (forgetting joined-letters which is a Latin special. Printing is cool). A stroke that does not make a mark on the writing surface but is an essential pencil movement inside the construction of a character.
  • Stroke direction. We grade direction into vertical, horizontal, angled-straight, curved, anti-clockwise, clockwise, angle start-point, angle distance, stroke up, stroke down and mark.
  • Stroke type. This is the noisy part of handwriting which largely encapsulates stroke direction. Line is obviously the dominant stroke type (without distinction on straight or curved) but even Latin has a dot on the i and j. Other languages have special marks such as diacritics, bindi's, matras and other specific language writing qualifiers. They all have to be included.
  • Total stroke count. This is the sum of aerial strokes plus paint strokes. Latin is relatively "stroke-cheap" as are curved languages like Telugu and Kannada (even though they look complex). We haven't done any analysis of Thai, Chinese or Middle-East character construction at this stage so cannot comment on those.
  • Note. Approach and departure strokes are not counted in the construction of a character. Letter stroke counting ALWAYS starts with the first paint stroke and ends with the last paint stroke.

This stroke analysis and diversity knowledge is required to create a hand-writing application that addresses all languages competently and completely.

The basic Latin alphabet is one of the most stroke economical letter forms. For example the stroke count for "A" is five. Three paint strokes and two aerial strokes. "C" is one stroke. But the Devanagari औ has 12 strokes including aerial strokes. That is a lot of strokes to make a sound.

The PTP construction tools have captured all this human handwriting magic and translate it into an easy learning experience through the PTP presentation tools.

Accessibility

In the developed world context accessibility means making content available to those with sight or aural impairments. IGP:Digital Publisher and IGP:FoundationXHTML are defined for web-content accessibility from the ground up for the "ARIA" market.

In the context of "the world" a simple program like PTP shows a single solution can make literacy accessible to the children and adults of the world in every language at little cost.

Because of the structure of the vector program it will be reasonably easy to include audio scripting (for the blind) and colour-coded stepping (for the autistic).

The world is a big place and PTP defines a new and different accessibility journey for education, learning and training that includes everyone around the world. This is the direction of valuable digital content.

PTP Joins the ALL-IN Modules

The PTP module brings a new level of interactivity to core language learning and literacy programs for the world.

We are pleased to be able to announce PTP is now a component of the ALL-IN learning library modules. That means all the tools are included with an IGP:Digital Publisher license. Books produced books from IGP:Digital Publisher for distribution in any quantity can include the PTP Javascript and letter profiles with no additional fees.

It takes professional effort and time to create the handwriting vector outlines for a new language. But once they are complete, they are available forever, at any size due to the marvel of CSS transforms!

History

This concept was born in 1997 and is now seeing light 16 years later in 2013. (Who's getting old then!)

The original C++ code was written by two interns (Jogesh Sharma and Vijay Kukreja - Hi guys wherever you are. Great work.) over six months. They created the vector character builder, the writing player and the bitmap character reading game. Rashmi Nerlikar was the language expert, especially for Indic languages, and Ramesh Gettiboena created the interactive vector maps for the various languages.

alt

Please Don't Criticise the Samples yet!

Yes! There are handwriting stroke errors in the examples as for various reasons the project went on hold. We are now working through these for the languages we have in hand, but we really expect those more saturated in hand-writing teaching to get things moving in the right direction.

Send us feedback and we will update the samples in near real-time.

The player application was completely re-written, just now, in 2013 with Deepak Chandran (our CTO) doing the core vector Javascript engine conversion and Milan Bishwakarma (product development and ALL-IN lead programmer) turning it into a product. This is the result of a very long and interrupted journey. The core concepts have stood the test of time and have absorbed the new HTML5/CSS3/Javascript technology available to us today. It is approximately 214.16 times easier to develop this type of interactivity in 2013 than it was in 1997.

Stroke Authoring Tool

The authoring tool was created in 1997 for Windows 95 and a 640px x 480px monitor! Because it was created in core C++ without any funny DLLs, it still works today on Windows 7/8. Congratulations Microsoft. That is very, very impressive.

We are now working on the "Javascripting" the animated vector authoring tools. That is of little more intense than the handwriting player.

Moving Ahead-More letter forms

Soon we will be starting on Chinese. The approach here will be "same but different" as it is not an alphabet language. The stroke construction rules are very strict and fall naturally into this type of application. Also if we find the right partners we will be able to add other languages character forms like Cyrillic, Greek, Thai, Hebrew, Ahmaric and possibly Arabic.

The ALL-IN module allows the inclusion of any letter combinations in a lesson. It doesn't have to be all letters in a rigid table-like layout as in the examples above. The module is designed to exploit pedagogical creativity. We will be providing some E0 packaged examples for AZARDI shortly.

Next. Reading

PTP is a two part program. Learning to read and learning to write. While writing implicitly gives phonetic association/reading skills this does not develop and is not the same as reading skills. These need to be taught independently. Instant letter/phoneme recognition and the ability to pronounce a letter in a reading context are different to pronouncing it while writing.

The next ALL-IN module is the character reading game. If you are into core language learning skill development or literacy training, watch this space. It only gets more exciting.

Remember. In the current avatar this is a Phonetic Training Program. The primary purpose is to allow people to associate language sounds they hear and make with their written language. 

It is not a reading or full literacy program and does not try to be any thing except a program that allows a noise to be interpreted by a person to construct a shape on a surface.

We call it writing. 

Posted by Richard Pipe

P.S.

Unfortunately EPub3 packaging rules make this type of education application difficult to create for distribution as ePub3. It is possible in AZARDI of course but other reading systems are too limited in their ePub3 implementation.

It is unlikely the forthcoming IDPF EDUPUB Conference will  consider the learning needs of the children and illiterate of the world because they are a "trade organization" who must follow the dictates of their dominant members. Software standards are politics- Ted Nelson!

That is why we have been pleased to work with the E0 group to define better and more sensible, elegant, forward looking package for digital content.

After two years of nothing happening ePub3 in its current avatar appears to be DOA. As ePub3's single biggest supporter on planet earth we are sad about that, but have to move on and learn from the mistakes of the past.

    

Start a real digital content strategy with

IGP:Digital Publisher

The complete digital publishing content management and production solution.

Available as for Small and Medium publisher:

Subscription Portals

Production Service Portals

IGP:Digital Publisher is also available as a full site license purchase.

Contact us for more information...

Use one master XHTML file to instantly create multiple print, e-book and Internet formats.

comments powered by Disqus