Calligraphy for kids in AR

Calligraphy for kids in AR


Calligraphy for kids in AR


To create this little AR project, I found an inspiration in an Andrew Fox’s kids book Learn to Draw Calligraphy Animals. The book has a step by step guide of how to draw an animal on one side, and a final drawing with some info about the animal on the other.



I bought this book for my niece when she was 3.5 years old at a time, and has been in love with drawing. As a young kid, she would need to be give a step by step tutorial on how to draw simple things. At the same time, I noticed 3 year olds are extremely fluent with how to use smart phones!

This finding led me to an idea to use a mobile phone to help with a step by step guide of how to draw calligraphy animals, animating it on the screen.



To tackle the task, I needed to:

  1. Create a step by step guide animations for each animal in the book (Photoshop + AfterEffects);

  2. Implement image recognition by camera, so that each animal drawing is triggering an animation when looked at through the camera (Unity3D + Vuforia).


Image recognition

After taking photographs of animals target images, I had to edit contrast and crop them in Photoshop, so there were no elements that would disturb recognition by the Vuforia Target Manager. Although overall, having had very distinct black and white images is great. Images were very easily found through the camera.

Screen-Shot-2017-03-11-at-11.20.27.png (9).gif

This is a very simple task, but I find a huge potential in is, as it can animate storytelling for kids. Reading an ordinary book with plain illustrations can be merged with watching animations through your phone camera.


Role: Research, Unity scene setup, animation, Vuforia integration.

Tools: Unity3D, Vuforia, Adobe Photoshop, Adobe AfterEffects.