New work: First AR Pop-up Book for iPad 2 and iPhone 4 using image recognition
Introducing a few sample pages from my new Augmented Reality (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below.
I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4.
Playful rhyming text takes you through the storybook where various ‘creepy crawlies’ (spider, ant, and butterfly) are awaiting to be discovered, appearing virtually as 3D models you can interact with. A tarantula attacks when you touch it, an ant hyperlinks to educational content with images and diagrams, and a butterfly appears flapping its wings atop a flower in a meadow.
(Above: Screen grabs from AR Pop-up Book working on iPad 2.)
The story for the AR Pop-up Book was inspired by AR psychotherapy studies for the treatment of phobias such as arachnophobia. AR provides a safe, controlled environment to conduct exposure therapy within a patient’s physical surroundings, creating a more believable scenario with heightened ‘presence’ and greater immediacy than Virtual Reality (VR).
[Article: Juan, Carmen M. et al. “Using Augmented Reality to Treat Phobias.” IEEE Computer Graphics and Applications 25.6 (2005): 31-37.]
In some ways, the AR Pop-up Book, “Who’s Afraid of Bugs?” provides a playful method for exposure and learning through story and technology to help children overcome their fear of bugs and discover that they aren’t so scary after all.
A portion of the AR Pop-up Book was demoed live during my talk on AR and Storytelling at ARE 2011 in Silicon Valley – watch video of my talk and slides here.
Design, concept, paper-engineering and production: Helen Papagiannis
Special thanks to Lukas Gruber for support with 3D model conversions.
AR Software: Junaio
*UPDATE: I’ve been so flattered by the wonderful response to my AR Pop-Up Book! Great big thanks to everyone for blogging, tweeting, and sharing my work, I really appreciate it! Here’s some of the coverage, thanks again: WIRED, Games Alfresco, Augmented Reality World, Adafruit, VR News, Junaio
-
1
Pingback on Jun 27th, 2011 at 5:58 pm
[...] Augmented reality pop up book via Bruce… Introducing a few sample pages from my new Augmented Reality (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below. I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4. [...]
-
2
Pingback on Jun 29th, 2011 at 7:41 am
[...] now she’s putting out a Augmented Reality Pop-Up Book for mobile devices using image recognition. The book can be enjoyed alone or with the enhanced [...]
-
3
Pingback on Jun 29th, 2011 at 1:10 pm
[...] http://tinyurl.com/5wyp43r Tags: augmented reality, Pop-up [...]
-
4
Pingback on Jul 3rd, 2011 at 8:25 am
[...] on some pretty cutting-edge concepts for using AR technology. She recently developed the first AR pop-up book for mobile devices. Check out the video here – the tarantula attacks when it’s touched [...]
-
5
Pingback on Jul 3rd, 2011 at 8:25 am
[...] on some pretty cutting-edge concepts for using AR technology. She recently developed the first AR pop-up book for mobile devices. Check out the video here – the tarantula attacks when it’s touched [...]
-
6
Pingback on Jul 3rd, 2011 at 4:46 pm
[...] Papagiannis hopes to treat phobias with a pop-up book with augmented reality extensions, full of creepy crawlies (powered by [...]
-
7
Pingback on Jul 4th, 2011 at 5:25 am
[...] e investigadora especializada en realidad aumentada que nos presenta su primer pop-up book para iPad y dispositivos móviles con cámara incorporada. De hecho se está usando como [...]
-
8
Pingback on Jul 10th, 2011 at 4:03 am
[...] Ref: http://augmentedstories.wordpress.com/2011/06/27/new-work-first-ar-pop-up-book-for-ipad-2-and-iphone… [...]
-
9
Pingback on Feb 27th, 2012 at 1:59 pm
[...] Papagiannis hopes to treat phobias with a pop-up book with augmented reality extensions, full of creepy crawlies (powered by [...]
-
10
Pingback on Mar 29th, 2012 at 7:25 am
[...] Papagiannis–a designer, PhD researcher and artist specializing in AR–has written an AR pop-up book designed to let those suffering from phobias directly encounter their fears in augmented space. [...]
June 28, 2011 at 8:25 am
Great presentation!
July 1, 2011 at 2:21 am
I just plus’d it in Google + -this is an awesome example.
July 7, 2011 at 7:20 am
We love it here @goaugmented – anything that is beautiful and next generation and helps proclaim the greatness of #AR especially in #mobile is wonderful in our book
January 21, 2012 at 4:19 pm
This is a great idea to get children more involved in reading since the original pop up books for kids have been fading away.
July 12, 2012 at 10:17 am
This is amazing. Thank you for the wonderful ang inspiring message that there are still endless wonders to be discovered.