New work: First AR Pop-up Book for iPad 2 and iPhone 4 using image recognition

Introducing a few sample pages from my new Augmented Reality  (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below.

I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4.

Playful rhyming text takes you through the storybook where various ‘creepy crawlies’ (spider, ant, and butterfly) are awaiting to be discovered, appearing virtually as 3D models you can interact with. A tarantula attacks when you touch it, an ant hyperlinks to educational content with images and diagrams, and a butterfly appears flapping its wings atop a flower in a meadow.

AR Pop-up Book by Helen Papagiannis

AR Pop-up Book by Helen Papagiannis

AR Pop-up Book by Helen Papagiannis

(Above: Screen grabs from AR Pop-up Book working on iPad 2.)

The story for the AR Pop-up Book was inspired by AR psychotherapy studies for the treatment of phobias such as arachnophobia. AR provides a safe, controlled environment to conduct exposure therapy within a patient’s physical surroundings, creating a more believable scenario with heightened ‘presence’ and greater immediacy than Virtual Reality (VR).

[Article: Juan, Carmen M. et al. “Using Augmented Reality to Treat Phobias.” IEEE  Computer Graphics and Applications 25.6 (2005): 31-37.]

In some ways, the AR Pop-up Book, “Who’s Afraid of Bugs?” provides a playful method for exposure and learning through story and technology to help children overcome their fear of bugs and discover that they aren’t so scary after all.

A portion of the AR Pop-up Book was demoed live during my talk on AR and Storytelling at ARE 2011 in Silicon Valley — watch video of my talk and slides here.

Design, concept, paper-engineering and production: Helen Papagiannis

Special thanks to Lukas Gruber for support with 3D model conversions.

AR Software: Junaio

*UPDATE: I’ve been so flattered by the wonderful response to my AR Pop-Up Book! Great big thanks to everyone for blogging, tweeting, and sharing my work, I really appreciate it! Here’s some of the coverage, thanks again: WIRED, Games Alfresco, Augmented Reality World, Adafruit, VR News, Junaio

About these ads

  1. I just plus’d it in Google + -this is an awesome example.

  2. Dan

    We love it here @goaugmented – anything that is beautiful and next generation and helps proclaim the greatness of #AR especially in #mobile is wonderful in our book

  3. This is a great idea to get children more involved in reading since the original pop up books for kids have been fading away.

  4. This is amazing. Thank you for the wonderful ang inspiring message that there are still endless wonders to be discovered.

  5. Way cool! Some very valid points! I appreciate you
    penning this post and the rest of the site is really good.

  1. 1 Augmented reality pop up book « adafruit industries blog

    [...] Augmented reality pop up book via Bruce… Introducing a few sample pages from my new Augmented Reality  (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below. I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4. [...]

  2. 2 Augmented Reality Pop-Up Book « Games Alfresco

    [...] now she’s putting out a Augmented Reality Pop-Up Book for mobile devices using image recognition.  The book can be enjoyed alone or with the enhanced [...]

  3. 3 First AR Pop-up book for iPad2 and iPhone4

    [...] http://tinyurl.com/5wyp43r Tags: augmented reality, Pop-up [...]

  4. 4 Augmented Reality: The past, present and future | Scripting4U Blog

    [...] on some pretty cutting-edge concepts for using AR technology. She recently developed the first AR pop-up book for mobile devices. Check out the video here – the tarantula attacks when it’s touched [...]

  5. 5 Augmented Reality: The past, present and future

    [...] on some pretty cutting-edge concepts for using AR technology. She recently developed the first AR pop-up book for mobile devices. Check out the video here – the tarantula attacks when it’s touched [...]

  6. 6 Weekly Linkfest Plus « Games Alfresco

    [...] Papagiannis hopes to treat phobias with a pop-up book with augmented reality extensions, full of creepy crawlies (powered by [...]

  7. 7 Libros y Realidad Aumentada en el iPad2 | AyudaiPad

    [...] e investigadora especializada en realidad aumentada que nos presenta su primer pop-up book para iPad y dispositivos móviles con cámara incorporada. De hecho se está usando como [...]

  8. 8 AR Pop-up Book for iPad2 and iPhone4 using image recognition « skyhorsewalkempty

    [...] Ref: http://augmentedstories.wordpress.com/2011/06/27/new-work-first-ar-pop-up-book-for-ipad-2-and-iphone… [...]

  9. 9 Coax Interactive Media Services » Interactive Media Solutions & Services Partner » Weekly Linkfest Plus

    [...] Papagiannis hopes to treat phobias with a pop-up book with augmented reality extensions, full of creepy crawlies (powered by [...]

  10. 10 Will the Law Require Augmented Reality for the Disabled? | Law of Social & Emerging Media | Wassom.com

    [...] Papagiannis–a designer, PhD researcher and artist specializing in AR–has written an AR pop-up book designed to let those suffering from phobias directly encounter their fears in augmented space. [...]

  11. 11 Augmented Reality: Helen Papagiannis AR Pop-Up Book | Beyond the Beyond | Wired

    […] http://augmentedstories.wordpress.com/2011/06/27/new-work-first-ar-pop-up-book-for-ipad-2-and-iphone… […]




Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


  • Follow ARstories on Twitter
  • About

    Dr. Helen Papagiannis is recognized as a leading expert in the field of Augmented Reality (AR). She has been working with AR for nearly a decade with a focus on storytelling and creating compelling experiences in AR. Dr. Papagiannis was named among the NEXT 100 Top Influencers (#16) of the Digital Media Industry in 2013, and is featured as an innovator in the book, "Augmented Reality: An Emerging Technologies Guide to AR", published in 2013. Her work and research in the field include her past roles as Chief Innovation Officer at Infinity Augmented Reality Inc. (New York City and Tel Aviv), and Senior Research Associate at York University's Augmented Reality Lab in the Department of Film, Faculty of Fine Art (Toronto). She has presented her interactive work and PhD research at global conferences and invited events including TEDx (Technology, Entertainment, Design), ISMAR (International Society for Mixed and Augmented Reality) and ISEA (International Symposium for Electronic Art). Dr. Papagiannis's TEDx 2011 talk was featured among the Top 10 Talks on Augmented Reality and Gamified Life. Prior to her augmented life, Dr. Papagiannis was a member of the internationally renowned Bruce Mau Design studio where she was project lead on “Massive Change: The Future of Global Design”, an internationally touring exhibition and best-selling book examining the new inventions, technologies, and events changing the world.
  • Archives


Follow

Get every new post delivered to your Inbox.

Join 439 other followers

%d bloggers like this: