Designing Technologies for Learning: Unity Prototype

Team: Timmy Chan, Guadalupe Ortiz, Shmuel Nyssen

Our team set forth to augment a book on sharks (Hoyos, 2017). The book is written by a biologist based in Mexico that is focused on great white shark research. The great white shark is one of the most important species that maintains the balance of the ocean.

Then, our project is designed as a tool to reinforce the learning of children about environmental education topics. One of the principal targets we are trying to achieve is to make use of augmented reality in order to show with more details in an interactive environment. In particular, we were interested in how AR can not only augment the content by display, but we designed this prototype so to highlight the potential towards immersion and tangible interfaces (Dede, 2009; Dunleavy et al., 2009; Marshall, 2007).

Source Code and Assets

Unity SDK

The source code is hosted on GitHub. All code was written using Unity SDK and Visual Studio.

The Android application package file is hosted here. (Note, we have some depreciated code, so please only compile with Vuforia versions 8.x.x.)

Description of Prototype

Tooth:

As the scientific name of the white shark is Carcharodon carcharias, which comes from the Greek meaning pointed tooth, when the page is recognized as a target, a 3D real size model will be displayed. This way, the user can have a clear idea of the size of shark teeth in comparison to humans. In a more complete project, a whole jaw will be shown, due to the specific alignment of up to three teeth rows they can have, and also because it’s one of the principal reasons they chase this animal for. For this part, the 3d model is sourced from Poly by Google.

Shark Splash + Video Flavor

Display of video to further add to the textual descriptions.

Island Topography:

Isla Guadalupe has a crucial role on white sharks life. As the island allows the perfect conditions for sharks to grow, it is the best place in the world to encounter and swim between these animals. The author has made the book as a tribute itself to the island, and has dedicated a whole chapter about it. Due to the remoteness of its location, which takes 24h of sailing to get, an augmented environment is a great opportunity to get to know the place.

Habitat Map + 2 Cards: Interaction and Multiple Representations

Target images: Two cards and map page in the book

The book talks about the aggregation zones of sharks in the world. We use the page of the book as the main recognition target to display a 3D model of the world. When a card of the White Shark is placed over the book the project recognizes it as a target, and a scheme of the places where that specific species lives is triggered, which is mainly at cold-water coasts. When a second card of the Tiger Shark is placed, a different scheme will be displayed, showing its natural habitat at warm water places. This way, the user will have a clear idea of the difference between the species habitat, and can see this augmented implementation of content via physically interacting with an Image Target. On a further project the 22 most common species will be mapped to have a greater understanding about the differences between sharks.

to be implemented: Growth and behavior

Three different image targets will trigger a scale model of a hammerhead, white and gray shark, in order to compare the size between different species. On a further project, those models will interact with each other showing the possible behavior they can have, such as parallel swim, fake ambush, and mutual recognition. Sample of animation for “calm”

References

Bower, M., Howe, C., McCredie, N., Robinson, A., & Grover, D. (2014). Augmented Reality in education – cases, places and potentials. Educational Media International, 51(1), 1–15. https://doi.org/10.1080/09523987.2014.889400

Cuendet, S., Bonnard, Q., Do-Lenh, S., & Dillenbourg, P. (2013). Designing augmented reality for the classroom. Computers & Education, 68, 557–569. https://doi.org/10.1016/j.compedu.2013.02.015

Dede, C. (2009). Immersive Interfaces for Engagement and Learning. Science, 323(5910), 66–69. https://doi.org/10.1126/science.1167311

Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and Limitations of Immersive Participatory Augmented Reality Simulations for Teaching and Learning. Journal of Science Education and Technology, 18(1), 7–22. https://doi.org/10.1007/s10956-008-9119-1

Hoyos, M. (2017). El gran tiburón blanco: Protector de los océanos. https://www.pelagioskakunja.org/books/el-gran-tiburon-blanco

Johnson-Glenberg, M. C. (2017). Embodied Education in Mixed and Mediated Realties. In D. Liu, C. Dede, R. Huang, & J. Richards (Eds.), Virtual, Augmented, and Mixed Realities in Education (pp. 193–217). Springer Singapore. https://doi.org/10.1007/978-981-10-5490-7_11

Marshall, P. (2007). Do tangible interfaces enhance learning? Proceedings of the 1st International Conference on Tangible and Embedded Interaction  – TEI ’07, 163. https://doi.org/10.1145/1226969.1227004

Radu, I. (2014). Augmented reality in education: A meta-review and cross-media analysis. Personal and Ubiquitous Computing, 18(6), 1533–1543. https://doi.org/10.1007/s00779-013-0747-y

Radu, I., & Schneider, B. (2019). What Can We Learn from Augmented Reality (AR)? Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems  – CHI ’19, 1–12. https://doi.org/10.1145/3290605.3300774

Credits:

  • Timmy (Programmer): GitHub, Webpage Hosting, all scripting in Unity + Vuforia.
  • Shmuel (2d & 3d Graphics Design) : 3d models of island, three unique and informative textures for the globe,
  • Guadalupe (Animator & Tester): Choosing the book, testing of prototype, making demo videos, access to video and friends with the author of the book.

Prototype Design Meeting Journal