Designing Technologies for Learning: Unity Prototype

Team: Timmy Chan, Guadalupe Ortiz, Shmuel Nyssen

Our team set forth to augment a book on sharks (Hoyos, 2017). The book is written by a biologist based in Mexico that is focused on great white shark research. The great white shark is one of the most important species that maintains the balance of the ocean.

Then, our project is designed as a tool to reinforce the learning of children about environmental education topics. One of the principal targets we are trying to achieve is to make use of augmented reality in order to show with more details in an interactive environment. In particular, we were interested in how AR can not only augment the content by display, but we designed this prototype so to highlight the potential towards immersion and tangible interfaces (Dede, 2009; Dunleavy et al., 2009; Marshall, 2007).

Source Code and Assets

Unity SDK

The source code is hosted on GitHub. All code was written using Unity SDK and Visual Studio.

The Android application package file is hosted here. (Note, we have some depreciated code, so please only compile with Vuforia versions 8.x.x.)

Description of Prototype

Tooth:

As the scientific name of the white shark is Carcharodon carcharias, which comes from the Greek meaning pointed tooth, when the page is recognized as a target, a 3D real size model will be displayed. This way, the user can have a clear idea of the size of shark teeth in comparison to humans. In a more complete project, a whole jaw will be shown, due to the specific alignment of up to three teeth rows they can have, and also because it’s one of the principal reasons they chase this animal for. For this part, the 3d model is sourced from Poly by Google.

Shark Splash + Video Flavor

Display of video to further add to the textual descriptions.

Island Topography:

Isla Guadalupe has a crucial role on white sharks life. As the island allows the perfect conditions for sharks to grow, it is the best place in the world to encounter and swim between these animals. The author has made the book as a tribute itself to the island, and has dedicated a whole chapter about it. Due to the remoteness of its location, which takes 24h of sailing to get, an augmented environment is a great opportunity to get to know the place.

Habitat Map + 2 Cards: Interaction and Multiple Representations

Target images: Two cards and map page in the book

The book talks about the aggregation zones of sharks in the world. We use the page of the book as the main recognition target to display a 3D model of the world. When a card of the White Shark is placed over the book the project recognizes it as a target, and a scheme of the places where that specific species lives is triggered, which is mainly at cold-water coasts. When a second card of the Tiger Shark is placed, a different scheme will be displayed, showing its natural habitat at warm water places. This way, the user will have a clear idea of the difference between the species habitat, and can see this augmented implementation of content via physically interacting with an Image Target. On a further project the 22 most common species will be mapped to have a greater understanding about the differences between sharks.

to be implemented: Growth and behavior

Three different image targets will trigger a scale model of a hammerhead, white and gray shark, in order to compare the size between different species. On a further project, those models will interact with each other showing the possible behavior they can have, such as parallel swim, fake ambush, and mutual recognition. Sample of animation for “calm”

References

Bower, M., Howe, C., McCredie, N., Robinson, A., & Grover, D. (2014). Augmented Reality in education – cases, places and potentials. Educational Media International, 51(1), 1–15. https://doi.org/10.1080/09523987.2014.889400

Cuendet, S., Bonnard, Q., Do-Lenh, S., & Dillenbourg, P. (2013). Designing augmented reality for the classroom. Computers & Education, 68, 557–569. https://doi.org/10.1016/j.compedu.2013.02.015

Dede, C. (2009). Immersive Interfaces for Engagement and Learning. Science, 323(5910), 66–69. https://doi.org/10.1126/science.1167311

Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and Limitations of Immersive Participatory Augmented Reality Simulations for Teaching and Learning. Journal of Science Education and Technology, 18(1), 7–22. https://doi.org/10.1007/s10956-008-9119-1

Hoyos, M. (2017). El gran tiburón blanco: Protector de los océanos. https://www.pelagioskakunja.org/books/el-gran-tiburon-blanco

Johnson-Glenberg, M. C. (2017). Embodied Education in Mixed and Mediated Realties. In D. Liu, C. Dede, R. Huang, & J. Richards (Eds.), Virtual, Augmented, and Mixed Realities in Education (pp. 193–217). Springer Singapore. https://doi.org/10.1007/978-981-10-5490-7_11

Marshall, P. (2007). Do tangible interfaces enhance learning? Proceedings of the 1st International Conference on Tangible and Embedded Interaction  – TEI ’07, 163. https://doi.org/10.1145/1226969.1227004

Radu, I. (2014). Augmented reality in education: A meta-review and cross-media analysis. Personal and Ubiquitous Computing, 18(6), 1533–1543. https://doi.org/10.1007/s00779-013-0747-y

Radu, I., & Schneider, B. (2019). What Can We Learn from Augmented Reality (AR)? Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems  – CHI ’19, 1–12. https://doi.org/10.1145/3290605.3300774

Credits:

  • Timmy (Programmer): GitHub, Webpage Hosting, all scripting in Unity + Vuforia.
  • Shmuel (2d & 3d Graphics Design) : 3d models of island, three unique and informative textures for the globe,
  • Guadalupe (Animator & Tester): Choosing the book, testing of prototype, making demo videos, access to video and friends with the author of the book.

Prototype Design Meeting Journal

Miscellaneous Updates

The very most recent news is that I have decided to join University of Illinois at Chicago to work on a PhD in Learning Sciences, with a focus on Mathematics Education. I’m very excited to join the Learning Sciences Research Institute (LSRI) in continuing my research!

I’m moving this July, and this site will see significantly more activity; especially WRT notes on math education! I’ll be compiling notes and some definitions here as a resource

Some Highlights of 2018-2019:

  • Spring 2018:
    • Received the Sally Casanova Scholarship for the academic year 2018-19 (See page 14 of this booklet).
    • Participated in the California Forum for Diversity in Graduate Education
    • Finalized all the code for my thesis
    • Teaching:
      • Math 199 – Precalculus
      • Math 227 (x2) – Calculus II (as TA)
  • Summer 2018
    • Generalized code to any dimension, final verification of code with Dr. Gubeladze
    • Worked on implementing California Executive Order 1110 – part of a team with tenured faculty working on creating the curriculum for stretch courses.
    • Created a gradebook template and a lesson plan template for general use.
  • Fall 2018:
    • Applied to twelve PhD programs, and had a bit of an existential crisis because PhD applications can be grueling.
    • Worked on writing out my thesis, as most of my work was coding up to this point.
    • Defended my master’s thesis, “Computational Verification of the Cone Conjecture”
    • Teaching:
      • Math 107 – Math for Business Calculus I
      • Math 197 – Prelude to Calculus I
  • Spring 2019
    • Out of 12 I was waitlisted at one and accepted into two.
    • Finalized edits for my master’s thesis and submitted to archives
    • Updated LaTeX template for Masters Thesis for STEM majors at SFSU
    • Graduated from the Masters program!
    • First semester to finish grading finals not on the day that grades are due 😀
    • Teaching:
      • Math 108 – Math for Business Calculus II
      • Math 198 – Prelude to Calculus II