2nd Story was an iOS & Android augmented reality application that I designed and developed for
The Only Animal.
The app is designed to be a site-specific experience, with two iterations - Ghost Light and DAREU.
Ghost Light took place in Vancouver's 'Blood Alley', an infamous spot that has seen it's fair share of poverty and addication. The Only Animal worked with the Portland Hotel Society and SFU Woodwards to canvas long-time residents of the community to offer stories that were geolocated within the alley, and came up with 70+ stories that had taken place over he past 30 years. The team then chose 10 of the stories to produce as videos, and I collaborated in the pre-production stage to assess AR target compatibility. When the videos were finished and loaded onto the phone, the resulting effect was that, in using the image recognition algorithms that I implemented, the user would trigger the video by scanning the area with their device's camera, and the subsequent video would start to play, having been shot from exactly the same location that the user was standing in. This effect was both immersive and engaging.
The second iteration was DAREU, using the same technology and user experience, but taking place in an underused corner of a parking garage on Granvile Island. This time the videos were fictional, designed by students, and particularly focused upon the aesthetic contraints and opportunities of viewing content in this form. I mentored the students during the production, and had to make significant changes to the computer vision algrithms to accomodate the vagaries of the location.
My role involved designing the user interface and user experience, developing and managing the backend system for content delivery, programming the app for both mobile platforms (which involved networking, computer vision, and media playback), and mentoring the production team on best practices for AR/VR content.
The project page can be seen here, the iOS application can be downloaded from the App Store, the Android application can be downloaded from Google Play, and the source code can be found on my GitHub for iOS and Android.