XR Sketches

Voice Activated Finger Guns

Pew pew – built in Unity with Oculus hand tracking and Windows speech recognition

AdjusTable

A prototype solution for a meeting in VR in which each participant sits at a desk of arbitrary height.

Trains

Hand Tracking Globe Rotation

Move a globe around in VR with your hands!

The Not So Subtle Knife

Slice open a window to other worlds.

Virtual Reality in VR

Experience Virtual Reality in VR. Made during the ITP stupid hackathon 2020.

Now That The Streets Have Names

Role: Developer

A satirical Augmented Reality tour through the streets of Yafo guided by a fictional former lieutenant.

I used IClone and Cinema4D to model the character, and IClone to animate lip movements and gestures based each station’s audio recording. I exported the keyframed kinematic files into Unity, and then paired each animation file and audio recording to the AR marker relevant to that station. I then developed the UI that would guide the users to each station, and released the Android app to the participants of the tour.

The project required over 40 minutes of near-photorealistic 3D animation to be rendered in real-time, in AR, on a phone. The optimisation challenges of the project were non trivial, and through them I learned a lot about smartphone capabilities, 3D texturing & rendering, and video compression