Blenduino is an almost-plug-and-play addon for Blender that facilitates easy access to a Serial data stream. Bringing information from the physical world into a virtual 3D environment has many potential applications, from experimental new interfaces for 3D modelling and animation to immersive interactive experiences that blend the real and the virtual.
Github Repo
A collection of my more everyday tinkerings on a blog. Also contains class assignments done during my time at ITP.
Inspired by twitch, a class called Mashups, and the secret desire to watch the world burn, this project is a proof-of-concept in handing control of a Unity-built game to the twittersphere.
A node.js server constructs a maze and places Dave in the center. The data of that maze is broadcast to all connected clients – clients being any of the Unity games running in a browser.
The server listens to the twitter stream for appearances of a specific phrase, in this case “#savedave”. If a tweet with that phrase also contains a direction (up, down, left, or right), the server updates Dave’s position in the maze and broadcasts the change, along with the tweet responsible, to all clients.
The clients simply handle rendering the data onto your screen.
You can find the documentation as it stands, as well as a play-by-play account of my terrible panic when everything broke on launch, here.
The entire NYUAD Arts Department opens their doors to the public on this intense evening of Works-In-Progress
My participation was both logistical, helping to prepare and organise the events, as well as creative, showcasing some projects in progress.
In 2016 Lecturer Pierre Depaz and I set up a live greenscreen studio that was broadcast around the campus to entice people to come in to the Arts Center and experience the event. For the finale of Open Studios, I developed a web-based app that would flash the screen and flashlight of a smartphone in different patterns that the dancers could control. With everyone gathered outside we pumped the music, launched the drone, and had a great collaborative dance party!
In 2017 I collaborated with the fabrication instructor, Dustin Foster, to create a neopixelled advertising board, I helped to laser cut and engrave a series of cardboard and paper animal masks, and I created a projection mapped audio visualiser that enveloped the outdoor dance arena.
Watch the 2016 dance party here.
Watch the 2017 dance party here.
Role: Developer
A satirical Augmented Reality tour through the streets of Yafo guided by a fictional former lieutenant.
I used IClone and Cinema4D to model the character, and IClone to animate lip movements and gestures based each station’s audio recording. I exported the keyframed kinematic files into Unity, and then paired each animation file and audio recording to the AR marker relevant to that station. I then developed the UI that would guide the users to each station, and released the Android app to the participants of the tour.
The project required over 40 minutes of near-photorealistic 3D animation to be rendered in real-time, in AR, on a phone. The optimisation challenges of the project were non trivial, and through them I learned a lot about smartphone capabilities, 3D texturing & rendering, and video compression
