Voyager 360 Spatial Audio with Video

link for mobile

(best on mobile with headphones)


To become more familiar with Facebook's Spacial Workstation for 360 audio, I chose to make a sound piece on the Voyager mission (with many opportunities for panning). As I was researching the mission, I came across a RadioLab interview with Ann Druyan, Carl Sagan's wife, and a hidden love story slowly emerged. Ann was directing the content for the Golden Record representing our world and culture, when she and Carl got engaged. Days afterwards, her vitals were recorded as she was thinking about Carl Sagan, and those recordings were included in the record on the Voyager spacecraft. The sound clips I used in editing this piece were all sampled from the same Golden record. For the video, I recorded a 360 video with a Theta from the inside of a globe/bar I found on the sidewalk. I edited the video in After Effects to create the illusion of looking at the stars from inside the globe (minus some masking/keying issues). 

Screen Shot 2017-09-20 at 6.17.08 PM.png
Screen Shot 2017-09-20 at 6.17.22 PM.png

Regex Image


As a supplement to my experiment The Last Question, I set out to generate an image with regex characters and symbols. I kept the short story generation in the first iteration, and added a function that *attempts* to redraw an uploaded file with characters based on the image pixel value. The characters are selected based on their pixel value. 

Screen Shot 2017-09-19 at 10.24.20 AM.png
Screen Shot 2017-09-19 at 10.31.19 AM.png
Screen Shot 2017-09-19 at 10.31.33 AM.png
Screen Shot 2017-09-19 at 10.33.43 AM.png
Screen Shot 2017-09-19 at 10.37.56 AM.png
Screen Shot 2017-09-19 at 10.40.01 AM.png
Screen Shot 2017-09-19 at 2.19.56 PM.png
Screen Shot 2017-09-19 at 2.20.20 PM.png

Voyager AR with BlippAR


In this straightforward exercise with BlippAR, I used the stereo version of a 360 sound piece I recently created in the style of a Radio Lab episode. In researching the Voyager mission I stumbled upon the love story between Carl Sagan and Ann Druyan and decided that would be a more interesting focus. After some testing with BlippAR, I chose an image of the Golden Record (containing recordings of what humans are all about) as a marker for a 3D model of the Voyager and the sound piece. 

Screen Shot 2017-09-16 at 6.59.04 PM.png

Arcade Joystick Controller


With the requirements to create a controller for Left, Right, Up, Down, and Quit controls, I set up a SparkFun switch with an arduino and neopixels highlighting selected directions. The housing was a departure from the typical "ITP box" (a bamboo box from the Container Store with an acrylic, laser etched lid), instead I aimed to reuse materials from the junk shelf. 


The Last Question


live website

This website was an experiment in accessing DOM elements in p5 and generating text with Rita.js. Once an image is uploaded, the RGB pixel value of each pixel determines the generated text sourced from Isaac Asimov's short story, "The Last Question". I mapped the combined RGB value of each pixel to the order of words as they appear in the short story. The darker the pixel, the further the word lives in the text.

Screen Shot 2017-09-10 at 6.57.55 PM.png
Screen Shot 2017-09-12 at 1.02.28 AM.png
Screen Shot 2017-09-12 at 12.23.51 AM.png
Screen Shot 2017-09-12 at 2.07.44 AM.png

Submarine Sound Piece


To get started in 360 sound design, we first took a look at Reaper and used it to construct a narrative with audio only. I wanted to play around with created different spaces with different background ambiances and saw a submarine as the perfect setting - I could travel from a very small metallic space to an underwater scene. The story itself is a bit morbid, but thanks to a Paulstrecthed Brian Wilson, the ending's a bit happier. 

Screen Shot 2017-09-17 at 11.13.11 AM.png