Format: Projected video with interactive touch elements, Physical book
Genre: Multisensory Experience
Winter 2024
Synesthesia:
"A perceptual phenomenon in which stimulation of one sensory or cognitive pathway leads to involuntary experiences in a second sensory or cognitive pathway."
Ever since I was a child, I have known that certain notes, chords, and even entire songs had certain corresponding colors to them. Depending on how complex they would be, I might see entire pictures in my mind composed of many different colorful scenes. The first step of this project involved a lot of exploration which included listening to a wide variety of songs and scales to visualize exactly what I see for each note. For this, I took all 24 basic scales, both major and minor, and put exactly what colors I see in my mind while listening to them. From there, I went forward by reflecting more in depth on what I see. From here, I began to explore some of my favorite songs which I felt encapsulated their own clear and colorful scene in my mind. After compiling 12 different songs, each with a different vibe, I began to work on creating the visuals. Using the National Archive, I compiled lots of video footage to create a sort of collage piece for each song. The last step after I had completed the videos was to figure out how exactly they would be shown. I then developed a device with three buttons, representing a forward arrow, a backward arrow, and a play button with which the user would control the experience. This device that I had made was then wired up to a makey-makey which translates the signals from the user to a figma prototype of the experience. This was probably the most abstract project I have done during my time at CCS, and it was a very rewarding experience to build something like this only from my imagination.
Figuring Out What I See
Finding Patterns
Imagining the Space
Constructing the Space
Experience in Action