Matrix Music Visualizer

As well as real-time sound visualisation for music and art, this project is also being explored within the context of virtual reality (see other projects here and here, and download apps here). Any visualisation process should be driven by an understanding of how humans perceive sound and light, and so here I combine data on human sensitivities to sound and light frequencies to generate an intuitive and natural synesthesia interaction between the user and herself and other users through technology mediated environments.

I did some research into the effect of crossed-sense modalities on presence in virtual reality, click here.

Matrix Music Visualizer Free! Get it now on iPhone/iPad!

Rez [level 5] - Adam Freeland - Fear is the mind killer

With the announcement of Rez Infinitely to be released on Playstation VR, I thought I would take the opportunity to revisit my favourite track from the game. The visualisation showcases some of the latest features, including new hexagonal and rhombic 3D lattice structures, new colour mappings and a variety of particle textures including triangles, squared and hexagons. More information can be found at http://bensoundcolour.blogspot.jp/

Experimental sound and music visualisation using a particle system in Unity 3D　(Music: Renick Bell - 808s)

Sound visualisation based on a natural algorithm for generating colour from sound spectra, taking into consideration an understanding of our visual and audial sensory systems. The new aspects of this visualisation are the use of a particle system to render the sound colour in a 3D way. The video demonstrates 3D lattice arrays arranged in simple cubic, body centred cubic, face centred cubic, and diamond lattice arrays, and also demonstrates a number of translations, rotations, sound-to-position coupling effects, changes in origin of sound colour projection and other effects.

Music is from Renick Bell, check him out at renickbell.net and at his SoundCloud soundcloud.com/renick