OrJo (for “Joysticks Orchestra”) is a research and development project on virtual instruments orchestra practices. This project involves several partners : Puce Muse (project coordinator), LAM, the LIMSI and the company 3Dlized.
I worked with the LAM-team on the development of “Dynamic intermediate Models” for digital lutherie which involve physical, topological and statistical interactions.
[pdf] Dynamic Intermediate Models for audiographic synthesis, Sound and Music Conference SMC 2010, Padova (It)
[pdf] A dynamic intermediate model based on cellular automaton “game of life”, Live Interfaces 2012, Leeds (UK)
Morphogenius is an application for tablet that was proposed for the exhibition on Leonardo Da Vinci at Cité des Sciences, Paris. It is inspired by Leonardo Da Vinci morphological drawings.
It allows to “transfer” reality as captured by the tablet’s camera into 3d drawings. The camera stream is processed with an edge detection algorithm easing the readability of shapes and structures. All drawings are done in 3d and the user can move, rotate and zoom them in any direction.
Pascal Criton, a french composer of contemporary music as well as a musicologist who studied Wyschnegradsky’s works, created an interactive piece inspired by Wyschnegradsky’s “ultrachromatic compositions” for association Puce Muse.
I designed a collective instrument able to produce complex polyrhytmic sequences of filtered sound texture. Each step of the sequence can be assigned a color nuance and a pitch, possibly micro-tonal. The result produces visual and sonic moires, reminding of Wyschnegradsky’s chromatic drawings.
Simple timelapse is a quick tool to make timelapse movies.
It uses an arduino for setting shutter intervals, an 4N35 opto-coupler to protect the camera from any accidental current, and a led to notify when shutter is in action. Focus was left manual to prevent from any automatic adjustement (that we don’t want anyway in timelapse!) and spare camera battery. Code and circuit was derived from intervaluino borrowing the opto-coupler idea from MaxTech, available at GitHub.
Meta-Screen was a video mapping project led at Puce Muse, to transform any surface into a projection screen. Developments included tools to quickly map a shape or a contour, as well a real-time algorithm to interact with these shapes, like physics engine to make virtual objects bounce on architectural features.
Digital moving picture.
107724404×8 is the audiovisual rendering of a binary pdf file raw data.
The video reveals the internal structure of the file as both visual and sonic shapes. Compressed parts of the file will look and sound noisy while uncompressed parts will show redundant patterns and somewhat harmonic sound spectrum.
Original video is 10min long and 1024× 768px.
Beware of the rrrraw sound.