mp.TUI — a Max package for multitouch screen interaction

mp.TUI is a Max package with OpenGL UI components ready for multitouch interaction (using the TUIO protocol).

It was presented at the ICLI’2018 conference in Porto and was used in a series of projects including the Phonetogramme, Xypre and FIB_R.

Sources available on Github : https://github.com/LAM-IJLRA/ModularPolyphony-TUI

A few reactive UI components.
Dynamic cursors tracking placed objects
Dynamic semi-stable cursors

 

FIB_R / forages

Live audio+visual performance by FORAGES.

Sounds and images are operating in real-time on stage.
FIB_R plunges us into a body, that of the optical fiber itself. The eye opens onto its invisible omnipresence, penetrates the network fabric and sounds out the running processes.
On stage, two performers enter an abstract dialogue made of textual, sonic and graphic data. This communication is caught up in a cycle of metamorphoses embodying the modalities of digital media. The network acts as a protagonist, an environment with its own rhythm and rules.
Manipulations of digital images (via multi-touch interfaces) and analog images (captured via microscope camera and endoscope) are performed live on stage. They generate and explore fiber as an organic environment, in which language, deconstructed then reconstructed, attempts to find its way from sign to poem.

FORAGES is Gladys Brégeon and Vincent Goudard.
Production : AIAGOS
Duration 40min.
Presentation [pdf].
Technical rider [pdf].

TEASER :

 

Downloadable pictures

Previous performances

PANAM — accessible tools for digital art pedagogy

PANAM (Pédagogie artistique numérique accessible et multimodale) is a research and development project led by Puce Muse and concerned with the development and analysis of HCI strategies and tools for collective music practice with digital music instruments. It focuses on the accessibility of such tools for disabled people.

As part of the LAM team, several tools have been developed for the mapping, visualisation, and building of digital music instruments. They have been implemented as modules for the Meta-Mallette software (©PuceMuse), and are available as part of the LAM-lib, a software library for Max/MSP.

Publication

[pdf] Vincent Goudard, Hugues Genevois, Lionel Feugère. On the playing of monodic pitch in digital music instruments. Anastasia Georgaki and Giorgos Kouroupetroglou. ICMC/SMC 2014, Sep 2014, Athènes, Greece. National and Kapodistrian University of Athens, pp.1418, 2014.

Partners

 

 

LAM-lib — a Max package for digital luthery

The digital lutherie toolkit you need.

LAM-lib is a toolkit for Max/MSP providing all kind of useful goodies you need when building digital music instrument with Max. I started it during my work at the Lutherie Acoustique Musique lab. It is distributed under LGPL licence so that you can check it, fork it, buy it, sell it, use it, break it, fix it, trash it…etc. Just credit it.

Get it from GitHub.

John — the semi-conductor (Max version)

John, the semi-conductor.

John is an application meant for collective free improvisation, which was born out of the needs encountered in free improvisation practice with the Orchestre National Electroacoustique.

Namely, John was invented as a virtual companion to find stimulating answers for issues encountered in collective free improvisation, like precise timings for transitions between contrasting parts, articulations of large movements, or the proposal of unusual scores taking us off the beaten path.

It is made of two parts :

  • a score editor which can generate random scores based on constraints and probablities defined by the user
  • a real-time “conductor” displaying the score during live performance

Its name refers to both John Cage and John Doe.

John-scoreGenerator
Random score generation panel
John, conductor Max screenshot
The conductor screen, with countdown and active players

The original development was made with Max, then later reworked to a reactive web app.

Le phonétogramme — an interactive installation for voice analysis

Le phonétogramme is an interactive audio-visual booth created and developed for the “Cité des Sciences” museeum in Paris. It consists in a graph showing the pitch versus the loudness of a voice. It shows various characteristics of one’s voice, including the ambitus, the change of amplitude at vocal register shifts, and possible voice disorders.

The installation involved a multitouch screen to control the multilingual app for the Cité des Sciences audience. A distance sensor was also used to ensure the distance between the user and the microphone was correct. All the graphics and sound interaction design was made with Cycling’74 Max.

It was a challenging thing to design the UI with Max/jitter, but a good opportunity to test the limits of what could be achieved there. This project triggered the development of the MP.TUI package.

A snapshot from the chinese interface of the Phonetogram app.

Computer graphics and multimedia production for the exhibition “La voix, l’expo qui vous parle”.
Client : Cité des Sciences & de l’Industrie

OrJo — a joysticks orchestra

OrJo (for “Joysticks Orchestra”) is a research and development project on virtual instruments orchestra practices. This project involves several partners : Puce Muse (project coordinator), LAM, the LIMSI and the company 3Dlized.
I worked with the LAM-team on the development of “Dynamic intermediate Models” for digital lutherie which involve physical, topological and statistical interactions.

Ressources

[pdf] Dynamic Intermediate Models for audiographic synthesis, Sound and Music Conference SMC 2010, Padova (It)

[pdf] A dynamic intermediate model based on cellular automaton “game of life”, Live Interfaces 2012, Leeds (UK)