SPEAKJAZZ 01 on artspeak

2022
Performance
+
Creative Coding
+
Algorithmic Music

Performed at CIT 4th floor, RISD on May 12 2022

One microphones, stereo speakers with custom MAX patch

research process in a book
SPEAKJAZZ is a live performance where the performer’s speech is automatically translated into a jazzy sound of two-handed piano and a drum. The performer’s speech is erratically transcribed on the monitor using a speech detection algorithm with a second delay. It is purposefully muted by overlapping the real-time algorithmic music, de-signifying the meanings of the speech.
MAX-built music-making algorithm, built in collaboration with Shawn Greenlee for the piece, mainly uses pitch detection, is a de-signification device, embracing glitches and mistranslation as musicality. Accordingly, in SPEAKJAZZ 01 on artspeak(2022), the artist statement is deconstructed, mistranslated, and remixed into jazz and machine transcription. And by this musical designificaiton device, the performance questions the meaningfulness of artspeak.






0.







Source Unknown from Threatening Music Notation(@ThreatNotation)





1.






Music notation generated from https://piano2notes.com.


Above is the first practice of using pitch music transcription algorithm. The original sound file I fed to the algorithm was the iPhone sound recording of me walking down the stairs to the apartment office to talk to the staff. The result of misusing the technology turned out to be this glitch-only MIDI file. And apparently, this does not sound anything like the original.






2.


















Full pages can be read in this link.


No.4 in G and Gb major are two-channel video that explored music transcription algorithm in the realm of bilingualism. Feeding same poems in two different languagues to the pitch detection algorithm, I generated two 4-handed piano music sheets-which is unplayable for human players, solely made up of unintentional glitches.

What is it to translate human speech to unplayable sheet music? What does it mean to manifest glitch-only piano notes as equivalent to bilingual identity?






0.






“Errors, ever unpredictable, surface the unnameable, point toward a wild unknown. To become an error is to surrender to becoming unknown, unrecognizable, unnamed.”

Legacy Russell, Glitch Feminism (New  York: Verso), 74.






3.







SPEAKJAZZ 01 on artspeak (2022)


In SPEAKJAZZ 01 on artspeak(2022), the artist statement is deconstructed, mistranslated, and remixed into jazz and machine transcription. And by this musical designificaiton device, the performance questions the meaningfulness of artspeak. MAX-built music-making algorithm, built in collaboration with Shawn Greenlee for the piece, mainly uses pitch detection, is a de-signification device, embracing glitches and mistranslation as musicality.




MAX Patch built for SPEAKJAZZ (in collaboration with Shawn Greenlee)