The artistic research project The Music of Language and Language of Music explores the relationship between music and speech, in particular between improvised music and everyday conversation. As a tool in this exploration, a digital musical instrument has been developed for “orchestrating” musical features of speech into music in real time. This has evolved into an electroacoustic performance concept entitled The Orchestra of Speech, where musical features of speech and conversation have been investigated and explored as sources for creating improvised music.