Sonic Information Design for the Display of Proteomic Data

William L. Martens

A research project focusing on the sonification of proteomic data distributions provided the context for the current study of sonic information design, which was guided by multiple criteria emphasizing practical use as well as aesthetics. For this case, the auditory display of those sonifications would be judged useful if they were to enable listeners to hear differences in proteomic data associated with three different types of cells, one of which exhibited the neuropathology associated with Amyotrophic Lateral Sclerosis (ALS). A primary concern was to ensure that meaningful patterns in the data would not be lost as the data were transformed into sound, and so three different data sonifications were designed, each of which attempted to capitalize upon human auditory capacities that complement the visual capacities engaged by more conventional graphic representations. One of the data sonifications was based upon the hypothesis that auditory sensitivity to regularities and irregularities in spatio-temporal patterns in the data could be heard through spatial distribution of sonic components. The design of a second sonification was based upon the hypothesis that variation in timbre of non-spatialized components might create a distinguishable sound for each of three types of cells. A third sonification was based upon the hypothesis that redundant variation in both timbral and spatial features of sonic components would be even more powerful as a means for identifying spatio-temporal patterns in the dynamic, multidimensional data generated in modern proteomic studies of ALS. This paper will focus upon the sound processing underlying the alternative sonifications that were examined in this case study of sonic information design.

1. Introduction	4. Results and Discussion
2. A Case Study of Proteomic Data Sonification	Biography
3. Sound Synthesis and Processing Methods	References

1. Introduction	4. Results and Discussion
2. A Case Study of Proteomic Data Sonification	Biography
3. Sound Synthesis and Processing Methods	References

References

Baier, Gerold and Thomas Hermann (2004). “The sonification of rhythms in human electroencephalogram.” In Proceedings Tenth Meeting of the International Conference on Auditory Display.

Barrass, Stephen (2012). “The aesthetic turn in sonification towards a social and cultural medium.” AI and society 27/2: 177-181.

Barrass Stephen and Virginia Best (2008). “Stream-based Sonification Diagrams.” In Proceedings of the 14^th International Conference on Auditory Display.

Barrass, Stephen and Gregory Kramer (1999). “Using sonification.” Multimedia Systems 7/1: 23-31.

Carey, John (2016). “Science and culture: musical genes.” Proceedings of the National Academy of Sciences 113/8: 1958-1959.

Dunn, John and Mary Anne Clark (1999). “Life music: the sonification of proteins.” Leonardo 32/1: 25-32.

Dutilleux, Pierre, Giovanni de Poli, Adrian von dem Knesebeck and Udo Zölzer (2011). “Time-segment processing.” In Udo Zölzer (ed.), DAFX - Digital Audio Effects (pp. 185-217). Second edition. Hoboken, NJ: John Wiley and Sons Ltd.

Grond, Florian and Jonathan Berger (2011). “Parameter Mapping Sonification,” In Thomas Hermann, Andy Hunt and John G. Neuhoff (eds.), The Sonification Handbook (pp. 363–397). Berlin: Logos Publishing House.

Grond, Florian and Thomas Hermann (2012). “Aesthetic strategies in sonification.” AI and Society 27/2: 213-222.

Hermann, Thomas and Gerold Baier (2013). “Sonification of the Human EEG.” In K. Franinović and S. Serafin (eds.), Sonic Interaction Design (pp. 285-297). Cambridge, MA: MIT Press.

Karplus, Kevin and Alex Strong (1983). “Digital synthesis of plucked-string and drum tones.” Computer Music Journal 7/2: 43-55.

Marozeau, Jeremy, Alain de Cheveigné, Stephen McAdams and Suzanne Winsberg (2003). “The dependency of timbre on fundamental frequency.” Journal of the Acoustical Society of America 114: 2946–2957.

Marozeau, Jeremy and Alain de Cheveigné (2007). “The effect of fundamental frequency on the brightness dimension of timbre.” Journal of the Acoustical Society of America 121: 383–387.

Martens, William L. (2003). “Perceptual evaluation of filters controlling source direction: Customized and generalized HRTFs for binaural synthesis.” Acoustical Science and Technology 24/5: 220-232.

Martens, William L., Philip Poronnik and Darren Saunders (2016). “Hypothesis-Driven Sonification of Proteomic Data Distributions Indicating Neurodegradation in Amyotrophic Lateral Sclerosis.” In Proceedings of the 22nd International Conference on Auditory Display.

Mihalas, George, Sorin Paralescu, Nicoleta Mirica, Danina Muntean, Mircea Hancu, Anca Tudor and Minodora Andor (2012). “Sonic representation of information: application for heart rate analysis.” In J. Mantas et al. (eds.), Proceedings of the 24th International Conference of the European Federation for Medical Informatics Quality of Life through Quality of Information (MIE).

Pereira, Frederico and William L. Martens (2018). “Psychophysical validation of binaurally processed sound superimposed upon environmental sound via an unobstructed pinna and an open-ear-canal earspeaker.” In Proceedings of the International Conference on Spatial Reproduction – Aesthetics and Science.

Schneiderman, Ben and Catherine Plaisant (2010). Designing the user interface: Strategies for effective human computer interaction. Fifth edition. Boston, MA: Addison-Wesley.

Takahashi, Rie and Jeffrey H. Miller. (2007). “Conversion of amino-acid sequence in proteins to classical music: search for auditory patterns.” Genome biology 8/5: 405.

Visi, Federico, Giovanni Dothel, Duncan Williams and Eduardo Miranda (2014). “Unfolding | Clusters: A Music and Visual Media Model of ALS Pathophysiology.” In Timour Klouche and

Eduardo Miranda (eds.), Proceedings of SoniHED Conference: Sonification of Health and Environmental Data.

Wierzbicki, James (2014). “The Imagined Sounds of Outer Space.” Journal of Sonic Studies 8.

Tip

Tip

References