Abstract
Since many years ago, musicians have composed music based on the images that they have had in their minds. On the other hand, music affects people’s imagination while hearing it. This research provides a method that can transform shape to music and music to shape. This method defines musical notations for horizontal, diagonal and vertical line segments, filled circle and curve with different colors, which are the basis of many shapes in transforming shapes into music. Then these primary mappings are generalized to more complex forms to transform any shape. Moreover, music can be transformed into shape by this method. For this transformation, primary musical notations such as simple notes, notes joined by a legato, notes with a staccato, notes joined by a legato and have crescendo or decrescendo and notes with an accent or a trill are defined. These primary musical notations are generalized to more complex forms to transform any music into shape. Also, the method of this research can be used in music cryptography. It employs mapping of notes in a twelve-tone equal musical system into shapes and mappings of shapes with an equal line width and different colors into music.
Similar content being viewed by others
Data availability
All data and material are available and can be shared on demand.
References
Apel W (2003) The Harvard dictionary of music, 4th edn. Belknap Press: An Imprint of Harvard University Press, Cambridge
Berman G (1999) Synesthesia and the arts. Leonardo 32(1):15–22
Boenn G (2018) Computational models of rhythm and meter. Springer International Publishing, New York
Burk P, Polansky L, Repetto D, Roberts M, Rockmore D (2011) Music and computers: a theoretical and historical approach. Preface to the Archival Version (Spring, 2011)
Calude CS (2013) Information and randomness: an algorithmic perspective. In: Texts in theoretical computer science. An EATCS series. Springer-Verlag, Berlin Heidelberg
Campen V (2010) Cretien. The hidden sense: Synesthesia in art and science. The MIT Press, Cambridge
Fornari J, Maia I (2011) Interactive notation: Towards a cmputer model for interactive musical composition. Revista EIMAS. http://www.ufjf.br/anais_eimas/ISSN. Accessed 2011
Goldreich O (2019) On the foundations of cryptography providing sound foundations for cryptography: on the work of shafi goldwasser and silvio micali. ACM Books, New York, pp 411–496
Güçlütürk Y, van Lier R (2019) Decomposing complexity preferences for music. Front Psychol 10:674
Halpern AR, Bower GH (1982) Musical expertise and melodic structure in memory for musical notation. Am J Psychol 95(1):31–50. https://doi.org/10.2307/1422658
Hargreaves DJ, MacDonald R, Miell D (2012) Explaining musical imaginations: creativity, performance, and perception. Musical imaginations. In: Multidisciplinary perspectives on creativity, performance, and perception. Oxford University Press, Oxford, pp 1–14
Isaacson EJ (2005) What you see is what you get: on visualizing music. Proceedings of ISMIR 2005, 6th International Conference on Music Information Retrieval, London, UK 11–15 September 2005
Kennedy M, Bourne J (2004) The concise Oxford dictionary of music. Oxford University Press, Oxford
Kumar C, Dutta S, Chakraborty S (2015) Hiding messages using musical notes: a fuzzy logic approach. Int J Secur Appl 9(1):237–248
Kumar C, Dutta S, Chakraborty S (2015) A hybrid Polybius-Playfair music cipher. Int J Multimed Ubiquit Eng 10(8):187–198
Kuo Y-T, Chuang M-C (2013) A proposal of a color music notation system on a single melody for music beginners. Int J Music Educ 31(4):394–412
Lamaute N, et al (2016) A substitution cipher for musical cryptography. In: Proceedings of Student-Faculty Research Day, CSIS, Pace University
London J et al (2019) Tapping doesn’t help: Synchronized self-motion and judgments of musical tempo. Atten Percept Psychophysiol 81.7:2461–2472
Maršık L, Pokorny J, Ilcık M (2014) Towards a harmonic complexity of musical pieces. Procedings of the Annual International Workshop on Databases, Texts, Specifications, and Objects (DATESO)
Milhaud D (2018) South Bay chamber music society. Accessed date: 10/21/2020
Nikitin N, Rozaliev V, Orlova Y (2017) Program for sound generation based on image color spectrum with using the recurrent neural network. IV International research conference “Information technologies in Science, Management, Social sphere and Medicine” (ITSMSSM 2017). Atlantis Press
Patterson RD, Gaudrain E, Walters TC (2010) “The perception of family and register in musical tones”. Music perception. Springer, New York, NY, pp 13–50
Percino G, Klimek P, Thurner S (2014) Instrumentational complexity of music genres and why simplicity sells. PLoS One 9(12):e115255
Plack CJ, Oxenham AJ, Fay RR (eds) (2006) Pitch: neural coding and perception, vol 24. Springer Science & Business Media
Pryer A (2011) Graphic notation. In: Latham A (ed) The Oxford companion. Oxford University Press, Oxford
Puckette M (1996) Pure data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, pp 37–41
Qadir AM, Varol N (2019) A Review Paper on Cryptography. 2019 7th International Symposium on Digital Forensics and Security (ISDFS). IEEE
Rodrıguez-González S, Pérez-Lancho B (2018) Modeling a Synaesthete System to Generate a Tonal Melody from a Color Distribution. International Joint Conference SOCO’18-CISIS’18-ICEUTE’18: San Sebastián, Spain, June 6–8, 2018 Proceedings. Vol. 771. Springer
Sams E (1979) Musical cryptography. Cryptologia 3(4):193–201
Sams E (2016) Musical Cryptography (Crypt. 1979), Ericsams.org. [Online]. Available: http://ericsams.org/index.php/on-cryptography/333-musical-cryptography. [Accessed: 21- Apr- 2016]
Seaberg M (2011) Tasting the universe: people who see colors in words and rainbows in symphonies. Red Wheel/Weiser
Shmulevich I, Povel D-J (2000) Complexity measures of musical rhythms. Rhythm perception and production, pp 239–244
Smith SM, Williams GN (1997) A visualization of music. Proceedings. Visualization’97 (Cat. No. 97CB36155). IEEE
Stokley SR (2018) Historic look on color theory. Johnson & Wales University, Providence
Strayer HR (2013) From neumes to notes: The evolution of music notation. Music Offerings 4.1:1
Tesla N (2007) The strange life of Nikola Tesla, vol 1. Library of Alexandria
Thul E, Toussaint GT (2008) Rhythm complexity measures: A comparison of mathematical models of human perception and performance. ISMIR
Tucker GM, Jones AV, Latham A (2011) The Oxford companion to music. Oxford University Press, Oxford
Vuust P, Witek MAG (2014) Rhythmic complexity and predictive coding: a novel approach to modeling rhythm and meter perception in music. Front Psychol 5:1111
Weiß C, Müller M (2015) Tonal complexity features for style classification of classical music. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE
Xing B, Zhang K, Zhang L, Wu X, Dou J, Sun S (2019) Image–music synesthesia-aware learning based on emotional similarity recognition. IEEE Access 7:136378–136390
Yastrebtsev V On NA (1999) Rimsky-Korsakov’s color sound- contemplation Russkaya muzykalnaya gazeta, 1908, N 39–40 (in Russian), cited by Hiilnl Galeyev
Author information
Authors and Affiliations
Contributions
Yasaman invented the study, proposed the system design and did the analyses and prepared materials. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Marandi, Y.M.H., Sajedi, H. & Pirasteh, S. A novel method to musicalize shape and visualize music and a novel technique in music cryptography. Multimed Tools Appl 80, 7451–7477 (2021). https://doi.org/10.1007/s11042-020-09962-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09962-8