Harmonic Words, Narrative Chords: Textual Sonification Using Part of Speech
Harmonic Words, Narrative Chords: Textual Sonification Using Part of Speech by Jiin Ko(Visiting Reseracher, Dec 2023-Mar 2024), Youngjun Choi(Ph.D Candidate) and professor Jinjoon Lee was accepted at Proceedings of the International Conference on New Interfaces for Musical Expression (NIME) 2024 Poster
[Abstract]
This research aims to identify the commonalities between words (language) and chords (music), exploring if text itself can be musical and harmonic. Rather than letters or phonemes, we focus on words and their relationship between each other and have realized texts as music by using part of speech as chord progression on an automated algorithm. Other elements such as length and sentiment information inherent in text were also assigned to corresponding musical elements. For this research, a full-text of George Orwell’s Animal Farm was turned into a three-hour harmonic piece.
[Abstract]
This research aims to identify the commonalities between words (language) and chords (music), exploring if text itself can be musical and harmonic. Rather than letters or phonemes, we focus on words and their relationship between each other and have realized texts as music by using part of speech as chord progression on an automated algorithm. Other elements such as length and sentiment information inherent in text were also assigned to corresponding musical elements. For this research, a full-text of George Orwell’s Animal Farm was turned into a three-hour harmonic piece.