DATA-TO-SOUND MAPPING: INTEGRATING VISUAL AND AUDITORY ANALYTICS

Abstract

This project focuses on transforming numerical data into sound using the concept of sonification, providing an alternative to conventional visual analysis methods. By mapping data values to auditory features such as pitch, loudness, and duration, the system enables users to “listen” to patterns and insights that might not always be clearly visible in graphical representations. This interactive approach improves data engagement and can benefit researchers, analysts, as well as individuals with visual impairments. The applications of this system extend to domains such as scientific research, education, accessibility technologies, and creative multimedia fields. The project introduces a sonification workflow that first converts numerical datasets into RGB color images and then transforms the color information into sound signals. Initially, a dataset is arranged within a structured two-dimensional matrix, which is visualized as an RGB image. Each pixel in the image contains red, green, and blue components that are interpreted as sound parameters such as frequencies and amplitudes. Through this layered transformation, the system creates a bridge between visual and auditory forms of data representation, allowing users to interpret patterns more intuitively. The approach can support multiple applications including data exploration, assistive tools for visually impaired users, and creative audio-visual experiments. By linking numerical values, color representations, and sound signals, the proposed method supports analytical applications while offering new insights into datasets and user interaction. Additionally, it opens opportunities for future developments in multimodal data representation systems that combine visual, auditory, and interactive elements to improve data understanding.