Combining a Time-Distributed Data Generator with the Niagara Particle System: Transforming 2D Audio-Visual Artwork into Interactive VR Experience.

Shvets, Anna; Trzepizur, Anthony

Abstract

In the contemporary landscape, AI solutions have emerged to assist in tasks such as 3D modelling, skybox creation, and the development of metaverse environments. Despite these advancements, the process of translating existing digital artwork into the realm of Virtual Reality (VR) still demands extensive 3D modelling efforts and resource-intensive spatial implementations. We propose an expedient and effective solution that involves scaling 2D digital audio-visual artwork to the VR context using time-distributed data generators and the Niagara particle system. This approach addresses the challenges associated with 3D modelling and enriching VR spaces with content. To illustrate this solution, we present an implementation featuring the "Carnival of Colour" audio-visual 2D artwork, created by Terry Trickett and set to music composed by Anna Shvets, which is available in video format. In our implementation, we surround the user with Niagara particle emitters, projecting the video frame representations as simultaneous displays of time steps received through the time-distributed data generator. This method ensures the preservation of audio correspondence, accompanied by visual variability. Additionally, the simulation of physical forces applied to the particles introduces volume to the initial 2D visual representation. We integrate several levels of user interaction with the audio-visual content, creating an illusion of a living organism. This design proposes a transitional space that bridges the aesthetics of modern art exhibitions with interactive VR technology.

Citation

Shvets, A., & Trzepizur, A. (2024, July). Combining a Time-Distributed Data Generator with the Niagara Particle System: Transforming 2D Audio-Visual Artwork into Interactive VR Experience. Presented at EVA London 2024: Electronic Visualisation & the Arts, London, UK

• Presentation Conference Type: Edited Proceedings
• Conference Name: EVA London 2024: Electronic Visualisation & the Arts
• Start Date: Jul 8, 2024
• End Date: Jul 12, 2024
• Acceptance Date: Feb 19, 2024
• Publication Date: 2024-07
• Deposit Date: May 30, 2025
• Publicly Available Date: Jun 6, 2025
• Peer Reviewed: Peer Reviewed
• Series Title: Electronic Workshops in Computing (eWiC)
• Series ISSN: 1477-9358
• Book Title: Proceedings of EVA London 2024 (EVA 2024)
• DOI: https://doi.org/10.14236/ewic/EVA2024.39
• Public URL: https://nottingham-repository.worktribe.com/output/47400401
• Publisher URL: https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/EVA2024.39