Soumya Vanka

Profile

I'm a PhD researcher in Audio and Music Technology at Queen Mary University of London currently working on AI-assisted music production and mixing style transfer. I previously did research at the Centre for Digital Music (C4DM) working with Dr. George Fazekas and Jean-Baptiste Rolland.

My work focuses on developing intelligent systems for music mixing and production, particularly emphasising mixing style transfer. I've developed Diff-MST, a framework comprising a differentiable mixing console and transformer controller that can transfer mixing styles between songs while maintaining interpretability and control. This work addresses key challenges in automated music production by allowing for post-hoc adjustments and supporting variable numbers of input tracks.

Beyond technical development, I'm also interested in understanding how AI technology is being adopted in professional music production workflows. Through my research, I've investigated how different user groups - from amateurs to professionals - interact with AI mixing tools, and how communication and reference songs play crucial roles in the mixing process. This human-centered approach helps inform the development of more effective and user-friendly AI systems for music production.

Publications

Diff-MSTC: A Mixing Style Transfer Prototype for Cubase

Diff-MSTC: A Mixing Style Transfer Prototype for Cubase

Soumya Sai Vanka, Lennart Hannink, Jean-Baptiste Rolland, George Fazekas

ISMIR 2024

Diff-MST: Differentiable Mixing Style Transfer

Diff-MST: Differentiable Mixing Style Transfer

Soumya Sai Vanka, C. Steinmetz, Jean-Baptiste Rolland, Joshua D. Reiss, George Fazekas

ISMIR 2024

The Role of Communication and Reference Songs in the Mixing Process: Insights from Professional Mix Engineers

The Role of Communication and Reference Songs in the Mixing Process: Insights from Professional Mix Engineers

Soumya Sai Vanka, Maryam Safi, Jean-Baptiste Rolland, György Fazekas

Journal of The Audio Engineering Society 2023

Adoption of AI Technology in the Music Mixing Workflow: An Investigation

Adoption of AI Technology in the Music Mixing Workflow: An Investigation

Soumya Sai Vanka, Maryam Safi, Jean-Baptiste Rolland, Georgy Fazekas

AES Europe 2023