New AI benchmark helps music generation systems better understand human preference

The study, CMI-RewardBench: Evaluating Music Reward Models with Compositional Multimodal Instruction, introduces a new framework for evaluating how effectively AI systems generate music that matches complex human instructions involving text prompts, lyrics, and reference audio simultaneously. 

As AI-generated music rapidly becomes more sophisticated, one of the field’s biggest challenges is determining whether the music produced actually sounds good to humans and follows creative intent accurately. Existing evaluation systems often struggle to capture nuanced human judgement, particularly when users provide layered instructions involving mood, genre, instrumentation, lyrics, or stylistic references. To address this, the researchers developed CMI-RewardBench, a large-scale benchmark designed to evaluate music AI systems under “compositional multimodal instruction” conditions  -where multiple forms of input are combined to guide music generation. 

The team also created CMI-RM, a lightweight “reward model” capable of assessing whether generated music aligns with human preferences for both musical quality and instruction-following. The model demonstrated state-of-the-art performance across several evaluation tasks and consistently outperformed a number of large multimodal AI systems in judging music quality and alignment. 

The benchmark combines more than 110,000 pseudo-labelled preference pairs with 4,000 expert-annotated music comparisons spanning diverse genres, moods, instruments, and multilingual prompts. 

The researchers found that specialised music evaluation models significantly outperformed general-purpose AI systems when assessing nuanced musical quality. Frontier multimodal models such as Gemini and Qwen struggled with fine-grained musical judgement and complex compositional instructions, while the newly developed CMI-RM model achieved substantially higher agreement with expert human preferences. 

The study also demonstrated that using reward-model-based reranking - where AI systems generate multiple candidate outputs and automatically select the strongest one - consistently improved the quality of generated music. 

Yinghao Ma, a PhD student in Computer Science and member of the Centre for Digital Music, the leading researcher on this project, says "the work could help improve future AI music systems by making them more responsive to human creativity, preference, and artistic intent". 

Importantly, the team emphasised ethical considerations throughout the project, including copyright concerns, responsible dataset release policies, and informed consent procedures for human preference data collection. 

While the research is highly technical, its implications are deeply human. 

Music is one of the most personal forms of expression, yet current AI systems often struggle to understand the subtle qualities that make music meaningful to listeners. By improving how AI systems evaluate creativity, emotion, mood, and artistic intent, this research moves AI-generated music closer to human expectations and experiences. 

In the future, this could help musicians, creators, filmmakers, educators, game developers, and everyday users collaborate more naturally with AI tools to generate personalised soundtracks, creative ideas, adaptive audio experiences, and accessible music production support. 

The research also highlights a broader shift in artificial intelligence: moving beyond systems that simply generate content towards systems that better understand human preference, creativity, and cultural expression. 

Rather than replacing human creativity, the researchers hope these tools will support and amplify it - helping people create music that feels more meaningful, expressive, and emotionally resonant

You can read the full study via the following page.