arXiv Sound

BridgeCode is a dual speech representation paradigm for autoregressive zero-shot TTS that predicts sparse tokens and reconstructs rich continuous features; reduces AR iterations and enhances naturalness, intelligibility, and synthesis speed.

A self-supervised learning approach for automatic music sample identification uses a multi-track dataset to create positive pairs of artificial mixes and a novel contrastive learning objective; outperforms previous state-of-the-art baselines.

ILD-VIT, a vision transformer framework, detects Interstitial Lung Disease from respiratory sound recordings; uses mel spectrogram image patches for classification and achieves 84.86% accuracy, sensitivity, and specificity.

Audio-Maestro is a tool-augmented audio reasoning framework that enables audio-language models to autonomously call external tools and integrate timestamped outputs, improving performance by analyzing and interpreting audio signals through specialized tools.

A dynamically slimmable network (DSN) for speech enhancement adaptively governs dynamic parts at a frame-wise resolution, with metric-guided training (MGT) guiding the policy module; achieves comparable performance with reduced complexity.

PEASE-8, a Phase-aware Ear-conditioned speaker Separation network, introduces a raw-STFT input to the early decoder layer for improved reconstruction; delivers strong separation and intelligibility in reverberant environments.

Diffusion-Link, a diffusion-based modality-bridging module, generatively maps audio embeddings into the text-embedding distribution; reduces the audio-text modality gap and achieves state-of-the-art performance on Automatic Audio Captioning.

EMM-TTS is a two-stage cross-lingual emotional speech synthesis framework based on perturbed self-supervised learning representations, explicitly encoding prosodic cues and restoring timbre; uses Speaker Consistency Loss and Speaker-Emotion Adaptive Layer Normalization.

VCB Bench is a Chinese benchmark built on real human speech for evaluating audio-grounded large language model conversational agents, assessing instruction following, knowledge understanding, and robustness.

MSRBench is a benchmark for Music Source Restoration, containing raw stem-mixture pairs across eight instrument classes; mixtures are produced by professional mixing engineers & augmented with real-world degradations.

RankMe, embedding effective rank, is used as a unifying metric to study scaling laws for general audio representations, revealing a power-law relationship between RankMe and representation quality.

A perceptually-motivated Ambisonics recording and rendering method compensates for playback room reverberation by spectrally and spatially compensating direct and reverberant sound field components; preserves auditory cues like DOA and IC.

FAC-FACodec is an accent conversion framework that provides an explicit, user-controllable parameter for accent modification to target pronunciation while preserving suprasegmental cues; performance comparable to recent systems, stronger speaker identity preservation.

ParsVoice, a large-scale Persian speech corpus for TTS, features 3,526 hours of speech from 2,000 audiobooks, filtered to 1,804 hours of high-quality data with 470+ speakers; publicly available.

DS-KWS, a two-stage framework for user-defined keyword spotting, uses a dual data scaling strategy to strengthen the acoustic model and enhance distinction of confusable words; achieves 6.13% EER and 97.85% AUC on LibriPhrase Hard.

Proficiency-aware multitask learning (ASR with proficiency classification) and targeted augmentation (spectrogram masking) are proposed to improve L2 ASR, reducing WER and narrowing proficiency gaps.

SS-DPPN, a self-supervised dual-path prototypical network, is proposed as a foundation model for cardiac audio representation & classification; achieves state-of-the-art performance on four benchmarks, generalizes across lung sounds and heart rate.

LSZone, a lightweight spatial information modeling architecture for in-car multi-zone speech separation, uses a spatial information extraction-compression module and an extremely lightweight Conv-GRU crossband-narrowband processing module for real-time performance.

A machine learning method assigns guitar tablature notation to MIDI, considering finger stretch and standard tuning; training with augmented data improves performance.

MARS-Sep, a reinforcement learning framework for sound separation, uses a factorized Beta mask policy optimized by a clipped trust-region surrogate with entropy regularization & group-relative advantage normalization; multimodal rewards incentivize semantic consistency.

KDFIP, a knowledge-decoupled functionally invariant path framework, integrates a gated parameter-isolation strategy into FIP for personalized ASR, separating generic and personalized knowledge; improves performance by 29.38%.

MRSAudio, a large-scale multimodal spatial audio dataset, includes binaural & ambisonic audio, video, motion trajectories, and fine-grained annotations for diverse scenarios; establishes five foundational tasks including spatialization and generation.

ProGress, a generative music framework, incorporates Schenkerian analysis with a diffusion modeling framework to enhance structural cohesion; adaptations of the DiGress model, phrase fusion, and user control improve musical compositions.

Peransformer incorporates a score-aware discriminator, trained on a note-to-note aligned MIDI dataset, to improve low-informed Expressive Performance Rendering; validated by subjective evaluations, extended automatic evaluation metrics.

Matchmaker, an open-source Python library, systematically compares real-time music alignment methods using music representations and alignment algorithms, evaluated on solo piano music datasets with comprehensive metrics.

A data augmentation framework for SER uses cross-modal information transfer and mutual information regularization to improve the quality of generated data and expand the scope to multimodal inputs; tested on IEMOCAP, MSP-IMPROV & MSP-Podcast.

UDSE, a Universal Discrete-domain SE model, redefines speech enhancement as a discrete-domain classification task, predicting clean discrete tokens quantized by a pre-trained neural speech codec; shows superior universality.

A framework using speech inversion as an auxiliary task and cross-attention to integrate predicted articulatory features into ASR models improved performance on LibriSpeech, particularly in low-resource conditions.

RePOPE-Spk, an audio-augmented benchmark, reveals that spoken queries under diverse acoustic conditions escalate hallucinations in multimodal large language models, increasing error rates by 3%.

LadderSym, a Transformer-based method for music error detection, uses a two-stream encoder with inter-stream alignment and multimodal symbolic scores as decoder prompts, doubling F1 for missed notes on MAESTRO-E.