arXiv Sound

AudioGen-Omni, a unified multimodal diffusion transformer, generates video-synchronized audio, speech, and songs using a novel joint training paradigm and AdaLN-based joint attention; achieves SOTA results on Text-to-Audio/Speech/Song tasks with improved efficiency.

An adaptive higher-order Ambisonics strategy dynamically scales Ambisonics order based on network throughput, balancing immersion and reliability in Networked Music Performance scenarios.

VR-PTOLEMAIC, a virtual reality system, implements the MUSHRA methodology for perceptual evaluation of spatial audio algorithms; user feedback indicates positive user experience and immersivity.

Continuous wavelet transform extracts spectral features; wavelet coherence analysis compares recorded audio spectrograms to synthetically generated Irish tunes derived from ABC notation for audio identification.

Recent scientific challenges and open-source activities have stimulated the development of automatic Speech Quality Assessment (SQA) methods, leading to their increased use in generative AI research.

A U-Net model segments beamformed audio maps for 360 acoustic source localization, trained on real-world drone recordings and GPS telemetry, generalizing across environments and improving angular precision.

A fully convolutional time-domain audio neural network (Conv-TasNet) upscales First-Order Ambisonics (FOA) to Higher-Order Ambisonics (HOA), improving spatial accuracy; quantitative evaluations show a 0.6dB average positional mean squared error difference.

Melody-Lyrics Matching (MLM) retrieves lyrics for a given melody using a self-supervised framework with contrastive alignment loss; introduces sylphone, a syllable-level lyric representation.

Audio language models were shown to excel at continuously detecting utterances identifying Hearing Difficulty Moments in conversational audio, outperforming ASR hotword heuristic and Wav2Vec fine-tuning.

MECAT, a Multi-Expert Constructed Benchmark for Fine-Grained Audio Understanding Tasks, was introduced, with fine-grained captions and QA pairs; DATE, a novel metric, penalizes generic terms and rewards detailed descriptions.

Two music albums using prompt-based AI music generation were created; an LLM interview explored authorship, musical identity, and new musical spaces.

WavLM-Large embeddings with attentive statistical pooling and Diff-Net variants (FFN, SE-ResFFN) were used for Voice Timbre Attribute Detection (vTAD); WavLM-Large+FFN generalized better to unseen speakers, achieving 77.96%.

Feature Importance across Domains (FiDo) estimates feature importance on spectral, time-domain acoustic features, and latent Whisper representations; FiDo was incorporated into MBI-Net+, reducing RMSE by 7.62%.

Full-Duplex-Bench v1.5, a benchmark simulating overlap scenarios, was introduced; benchmarking five agents revealed repair-first rapid yielding vs. continuity-first sustained flow strategies, with scenario-dependent performance trends.

A multi-view SSL framework combining contrastive and reconstructive objectives was proposed for disentangling music audio representations; reconstruction and contrastive strategies complement each other for attribute disentanglement.

Dynamic SSCF-based polar parameters and SSCF0 pseudo-feature were combined with MFCCs in Vietnamese ASR; the proposed parameters reduced word error rates and showed greater gender independence.

Dragon-FM, a text-to-speech model unifies AR and flow-matching; AR models across chunks, flow-matching within chunks, enabling KV-cache and future context use.

A k-space approach models multi-channel parametric array loudspeaker systems, solving the linear ultrasound field and computing the quasilinear audio sound field in k-space; achieves high computational and memory efficiency.

A novel duration prediction framework gives compromising phoneme-level duration distribution; improves alignment accuracy by ~11% and enhances zero-shot TTS model robustness.

Speech intelligibility prediction method simulates auditory degradations by broadening cochlear filters and low-pass modulation filtering; Vision Transformer integrates STM maps and NCC embeddings, outperforming HASPI v2.

Overestimated privacy protection in voice anonymisation is demonstrated; performance is overestimated when the verification system is poorly trained, with mismatched data leading to exaggerated performance reports.

A two-step learning framework with tracwise reordering maintains temporal consistency; trains SED and DoA networks separately, then fuses features to enhance SELD, improving event classification and localization.

QPAudioEraser, a quantum-inspired audio unlearning framework, erases individual-specific voice signatures by weight initialization using destructive interference, superposition-based label transformations, uncertainty-maximizing quantum loss function, and entanglement-inspired mixing.

Tiny noise-robust VAD combines a light-weight VAD with data pre/post-processing; enhances accuracy in noisy environments without larger models or fine-tuning, also improving clean speech detection.

Vanilla transformer models effectively scaled up on sEMG data to 110M parameters, improving cross-user performance; distilled into 50x smaller models with minimal performance loss.

Whilter, a Whisper-based model, uses utterance-level multi-task classification to filter undesirable features in-the-wild speech corpora, achieving F1 scores above 85.

SpeechFake, a large-scale multilingual speech deepfake dataset, contains over 3 million samples generated using 40 speech synthesis tools; baseline detection models show strong performance on seen and unseen test sets.

RAVEN, a real-time audio-visual speech enhancement system, isolates on-screen target speakers using visual embeddings from AVSR and ASD models; concatenating embeddings improves performance in low-SNR, multi-speaker environments.

Subjective speech assessments of HNC patients correlated with objective acoustic measures; intelligibility, articulation, and voice quality showed strong correlations; a single intelligibility measure may be sufficient for clinical monitoring.

Combolutional layers, learned-delay IIR comb filters and fused envelope detectors, extract harmonic features in the time domain for audio tasks; outperforms convolutional layers in piano transcription, speaker classification, and key detection.