📢 This week at our Conv AI Reading Group, We’re happy to welcome :
🎙 Speaker: Ricard Marxer ( @ricard.bsky.social) - Université de Toulon, ILLS, CNRS
📖 Advancing the Linguistic Capabilities of Speech Language Models.
📅 Thursday, March 12 | 11:00 AM – 12:00 PM EST
I’m excited to share that our TABMON project has now a cool website!
TABMON is a new initiative funded by @biodiversa.eu that’s building the first transnational acoustic biodiversity monitoring network in Europe.
👉 See our website and meet the team here: tabmon-eu.nina.no
New paper! Using AI to track the frequency of vocalisations across a (very) wide range of species
www.ricardmarxer.com/f0-bioacoust...
In wolves, dolphins, etc, the up-down of frequency of their calls is where all the information is. Neural nets can do this automatically!
@brbbfreitas.bsky.social @frantsjensen.bsky.social @arikkershenbaum.bsky.social @malavika-m.bsky.social @hollyhowls.bsky.social
Robert C. Liu, Malavika Madhavan, Andrew Markham, Marie A. Roch, Holly Root-Gutteridge, Martin Šálek, Grace Smith-Vidaurre, Ariana Strandburg-Peshkin, Megan R. Warren, Matthew Wijers
🔗 Project page: www.ricardmarxer.com/f0-bioacoust...
📄 Paper: doi.org/10.1080/0952...
Fantastic work with Paul Best and Marcelo Araya-Salas, Axel G. Ekström, Bárbara Freitas, Frants H. Jensen, Arik Kershenbaum, Adriano R. Lameira, Kenna D. S. Lehmann, Pavel Linhart
We provide:
🔧 A tool with pretrained models to estimate F0 on new data
📊 An annotated dataset of 250k+ vocalisations
Key findings:
✅ Neural network models show strong potential
✅ Supervised models generalise to unseen species
✅ Self-supervised models can perform on par with supervised ones in some cases
✅ As expected, performance correlates with F0 saliency
The diversity of bioacoustic signals—in frequency range, harmonicity, SNR, etc.—makes F0 estimation particularly challenging.
We study how well #MIR F0 estimation transfers to non-human vocalisations, benchmarking SOTA models across 14 taxa:
📢 New paper!
F0 estimation is a classic task in the Music Information Retrieval (#MIR) community. Yet, it's much less studied in bioacoustics—despite its frequent use to describe animal sounds.
Images from doi.org/10.1038/srep... doi.org/10.1098/rspb... doi.org/10.3389/fmar...
Our study on #orcas vocal complexity!
doi.org/10.1016/j.ec...
We analyse #bioacoustics recordings spanning 5 years of wild orcas. DL classification and subsequent complexity measures are contrasted to pod sizes, to approach the social complexity hypothesis in #cetaceans
Good collab Best et al!
Happy to see this work out there. Good job @charlylamothe.bsky.social et al. it was really nice working with you all!
Come and work with us! Be a Postdoctoral Fellow in AI for Ultrasonic Bioacoustic Monitoring! All the details: https://www.naturalis.nl/en/about-us/job-opportunities/postdoctoral-fellow-in-ai-for-ultrasonic-bioacoustic-monitoring #academicjobs #postdoc #PDRA #netherlands #biodiversity #AI […]
Hi! 👋
I am Benjamin and I am a researcher at the Norwegian Institute for Nature Research (NINA).
I work at the intersection of #statistics, #AI methodologies (deep learning really) and #biodiversity monitoring - more specifically #bioacoustics 🦜🔊
Academic Job! Come and work with us as "Assistant Professor, Data Science & AI" tiu.nu/22594 - friendly department, lots of stimulating colleagues, Dutch work-life balance... oh and the #AI & #datascience #research :) #jobs #academicjob #netherlands
Today Santiago Cuervo and I are presenting our study on "Scaling Properties of Speech Language Models" at #EMNLP2024. More details soon. Can't wait? come chat with us at Poster session D.
Check out our latest survey on the use of #machinelearning for #bioacoustics ! We aimed to make it interesting to both biologists and computer scientists.
I had a great time working with this team.
doi.org/10.1111/brv....
So happy to finally be presenting this work with Clementin Boittiaux et al!
SUCRe uses SfM/MVS dense reconstruction to recover colors from underwater images.
🔗 clementinboittiaux.github.io/sucre/
To appear at #3DV2024 in March.
#underwater #deepsea #ai #machinelearning #computervision
Become a 4th wave student of our #ErasmusMundus #MSc in Marine and maritime Intelligent Robotics (MIR)
An international program combining #AI and #Robotics for #Ocean applications 🧠🤖🌊
Applications open tomorrow October 28th 2023
More here: www.master-mir.eu/emjmd-mir-ne...
