Lukas Schäfer

🇨🇦 Heading to @rl-conference.bsky.social next week to present HyperMARL (@cocomarl-workshop.bsky.social) and Remember Markov (Finding The Frame Workshop).

If you are around, hmu, happy to chat about Multi-Agent Systems (MARL, agentic systems), open-endedness, environments, or anything related! 🎉

Will be at ICML and looking to hire a postdoc to help us scale up and deploy RL in self-driving. So, hit me up to chat.

The Edinburgh RL Reading group is back with a fresh new website 👏
Anyone is welcome to attend!

Love these curated and shareable feeds on here. Such a good feature to give more control to the users and community to make the experience what they want it to be rather than leaving it in the control of the platform!

Eugene is awesome! — if you are interested in autonomous driving and RL, and New York sounds like an exciting place for a postdoc then this is an amazing opportunity! 👇

Robust Autonomy Emerges from Self-Play Self-play has powered breakthroughs in two-player and multi-player games. Here we show that self-play is a surprisingly effective strategy in another domain. We show that robust and naturalistic drivi...

Hiring a postdoc to scale up and deploy RL-based planning onto some self-driving cars! We'll be building on arxiv.org/abs/2502.03349 and learn what the limits and challenges of RL planning are. Shoot me a message if interested and help spread the word please!

Full posting to come in a bit.

Thanks! @sharky6000.bsky.social

GitHub - marl-book/marl-book-exercises: Code exercises for the MARL Textbook Code exercises for the MARL Textbook. Contribute to marl-book/marl-book-exercises development by creating an account on GitHub.

We also updated and moved our code exercises which we had built for a summer school to the marl-book github page so they can be easily found at github.com/marl-book/ma...

Thanks @sacha2.bsky.social for the reminder on that! They had previously been hidden inside my GitHub account 😅

Our textbook “Multi-Agent Reinforcement Learning: Foundations and Modern Approaches” has sold out! Another print round with minor corrections is in production with @mitpress.bsky.social and coming 👏

An errata of these corrections and the updated book PDF can already be found at www.marl-book.com

GitHub - LukasSchaefer/marl-book-exercises: Code exercises for the MARL Textbook Code exercises for the MARL Textbook. Contribute to LukasSchaefer/marl-book-exercises development by creating an account on GitHub.

Awesome to see the slides publicly available, wasn’t aware they are now!

And yes actually, the code exercises are here: github.com/LukasSchaefe...

Good point though, I wanted to migrate them to the book github project. I’ll have a stab at that later!

📜🤖 Can a shared multi-agent RL policy support both specialised & homogeneous team behaviours -- without changing the learning objective, requiring preset diversity levels or sequential updates? Our preprint “𝘏𝘺𝘱𝘦𝘳𝘔𝘈𝘙𝘓: 𝘈𝘥𝘢𝘱𝘵𝘪𝘷𝘦 𝘏𝘺𝘱𝘦𝘳𝘯𝘦𝘵𝘸𝘰𝘳𝘬𝘴 𝘧𝘰𝘳 𝘔𝘶𝘭𝘵𝘪-𝘈𝘨𝘦𝘯𝘵 𝘙𝘓” explores this!

Thanks, will check it out!

That sounds exciting! Are there any recordings or slides available to check this out? 👀

Today, I’ll be presenting our work on exploration in MARL using ensembles here! 👇

Multiagent Learning Session
Where: Ambassador Ballroom 1 & 2
When: 14:00 - 14:13

I’ll also present the poster later at the Learn track of the poster session at 15:45 - 16:30

Thanks!

We wanted to have a game with more realistic visuals. We decided on CS:GO mainly since there already existed an open dataset to train on and compare results to prior methods that used the same dataset.

Also, we finished initial experiments actually on the same day as CS2 released 😅

Thanks for the encouragement Marc — I’ll look out for you!

Thank!

Thanks to all the co-authors and collaborators!
Logan Jones, Anssi Kanervisto, Yuhan Cao, Tabish Rashid, Raluca Georgescu, David Bignell, Siddhartha Sen, Andrea Treviño Gavito, and first and foremost Sam Devlin

It's been an absolute joy working with this group of kind folks 👏

GitHub - microsoft/imitation_learning_in_modern_video_games: Accompanying code for "Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games" publication Accompanying code for "Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games" publication - microsoft/imitation_learning_in_modern_video_games

Paper: arxiv.org/abs/2312.02312

It took some time but I'm super excited that now our code is also open-source and available for everyone to use at: github.com/microsoft/im...

At the Adaptive and Learning Agents Workshop I'll be presenting our comprehensive study on the efficacy of different visual encoders for imitation learning in modern video games.

I'll be presenting the work as a short talk and poster at the ALA workshop on Monday!

This has been a long time coming, thanks a lot for my collaborators for all their help! Oliver Slumbers, Stephen McAleer, Yali Du, Stefano V Albrecht, and David Mguni

It's actually going to be my first ever oral presentation, so excited (and nervous) about that 👀

At the main conference, I'll be presenting our work on using ensembles of value functions for multi-agent exploration!

I'll be presenting the oral at the Multi-agent Learning 1 session on Wednesday (2:00 - 3:45pm), and the poster after 3:45pm!

Paper: arxiv.org/abs/2302.03439

On my way to Detroit for @aamasconf.bsky.social! Looking forward to presenting the last work from my PhD at the main conference, and work from @msftresearch.bsky.social at the Adaptive and Learning Agents Workshop. More info 👇

If you'd like to chat, feel free to DM me!

Congrats Matthew, looks awesome! 👏

I’ll be coming to Detroit! Would be awesome to have chance to meet and chat in person :)

WHAMM! Real-time world modelling of interactive environments. - Microsoft Research Today we are making available an interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. This blog post provides a deeper look at the research underpinni...

We are making available an experimental and interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. Learn more about the research underpinning this experience: www.microsoft.com/en-us/resear...

Workshop website screenshot showing the title and important dates of the website.

Call for papers! 🎉 If you have felt confused about evaluation in explainable AI, this workshop is for you! We are excited to go to Bologna @ ECAI'25 as we try to build better methods for evaluating XAI. Can't wait to see what ideas the community will bring!
sites.google.com/view/excd-20...

My group @FLAIR_Ox is recruiting a postdoc and looking for someone who can get started by the end of April. Deadline to apply is in one week (!), 19th of March at noon, so please help spread the word: my.corehr.com/pls/uoxrecru...

Why we're training AI on video games AI is already a powerful tool for collaboration — but this is just the tip of the iceberg, says AI researcher Katja Hofmann. She describes her team's work training AI on years of human gameplay data f...

What happens when we train generative AI models to predict everything that happens in a modern video game? In my TED AI talk I share insights from how AI can learn the physics of a game, and how this research could empower game creatives: www.ted.com/talks/katja_...

Wow! Awesome to see this recognition 👏