Anastasiia Pedan

my main takeaway from a talk on reward design in rl: ai only beat humans when they were asked not to collaborate 👀👀

25.08.2025 19:07 — 👍 2    🔁 0    💬 1    📌 0

thank you, Claas, you're the best mentor I could've asked for!!!!

20.06.2025 17:05 — 👍 1    🔁 0    💬 0    📌 0

This was an amazing collaboration with a cracked team consisting of @cvoelcker.bsky.social, me, Arash Ahmadian, Romina Abachi, @igilitschenski.bsky.social, and @sologen.bsky.social

#ReinforcementLearning #ModelBasedRL #RLTheory #ICML2025

19.06.2025 02:39 — 👍 3    🔁 0    💬 0    📌 0

Calibrated Value-Aware Model Learning with Probabilistic Environment Models The idea of value-aware model learning, that models should produce accurate value estimates, has gained prominence in model-based reinforcement learning. The MuZero loss, which penalizes a model's val...

For more details, feel free to come chat with us in Vancouver⛰️🌲🌊 and check out our paper🤖! www.arxiv.org/abs/2505.22772

19.06.2025 02:39 — 👍 4    🔁 1    💬 1    📌 0

We can correct the MuZero loss and other losses from the same family by pushing the value estimates computed from different sampled model rollouts to have the correct variance and mean. We prove the soundness of this change and show that it is beneficial for agent performance 📈📈📈!

19.06.2025 02:39 — 👍 3    🔁 0    💬 1    📌 0

Getting a correct value estimate is instrumental in model-based RL, so if your algorithm fails to provide correct targets for model learning, your agent is in trouble because these errors will accumulate fast 📉📉📉!

19.06.2025 02:39 — 👍 4    🔁 1    💬 1    📌 0

Would you be surprised to learn that many empirical implementations of value-aware model learning (VAML) algos, including MuZero, lead to incorrect model & value functions when training stochastic models 🤕? In our new @icmlconf.bsky.social 2025 paper, we show why this happens and how to fix it 🦾!

19.06.2025 02:39 — 👍 8    🔁 3    💬 1    📌 1