Pablo Samuel Castro

Pablo Samuel Castro

@pcastr.bsky.social

Señor swesearcher @ Google DeepMind, adjunct prof at Université de Montréal and Mila. Musician. From 🇪🇨 living in 🇨🇦. https://psc-g.github.io/

3,571 Followers 343 Following 360 Posts Joined Nov 2024
1 week ago

In light of the ongoing conflict in the Middle East, RLC decided to remove the abstract deadline: rl-conference.cc/callforpaper...

The only deadline is for the full paper: Mar 5(AOE) openreview.net/group?id=rl-...

Affected folks may also contact the PCs to discuss deadline extensions before Mar 5.

14 8 1 2
1 week ago

RLC 2026 Call for Workshop is live on OpenReview!

Submission deadline: Mar 12 (AoE).
Full details here: rl-conference.cc/call_for_wor...

@glenberseth.bsky.social @eugenevinitsky.bsky.social @twkillian.bsky.social @schaul.bsky.social @sologen.bsky.social @audurand.bsky.social @bradknox.bsky.social

10 3 0 1
3 weeks ago

It's been such a pleasure working with @caroline-wang.bsky.social the last few months. She is a fantastic researcher, engineer, & person, and I really hope we can work together again.
Check out the paper that came out of her time with us, comparing strategic behavior of humans and LLMs!👇🏽

18 0 0 0
1 month ago
Preview
The Formalism-Implementation Gap in Reinforcement Learning Research The last decade has seen an upswing in interest and adoption of reinforcement learning (RL) techniques, in large part due to its demonstrated capabilities at performing certain tasks at "super-human l...

This is something I talk about in my paper, where I suggest being explicit about {\gamma}_train (some methods use multiple gammas during training) and \gamma_eval.
One of my students is empirically investigating this and, as one would expect, it can have a huge impact.

arxiv.org/abs/2510.16175

12 1 1 1
1 month ago
Post image

Today's wordle spoke volumes.

Wordle 1,677 2/6

⬛🟩⬛🟩🟩
🟩🟩🟩🟩🟩

P.S. here's a selfie of my x-country ski commute this morning 😃🎿

2 0 0 0
2 months ago

Today's wordle energized me

Wordle 1,662 2/6

🟨🟩🟩⬛⬛
🟩🟩🟩🟩🟩

3 0 1 0
2 months ago
Post image

How I started 2026, hoping to keep this spirit up throughout the year!
Happy new year!

10 0 0 0
2 months ago

Another one of my favorite spots in Ecuador: El Pailón del Diablo 🇪🇨

5 0 0 0
2 months ago

Gets better the closer you get 🏔️🇪🇨

12 0 0 1
2 months ago

Quito, Ecuador

3 0 1 0
2 months ago
Post image

Will never tire of this view ❤️🇪🇨

13 0 1 1
2 months ago
RLJ | RLC Call for Papers

Hi RL Enthusiasts!

RLC is coming to Montreal, Quebec, in the summer: Aug 16–19, 2026!

Call for Papers is up now:
Abstract: Mar 1 (AOE)
Submission: Mar 5 (AOE)

Excited to see what you’ve been up to - Submit your best work!
rl-conference.cc/callforpaper...

Please share widely!

61 28 0 8
2 months ago

Today's wordle made me feel warm.

Wordle 1,646 2/6

⬛🟨🟩⬛⬛
🟩🟩🟩🟩🟩

3 0 0 0
2 months ago

Despite some of its flaws, OpenReview has had a tremendously positive impact on our research community.
This is a great initiative! Join me, and many others, in donating to ensure OpenReview not only remains a positive force, but is able to improve.

1 0 0 0
3 months ago

It was really great to chat with so many friends that I don't always get a chance to see, and to meet new ones, especially during our morning runs.
I really enjoyed this #NeurIPS2025 , but am also exhausted 🥰🫩

Until next time!

bsky.app/profile/did:...

2 0 0 0
3 months ago

Finally, on Saturday I gave a talk at the Embodied World Models for Decision Making workshop on our recent paper on using foundation models to automatically design Reward Machines for improved RL training:

Paper: arxiv.org/abs/2510.14176

Post:
bsky.app/profile/roge...

1 0 1 0
3 months ago
Post image

On Friday afternoon Eduardo Pignatelli and I *should have* presented our paper on NAVIX: Jax-based MiniGrid for super speedy experiments! 🚀
Due to our miscommunication our poster was MIA 😅

openreview.net/forum?id=lPV...

1 0 1 0
3 months ago
Post image Post image

Also on Friday morning, Jiashun and @johanobandoc.bsky.social presented our Measure Gradients, not Activations paper: moving from ReDo to ReGraMa to improve learning performance of RL agents!

openreview.net/forum?id=FjN...

1 0 1 0
3 months ago
Post image Post image Post image Post image

On Friday morning @roger-creus.bsky.social @johanobandoc.bsky.social @glenberseth.bsky.social and I presented our (spotlight) Stable Gradients paper: scaling depth and width of RL networks by avoiding vanishing gradients!
(Also presented this at LXAI workshop)

openreview.net/forum?id=Vqj...

2 0 1 0
3 months ago
Post image Post image

On Thursday Ghada Sokar and I presented our Mind The Gap paper: better understanding of (and simplifying) how to scale RL networks!

openreview.net/forum?id=LrB...

1 0 1 0
3 months ago
Post image Post image

On Wednesday Reggie and Evangelos presented our MetaWorld+ paper: Multi-task continuous control done right!

openreview.net/forum?id=1de...

2 1 1 0
3 months ago

This #NeurIPS2025 was tiring, but it was fantastic to connect with so many friends and colleagues!
I was so busy I didn't get a chance to tweemote our papers at the conference, so I'll remedy that with this post-hoc thread: 👇🏾

2 1 1 0
3 months ago

Sixth, and last, #runconference at #NeurIPS2025 had the best turnout yet!
Thanks to everyone who came out, until the next conference!
The second picture is of those who stayed until the end 😅🏅
🤖🏃🏾👋🏾

11 0 0 1
3 months ago

Fifth #runconference at #NeurIPS2025 , good turnout again!
Tomorrow is the last run (at least with me), so if you've had FOMO this week, you have one more chance!
🤖🏃🏾

7 0 0 1
3 months ago

Fourth #runconference at #NeurIPS2025 had the best turnout yet!
Help us beat it tomorrow, same place, same time (follow tweet thread for details)!
🤖🏃🏾

13 0 0 1
3 months ago

Third #runconference at #NeurIPS2025 was great, including special guest @JeffDean !
Same place, same time, tomorrow morning if you want to join!
🤖🏃🏾
(I forgot to post yesterday's pic, so including it here)

3 0 0 1
3 months ago

. @roger-creus.bsky.social and @johanobandoc.bsky.social did an awesome job presenting our paper at the LatinX in AI workshop at #NeurIPS .

If you missed it, come to our poster #310 on Friday 11am, exhibit hall C,D,E.

1 0 0 0
3 months ago

Join us tomorrow at #runconference for #NeurIPS2015, same time, same place (see quoted thread for details)!

It was three of us this morning but I forgot to take a picture before we separated, so here's a selfie to prove we actually went out 🤭

Hope to see more of you tomorrow!

3 0 0 1
3 months ago
Post image

Just landed in San Diego for #NeurIPS2025 !
If anyone wants to join me for #runconference tomorrow, meet me at the pin at 7:00am. We'll play distance and pace by ear, based on who shows up
See you then!
🤖🏃🏾
maps.app.goo.gl/W7fedHdpsrFn...

5 0 1 1
3 months ago

Today's wordle was received as a gift.

Wordle 1,622 2/6

⬛🟩🟩⬛⬛
🟩🟩🟩🟩🟩

6 0 0 0