Ishan Durugkar's Avatar

Ishan Durugkar

@idurugkar.bsky.social

Reinforcement learning researcher, dabbled in robotics, and generative techniques that were later made out of date by diffusion. Currently at Sony AI, working on game AI

216 Followers  |  208 Following  |  22 Posts  |  Joined: 22.01.2025
Posts Following

Posts by Ishan Durugkar (@idurugkar.bsky.social)

Tulips in my garden are past their prime now 😞
Can totally see why people wanted to invest in these drops of sunshine though

30.04.2025 19:09 — 👍 0    🔁 0    💬 0    📌 0

Very creative!

23.04.2025 02:24 — 👍 2    🔁 0    💬 0    📌 0

Nuance?! Oh no!

29.03.2025 04:03 — 👍 0    🔁 0    💬 1    📌 0

Hey Pablo! Is this role for the Summer? I can point some folks to this great opportunity

20.03.2025 14:46 — 👍 3    🔁 0    💬 1    📌 0

Top notch. "discourse about large models as intelligent agents is fundamentally misconceived. ... Large Models should not be viewed primarily as intelligent agents, but as a new kind of cultural and social technology, allowing humans to take advantage of information other humans have accumulated."

14.03.2025 17:55 — 👍 65    🔁 17    💬 0    📌 1

Oof! I can imagine. Eternally grateful that I'm working from home right now and can just take a break to go hang with the baby whenever

16.03.2025 11:02 — 👍 2    🔁 0    💬 0    📌 0

Very interesting reframing of the perspective through which we should look at the impacts of LLMs and other large models. To me, it is intuitively more satisfying than the debate around whether AGI is around the corner.

15.03.2025 15:42 — 👍 2    🔁 0    💬 0    📌 0

This thread presents a very different viewpoint compared to my intuitions and the debate I usually see online. Looking forward to diving in!

15.03.2025 15:01 — 👍 0    🔁 0    💬 0    📌 0

Very cool application of MARL! I'm excited to see more systems like this in the wild.

12.03.2025 05:56 — 👍 1    🔁 0    💬 1    📌 0

*Please repost* @sjgreenwood.bsky.social and I just launched a new personalized feed (*please pin*) that we hope will become a "must use" for #academicsky. The feed shows posts about papers filtered by *your* follower network. It's become my default Bluesky experience bsky.app/profile/pape...

10.03.2025 18:14 — 👍 522    🔁 296    💬 23    📌 83

Oof, yes. Agree with most of it too. I worry we're staring at another AI winter 😞

11.03.2025 04:22 — 👍 0    🔁 0    💬 0    📌 0
Preview
Andrew Barto and Richard Sutton are the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. Andrew Barto and Richard Sutton are the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. In a series of papers beginnin...

I got hooked on RL at UMass, where Andy and Rich started their collaboration. Really happy to hear that they are this year's Turing Award winners!

www.acm.org/media-center...

05.03.2025 17:21 — 👍 2    🔁 0    💬 0    📌 0

Good to know!

03.03.2025 05:37 — 👍 0    🔁 0    💬 0    📌 0

Whoa! I should try!

25.02.2025 18:05 — 👍 0    🔁 0    💬 0    📌 0

The first part of my suggestion was kinda serious

25.02.2025 17:45 — 👍 0    🔁 0    💬 1    📌 0

Maybe we should add some sort of comment section to ArXiv

Then we can have some experienced researchers who are not affiliated with the authors decide which papers have crossed the threshold to be classified as finalized papers.

25.02.2025 17:40 — 👍 0    🔁 0    💬 1    📌 0
Post image

Many people have asked me about the France Action Summit.

I think a summit is typically most valuable as a catalyst, not as a solution in itself.

But, will share some observations.

13.02.2025 09:08 — 👍 42    🔁 10    💬 2    📌 2

Now we need to train a Minecraft agent that can play Atari games in there

13.02.2025 14:13 — 👍 1    🔁 0    💬 1    📌 0

🚨🚨 RLC deadline has been extended by a week! Abstract deadline is Feb. 21 with a paper deadline of Feb. 28 🚨🚨. Please spread the word!

08.02.2025 18:05 — 👍 25    🔁 13    💬 1    📌 2

Oh no

09.02.2025 02:26 — 👍 0    🔁 0    💬 0    📌 0

Haha it's so hard to keep these exciting results to yourself until you can talk about them properly! Looks like it was totally worth it though

08.02.2025 02:00 — 👍 0    🔁 0    💬 0    📌 0

Whoa! Very cool stuff!

06.02.2025 20:52 — 👍 3    🔁 0    💬 1    📌 0

grad student descent is passe. Time for LLM descent!

01.02.2025 18:09 — 👍 1    🔁 0    💬 0    📌 0
RLJ | RLC Call for Papers

Welcome to the other side of ICML dear bleary-eyed RL researchers. Time to get ready for the RLC deadline, Feb. 14 AOE! So excited for your papers.
See the call for more info: rl-conference.cc/callforpaper...

31.01.2025 18:26 — 👍 10    🔁 5    💬 0    📌 0

The LLM is training us to give it a dense signal

25.01.2025 05:57 — 👍 2    🔁 0    💬 0    📌 0

It seems to make the problem of exploration more tractable. The agent doesn't have to explore everything, it just needs to explore efficiently in the neighborhood of the base policy.

So maybe it's actually removing some of the hardest challenges from general RL?

24.01.2025 19:39 — 👍 0    🔁 0    💬 0    📌 0

Hello world!

24.01.2025 19:36 — 👍 6    🔁 0    💬 0    📌 0