Nishanth Anand's Avatar

Nishanth Anand

@itsnva7.bsky.social

Final-year PhD student in AI at Mila (Quebec AI Institute) and McGill University w/ Doina Precup. Research: RL, continual RL, and neuro-inspired RL.

35 Followers  |  71 Following  |  6 Posts  |  Joined: 17.03.2025  |  1.6981

Latest posts by itsnva7.bsky.social on Bluesky

Post image

I am in Vancouver at ICML, and tomorrow I will present our newest paper "Partially Observable Reinforcement Learning with Memory Traces". We argue that eligibility traces are more effective than sliding windows as a memory mechanism for RL in POMDPs. 🧵

16.07.2025 01:35 — 👍 59    🔁 12    💬 3    📌 3
Preview
GitHub - NishanthVAnand/eligibility_state: Eligibility state experiments. Eligibility state experiments. Contribute to NishanthVAnand/eligibility_state development by creating an account on GitHub.

When I first started working with Doina as a master’s student 7 years ago, this was the first idea that I tried (github.com/NishanthVAna...). But, I gave up on it too soon!

I’m happy and pleased to see you explore this path in depth with a solid paper! E-traces are the best idea to come out of RL!!

17.07.2025 04:23 — 👍 2    🔁 0    💬 0    📌 0
Preview
Mila Launched Canada’s First AI Computing Cluster Dedicated to Academic Research | Mila Mila, in partnership with Université Laval and Calcul Québec, officially launched TamIA, the first AI computing cluster specifically designed to support academic research in the country.

Introducing TamIA, the first AI computing cluster in Canada dedicated to academic research! A collaboration of Mila, Digital Research Alliance of Canada, CIFAR, Amii, @vectorinstitute.ai, Calcul Québec, Université Laval, @ualberta.bsky.social and University of Toronto. mila.quebec/en/news/mila...

24.04.2025 14:35 — 👍 9    🔁 3    💬 0    📌 0
Post image

This week, Mila researchers will present more than 90 papers at @iclr-conf.bsky.social in Singapore. Every day, we will share a schedule featuring Mila-affiliated presentations.
Day 1 👇 #ICLR2025
mila.quebec/en/news/foll...

23.04.2025 23:12 — 👍 12    🔁 3    💬 0    📌 1

Neat! What about two neural networks that have different architectures? Are there any metrics that you’re aware of could help compare them?

01.04.2025 23:19 — 👍 1    🔁 0    💬 1    📌 0

Does this mean we can evaluate the representation quality of two different neutral networks and objectively say one is better than the other?

01.04.2025 19:53 — 👍 1    🔁 0    💬 1    📌 0
Doina lab group picture

Doina lab group picture

We had a lab social and the mandatory pic after 💜

22.03.2025 12:27 — 👍 1    🔁 0    💬 0    📌 0
Post image

I am hoping to contribute to this thread equally!

21.03.2025 23:27 — 👍 0    🔁 0    💬 0    📌 0

add me too please: @itsnva7.bsky.social

17.03.2025 19:13 — 👍 2    🔁 0    💬 0    📌 0

@itsnva7 is following 20 prominent accounts