Rushiv Arora

Excited to share that an abstract of this paper was accepted at RLDM!

I’m genuinely excited to go for the conference—it is one of my favorite venues for interdisciplinary discussions!

This is a cause that is very close to my heart, and I am glad to have found the NOCC. They do a lot of important work for patients and their caregivers.

My grandmother passed away from ovarian cancer in 1995. I never got the chance to meet her, but I have always felt extremely connected with her through the countless stories and family heirlooms my parents have shared with me.

2025 TCS New York City Marathon - Rushiv Arora My grandmother passed away from ovarian cancer in 1995. I never got the chance to meet her, but I have always felt extremely connected with her, and all my ancestors, through the countless stories and...

I am thrilled to announce that I am running the 2025 New York City Marathon for the National Ovarian Cancel Coalition.

I would be grateful if you would consider donating or sharing the message to help me fundraise for this very important cause! Every share counts!

p2p.onecause.com/nycmarathon2...

This paper is personally meaningful to me since it is my first solo-authored paper! (And 7th overall!).

I got the idea in 2023 in the final months of my master’s but didn’t have the chance to work on it until last year. I am thrilled to finally publish it!

Read the paper to explore how H-UVFAs advance scalable and reusable skills in RL! #ReinforcementLearning #MachineLearning #AI

- Outperforming UVFAs: In Hierarchical settings, H-UVFAs have superior performance and generalization than UVFAs. In fact, UVFAs failed to learn in some settings.

- Learning in both supervised and reinforcement learning contexts.

Core Contributions:
- Hierarchical Embeddings: We show that it is possible to break down hierarchical value functions into its core elements by leveraging higher-order decomposition methods in Mathematics like Tucker Decompositions.

- Zero-shot generalization: H-UVFAs can extrapolate to new goals!

We extend Universal Value Function Approximators (UVFAs) to hierarchical RL, enabling zero-shot generalization across new goals in multi-task settings while retaining the benefits of temporal abstraction.

Hierarchical Universal Value Function Approximators There have been key advancements to building universal approximators for multi-goal collections of reinforcement learning value functions -- key elements in estimating long-term returns of states in a...

First post on here and it’s an exciting one! I am happy to share my new paper “Hierarchical Universal Value Function Approximators” (H-UVFAs): arxiv.org/abs/2410.08997