Steph Milani's Avatar

Steph Milani

@stephmilani.bsky.social

PhD Student in Machine Learning at CMU. ๐Ÿฆ twitter.com/steph_milani ๐ŸŒ stephmilani.github.io

4,265 Followers  |  126 Following  |  32 Posts  |  Joined: 17.11.2024  |  1.8312

Latest posts by stephmilani.bsky.social on Bluesky

NeurIPS 2025 competition track submission summary, scores, and recommendation to accept

NeurIPS 2025 competition track submission summary, scores, and recommendation to accept

Excited to share that the PokeAgent challenge was accepted as a NeurIPS competition!

This should serve as an excellent benchmark for competitive games AND โ€˜speedrunningโ€™ the RPG. I hope to see both the RL and LLM agent communities working together here to eval agents in Pokemon

More info soon๐Ÿ‘€

26.05.2025 19:55 โ€” ๐Ÿ‘ 19    ๐Ÿ” 3    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 1

Iโ€™m defending my thesis on Friday!! ๐Ÿคบ

Message me for the Zoom link

14.05.2025 14:52 โ€” ๐Ÿ‘ 5    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

What do you mean? This is excellent

20.02.2025 15:57 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Happy to announce our paper is accepted to #ICLR ๐Ÿฅณ

Great working with Zhuorui Ye (a fantastic undergrad applying for PhD!), Geoff Gordon, & Fei Fang on this project.

๐Ÿ’ซ Stay tuned for an interpretable human-in-the-loop reinforcement learning agent that dramatically reduces human annotation burden!

22.01.2025 18:35 โ€” ๐Ÿ‘ 18    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Ahh I would come if it was 11:30pm

12.12.2024 05:43 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Thank you!

12.12.2024 05:40 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Hi! Could you add me please? I'm a PhD candidate in machine learning at CMU

12.12.2024 05:37 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I created a starter pack for people who are or have been affiliated with the Machine Learning Department at CMU. Let me know if I missed someone!

go.bsky.app/QLTVEph

#AcademicSky

18.11.2024 15:46 โ€” ๐Ÿ‘ 4    ๐Ÿ” 4    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Tagging my amazing collaborators w/ BlueSky accounts: @ruiyiwang.bsky.social @zhiyuchen.bsky.social

03.12.2024 16:40 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ—“๏ธ Schedule might change:

12/14:
* 10:40am, Oral @ GenAI4Health
* 11:20am, Poster @ AIM-FM
* 1:00pm, Poster @ GenAI4Health
* 4:20pm, Poster @ GenAI4Health
* 5:10pm, Poster @ AIM-FM

12/15:
* 11:40am, Oral @ FM-EduAssess
* 12:25pm, Poster @ FM-EduAssess

03.12.2024 16:40 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

๐Ÿ‡จ๐Ÿ‡ฆ Attending my last NeurIPS as a PhD student! Presenting our recent work, Patient-ฮจ, at a few workshops --- come by! Schedule in ๐Ÿงต

I'm on the job market, looking for TT faculty roles & post-docs.

DM if you'd like to chat (or invite me to a party ๐Ÿฅณ)!

03.12.2024 16:40 โ€” ๐Ÿ‘ 14    ๐Ÿ” 1    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1

See you there ๐Ÿ‘€

01.12.2024 00:41 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Hi Bsky people ๐Ÿ‘‹ I'm a PhD candidate in Machine Learning at Carnegie Mellon University.
My research focuses on interactive AI, involving:
๐Ÿค– reinforcement learning,
๐Ÿง  foundation models, and
๐Ÿ‘ฉโ€๐Ÿ’ป human-centered AI.

Also a founding co-organizer of the MineRL competitions ๐Ÿ–ค Follow me for ML updates!

18.11.2024 15:05 โ€” ๐Ÿ‘ 70    ๐Ÿ” 6    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

I had the opportunity to intern with @katjahofmann.bsky.social in 2021! She is an amazing mentor with a fantastic team & I highly recommend applying ๐Ÿ’ซ

25.11.2024 15:54 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

RL list is getting kinda full but I'm mostly here for new papers so... go.bsky.app/2Gibu1a

Chime in! No rules but the title

24.11.2024 05:45 โ€” ๐Ÿ‘ 81    ๐Ÿ” 10    ๐Ÿ’ฌ 21    ๐Ÿ“Œ 0

Oh no... I fear this might be me

22.11.2024 19:41 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Not sure of the exact problems you looked at, but we've also found that using VLMs to do simple image annotations (e.g., location of an agent in a grid) can be very error-prone ๐Ÿ˜…

21.11.2024 20:08 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I had a great time speaking with @khulick.bsky.social about AI safety & our work on training better-behaved agents via the BASALT competition series!

Excited about the potential for using Minecraft as a sandbox to develop safer AI systems. ๐ŸŽฎ

20.11.2024 18:15 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

For those interested in ethical implications of AI, as well as work on Responsible and Trustworthy AI - here is a starter pack (non-exhaustive) to help find out more or connect with colleagues go.bsky.app/RnucJWZ

17.11.2024 15:44 โ€” ๐Ÿ‘ 59    ๐Ÿ” 20    ๐Ÿ’ฌ 12    ๐Ÿ“Œ 2

๐Ÿ‘€๐Ÿ‘€๐Ÿ‘€

20.11.2024 16:30 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ‘‹ Could I be added?

20.11.2024 16:08 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Thanks, Miguel!!

20.11.2024 14:29 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Thanks, Chase :)

20.11.2024 14:29 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I've updated my starter pack of #WomenInTech. Whether you are new or established here, these women are worth following:
go.bsky.app/EL57ogD
My DMs are open. If I missed someone, let me know!

18.11.2024 02:36 โ€” ๐Ÿ‘ 33    ๐Ÿ” 7    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 2

Hi! Could you please add me to the list? Btw your DMs are not open :)

19.11.2024 15:14 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Thank you, Simone!!

19.11.2024 15:02 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ™Œ๐ŸŽ‰ Congratulations, Dr. @samvelyan.com!

19.11.2024 14:55 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Hi! Would you mind adding me to the list? I've done research in games (particularly Minecraft), including investigating perceptions of human-like behavior in a video game :)

19.11.2024 14:54 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

The RL (and some non-RL folks) starter pack is almost full. Pretty clear that the academic move here has succeeded
go.bsky.app/3WPHcHg

18.11.2024 20:30 โ€” ๐Ÿ‘ 104    ๐Ÿ” 32    ๐Ÿ’ฌ 12    ๐Ÿ“Œ 3

Adding a few tags here ๐Ÿ˜„

@academic-chatter.bsky.social

#academicsky #mlsky

18.11.2024 18:14 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

@stephmilani is following 20 prominent accounts