Ed Clark

Makes a lot of sense! I should probably stop wondering about this and just put out some interesting academic content then!

Does anybody know the level of interaction a general account on BlueSky has? Despite over 1000 followers I feel it's a lot lower than many other social platforms. Do you think this is a result of a large influx of non 'organic' growth?

#meta
#bluesky
#askbluesky

Is there a way to shift my doomscrolling from Instagram to Bluesky? I know I'd end up more informed and positive from 10 minutes on here than on insta. Maybe some good suggestions of random fun accounts to follow?

Wallace and Grommit serving up some great PSA's on AI and automation. Doesn't just seem to play out the AI bad trope and shows to a general audience how it can go wrong quickly.

Starting to debate getting dual providers but can't quite justify the cost. Starlink as back up seems a little steep for redundancy too! So I'm at the whim of virgin media for now....

Oooh I might go for a feeder on the window!

Thank you! Still need to put up my whiteboard! Currently in storage

Yep was very conscious about lighting so put a Philips hue ceiling light in for adjustability and a SAD lamp to fend off the feels

Adorable! But sadly not with my horrific allergies... However a little lamp for the tortoise to come bask under could work

I've built my own desk at a nice sitting height, but was thinking of adding an optional standing riser!
And a full teapot and biscuit tin is non optional

Just starting to build out my home office to have a nice space to push through the end of my PhD. What's your number one item to have in it? Can be anything from plants to monitors!
🌊🧪
#phdlife
#academia

All the different kits and bikes before the official change over in the new year! Love seeing the mixes of the new signings integration.

Unfortunately I have broken the illusion of childhood that one can have snacks with no prior work... It has ruined me

Routine is currently, sit and look at my outline in bullet points. Hate most of it, procrastination for the rest of the day 😂

Great idea giving a talk about it! Might help me figure out the figures I actually want.

Sits down to write paper...

6 months later. This paper hasn't written itself yet no matter how many times I ask nicely...

What are your tips for breaking through writing block and pushing out your paper? Could really do with some advice from the academic community!
🧪🌊

@carlosduartephd.bsky.social (I hope this is the right @ for you!)

The soundscape of the Anthropocene ocean Sound travels faster and farther in water than in air. Over evolutionary time, many marine organisms have come to rely on sound production, transmission, and reception for key aspects of their lives. ...

Our oceans aren't quiet and they're getting louder. A great paper on how important sound is in the ocean and how humans are impacting it. This is not only important for the biosphere but louder oceans make bad actors harder to detect.
🧪 🌊

www.science.org/doi/10.1126/...

e introduce the effective horizon, a property of MDPs that controls how difficult RL is. Our analysis is mo- tivated by Greedy Over Random Policy (GORP), a simple Monte Carlo planning algorithm (left) that exhaustively ex- plores action sequences of length k and then uses m random rollouts to evaluate each leaf node. The effective horizon combines both k and m into a single measure. We prove sample complexity bounds based on the effective horizon that correlate closely with the real performance of PPO, a deep RL algorithm, on our BRIDGE dataset of 155 deterministic MDPs (right).

Kind of a broken record here but proceedings.neurips.cc/paper_files/...
is totally fascinating in that it postulates two underlying, measurable structures that you can use to assess if RL will be easy or hard in an environment

For those doing lit reviews, be aware that Scopus can now search for pre prints as well! Great for getting visibility of what's on the horizon in your field.
🧪

Brilliant thank you I'll check it out!

Do you have a link to the whale use index paper? I'm interested at how they account for detection bias.

I've considered doing it but I use an acoustic propagation model in my environment which I think I'd also have to re-write. Wonder if an llm would have a go at refactoring into being jax compatible

Thank you for this starter pack! Would you be able to add me to it? I look at how we deploy and manage ocean sensing platforms for passive acoustic monitoring

These are amazing! Do you have an online store?

The beginnings of a starter pack for UK-based PhD students. Please let me know if you'd like to be added! go.bsky.app/8Uj4vn7

Would love to be added! Great to see so many UK researchers on here

Reinforcement Learning The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intel...

The best intro to RL book there is:
mitpress.mit.edu/978026203924...

What's the performance gains like between gym and gymnax?

What's your reinforcement learning stack?

I use:
- Custom gymnasium env
- Stable baselines 3 - RL library
- PPO - Algorithm
- NatureCNN - Model network
- wandb - run tracking
- wandb sweeps - hyper-parameter optimization
- tensorboard - offline tracking

#AI
#DRL
#RL
#Reinforcementlearning