Just Some Feeds

Hi, I have let go of the blueskyfeeds .com domain, and am no longer associated with it.

From now on this account is focused on open source improvements on the feed server and running a few lightweight feeds.

Running it now on my much smaller server.

Will take a while to fill up again.

They're not affected. All the feeds affected have already stopped working.

i.e. UKPolitics feed will be gone on July 7 unless @johnlf.bsky.social does something about it

Hi, sorry, I missed your post. A sticky is a post that crops up every time. The feed this post is 'stuck' on will be deleted on July 7th unless the feed maker transfers it to somewhere else.

Like the 'sticky' post to get rid of it.

Smaller issues if possible, but yeah, any kind of feedback is good feedback, honestly.

I've Open Sourced the blueskyfeeds.com code here for those who want to deploy or experiment.

Will work on a dockerizing the standalone simple-feed after a break 💤

anianimals-moe’s gists GitHub Gist: star and fork anianimals-moe's gists by creating an account on GitHub.

gist.github.com/anianimals-m...

Above is a gist of the json format exported from blueskyfeeds.com, it's quite hastily put together 😖

anianimals-moe - Overview anianimals-moe has 4 repositories available. Follow their code on GitHub.

blueskyfeeds.com code is up on github.com/anianimals-m...
Simple feed is a single-user standalone feed builder without UI that can use feeds exported from the main app. It runs with a local sqlite database

The other 3 are the existing large server that uses mongodb

@oro.lol Are you experienced in building dockers? It's been more than a year since I last built one. But I should have the node.js code up on github in the next 24 hours.

Open source code for feed self-host and potentially running in a docker container is tentatively working.

Doing some tests and writing a readme now.

Good idea, a docker version could even run on a local SQLite and if not complicated could run on jetstream instead of the full firehose.

It's a legacy issue. In 2023, when I started this project, Bluesky was small and I got feedback to make creative feeds e.g. Quote 📷 🐈‍⬛ , it'd make a feed of posts photographed.

Many feed features just never made it to jetstream. The firehose is still fine with optimization and horizontal scaling.

I'm also looking to work w/ any feed providers who want to support migrating feeds on my service.

Keep your json backup, and hopefully someone will support feed migration from it.

I'm checking with graze if they can transform my json export to their format, so do backup your feed json in case, I'll post an update if it works.

Docs | Migrating a Feed How to migrate a feed built elsewhere to Graze

Any feed provider that supports migrating that keeps the feed url like graze should work (but the json logic is not compatible)

www.graze.social/docs/migrati...

Thanks for all the supportive words. I'm trying to rush out the open source next week for those who can deploy on a micro instance or device.

I recommend deploying on a service where Inbound Data is free or very cheap because reading the firehose is 300+GBs of data per month.

There's a few sites that do something similar now, compared to when I first launched.

I'm sorry that I personally don't have the capacity to keep the site up.

Thank you to those who have contributed on ko-fi for operating costs. I've cancelled all monthly subscriptions, and if you contributed recently and wish to get a refund, please let me know on that platform.

Please start looking for ways to migrate your feeds to another service.

I will be fully open sourcing the code on github on a later date once I've cleaned it up a little. If you have dev experience, you can possibly just run a small server for yourself.

Hi, I am starting the process of closing the blueskyfeeds.com feed service in early July. I am having difficulty dealing with site outages, issues with the firehose, ballooning cloud operating costs, and blocking users trying to 'stress test' with feeds that store every post (you know who you are).

Oh, I haven't enabled videos in this feed yet, I'll enable it now.

There was also an outage I fixed about 27 hours ago that caused posts to be out of order/missing so one of your posts didn't get in.

This time it was the database automatically resetting for 10 minutes that broke my reset. Adding a manual reset with a longer delay for that.

I'm not in a good headspace right now to do much more than that 😭. Real life is rough.

That post itself isn't 'appearing in the feed', it's the later post that mentions a bunch of clubs including those in your keywords:
bsky.app/profile/geor...

The default bsky.app loads posts, their parent post, and their root post in a single block as part of the context.

A screenshot showing how to build a feed with only Adult posts

In the Picture Posts Filter, only enable 'Posts with at least one picture', and disable Text-only posts, and you'll see this row appear.

Is your password manager editing the 'Federated PDS Domain' field? That's supposed to stay as bsky.social unless you specifically signed up on a PDS.

Service is up, and I don't see any errors here. Try using your email instead of username or clearing your browser cookies for the page and login again.

Have you checked out the others not done by the big provider? I don't think anyone else injects data into the PDS either.

E.g. science one:
bsky.app/profile/boss...

There is also a maximum size for the JSON pushed to the feed configuration, and my builder supports arbitrarily long lists of keywords and user-dids. Whereas my competitor has limits on the number of blocks, and regex is very compact compared to my keyword format.

So basically it can't fit.