Pete Naylor's Avatar

Pete Naylor

@pete-naylor.bsky.social

Distributed datastores and indexing are my areas of interest. Extensive experience with DynamoDB at AWS. Now working on the core datastore for Elasticsearch.

201 Followers  |  40 Following  |  29 Posts  |  Joined: 24.10.2024  |  2.301

Latest posts by pete-naylor.bsky.social on Bluesky

Perhaps the docs will improve soon - it is quite a new feature and they've only had 15 years to get it right after all. Besides, it's not like anyone really cares about data integrity 🀯

31.10.2025 20:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

While I was at AWS, I heard many stories of painful disappointments in S3's multipart upload feature. Still wasn't prepared for how shockingly bad it is - the documentation is appalling.

31.10.2025 20:21 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Video thumbnail

πŸ‘‹ Welcome to Elastic Dev β€” your new go-to for hands-on demos, cheat sheets, concept explainers & more. Get the latest on search, data & GenAI straight from the source.

Expect:
- Practical demos & how-tos
- Posts & technical deep dives
- Open source updates
+ more

Ready, set, build. Hello, world.

20.10.2025 21:28 β€” πŸ‘ 7    πŸ” 5    πŸ’¬ 0    πŸ“Œ 0

How did it take me so long to see these photos?! Grateful for a solid crew that day David - thanks for making the journey. Let's plan an even bigger adventure next time πŸ˜€

21.10.2025 05:34 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

You mention the concept of a "consistent write" and to me this seems quite out of place. IMO, the property that is actually meaningful in context of an applied mutation is isolation.

16.08.2025 05:56 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Only if anyone was actually using on-demand and global tables at scale.

06.05.2025 05:13 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Spent the last 5 weeks back "home" in Australia πŸ‡¦πŸ‡Ί Time with family and old friends, bird songs, eucalypt smells, swimming at beaches - all healthy food for the soul. Driving on the other side of the road, meat pie consumption, sampling local brews probably more of a health risk - but worth it.

06.04.2025 23:32 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Happy Australia Day!!

26.01.2025 05:48 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Coming years will be like one big long episode of a lousy reality TV show. Americans seem to be hooked on the drama.

21.01.2025 20:30 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Today is a good day to focus on remembering real American leaders and everything they stood for. I am a US citizen but these days, I'm pleased to "still call Australia home".

21.01.2025 04:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

When my boat grows up she wants to be just like the Lindsey Foss.

21.12.2024 00:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
etcd: getting 30% more write/s Undertaking performance analysis on our etcd clusters, I ended up with a 30% performance increase, and learnt lots about databases & disk…

One thing I see in this blog post is people running etcd on … EBS volumes, which of course introduced insane latency into fsync.

zendesk.engineering/etcd-getting...

Perhaps the first step in dealing with etcd performance is sitting on an acceptable local SSD?

18.12.2024 10:59 β€” πŸ‘ 5    πŸ” 3    πŸ’¬ 2    πŸ“Œ 0

Agree that Snapshot Isolation is a sweet spot for application developers. It also enables practical time travel queries and debugging, which is challenging with lower isolation levels. I covered this topic in my blog post for my VLDB'23 paper: qianli.dev/blog/timetra...

18.12.2024 22:21 β€” πŸ‘ 18    πŸ” 2    πŸ’¬ 1    πŸ“Œ 1

Can't quite tell what you're talking about here.

16.12.2024 09:04 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Not unusual, but I would start raising questions now.

16.12.2024 07:02 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Just wow. Striped hound and me kinda wiped out by a Werner Hertzog documentary.

16.12.2024 06:56 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

+1 for awk

13.12.2024 05:24 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I expect in time that DSQL will become a very good alternative to DDB for a great many use cases - now's a good time to experiment and share learnings!

12.12.2024 19:16 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Finally there are limitations which don't seem well defined yet. For example we know DSQL can have hot key contention on writes, but we don't know when to expect it. With DynamoDB we know it's 1000 writes/second for a given item up to 1KB in size.

12.12.2024 19:16 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

DSQL is in preview and it could remain so for some time - the service has not yet had the level of production experience of DynamoDB and might have some wrinkles to iron out. I think also that there will be modeling best practices to map out - how to model for most consistent latency results.

12.12.2024 19:16 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Hi Luke - thanks for the shout out on my article - so glad you found some value in reading it. Your question about whether to choose DDB or DSQL is one that will be top of mind for many I think. IMO, for the moment DDB is still the steady and reliable production choice.

12.12.2024 19:16 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
PGDay Chicago | PostgreSQL Conference United States PostgreSQL Association

The CFP for PgDay Chicago 2025 is open! Click the link below for more information!

https://buff.ly/3OOofA1

@PostgreSQL #postgres #cfp #callforpapers

10.12.2024 18:44 β€” πŸ‘ 4    πŸ” 4    πŸ’¬ 0    πŸ“Œ 0

Dislike. "Good morning! Here is what I ate last night". Our dog has been having some sort of GI trouble of late - similar middle-of-the-night surprises.

03.12.2024 15:27 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

PSA: beware of rabbit holes!

Excited to see the eng team publishing this newsletter. πŸ€“ If you are interested in data, databases, Postgres, analytical queries over various open data lake formats, streaming, Kubernetes etc, this will be a terrific curated source of info that you'll enjoy.

03.12.2024 15:24 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
PgUS - Become a Member The United States PostgreSQL Association affectionately known as PgUS is a IRS 501(c)(3) public charity. Our purpose is to support the growth and education about The World's Most Advanced Open Source…

We want you, yes you, to join PgUS! Why? To help bring more resources and education to the PostgreSQL community! Join today!

https://buff.ly/3czbR3G

#PostgreSQL #postgres

27.11.2024 17:04 β€” πŸ‘ 7    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0

Still way too expensive.

24.11.2024 09:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I don't actually think the price cuts on DDB are "big". Not expecting much, but hoping they'll have some actually meaningful announcements.

24.11.2024 08:57 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

All good! Power was out for about 4hrs and had a tree limb fall across the driveway. Some suspicious pieces of roofing shingles in the yard that will need investigation.

20.11.2024 18:23 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Are you following @eatonphil.bsky.social ? If you are interested in data, databases, distributed services, Phil will connect you with so many resources.

20.11.2024 08:41 β€” πŸ‘ 8    πŸ” 5    πŸ’¬ 1    πŸ“Œ 0

National Weather Service says it might get β€œbreezy”. Confirmed! November is often a string of storms - this is a little unusual to me because of the east winds - standard program is from the south. Power is out - could be a while.

20.11.2024 08:30 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 3    πŸ“Œ 0

@pete-naylor is following 20 prominent accounts