Marc Brooker's Avatar

Marc Brooker

@marcbrooker.bsky.social

Serverless, databases, and serverless databases at AWS. Views my own. Check out my blog: https://brooker.co.za/blog/

3,640 Followers  |  127 Following  |  172 Posts  |  Joined: 26.09.2023
Posts Following

Posts by Marc Brooker (@marcbrooker.bsky.social)

Post image

New blog post, about a great little way to add fairness to distributed systems.

Combining stochastic fairness queuing, best-of-two, and shuffle sharding. Read it here: brooker.co.za/blog/2026/02...

25.02.2026 21:24 β€” πŸ‘ 29    πŸ” 6    πŸ’¬ 1    πŸ“Œ 0
Aurora DSQL: Serverless, Scalable, Global OLTP Database System (Marc Brooker)
YouTube video by CMU Database Group Aurora DSQL: Serverless, Scalable, Global OLTP Database System (Marc Brooker)

Now on YouTube, Monday's CMU Database Seminar on Aurora DSQL. Thanks again to the awesome CMU folks (especially Andy Pavlo) for inviting me to do this talk.

www.youtube.com/watch?v=mK2h...

11.02.2026 20:14 β€” πŸ‘ 13    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Yes. More accurately, I think I mean "code for which a good (if informal) specification of correctness exists", where that specification can be written business logic, or even something like "number go up".

We aren't there 100% for complex specifications yet, but the rate of improvement is v high

09.02.2026 21:08 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I don't think, at least for business logic code, having humans in the loop of reviewing code adds a lot of value. We haven't quite built the tools that make it unnecessary, but I don't think human-in-the-code is where we end up long-term.

09.02.2026 19:26 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Aurora DSQL: Serverless, Scalable, Global OLTP (Marc Brooker) - Carnegie Mellon Database Group Amazon Aurora DSQL is a distributed SQL database, designed to make it... Read More +

Today's Postgres vs. World Seminar Speaker: Marc Brooker (@marcbrooker.bsky.social) will present the architecture of Amazon's Aurora DSQL Postgres-compatible serverless OLTP DBMS. Zoom talk open to public at 4:30pm ET. YouTube video available after: db.cs.cmu.edu/events/pg-vs...

09.02.2026 13:59 β€” πŸ‘ 13    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0

Hiking too. It took an economic activity (walking to get somewhere) and turned it into a leisure activity (walking for the joy of exploration or exercise). Again, nothing wrong with that.

But the economic activity of walking is much less relevant now (at least as a large % of daily time spend).

08.02.2026 19:45 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

The example was picked for that reason. Knitting, in form, is hard to automate. But the truly economically interesting cases have been replaced or automated.

What remains is craft. People love to do it, people love to see it and buy it. Great! But it's no longer a large-scale economic activity.

08.02.2026 19:44 β€” πŸ‘ 0    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
You Are Here - Marc's Blog

The cost of turning written business logic into code has dropped to zero. At best, near-zero.

The cost of integrating services and libraries, the plumbing of the code world, has dropped to zero. At best, near-zero.

What does that mean for the future?

New blog post: brooker.co.za/blog/2026/02...

07.02.2026 18:36 β€” πŸ‘ 42    πŸ” 11    πŸ’¬ 1    πŸ“Œ 3
Post image

The world if MacOS supported SECCOMP_RET_USER_NOTIF

05.02.2026 17:59 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I'm still learning how easy it is to go from "software I wish existed" to "software that exists" now, especially for anything that's a script, automation, or small utility.

Everything I internalized in 20 years about the cost of building things has changed in less than two years.

27.01.2026 21:31 β€” πŸ‘ 15    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

I’m happily building DSQL persistence for @temporal.io.

@marcbrooker.bsky.social and team have gifted us a fab service.

I readily accept I may be messing up my integration πŸ˜‚ Guidance greatly accepted πŸ™

(Oh! @kiro.dev has proven invaluable in this ❀️)

25.01.2026 13:23 β€” πŸ‘ 4    πŸ” 1    πŸ’¬ 2    πŸ“Œ 0
Pass@k is Mostly Bunk - Marc's Blog

New blog post "Pass@k is mostly bunk" brooker.co.za/blog/2026/01...

Pass@k, especially for k>3, can make basically anything look good.

22.01.2026 20:25 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Agent Safety is a Box - Marc's Blog

In my first blog post of the year: The Box.

Constraining what AI agents can do is required for making them safe and reliable. Pushing that control out of the agent itself, into its environment (The Box), is the only way to get the outcome we need.

brooker.co.za/blog/2026/01...

12.01.2026 17:51 β€” πŸ‘ 12    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Episode #277: Moving Towards Spec-Driven Development – The Real Python Podcast What are the advantages of spec-driven development compared to vibe coding with an LLM? Are these recent trends a move toward declarative programming? This week on the show, Marc Brooker, VP and Disti...

Moving Towards Spec-Driven Development with Kiro and Agentic AI. Listen to @marcbrooker.bsky.social on The Real Python Podcast @realpython.com realpython.com/podcasts/rpp...

05.01.2026 20:36 β€” πŸ‘ 7    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

Finally, the session i have been most looking forward to at #reinvent2025! @marcbrooker.bsky.social discussing virtualization techniques used with services like #AgentCore - a 500-level Chalk Talk (with no slides).

We need more of these types of sessions @awscloud.bsky.social

03.12.2025 21:13 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
On the success of 'natural language programming' - Marc's Blog

On the success of β€˜natural language programming’ via @marcbrooker.bsky.social brooker.co.za/blog/2025/12... #programming #genAI #aI

18.12.2025 12:54 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Fixing UUIDv7 (for database use-cases) - Marc's Blog

New short blog post, touching on how I'd redesign UUIDv7 to keep the database performance benefits while mitigating most of the downsides.

Short version: replace unix_ms with H(unix_ms, unix_ms >> 13 | salt).

Get yer extremely niche RFC commentary here: brooker.co.za/blog/2025/10...

22.10.2025 23:21 β€” πŸ‘ 19    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Seven Years of Firecracker - Marc's Blog

New blog post, reflecting on nearly seven years since the Firecracker launch, and how we're using Firecracker to power serverless databases (in Aurora DSQL) and infrastructure for AI agents (in Bedrock AgentCore).

Here's the post: brooker.co.za/blog/2025/09...

23.09.2025 16:46 β€” πŸ‘ 25    πŸ” 11    πŸ’¬ 1    πŸ“Œ 0
Post image

NULL BITMAP: Using Huffman Coding for Sampling Discrete Distributions: buttondown.com/jaffray/arch...

18.08.2025 18:29 β€” πŸ‘ 14    πŸ” 5    πŸ’¬ 1    πŸ“Œ 0

In DynamoDB, writes and their preconditions are evaluated atomically, and are linearizable. You could say that makes them strict serializable transactions, but that's not the most useful mental model for the app developer.

18.08.2025 16:20 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

TL;DR Despite the similar name, Dynamo and DynamoDB have fairly little in common architecturally, and make some very different decisions.

16.08.2025 01:43 β€” πŸ‘ 6    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Transactions and Coordination in Aurora DSQL Β· Luma Join us for a Seattle Systems talk that’s definitely worth your time as we welcome Marc Brooker, Distinguished Engineer at AWS, for a deep dive into the inner…

Seattle friends - in case you missed it: lu.ma/umtmqb38
The Seattle Systems group is hosting their very first meetup! @marcbrooker.bsky.social will be presenting Aurora DSQL.

Excited to see more systems groups popping up (thanks @eatonphil.bsky.social). My colleague @devhawk.net is co-organizing.

16.08.2025 00:37 β€” πŸ‘ 9    πŸ” 5    πŸ’¬ 0    πŸ“Œ 1
Dynamo, DynamoDB, and Aurora DSQL - Marc's Blog

People often ask me about the differences in architecture between Amazon Dynamo (the 2007 SOSP paper), DynamoDB (the AWS serverless NoSQL database), and Aurora DSQL (the AWS serverless SQL databases).

I memoized the response on my blog. brooker.co.za/blog/2025/08...

16.08.2025 01:42 β€” πŸ‘ 51    πŸ” 10    πŸ’¬ 3    πŸ“Œ 0
Preview
Transactions and Coordination in Aurora DSQL Β· Luma Join us for a Seattle Systems talk that’s definitely worth your time as we welcome Marc Brooker, Distinguished Engineer at AWS, for a deep dive into the inner…

If you're into databases and you're in Seattle, @marcbrooker.bsky.social is talking at Seattle Systems on Aug 21: lu.ma/umtmqb38

11.08.2025 13:59 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

LLMs are more powerful, more dependable, more efficient, and more flexible when deployed as a component of a carefully designed system.

New blog post: brooker.co.za/blog/2025/08...

12.08.2025 16:06 β€” πŸ‘ 12    πŸ” 1    πŸ’¬ 1    πŸ“Œ 1
Scaling Correctness: Marc Brooker on a Decade of Formal Methods at AWS
YouTube video by Antithesis Scaling Correctness: Marc Brooker on a Decade of Formal Methods at AWS

Check it out on YouTube (youtube.com/watch?v=UGdM...), Apple Podcasts (podcasts.apple.com/us/podcast/t...), or Spotify (open.spotify.com/show/5GtS7mZ...).

06.08.2025 17:27 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I had a great time talking to Ben and Will from Antithesis on the BugBash podcast about software testing and validation at AWS.

In this wide-ranging hour we talk deterministic simulation testing, fuzzing, formal methods, the history and future of testing, and much more.

06.08.2025 17:27 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

Fun conversation with @jkxosound.com about where I think things are going in the AI agents space, Strands Agents, and rats πŸ€

17.07.2025 19:48 β€” πŸ‘ 7    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

I hear TPC-C is the best, most representative, benchmark for modern analytics applications.

16.07.2025 20:35 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Introducing Amazon Bedrock AgentCore: Securely deploy and operate AI agents at any scale (preview) | Amazon Web Services Amazon Bedrock AgentCore enables rapid deployment and scaling of AI agents with enterprise-grade security. It provides memory management, identity controls, and tool integrationβ€”streamlining developme...

Prototyping agents is easy, fast, and fun (especially if you use Strands). But how to you get them into production with all the scalability, security, and resilience you need?

We've been building Bedrock AgentCore to answer exactly that question. Check it out: aws.amazon.com/blogs/aws/in...

16.07.2025 17:51 β€” πŸ‘ 12    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0