Jacek Migdal

Outbox pattern. @gunnarmorling.dev seems to be burnt by dual writes. For example, if you add two rows into different SQL tables in a single transaction, there are no atomic guarantees after Debezium CDC puts that into Kafka.

The Outbox pattern fixes that by adding a new table.

All you need to make founder happy is a meeting with ideal customer persona (ICP) with some sense of urgency.

SysOps/DevOps meetup at Allegro.

Will be speaking about Observability Query Languages.

Things we learned about LLMs in 2024 A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past …

Two great summaries of 2024, databases and LLMS:
www.cs.cmu.edu/~pavlo/blog/...
simonwillison.net/2024/Dec/31/...

Happy new year!

Last year at Quesma we went from zero to one:
No team -> eight of us
No real code -> working product used by a few on prod
Virigin company with $2.5mln funding -> some revenue, low burn

The biggest lesson is to keep shipping while talking to users.

Congratulations! All-star.

The day 24 was fun, Christmas tree detection was also fun but way easier. I also got stuck with the simulation of a virtual machine.

All set with Advent of Code! 50 stars.

The penultimate day (day 24) of the Advent of Code, part 2, is tedious but doable with a tiny trick. I am glad I know a thing or two about hardware.

I am impatiently waiting for the final puzzle.

One star was missing in Advent of Code, though on day 21, part 2 was somewhat hard by my standards. I have an idea how to solve it, though there are a couple of tricks. Am I getting less technical?

Back in the Advent of Code game. I’ve caught up with my delay.

Startups in ZIRP, 2022: Bragging how big their teams are and how fast they hire.

Startups in 2024: Bragging how small their team is.
E.g. Quesma is in that camp.

Converse job ad:

In startups, the highs can be incredibly rewarding, while the lows can be deeply challenging, but both are part of the experience.

Day 14, part 2 of the #AdventOfCode, is my favourite so far. In changing ASCII art, find a Christmas tree. I love that spec; it matches the reality.

Halfway through #AdventOfCode 2024, 22 stars so far: adventofcode.com/2024/day/11

Many mainstream media outlets cover tech through clickbaits, PR statements, drama, or lagging trends.

For a tiny fee, you can escape that trap and get ahead.

Have you revered S3 Tables compaction strategy?

Great writeup! Compaction seems to be the most significant question mark. In some use cases, you may regularly add records (e.g. 1GB per day, flushed every 30 seconds). It would make for the ecosystem to provide a library doing microcompactions as you add those small files.

Tabular Data Storage At Scale - Amazon S3 Tables - AWS Amazon S3 Tables deliver an efficient way way to store tabular data at scale, helping you optimize query performance and costs as your data lake grows.

Native support for Iceberg has been announced in S3:
aws.amazon.com/s3/features/...

Besides generating social media buzz, there is rarely an upside to being obsessed about past mishaps.

Life is short. Move on. The next thing can be huge. No point in wasting your neural net cycles on that; you need all of them for the next big thing.

AI saved my day when I was exporting invoices from accounting system. Still I get best results when I micro-manage AI aggresively. Any time I trust AI too much, it ends up poorly.

I just completed "Historian Hysteria" - Day 1 - Advent of Code 2024 #AdventOfCode adventofcode.com/2024/day/1

;) Yeah you should be also thankful that you pay taxes, it means that you have income.

In the spirit of Thanksgiving engineering teams across the globe should do a thankfulness exercise.

During daily or status each member says what they are thankful for. Simple but works.

Most PMs hate refactoring, but our PM at Quesma asked for that.

Why?
1. Good overall velocity.
2. Paid clients, so we have to graduate from early-startup mode.
3. One architecture that would cover more use cases.

Excuse me for X double posting, I’m trying to migrate to BlueSky. Much better start in my tech bubble that Threads or Mastadon.

The Pragmatic Engineer is my favourite paid tech subscription. I read many articles, but there are still gems I missed.

I’ve also submitted it. Two proposals. One is about transpilling query languages, and the other is pipeline query languages in observability.

Full room at DSS conference for my talk about data trends in 2024.

Adam Szymanski, CTO & Founder of Oxla at Data Science Summit Main Stage.

“Based on what you know about me, draw a picture of what you think my life looks like.”

ChatGPT