Conor McCarter's Avatar

Conor McCarter

@conormccarter.bsky.social

Co-Founder @ Prequel

97 Followers  |  87 Following  |  13 Posts  |  Joined: 01.11.2024  |  1.5542

Latest posts by conormccarter.bsky.social on Bluesky

Yes! Thanks for sharing. I’m really excited to check it out. Have you played around? Any initial thoughts?

11.04.2025 20:09 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Oh really cool. Thanks!

@benesch.bsky.social, sounds like you might have more to write about soon…

10.12.2024 23:16 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Ooo, I haven’t heard of any of the assumptions β€” what have you heard?

…it could be interesting if e.g. they added built-in caching of Iceberg metadata and Parquet files to offer Express One Zone-like performance on frequently accessed objects. Maybe that would move the performance needle…

10.12.2024 22:50 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I wish their claim of β€œ3x query performance and 10x transactions per second compared to self-managed tables in general purpose buckets” was based on new tech, not worst-case assumptions about how general purpose tables are used…

10.12.2024 21:56 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

This also feels like something Cloudflare should do on top of R2 only with an Iceberg REST catalog implementation. To me, it actually feels more like the type of product that Cloudflare has been shipping, and would be a nice compliment to their serverless D1 database (~SQLite for up to 10GB)

04.12.2024 01:39 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 1

For anyone keeping score in the open table format wars, AWS launching their s3 table bucket with only Iceberg support seems like a really big deal. Nothing is named in such a way that they can't add support for Delta down the line, but this feels like a huge endorsements of Iceberg (vs. others)

04.12.2024 01:32 β€” πŸ‘ 9    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

So at first glance, it looks to be like a tighter integration with GlueCatalog, but not necessarily a new underlying catalog implementation (as far as I can tell).

04.12.2024 00:09 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

In the AWS console, when you follow the "create table bucket" flow and look under the integration details dropdown, you see: "A catalog named s3tablescatalog is created in AWS Glue Data Catalog, as well as subcatalogs within it for each table bucket in this Region."

04.12.2024 00:09 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

You lost me at β€œground up rewrite of DD in C” (as fun as that sounds) πŸ˜…

21.11.2024 04:42 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Really cool!… but aren’t the egress fees on 10GB of free data is going to add up quick? A single query across the full dataset could cost them $0.50 (at a very conservative $0.05/GB)

21.11.2024 00:28 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Woah congrats! This is super cool. Is it possible/planned to enable queries from a non Postgres query engine? (even if read-only)

21.11.2024 00:09 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

100% β€” some of our use cases are uniquely good fits for duckdb! E.g in-process Parquet de/serialization.

08.11.2024 21:08 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Great meeting you @chris.blue !

08.11.2024 20:56 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@conormccarter is following 19 prominent accounts