Feldera's Avatar

Feldera

@feldera.bsky.social

The incremental compute platform for data-intensive products

133 Followers  |  188 Following  |  83 Posts  |  Joined: 21.11.2024  |  1.6839

Latest posts by feldera.bsky.social on Bluesky

Video thumbnail

It's time to build AI-era products that were impossible before.

Batch processing recalculates everything, even when 99.9% of your data didn’t change.

Feldera fixes that w/ incremental compute.

Bring your existing SQL and get millisecond freshness instead of hours-long (or days-long) batch jobs.

12.02.2026 16:55 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Can your incremental compute engine do this? **Feldera Incremental Computation Engine Benchmark Results** **Test Query Complexity:** - 61 input tables, 33 output views - 217 join operators (including left joins) - 27 aggregation operators - 287…

That’s actual incremental computation.

Read more: www.feldera.com/blog/can-you...

P.S. If your incremental engine can do this, we’d love to see the results.

05.02.2026 22:51 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

We ran it on Feldera:
- 200ms update latency on input changes
- Single machine (16 CPU cores)
- 15GB RAM steady state

How?
Feldera does work proportional to your changes, not your table size. When you update one or many rows, we recompute only answers that changed and nothing else.

05.02.2026 22:51 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Query plan for a complex, real-world SQL program

Query plan for a complex, real-world SQL program

This is a query plan for a real customer’s production SQL.
- 61 input tables -> 33 output views
- 217 joins
- 27 aggregations
- 218 projections and filters

Most systems would either do an expensive full recomputation or flat out fail.

05.02.2026 22:51 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Your pipeline was disrupted.

Feldera’s Health Page tells you why in seconds. No K8s access. No waiting on DevOps.

Details -> www.feldera.com/blog/introdu...

26.01.2026 21:15 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

Introducing Feldera Health 🩺

A lightweight health monitoring solution built directly into Feldera. See the real-time status of your compiler, API server, and runner at a glance.

βœ… Available today on try.feldera.com and Enterprise Feldera
πŸ“ Detailed technical blog coming soon

22.01.2026 19:00 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
January Edition 2026 The past many months have been busy for us at Feldera. We continue to ship compounding improvements for our customers when it comes to usability, performance and efficiency.

Incremental Updates - January 2026 edition is here! πŸš€

This edition covers:
- Product updates: adaptive join rebalancing, GC for ASOF joins and more
- New blogs: deep dive into our profiler, constant folding in Calcite, and a look back at our progress in 2025

www.linkedin.com/pulse/januar...

15.01.2026 17:50 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

🩻 X-ray vision for your SQL pipeline in Feldera.

-Click any node -> see metrics across all cores.
-Heat map shows bottlenecks instantly.
-Expand to trace back to your SQL code.

⚑ Seconds to see what used to take hours to find.

Dive deeper: www.feldera.com/blog/introdu...

23.12.2025 21:38 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
Feldera in 2025: Building the Future of Incremental Compute Feldera's 2025 year in review: comprehensive SQL support, state-of-the-art infrastructure, advanced connectors, and the future of real-time analytics.

2025:
πŸ“¦ 166 unique releases, 1,162 changes, avg. new release every 2.4 days
πŸ“Š 10x cost reduction for users, hours old insights into sub-second latency
⚑ 70-node Spark clusters -> single digit Feldera instances

2026: Make incremental compute inevitable

Full story: www.feldera.com/blog/feldera...

19.12.2025 18:59 β€” πŸ‘ 5    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Preview
A visualization tool for the runtime behavior of Feldera pipelines We built a browser-based visualizer to dig into a Feldera pipeline's performance metrics. This tool can help users troubleshoot performance problems and diagnose bottlenecks.

Because when you're processing millions of changes per second, you need to see what's happening to optimize it.

Read the technical deep-dive: www.feldera.com/blog/introdu...

11.12.2025 17:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

πŸ“Š Real-time metrics per operator: execution time, memory, data volumes, disk I/O
🎨 Visual dataflow graphs with color-coded performance heatmaps
πŸ” Interactive exploration - click any operator to see detailed breakdowns

11.12.2025 17:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

That’s why we built the Feldera profiler. It shows exactly where your computation time and resources are going.

11.12.2025 17:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

You can’t optimize what you can’t profile.

Which operators are a bottleneck? Are there skewed joins? Why is storage use spiking?

Our engineering team used to spend hours trying to answer these questions when performance problems would show up in the wild.

11.12.2025 17:44 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

They’re all available today. Now go build something fast. 🏎️

03.12.2025 18:54 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Modifying a Pipeline While Preserving its State | Feldera Documentation This feature is only available in Feldera Enterprise Edition.

Backfill avoidance: modifying a query used to mean having to recompute & backfill all over again. With backfill avoidance, you can avoid another backfill by reusing existing states when applicable, & recomputing only what’s new. Much faster than starting over.

docs.feldera.com/pipelines/mo...

03.12.2025 18:54 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Efficient Bulk Data Processing using Transactions | Feldera Documentation Transaction support is an experimental feature and may undergo significant

Fast backfill (HUGE steps): you know backfilling historical data can take forever. That's why we shipped a transaction API where you control the batch size - whether small or HUGE - for efficient bulk ingests.

docs.feldera.com/pipelines/tr...

03.12.2025 18:54 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Parallel Compilation | Feldera Documentation Parallel compilation allows Feldera to compile multiple pipelines concurrently by distributing the workload across several compiler server pods. This dramatically reduces total compile time for large ...

Parallel compilation: we used to compile pipelines one at a time. Now we distribute the workload across multiple servers. Pipeline builds that were queued back-to-back can now complete simultaneously within minutes. It shaved an hour off of our CI pipeline!

docs.feldera.com/get-started/...

03.12.2025 18:54 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Rust Compilation can be slow. Backfills can take days. And no one likes to wait. ⏳

We’ve recently shipped features that will get you deploying faster and scaling more efficiently:

- Parallel Compilation
- Fast Backfill
- Backfill Avoidance

03.12.2025 18:54 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
Jobs

If you’re excited about hard technical problems and want to shape the future of real-time systems, Feldera is hiring (remotely!) for a Solutions Engineer (Enterprise) and a Software Engineer (Reliability, Performance)

jobs.ashbyhq.com/feldera/544a...

06.09.2025 00:57 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Hi Ben,

I wanted to follow up on my recent note about your containerized solutions. If  Feldera is exploring ways to improve mobility or streamline deployment, our container wheels could be a great fit.

Here’s what our solutions offer:

    Increased flexibility
    Reduced operating costs
    Safe and practical mobility
    A more sustainable option

With logistics hubs in both the US and EU, our casters are already helping teams in container rental, storage, and logistics cut down on equipment costs, labor, and time.

Hi Ben, I wanted to follow up on my recent note about your containerized solutions. If Feldera is exploring ways to improve mobility or streamline deployment, our container wheels could be a great fit. Here’s what our solutions offer: Increased flexibility Reduced operating costs Safe and practical mobility A more sustainable option With logistics hubs in both the US and EU, our casters are already helping teams in container rental, storage, and logistics cut down on equipment costs, labor, and time.

Some of my work at @feldera.bsky.social involves containers. I keep getting spam from some vendor who wants to sell me casters to put on the containers 🀣

02.09.2025 15:22 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
How Feldera Customers Slash Cloud Spend (10x and beyond) By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics.

"This is the true power of incremental compute. By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics."

πŸ‘‡

www.feldera.com/blog/how-fel...

20.08.2025 17:01 β€” πŸ‘ 6    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

At @feldera.bsky.social I've been doing a lot of performance work. I needed an easy way to watch the Prometheus metrics for a pipeline, so I wrote a simple tool for the Feldera CLI that shows the pipeline metrics. Here's the progress of a pipeline that runs in about 30 seconds.

20.08.2025 00:27 β€” πŸ‘ 6    πŸ” 3    πŸ’¬ 2    πŸ“Œ 0
Preview
Stream Integration In this blog post we informally introduce one core streaming operation: integration. We show that integration is a simple, useful, and fundamental stream processing primitive, which is used not only…

If you've written even the most basic compute program, you've likely already written programs that "integrate".

Integration is central to Feldera and its underlying theory of incremental compute. It is also all around us in the real world! πŸ‘‡

18.08.2025 15:14 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 0    πŸ“Œ 1

The future of data security isn't about choosing between compliance and performance. It's about making security a performance feature.

Learn how to implement fine-grained authorization without performance penalties: docs.feldera.com/use_cases/fi...

05.08.2025 14:30 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

What if you could have both security AND speed?
Modern fine-grained authorization embeds security directly into data processing, delivering:

- Microsecond authorization decisions
- Real-time row/column-level filtering
- Automated compliance reporting
- Actually improved query performance

05.08.2025 14:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

What are some the the typical challenges?
- 300-500ms latency added per query
- Complex compliance audits taking weeks
- Manual permission tracking via spreadsheets
- Performance degradation with granular controls

05.08.2025 14:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Traditional authorization systems force an impossible trade-off: secure data access OR fast query performance. With SOX compliance audits intensifying and data breach costs averaging $4.45M, this choice is becoming a business risk.

05.08.2025 14:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

"We chose performance over security" - a dilemma no data team should face.

#DataEngineering #DataSecurity #RealTimeAnalytics

05.08.2025 14:30 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
How to Incrementally Get Results from Your Graph Data with Feldera
YouTube video by Feldera, Inc. How to Incrementally Get Results from Your Graph Data with Feldera

New tech talk:

How to Incrementally Get Results from Your Graph Data with Feldera.

Interested in practical techniques for incremental computation or want to see how this fits into modern data engineering workflows?

Check it out: youtu.be/vpVAZbaZ2Hg

18.06.2025 19:47 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Mihai Budiu, our exceptional Chief Scientist, won the 2025 #ACM #SIGCOMM Networking Systems Award for his groundbreaking work on #P4.

Details: www.sigcomm.org/awards/sigco...

17.06.2025 17:22 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@feldera is following 20 prominent accounts