PR of Astropy using Narwhals

🌝 The next @astropy.org release will support generic dataframe tables (like @pola.rs )

🌊🦄 Powered by Narwhals

oh no!!! 😭

Demo of inlay hints with Narwhals

Enabling inlay hints in vscode

💡 Life-pro-tip: enable inline type hints

🏷️ Your editor will display inferred types for variables you haven't annotated

🕵️ Debugging those red squiggly lines will become much easier

polars Series implement __array__, I'd have thought that a lot of the time you can pass Series as then they'll be converted by any `np.asarray` call. at least passing Polars Series to matplotlib works like that

which stats packages are tied to pandas?

Demo of pd.col

✨🐼 Pandas 3.0 will have `pd.col` syntax

💡 You can use it for clean chaining in `assign` and `loc`

🚀 It's happening, the PR just got merged!

Example of `.name` chaining with Polars

Example of `.name` chaining with Narwhals

✨ New @pola.rs feature - you can now chain `name` expressions!

🌊🦄 As of Narwhals 2.0 (yes, we've released 2.0 🚀), this feature is available there as well! Little example below with our friend @duckdb.org

temporary solution added to pandas 12 years ago

💡 "There's nothing for permanent than a temporary fix"

Case in point, this pandas comment which was added [checks git log] ... 12 years ago 🙈

"If the U.S. can't get its greenhouse emissions under control, they need to face real consequences" said the rest of the world.

Screenshot of 17-year-old commit message in NumPy

💡 Today in open source: a 17-year-old NumPy commit promising that a new feature will be coming soon

Any day now..

gt-extras demo

😍 @posit.co have done it again

🧙 gt-extras offers even more functionality for their table renditions of @pola.rs and pandas dataframes!

🌊🦄 Using Narwhals for some dataframe logic

solarized light

Meme of panicked Astronomer CEO caught on cam with the head of HR, with "When you find a new data science library" and "When you realise it only supports pandas" text overlaid

💡 Solution: use Narwhals for universal dataframe support 🌊🦄

Demo of Formulaic with native Polars support

✨ New Formulaic release (1.2), featuring native support for @pola.rs !

🌊🦄 Powered by Narwhals

YouTube video by PyData Marco Gorelli - How Narwhals brings Polars, DuckDB, PyArrow, & pandas together | PyData London 25

🎢 When the Q&A goes off-script 🤣

🇯🇵 Japanese math rock, 🅿️ porpoises and unfortunate aliases, and 🎤 Taylor Swift:

🥈All of these unexpectedly came up in this fun session, which is currently the 2nd most viewed of the conference

🙏 Thanks @pydatalondon.bsky.social for inviting me!

Adopt Narwhals to support multiple eager dataframe · Issue #16518 · mlflow/mlflow Description Follow up from #10292 (comment) What's Narwhals? Narwhals is a lightweight compatibility layer between dataframe libraries, with negligible overhead. Its API is a subset of the polars o...

github.com/mlflow/mlflo...

MLFlow maintainer announcing that they merged the Polars dataset PR

🥳 The next version of @mlflow.org will support @pola.rs !

😩 Slightly disappointingly, they do so by converting to pandas

🌊🦄 Could Narwhals help make MLFlow gain native support for Polars? Link to the discussion below 👇

sure - how do you know

PR which added Ibis support to Narwhals

Demo of Ibis via Narwhals

🙀 It's scary to merge a 2,000+ line PR!

😇 But, this one was so thorough that we just had to ship it

🏆 Thanks to an incredible effort by Ryan Whitten, Narwhals supports Ibis!

💡You can now use Narwhals with all of Ibis' backends, plus some extra, whilst keeping @pola.rs expressive API!

Release Python Polars 1.30.0 · pola-rs/polars 🚀 Performance improvements Switch eligible casts to non-strict in optimizer (#22850) Allow predicate passing set_sorted (#22797) Increase default cross-file parallelism limit for new-streaming mul...

github.com/pola-rs/pola...

Demo of `list.filter` in Polars

✨ @pola.rs now supports `list.filter`

🪄 The `list` namespace is now even more turbocharged ⚡

👇 Full release notes for 1.30

sometimes that's all you need 😀

Example of using PySpark via Narwhals

✨ PySpark 4.0 is out

🌊🦄 And it's already supported by Narwhals, including PySpark connect (thanks Francesco Bruzzesi!)

Looks like a good decision, given she committed fraud

GitHub - narwhals-dev/narwhals: Lightweight and extensible compatibility layer between dataframe libraries! Lightweight and extensible compatibility layer between dataframe libraries! - narwhals-dev/narwhals

👉🌟 Narwhals: github.com/narwhals-dev...

📚 Narwhals and SQL: narwhals-dev.github.io/narwhals/gen...

Demo of forward-fill with Narwhals

Forward-fill as DuckDB SQL

✨ Narwhals now supports `fill_null` with forwards and backwards strategies

🎬 Here's a demo of a fill-forward function which supports PySpark, @pola.rs , @duckdb.org , pandas, cuDF, and more!

🎁 Bonus: curious about what this looks like as DuckDB SQL? We got you covered 😎

Demo of Narwhals dataframe-agnostic function which supports PySpark

Plot of PySpark dataframe after converting it to PyArrow

SQL generation from Polars syntax

✨ Narwhals now supports PySpark

🎇 If you have a dataframe-agnostic function, you can pass in `pyspark.sql.DataFrame`

📈 Here's a demo, made with @marimo.io

🎁 BONUS feature: combine with SQLFrame, to generate SQL from @pola.rs syntax 🪄

Narwhals tests in cuDF's CI

🛠️ NVIDIA's cuDF library now runs the Narwhals test suite as part of its CI process

🙀

in netherlands?

I still name my Marimo notebooks `untitled42.py` 🙈