Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
@francescalted.bsky.social
Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
Haha, this from the New Yorker is getting passed around the math dork community. I did a comic about this kind of thought a few years ago: www.smbc-comics.com/comic/commut...
07.11.2025 17:26 β π 1020 π 170 π¬ 21 π 19Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
π’π¨Blosc2 3.11.0 Released! π¨ π’
Blosc2 is part of the NumPy array library ecosystem: numpy.org
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:
ππππππΈ.ππππππ(π°, π±)
for π°, π± PyTorch, Jax, Tensorflow, Zarr... arrays!
#Compute
#Tensor
#PyTorch
The importance of linear algebra in modern computing is undeniable π.
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated π, the performance gains can be transformative. π
π IronPill 1π
Blosc2 calculates Fourier approximations:
β‘5x faster than NumPy
π£ fraction of the memory footprint
π one-line syntax πππ(πβ*βπππ(π)β+βπβ*βπππ(π),βππ‘ππ=π·)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
From a programmer's virtue to a computational powerhouse: laziness transforms a developer's best practice into the engine of modern computing.
15.10.2025 12:07 β π 1 π 0 π¬ 0 π 0Inspired by the ESA's Gaia Milky Way map π!
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! π
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
That's great news! Blosc2 is on its way to become a standard computing engine for most common array containers out there π
Thanks to the array API standard effort; without it we could not possible reach this level of generality π
Compress Better, Compute Faster
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
22.09.2025 12:20 β π 1 π 1 π¬ 0 π 0Voyager redefined my adolescence in a deep way (specially after its encounter with Jupyter). BTW, 7 million miles is around 11 million kilometers for non-US people.
22.09.2025 05:52 β π 0 π 0 π¬ 0 π 0added a cheat sheet to the official Git website https://git-scm.com/cheat-sheet
16.09.2025 18:26 β π 8 π 3 π¬ 1 π 0π Exciting news! Python-Blosc2 is making huge strides towards array-api compliance. π
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. πͺ
There's more to come, but what a fantastic milestone! β¨
π£οΈ Announcing C-Blosc2 2.21.2
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
LLMs are getting quite good at producing code. But when that last drop of performance counts, it seems our carbon-based predecessors π§ , armed with good tools and a healthy obsession, still have a few tricks up their sleeves.
08.09.2025 12:18 β π 2 π 2 π¬ 0 π 0This is exactly the kind of application we envisioned for Blosc2, enabling more efficient and scalable data handling (in this case, image handling).
01.09.2025 17:34 β π 0 π 0 π¬ 0 π 0QuΓ¨ bΓ© que li vindria aixΓ² a l'antic mercat del dilluns de CastellΓ³ de la Plana (que per cert, encara no sembla que tinga compte en BlueSky).
24.08.2025 06:31 β π 2 π 0 π¬ 0 π 0#Paris has removed the paving from its city hall square and transformed it into an #Urbanforest
#Urbanism #OWGF #SolarPunk #ClimateAction
The slides of my talk about _Blosc2: Compress Better, Compute Bigger_ for the recent @euroscipy.bsky.social:
www.blosc.org/docs/2025-Eu...
EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!
π I'm also thrilled about the new blosc2.TreeStore class π
We had the opportunity to show it in action during our recent tutorial at #EuroSciPy 2025, where we had a good time seeing audience engagement. Thanks to the attendees!
There's a special joy in deleting code. This Caterva2 release included a huge refactoring effort to shed complexity, resulting in a much cleaner and more robust system. It's one of the most satisfying parts of the job! β¨
07.08.2025 10:03 β π 0 π 0 π¬ 0 π 0Hey fam π
In a new blog post, I wrote about my journey from zero to RAG engineer after 1200 hours building enterprise AI.
What actually works vs. what's just hype. Hard-learned lessons so you don't repeat my mistakes π
news.ycombinator.com/item?id=4474...
#TechBlog #BuildInPublic #RAG #AI #LLM
While we've poured lots of β€οΈ into #Blosc2 internal algorithms, every use case is unique. No worries! You can always tweak the internal knobs to get the best performance for your needs πͺ
29.07.2025 08:45 β π 0 π 0 π¬ 0 π 0If you believe all human beings are created bβtzelem Elohim, in Godβs image, then you must speak up now against the daily atrocities in Gaza.
www.haaretz.com/opinion/2025...
Hats off to the excellent work that @lshaw-ironarray.bsky.social is doing to the @ironarray.io and @blosc.org ecosystems.
Fancy indexing is like a wild animal difficult to tame, but in this particular case he did an outstanding work at it! π
Undergoing endless guesswork to find the best compression parameters? π€ Let Btune do the heavy lifting! πβ¨
16.07.2025 12:26 β π 0 π 0 π¬ 0 π 0Ready to supercharge your I/O performance? π
Join our tutorial at @euroscipy.bsky.social 2025, where we'll dive deep into these techniques and share more expert tips for maximizing data throughput. See you there!
Mixing #JupyterLite, #WebAssembly and #Cat2Cloud allows incredible speed and flexibility in accessing large remote data silos, both in #Blosc2 and #HDF5 formats β‘
09.07.2025 15:24 β π 1 π 0 π¬ 0 π 0Experience the future of large-scale data processing without leaving your browser window.
08.07.2025 10:54 β π 2 π 1 π¬ 0 π 0For those who could not attend, the recording of our recent webinar, "A Gentle Introduction to Cat2Cloud," is now available!
ironarray.io/cat2cloud#we...
If interested, remember that the subscription to our beta program is currently open!
Compress Better, Compute Bigger, Share Faster!