Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
@ironarray.io.bsky.social
Compress Better, Compute Larger, Share Faster
Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Blosc2 is making its way towards becoming a general array library for data that is in memory, on disk or remote. This will be extremely useful to add flexibility to our cat2cloud SaaS service: ironarray.io/cat2cloud π π
03.11.2025 09:29 β π 1 π 0 π¬ 0 π 0π IronPill 1π
Blosc2 calculates Fourier approximations:
β‘5x faster than NumPy
π£ fraction of the memory footprint
π one-line syntax πππ(πβ*βπππ(π)β+βπβ*βπππ(π),βππ‘ππ=π·)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
π’Blosc2 3.10.2 Released! π’
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
π¨Blosc2 3.9.1π¨
Blosc2 as a mature computation engine >>>
β’ Array API standard compliance - 70 new functions
β’ Fast linalg: tensordot 12x π
πππππ than NumPy for large arrays !
β’ Fast calc: Funcs like hypot 10x π
πππππ than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
22.09.2025 12:20 β π 1 π 1 π¬ 0 π 0Struggling to get performant code from LLMs? π€
We can help! πͺ We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).
Ready to dive in? π
πΉ EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
πΉ Tutorial: github.com/Blosc/EuroSc...
#HPC #Blosc2
π We're thrilled to announce *TreeStore*, a new class in Python-Blosc2! Endow your datasets with a hierarchical structure! β‘οΈ
π We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
π£ #Caterva2 2025.8.7 is out! π
We did a major refactoring for a simpler, more robust system, with client APIs unaffected. β
The highlight is the new cat2agent π€, a CLI client to watch a directory and auto-sync it with a Caterva2 server.
Release notes: github.com/ironArray/Ca...
#OpenSource
Tired of trial-and-error with #Blosc2 compression?
You can do better with #Btune! π
Btune can be trained to automatically find the best parameters for your specific datasets and use case.
Learn more about optimizing your compression workflow: ironarray.io/btune
#DataCompression #Optimization
Accessing remote datasets in less than 100 ms
Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye.
Try it out by yourself! π cat2.cloud/demo/roots/@...
Share Data Faster!
#BigData #RemoteAccess #Performance
For those who could not attend, the recording of our recent webinar, "A Gentle Introduction to Cat2Cloud," is now available!
ironarray.io/cat2cloud#we...
If interested, remember that the subscription to our beta program is currently open!
Compress Better, Compute Bigger, Share Faster!
π£ Final call! π£
Join us tomorrow, June 26th at 14:15 UTC, for our live webinar: A Gentle Introduction to Cat2Cloud
Discover how you can: π€ Upload π Visualize π» Compute π€ Share ...your data right in the cloud, in the most efficient way possible! βοΈβ¨
www.linkedin.com/feed/update/...
See you there!
In this chapter, our Luke Shaw explains how filters work in Caterva2, a free software that you can run on your own laptop (or server, if you are more serious about large datasets). It works for either #Blosc2 or #HDF5 datasets.
Have it a try!
#WebGUI #DataAnalysis #LargeData
π Excited to share more about Caterva2, your ultimate gateway to #Blosc2 / #HDF5 repositories! π
#Caterva2 is designed to revolutionize how you interact with large datasets. Want to see it in action? π€ See our new video showcasing Caterva2's main functionalities! π¬
ironarray.io/caterva2
Enjoy!
β¨ Ever wondered how to effortlessly apply lazy expressions to tomographic HDF5 datasets and visualize them instantly in Cat2Cloud? π€―
π¬ Discover how Python π magic and our user-friendly web interface simplify the process.
π Watch the full video to see the magic unfold: ironarray.io/cat2cloud
Caterva2 displaying the result of a computed tomography of a large HDF5 dataset in real-time.
We're making HDF5, the standard for scientific data π, faster β‘ and more versatile π οΈ. By integrating Blosc2 with HDF5, our Caterva2 platform allows you to natively serve βοΈ, share π€, visualize π, and compute π» your HDF5 datasets with greater efficiency and ease.
Slides:
www.blosc.org/docs/2025-Eu...
π Meet Cat2Cloud: High-Speed Throughput for AI/ML and HPC Workloads β‘οΈπΎ
Managing large datasets shouldn't mean navigating complex architectures or unpredictable fees. Visit ironarray.io/cat2cloud to explore how Cat2Cloud can transform your data management experience.
#DataManagement #CloudComputing
Python-Blosc2 3.3.3 is live! β¨ Bug fixes, smoother string lazy expressions, and Windows mmap improvements thanks to the latest C-Blosc2.
Upgrade now: pip install blosc2 --update
Learn more: github.com/Blosc/python...
#Python #Blosc2 #DataScience
π£οΈ Exciting news! We're introducing a new way to work with large datasets in the βοΈ, inspired by spreadsheets π.
Imagine an expression that automatically updates its value whenever the underlying data changes β that's what we've brought to cloud-based data analysis.
Join our beta program and enjoy! π
Your data does not need to be scattered throughout the world. See how you can use Blosc2/Caterva2 for centralize its storage, computing and sharing needs at easy!
Compress Better, Compute Bigger, Share Faster
First video explaining the roots concept, and how to upload and download data
π£οΈ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:π€
- ποΈ Access to the best compression algorithms available
- π Share complex data securely and effortlessly
- β‘ Perform advanced computations directly in the cloud
...and more!
ironarray.io/cat2cloud
Happy to sponsor such an excellent work!
12.03.2025 13:25 β π 1 π 2 π¬ 0 π 0π’ We are happy to announce the release of Python-Blosc2 3.2.0!
This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...
Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...
Enjoy!
Happy to be sponsoring such an extremely useful project! Cheers! π₯
25.02.2025 17:07 β π 0 π 0 π¬ 0 π 0Happy to sponsor this fine work.
14.02.2025 13:21 β π 0 π 0 π¬ 0 π 0Difference in perception when using blosc2+grok for a 2x better compression ratio.
@Blosc2 makes compression even better for tomography in synchrotron facilities in Europe by allowing up to 2x better compression ratio, helping already good codecs to shine even more, without almost no loose in perceived quality.
Read our paper on how we achieved this:
blosc.org/docs/LEAPS-I...
Happy to see this multi-year effort out of its cage! Best of luck!
13.12.2024 12:50 β π 0 π 0 π¬ 0 π 0