ironArray SLU's Avatar

ironArray SLU

@ironarray.io.bsky.social

Compress Better, Compute Larger, Share Faster

13 Followers  |  4 Following  |  21 Posts  |  Joined: 11.12.2024  |  2.0026

Latest posts by ironarray.io on Bluesky

Post image

Stop downloading. Start computing.

Everything changes on November 18, 2025.

#Cat2Cloud is coming.

12.11.2025 09:13 β€” πŸ‘ 3    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
18.08.2025 Compress, Compute, and Conquer: Python-Blosc2 for Efficient Data Analysis
YouTube video by EuroSciPy 18.08.2025 Compress, Compute, and Conquer: Python-Blosc2 for Efficient Data Analysis

Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.

www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource

07.11.2025 11:38 β€” πŸ‘ 4    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

Blosc2 is making its way towards becoming a general array library for data that is in memory, on disk or remote. This will be extremely useful to add flexibility to our cat2cloud SaaS service: ironarray.io/cat2cloud πŸš€ πŸŽ‰

03.11.2025 09:29 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

πŸ’Š IronPill 1πŸ’Š
Blosc2 calculates Fourier approximations:
⚑5x faster than NumPy
πŸ‘£ fraction of the memory footprint
🐍 one-line syntax πšœπšžπš–(πšŠβ€‚*β€‚πšŒπš˜πšœ(𝚝) +β€‚πš‹β€‚*β€‚πšœπš’πš—(𝚝),β€‚πšŠπš‘πš’πšœ=𝟷)

Full notebook: github.com/Blosc/python...

(inspiration: towardsdatascience.com/numexpr-the-...)

#Blosc2
#Data
#SignalProcessing

20.10.2025 12:06 β€” πŸ‘ 4    πŸ” 2    πŸ’¬ 0    πŸ“Œ 1
Post image

πŸ“’Blosc2 3.10.2 Released! πŸ“’

Lazy evaluation for ALL Blosc2 functions in version 3.10!

Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!

#Zarr
#HDF5
#Python

15.10.2025 11:58 β€” πŸ‘ 4    πŸ” 2    πŸ’¬ 0    πŸ“Œ 1
Post image

🚨Blosc2 3.9.1🚨

Blosc2 as a mature computation engine >>>

β€’ Array API standard compliance - 70 new functions
β€’ Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
β€’ Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!

Blog: ironarray.io/blog/array-api

#Python
#linalg
#computation

01.10.2025 09:20 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 2

It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.

22.09.2025 12:20 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

Struggling to get performant code from LLMs? πŸ€”

We can help! πŸ’ͺ We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).

Ready to dive in? πŸš€
πŸ”Ή EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
πŸ”Ή Tutorial: github.com/Blosc/EuroSc...

#HPC #Blosc2

08.09.2025 12:11 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 1
Post image

πŸš€ We're thrilled to announce *TreeStore*, a new class in Python-Blosc2! Endow your datasets with a hierarchical structure! ⚑️

πŸ“ We've blogged about it:
www.blosc.org/posts/new-tr...

It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!

#Python #Blosc2 #TreeStore #DataScience #OpenSource

20.08.2025 06:07 β€” πŸ‘ 3    πŸ” 2    πŸ’¬ 0    πŸ“Œ 1
Post image

πŸ“£ #Caterva2 2025.8.7 is out! πŸš€

We did a major refactoring for a simpler, more robust system, with client APIs unaffected. βœ…

The highlight is the new cat2agent πŸ€–, a CLI client to watch a directory and auto-sync it with a Caterva2 server.

Release notes: github.com/ironArray/Ca...

#OpenSource

07.08.2025 10:01 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 1
Post image

Tired of trial-and-error with #Blosc2 compression?

You can do better with #Btune! πŸš€

Btune can be trained to automatically find the best parameters for your specific datasets and use case.

Learn more about optimizing your compression workflow: ironarray.io/btune

#DataCompression #Optimization

16.07.2025 12:24 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Accessing remote datasets in less than 100 ms

Accessing remote datasets in less than 100 ms

Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye.

Try it out by yourself! πŸ‘‰ cat2.cloud/demo/roots/@...

Share Data Faster!

#BigData #RemoteAccess #Performance

09.07.2025 15:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Post image

For those who could not attend, the recording of our recent webinar, "A Gentle Introduction to Cat2Cloud," is now available!

ironarray.io/cat2cloud#we...

If interested, remember that the subscription to our beta program is currently open!

Compress Better, Compute Bigger, Share Faster!

08.07.2025 08:55 β€” πŸ‘ 0    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
πŸš€ Exciting Webinar Announcement! | Francesc Alted πŸš€ Exciting Webinar Announcement! πŸš€ We're thrilled to invite you to our upcoming webinar: **"A Gentle Introduction to cat2.cloud"** Hosted by ironArray πŸ“… **Date:** 2025-06-26 πŸ•‘ **Time:*...

πŸ“£ Final call! πŸ“£

Join us tomorrow, June 26th at 14:15 UTC, for our live webinar: A Gentle Introduction to Cat2Cloud

Discover how you can: πŸ“€ Upload πŸ“Š Visualize πŸ’» Compute 🀝 Share ...your data right in the cloud, in the most efficient way possible! ☁️✨
www.linkedin.com/feed/update/...
See you there!

25.06.2025 11:35 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

In this chapter, our Luke Shaw explains how filters work in Caterva2, a free software that you can run on your own laptop (or server, if you are more serious about large datasets). It works for either #Blosc2 or #HDF5 datasets.

Have it a try!

#WebGUI #DataAnalysis #LargeData

18.06.2025 09:29 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

πŸš€ Excited to share more about Caterva2, your ultimate gateway to #Blosc2 / #HDF5 repositories! πŸš€

#Caterva2 is designed to revolutionize how you interact with large datasets. Want to see it in action? πŸ€” See our new video showcasing Caterva2's main functionalities! 🎬

ironarray.io/caterva2

Enjoy!

06.06.2025 17:04 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Video thumbnail

✨ Ever wondered how to effortlessly apply lazy expressions to tomographic HDF5 datasets and visualize them instantly in Cat2Cloud? 🀯

🎬 Discover how Python 🐍 magic and our user-friendly web interface simplify the process.

πŸ‘‡ Watch the full video to see the magic unfold: ironarray.io/cat2cloud

29.05.2025 17:09 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Caterva2 displaying the result of a computed tomography of a large HDF5 dataset in real-time.

Caterva2 displaying the result of a computed tomography of a large HDF5 dataset in real-time.

We're making HDF5, the standard for scientific data πŸ“Š, faster ⚑ and more versatile πŸ› οΈ. By integrating Blosc2 with HDF5, our Caterva2 platform allows you to natively serve ☁️, share 🀝, visualize πŸ‘€, and compute πŸ’» your HDF5 datasets with greater efficiency and ease.

Slides:
www.blosc.org/docs/2025-Eu...

27.05.2025 16:46 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image

πŸš€ Meet Cat2Cloud: High-Speed Throughput for AI/ML and HPC Workloads βš‘οΈπŸ’Ύ

Managing large datasets shouldn't mean navigating complex architectures or unpredictable fees. Visit ironarray.io/cat2cloud to explore how Cat2Cloud can transform your data management experience.

#DataManagement #CloudComputing

15.05.2025 11:25 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Preview
Releases Β· Blosc/python-blosc2 A high-performance library for compressed ndarrays, with a flexible computational engine - Blosc/python-blosc2

Python-Blosc2 3.3.3 is live! ✨ Bug fixes, smoother string lazy expressions, and Windows mmap improvements thanks to the latest C-Blosc2.

Upgrade now: pip install blosc2 --update

Learn more: github.com/Blosc/python...

#Python #Blosc2 #DataScience

14.05.2025 16:12 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

πŸ—£οΈ Exciting news! We're introducing a new way to work with large datasets in the ☁️, inspired by spreadsheets πŸ“Š.
Imagine an expression that automatically updates its value whenever the underlying data changes – that's what we've brought to cloud-based data analysis.

Join our beta program and enjoy! πŸ˜€

09.05.2025 11:03 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Your data does not need to be scattered throughout the world. See how you can use Blosc2/Caterva2 for centralize its storage, computing and sharing needs at easy!

Compress Better, Compute Bigger, Share Faster

15.04.2025 19:46 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
First video explaining the roots concept, and how to upload and download data

First video explaining the roots concept, and how to upload and download data

πŸ—£οΈ After 15 years delivering Blosc/Blosc2, we are glad to announce the beta program for Cat2Cloud:🀟

- πŸ—œοΈ Access to the best compression algorithms available
- πŸ”„ Share complex data securely and effortlessly
- ⚑ Perform advanced computations directly in the cloud

...and more!

ironarray.io/cat2cloud

02.04.2025 16:06 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 2

Happy to sponsor such an excellent work!

12.03.2025 13:25 β€” πŸ‘ 1    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Optimizing chunks for matrix multiplication in Blosc2 Exploring how to optimize chunk sizes in Blosc2 to improve performance in matrix multiplication.

πŸ“’ We are happy to announce the release of Python-Blosc2 3.2.0!

This release introduces the new blosc2.matmul() function. We have written a nice blog: www.blosc.org/posts/optimi...

Lastly, we are excited to introduce WASM32 wheels for the first time. More info at: github.com/Blosc/python...

Enjoy!

12.03.2025 13:17 β€” πŸ‘ 2    πŸ” 3    πŸ’¬ 0    πŸ“Œ 1

Happy to be sponsoring such an extremely useful project! Cheers! πŸ₯‚

25.02.2025 17:07 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Happy to sponsor this fine work.

14.02.2025 13:21 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Difference in perception when using blosc2+grok for a 2x better compression ratio.

Difference in perception when using blosc2+grok for a 2x better compression ratio.

@Blosc2 makes compression even better for tomography in synchrotron facilities in Europe by allowing up to 2x better compression ratio, helping already good codecs to shine even more, without almost no loose in perceived quality.

Read our paper on how we achieved this:
blosc.org/docs/LEAPS-I...

26.12.2024 13:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1

Happy to see this multi-year effort out of its cage! Best of luck!

13.12.2024 12:50 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@ironarray.io is following 4 prominent accounts