Zarr

Welcome! You are invited to join a webinar: Reusable Deep Learning with EOPF Zarr Samples. After registering, you will receive a confirmation email about joining the webinar. The aim of this webinar is to demonstrate how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE) with the data and tools provi...

♻️ 7/8 - Webinar: Reusable Deep Learning with EOPF Zarr Samples - ESA Copernicus Earth Observation Processor Framework

Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).

#datascience #deeplearning

The Google Earth Engine code editor displaying an evaporation map loaded directly from ARCO-ERA5! The black and white map overlooks the continental US. It's easy to make out land masses, but there are also cloud-looking visuals on the map.

I've been waiting a few years for this: Zarr v2 support was just launched in Google Earth Engine! Check out this demo that loads ARCO-ERA5 into GEE 🔥

code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...

If you missed today's presentation at the LPS by @thejeran.bsky.social on Browzarr, a browser-based visualization toolkit for exploring and analyzing Zarr data stores, go and check out the version online, and open issues and do feature requests on GitHub. github.com/EarthyScienc...

comic doodle of Evgeny Zakharov in a suit and stripey shirt, with a small plane to the left, while DNA strands and bases are above, a camera is taking a photo of a feather and a wasp, the coloring is grey shades on a red background.

comic doodle of Jerome Kelleher in a t-shirt and stripey shirt, the background is full of small peon people with DNA strands in them and 4 files with the word ZARR written on them, the coloring is grey shades on a green background.

doodles of two Tree of Life department speakers @sangerinstitute.bsky.social this week, Evgeny Zakharov talking about insanely large scale barcode sequencing and Jerome Kelleher talking about large scale human genomic data analysis.

that's a lot of data 🧬📄

GitHub - zarr-developers/zarr-python: An implementation of chunked, compressed, N-dimensional arrays for Python. An implementation of chunked, compressed, N-dimensional arrays for Python. - zarr-developers/zarr-python

We welcome a new project to OpenSustain.tech #climate #sustainability #opensource #opensustain #openscience github.com/zarr-develop...

Analysis-ready VCF at Biobank scale using Zarr AbstractBackground. Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics.

ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩

doi.org/10.1093/giga...

OME-Zarr 4 life

"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."

1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.

Curious about climate patterns? The new ERA Explorer app lets you compare 85 years of climate data worldwide. Analyse climatological averages at any map point or explore month-by-month data.Dive deeper with ERA Explorer! era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S #beautifuldata

@zarr.dev even 🤩 Love it #beautifuldata

🧠 Interested in extending #Zarr?

Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅

github.com/zarr-develop...

Just back from #CNG2025, I wrote up some thoughts on the traction the @zarr.dev format is gaining in the broader geospatial industry (specifically Earth Observation). I also summarize what features and tools the user and developer communities are asking for to fully leverage Zarr. 👇👇👇

Fundamentals: What is Cloud-Optimized Scientific Data? What cloud-optimized data really means, and how Zarr and Icechunk enable fast access to massive scientific datasets in cloud object storage.

1/ 💡 Our latest blog post in the fundamentals series, written by @tegnicholas.bsky.social, demystifies cloud-optimized scientific data formats!

Read more: earthmover.io/blog/fundame...

🚀 Big launch today: introducing Flux — a game-changing way to serve geospatial data via standard APIs in seconds. Built for scale, speed, and simplicity.

This one was a lot of fun to work on! Why @xarray.bsky.social and @zarr.dev are faster than DuckDB and Parquet for gridded data...from first principles.

What's behind ERA Explorer's speed? Meet the ZARR archive! 🚀 ZARR revolutionises data processing, enabling fast, efficient access to over 80 years of climate data.
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...

#C3S @zarr.dev #beautifuldata

Just started using Zarr - literally unbelievably good.

🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "

🚨 New blog post 🚨

In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.

GitHub - mathworks/MATLAB-support-for-Zarr-files: This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which... This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which is optimized for cloud storage and parallel co...

ICYMI: A MATLAB implementation of @zarr.dev has dropped from @mathworks.bsky.social 🚀

github.com/mathworks/MA...

ZAPBench ZAPBench evaluates how well different models can predict the activity of over 70,000 neurons in a novel larval zebrafish dataset.

Really cool new neuroscience benchmark just dropped.

Data is in @zarr.dev and demos use tensorstore.

zapbench-release.storage.googleapis.com/landing.html

Very happy to announce our winter release of syGlass: 2.2.0!
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...

You, yes you, can help the Cloud Native Geospatial Movement! Have you benefitted from COG’s, STAC, Zarr, COPC or GeoParquet? Join us in Utah for the first CNG Conference and help just by attending.

You, yes you, can help the Cloud Native Geospatial Movement!

Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?

Learn how to give back in my post: cholmes.medium.com/you-yes-you-...

We're a bit late to the bsky game so we appreciate a boost! @loicaroyer.bsky.social @haesleinhuepf.bsky.social @florianjug.bsky.social @lhinderling.bsky.social @kbias.bsky.social @zarr.dev @xarray.bsky.social @scipyconf.bsky.social @drlachie.bsky.social @henriqueslab.bsky.social @globias.bsky.social

If you missed the Zarr-Python 3 release party last week, no worries because today, we released zarr-python 3.0.1 and numcodecs 0.15.0.

release notes 👉 zarr.readthedocs.io/en/stable/re...

Microscopy Nodes loads data from a @zarr.dev bucket, making it easy to use open data archives that host Zarr data!
This is a mitotic cell from Walther et al. 2018, that's hosted publicly on the Image Data Resource 😱

😍 That's what friends are for!!

#opensource #scientific #python #ftw 💪

🎉 Zarr-Python 3 is here! 🎉

- Full support for Zarr v3 spec
- Chunk-sharding for more efficient data storage
- Major performance boosts with async I/O & parallel compression

💻 pip install --upgrade zarr
💻 conda install --channel conda-forge zarr

Blog post: https://buff.ly/3C3OwYw

Hi, Zarr community! 👋

🚨 Big news: Zarr-Python 3.0 is dropping next week! 🚨

If your project depends on Zarr-Python, make sure to check out the migration guide to get ready for the update.

Guide: https://buff.ly/3W0cLxd

More updates soon! 🧑🏻‍💻