From Josh Moore, German Bioimaging research software engineer and OME and Zarr developer and maintainer:
๐ Weโre hiring again! Join German BioImaging as a Software Developer!
๐ป Build scalable #bioimaging solutions
๐ Collaborate globally
๐ฏ Contribute to open science through #OME #Zarr
๐ฃ Tell your #NGFF friends.
Remote, full-time. Apply by 30 June 2025. All submissions via:
https://gerbi-gmb.de/machform/view.php?id=86038
๐ Weโre hiring again! Join @GerBI as a Software Developer!
๐ป Build scalable #bioimaging solutions
๐ Collaborate globally
๐ฏ Contribute to open science through #OME #Zarr
๐ฃ Tell your #NGFF friends.
Remote, full-time. Apply by 30 June 2025: All submissions via http://bit.ly/gerbi-jobs-202505
๐๐ ๐ ๐ฒ๐๐ฎ๐ฑ๐ฎ๐๐ฎ ๐๐ผ๐ป๐๐ฒ๐ป๐๐ถ๐ผ๐ป๐ support #OpenScience by automating processes via metadata in #NetCDF and #Zarr files. They establish a unified language for the #weather, #climate, #ocean, and #EO community. https://buff.ly/rGPuoku
#remotesensing #EarthObs
Well here we go
Hi Zarrites! ๐๐ป
We have our bi-weekly community meeting today @ 11:00 PT. ๐๏ธ
Today, Joe Hamman will open the community meeting by talking about how they're using #Zarr at EarthmoverHQ to make cool stuff! ๐๏ธ
Zoom: https://zoom.us/j/300670033?pwd=OFhjV0FHQmhHK2FYbGFRVnBPMVNJdz09
More info: https://zarr.dev/community-calls/
what does #Zarr call the chunking "dangle", when the chunk shape doesn't divide neatly into the parent shape?
does it pad marginal chunks or record their actual size?
hmm maybe this is the #zarr lib we need
OK here we go! "Using Zarr and FLAC for storing large audio data files in cloud-optimised format" -- my Friday blog with example code, finding the FLAC compressor very handy: http://mcld.co.uk/blog/2024/using-zarr-for-storing-large-audio-data-files-in-cloud-optimised-format.html #Zarr #FLAC #audio #data @zarr
Here's a very cool thing for audio data in #Zarr: someone has implemented the FLAC codec! https://github.com/AllenNeuralDynamics/flac-numcodecs (I haven't tested it) #flac #codec #audio
The #Zarr data format doesn't have a #Wikipedia page! Until now: https://en.wikipedia.org/wiki/Zarr_(data_format) Could you help expand it? What should be said about it? #datascience
I think about "big cloud data" in bioacoustics: very large audio data, or very large deep embeddings -- which (for audio) are essentially a kind of vector time-series. Inspired by the similar issues raised in @jack_kelly recent blog, and this interesting comparison https://waterdata.usgs.gov/blog/cloud_data/ I'm wondering if #Zarr or #Parquet could be good for our audio/time-series... #audio #deeplearning #dataengineering
ooh #Zarr does have overviews, they call it "multiscales"
https://github.com/zarr-developers/geozarr-spec/pull/42/files
I just ran this on a GEBCO subset, this is cool
https://gist.github.com/mdsumner/1381b490ecd0ddf518cff41831d68d18#file-zarr_overviews-md
๐ Let there be zarr! @dynamical NOAA GFS hourly analysis is now live.
We are excited to announce the first entry into dynamicalโs catalog: an hourly GFS analysis from 2015-01-15 to present. https://dynamical.org/catalog/noaa-gfs-analysis-hourly/
If you work in weather data, check it out. You can view our roadmap for additional catalog entries here: https://dynamical.org/catalog/
Hi Zarrites! ๐๐ป
We have our bi-weekly community meeting today. ๐๏ธ
Today, Brianna R. Pagรกn will be talking about how #Zarr is used across NASA data centres! ๐ฐ๏ธ
Join here: https://zarr.dev/community-calls/
Hola Zarr Community! ๐
We have a new blog post written by Zoe Waring from NASA LaRC's POWER Project. โ๏ธ
Read more to find out why POWER has been using #Zarr and why they love it! โค๏ธ
Hi everyone!
We're conducting a survey to collect information about #Zarr usage and applications across NASA. ๐ฐ๏ธ
If you use Zarr in any way and are working at NASA, please fill out this quick survey: https://github.com/zarr-developers/zarr-python/discussions/1930
If, like me, you are confused about all the terminology around geospatial cloud computing and how it all fits together, I recommend this video. Great explanation! #STAC, #COG, #Zarr, #Dask, #AWS, #EarthEngine
https://www.youtube.com/watch?v=YPno-89l54Q
When you skip working on multiscale and just go to the highest resolution in your zarr, then take off your mask to reveal that you are Don Diego de la Vega...
