I am excited to announce xarray-grass, a new free software Python library designed to bridge two open source data science heavy weights: @grassgis and #xarray (https://xarray.dev/).

Although xarray-grass is in its nascent phase, I encourage you to check out the repository on GitHub (https://github.com/lrntct/xarray-grass) and experiment with it. Your insights and contributions will play a significant role in the project's future.

#geo #RemoteSensing #earthobservation people! Has anyone got an example of using the #Copernicus #DataSpace -> https://documentation.dataspace.copernicus.eu/ to go from searching using #pystac to getting a working #xarray dataset for #Sentinel2 reflectances? #python #geopython

I am really looking forward to a time when scientific data analysis is less of a constant fuckaround and fight with technical bullshit. I'd *really* like

- #netCDF natively supporting complex numbers
- #Python #xarray and #pandas to natively support physical units (#pint is great on its own but the integrations leave a LOT to be desired)
- #Jupyter notebooks to suck less (crashes, glitches, widget plots not saved statically, an effing BUILTIN formatter, etc.)
- proper data pipeline systems
...

Seeking recommendations for a #WebMapping tutorial / course?

Slightly at sea on where to start.

- My current JS skill level is _extreme novice_.
- I don't have access to ArcGIS.
- Comfortable with #QGIS [*] and the #python #geospatial ecosystem (#geopandas #xarray #rasterio and plotting with #matplotlib)

Suggestions welcome. TIA. 👍

* I have looked at the qgis2web plugin, but having some issues associated with my aged laptop (2012 mbp running Ubuntu) and a 'Wayland session'.

#Leaflet #OpenLayers #MapBox #PrototoMaps #MapLibre #d3js #OpenStreetMap #GIS

𝗚𝗲𝗼𝘀𝗽𝗮𝘁𝗶𝗮𝗹 𝗣𝘆𝘁𝗵𝗼𝗻 𝗧𝘂𝘁𝗼𝗿𝗶𝗮𝗹𝘀
SpatialThoughts provides tutorials which cover a broad range of geospatial topics and technologies, e.g., #GeoPandas, #XArray, #dask, and more. Each technology is described in a notebook with step-by-step explanation. Check it out.
https://www.geopythontutorials.com

GSPy - A New Toolbox And Data Standard For Geophysical Datasets
--
https://doi.org/10.3389/feart.2022.907614 <-- shared paper
--
https://doi.org/10.5066/P9XNQVGQ | https://code.usgs.gov/g3sc/gspy <-- shared code repository
--
[an older paper, but code is in active and ongoing development/evolution]
#GIS #spatial #mapping #geophysics #geophysical #NetCDF #datatypes #code #opensource #library #dataformats #standardisation #standardization #openstandard #portable #metadata #Python #package #GSPy #methods #workflows #xarray #CRS #opendata #architecture #toolbox

Justus made a great intro on using #DGGS through #xarray #xdggs at the #Pangeo showcase talk. Xdggs is now in a stage where you can use it fairly robustly with #HEALPIX and #H3. Other integrations like for #DGGRID are developed as separate plugins.

https://youtube.com/watch?v=bAMGFKsxsjs&si=hnfpk04VMn-rggEV

... while I find ChatGPT increasingly useful for technical things like telling me how to manipulate #xarray datasets in #python, or how to add a docstring to my python routine.

I am moving all my computing libraries to #xarray, no regrets. It is a natural way to manipulate datasets of rectangular arrays, with named coordinates and dimensions: https://xarray.dev/
There are several possible backends, including #dask which allows lazy data loading.
I had the pleasure of meeting some of the devs last week, who showed me a preview of the upcoming `DataTree` structure which is going to make this library even more versatile!

#Python #numpy #ScientificComputing

🌍📊 Want to work with NetCDF files in Python? My tutorial series covers everything from opening and plotting NetCDF data to creating CF-compliant files for FAIR data publication.

Whether you're new to NetCDF or looking to enhance your skills, I've got you covered! 🚀 Check it out: https://lhmarsden.github.io/NetCDF_in_Python_from_beginner_to_pro

Topics include:
🔸Extracting data 📝
🔸Plotting 📈
🔸Creating CF-compliant files 🌐
🔸Granularity 🖥️
🔸CF & ACDD 🖥️

Suggestions? Let me know! #Python #DataScience #NetCDF #xarray #FAIRData #ClimateData

I dreamt that #xarray kerchunk/VirtualiZarr was being used to stream music

xarray.open_mfdataset() is worth all the effort of learning #python and #xarray
every single time I use it makes me laugh

"just open this mf dataset(s), please and thank you"

Can we serialize a lazy #xarray to json? Lining up 10000 URLs takes a minute, can we save it out?

I figure that's what #kerchunk is, but it doesn't seem like it's used that way 🙏

My mental picture of image files has always been of pixels covering a surface as tiles each like a tiny rectangular shapefile.

Investigating #Python #xarray has made me see the elegance of handling images as a grid of equally spaced dimensionless sensor readings. Upscaling/downscaling and interpolation become more meaningful and lossless, and image data is functionally identical to (although denser than) other point-based sensor data (e.g. weather stations).

The data science becomes so clean.

Excellent #OpenSource #OpenScience job opportunity: #xarray community developer at Earthmover PBC:

https://github.com/pydata/xarray/discussions/9059

US-only 😞, but remote available 😊. And the Earthmover folks are awesome!

#GetFediHired

🎉 🎉 I released gsw-xarray v0.4.0 🎉 🎉

https://pypi.org/project/gsw-xarray/0.4.0/

this release brings a new accessor for xarray, which may be a game changer for clarity and ease:
`ds.gsw[["sigma0", "alpha"]]`

#xarray #oceanography

v0.3.0 of yt_xarray is out!

This includes the initial release of the embedded transformation framework -- the main perk being how it simplifies the process of using yt's volume rendering methods with non-cartesian data (which is common in geophysical datasets)!

Full release notes at https://github.com/data-exp-lab/yt_xarray/releases/tag/v0.3.0

Figure uses relative humidity from a MERRA-2, see https://chrishavlin.github.io/NASASoftwareWorkshop2024/yt-xr-dev-02-transformations.html for an overview.

#yt #geophysics #xarray #python #DataVisualization #geodata

I am deepening my knowledge of #xarray by actually using it to store intermediate data for the interferometric processing of Sentinel-1. I found that learning by doing is much more efficient for me than just reading about a topic.

#datascience #remotesensing #python

Join this cool #Pangeo presentation (or watch it afterwards) about scalable #Zarr with #Dask and #Xarray

https://discourse.pangeo.io/t/webinar-building-a-planetary-scale-earth-observation-data-cube-in-zarr/

A possible hook for # RStats folks, dask is like {targets} become toolkit, inside Xarray and all automatic

@pokateo

Checking in from New Zealand! I'm developing a library to decode #GeoTIFF files in #rustlang (without using GDAL 😂). Currently trying to add an #xarray backend (in Python) at https://github.com/weiji14/cog3pio/pull/14.