Creating a Zarr Store from netcdfs in cloud storage using Dask Gateway
Автор: EEHolmes-DataScience
Загружено: 2025-12-20
Просмотров: 14
Talking through the process of creating a Zarr store on cloud storage from netcdfs in another cloud storage bucket. Using Dask Gateway. If you don't have Dask Gateway, you can use the same idea with https://coiled.io/
Cost for this Dask Gateway run was about $35 for the compute. I was on an AWS hub and writing to GCS so there was also a AWS to GCS egress fee for writing. That was like another $50. You can avoid this by running your workers in the same cloud as your bucket which you can easily do with https://coiled.io/ .
https://github.com/fish-pace/chla-z-m...
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке: