I was looking into the #DANDI archive, following a post of @jonny that mentioned it as a possibility for #Neuroscience data storage.. It looks like it could be useful indeed but what is this warning??

https://dandiarchive.org/

Generated a quick plot to see usage trends for Open Source Brain v2 (#OSBv2): an integrated #research platform for #neuroscience that indexes multiple model and data sources (#DANDI, #ModelDB, #Biomodels, #Github) and provides compute resources on the #cloud in "workspaces". It also includes specialist applications: #NWBExplorer for working with data in the NeuroData Without Borders (#NWB) format; #NetPyNE-UI for biophysically detailed #ComputationalModelling and a #JupyterLab environment.

Applications open for Neurodata Without Borders' #NeuroDataReHack 2024!

Get trained on:
- the DANDI Archive's open neurophysiology datasets
- maximizing the archive & NWB
- using the above to incorporate existing data into your workflows

Apply by Mar 1: bit.ly/NWBNeuroDataReHack2024

#neuroscience #neuroinformatics #OpenData #OpenScience #neuroinformagical #NWB #NeurodataWithoutBorders #DANDI #DANDIArchive

Applications open for Neurodata Without Borders' #NeuroDataReHack 2024!

Get trained on:
- the DANDI Archive's open neurophysiology datasets
- maximizing the archive & NWB
- using the above to incorporate existing data into your workflows

Apply by Mar 1: bit.ly/NWBNeuroDataReHack2024

#neuroscience #neuroinformatics #OpenData #OpenScience #neuroinformagical #NWB #NeurodataWithoutBorders #DANDI #DANDIArchive

Applications open for Neurodata Without Borders' #NeuroDataReHack 2024!

Get trained on:
- the DANDI Archive's open neurophysiology datasets
- maximizing the archive & NWB
- using the above to incorporate existing data into your workflows

Apply by Mar 1: bit.ly/NWBNeuroDataReHack2024

#neuroscience #neuroinformatics #OpenData #OpenScience #neuroinformagical #NWB #NeurodataWithoutBorders #DANDI #DANDIArchive

Don't get me wrong, I like all the people I've met who work on #DANDI (an archive for neuroscientific data), but it seems like they quietly dropped the part of their roadmap where they planned on interoperability with #IPFS, or any other data system that isn't AWS's public dataset program. So, what exactly is "Distributed" about the "Distributed archives for neurophysiology data integration" now?

Another scientific infrastructure project destined for a half-limping life to inevitable death or capture. Thank god it's made free by this AWS program that can be terminated at any time and is definitely not a trap.

I feel like I can't wave my hands over my head and yell loud enough about how we're literally walking into ANOTHER "open science" scam where the open data mandates are just going to be "pay AWS a fifth of your grant" mandates.

I don't fault tool builders for both doing the overwhelmingly normal thing in making a database nor responding to the direct calls from funders to build cloud infra. but I do think researchers at large need to recognize that any sort of systematic push to make any one (or even few) cloud provider an official or expected resting place for all data makes us a runaway funding drain we don't want.

Sure it's free for now. in a few years you have saved a few hundred TB of your lab's data. the free trial ends. that's p bad, but if you're required, want to, or can't manage the data infra to avoid hosting that data indefinitely, that number never goes down. How much will storage and egress costs be with 5 years of data, 10, etc. for everyone. and larger archives have it some orders of magnitude worse.

it seems like an obviously bad plan to me! but the infrastructure plans of both major basic research funders in the US don't seem to think so!

https://web.archive.org/web/20221003210910/https://www.dandiarchive.org/

edit: clarifying intent

Diversity & Inclusion…

Do we ever hesitate?
Do we ever filter?
Do we ever exclude?

RIP #PaulOGrady ... https://youtu.be/hsiPd1jmIOI

#DandI