Jose from European #XFEL is digging into the details of KaraboHDF, their solution of collecting all data from diverse sources (really fast 2D imaging detectors, medium to slow 1D or 0D detectors and what-not) into coherent files.
It's not only about storing values, but also meaning: that means the "what" of the data, and also the physical units.
Massive data rates are distributed among several files, now we're discussing of how to glue this data back together.