Implementation of alternative data streaming II
Similar to #55 (closed), this branch is dedicated to implement an alternative data streaming that allows handling of datasets that do not fit into memory.
While the approach in #55 (closed) turns out to work, this branch is set up to test a further alternative based on xarray.open_mfdataset
. This approach has the benefit of handling data in a highly flexible manner while also circumventing the persisting memory-issue (dataset duplictaes). The approach tested here constitutes the last test documented in the corresponding Jupyter Notebook of #52 (closed).