[meta] Add Apache Arrow support
Aims
Currently, we only have hdf5 as data output format, but discussed in #369 the possibility of adding support for Apache Arrow. This meta issue is there to bundle the steps necessary to achieve this integration. Below is a tentative list of steps needed to make Arrow available.
Tasks
-
Find an of the current hdf5
structure to supportarrow
and future extensions without breaking the interface #373 -
Integrate this abstraction into the DataManager
if necessary. -
Implement necessary wrappers for Apache Arrow
. -
Add Arrow support for the DataManager
.
People involved
Edited by Harald Mack