In SDMX-CSV return higher-level ref. metadata for both DF and DSD
As Anastassia,
I want that SDMX-CSV requests for higher-level reference metadata for a DF return both, those related to the DF and those related to the underlying DSD, in the same response in 2 different datasets,
So that both get accessible and can be edited with the Excel Add-in.
Details
With the release of dotstatsuite-core-transfer#596 (closed), ref. metadata are returned for either dataflow, if available, or alternatively for datastructure.
This ticket requires the changes only for SDMX-CSV. If this impacts SDMX-JSON, due to the need for 2 datasets, then another DE ticket needs to be created to take the impact into account!
The content of such an SDMX-CSV would look like this:
STRUCTURE,STRUCTURE_ID,ACTION,DIM_1,DIM_2,DIM_3,MD_ATTR
datastructure,{agencyID}:{DSD_ID}({version}),R,A,B,2014,"en:""A DSD-specific Value"",fr:""Une valeur spécifique pour le DSD"""
dataflow,{agencyID}:{DF_ID}({version}),R,A,B,2014,"en:""A DF-specific Value"",fr:""Une valeur spécifique pour le DF"""
Example
Reusing test data from Postman test ('referential-metadata-DF-DSD-levels'):
- structures: OECD.SDD.SDPS_DF_TEST_REF_METADATA_1_1.0_-_structures.xml
- data: OECD.SDD.SDPS-DF_TEST_REF_METADATA_1-1.0-data.csv
- ref. metadata at DSD level: OECD.SDD.SDPS-DSD_TEST_REF_METADATA-1.0-DSD%20Level%20Metadata.csv
- ref. metadata at DF level: OECD.SDD.SDPS-DF_TEST_REF_METADATA_1-1.0-metadata.csv
Expected output:
STRUCTURE,STRUCTURE_ID,ACTION,DIM_1,DIM_2,TIME_PERIOD,MD_ATTR_1,MD_ATTR_2
DATASTRUCTURE,OECD.SDD.SDPS:DSD_TEST_REF_METADATA(1.0),I,~,~,~,"en:""Ref metadata at DSD level"",fr:""Ref metadata au niveau DSD""",
DATAFLOW,OECD.SDD.SDPS:DF_TEST_REF_METADATA_1(1.0),I,~,~,~,"en:""High-level ref metadata referenced by dataflow 1"",fr:""Ref metadata haut-niveau référencé par le dataflow 1""",
DATAFLOW,OECD.SDD.SDPS:DF_TEST_REF_METADATA_1(1.0),I,A,A,~,,"en:""Ref metadata For dataflow 1"",fr:""Ref metadata pour le dataflow 1"""
DATAFLOW,OECD.SDD.SDPS:DF_TEST_REF_METADATA_1(1.0),I,A,B,~,,"en:""Ref metadata For dataflow 1 again"",fr:""Ref metadata pour le dataflow 1 encore"""
Note: It would be good to enhance the Postman tests to include also other higher-level metadata related to the DSD (in addition to current only top-level).