One (freq-related) metadata too much for X-Level-upperOnly - SDMXRI-1832 - NSI WS 8.11.0
When using query https://nsi-qa-stable.siscc.org/rest/V2/data/dataflow/TN1/MILLED_RICE/1.0/ASIKHM..?attributes=msd&measures=none
with Accept=application/vnd.sdmx.data+csv;version=2.0;urn=true
and X-Level=upperOnly
I'm getting these 3 metadata:
STRUCTURE,STRUCTURE_ID,REF_AREA,UNIT_MEASURE,FREQ,TIME_PERIOD,HTML,STRING,BOOLEAN,DATETIME
DATAFLOW,TN1:MILLED_RICE(1.0),,,,,"en: ""test dataflow-level ok"",fr: ""test dataflow-level parfait""","en: ""only English""",FALSE,2022-02-07T17:45:30Z
DATAFLOW,TN1:MILLED_RICE(1.0),ASIKHM,,,,"en: ""test \""ASIKHM,,,\"" ok"",fr: ""test \""ASIKHM,,,\"" parfait""",,TRUE,2022-02-07T17:45:30Z
DATAFLOW,TN1:MILLED_RICE(1.0),ASIKHM,,A,,"en: ""test \""ASIKHM,,A,\"" ok"",fr: ""test \""ASIKHM,,A,\"" parfait""","en: ""only English""",False,2022-02-07T17:45:30Z
The last metadata attachment (ASIKHM,,A,
) should not have been returned.
Here are the related files (to be loaded in this order):
- metadata structures: TN1-MSD_MILLED_RICE-1.0-all.xml
- data structures: TN1-MILLED_RICE-1.0-all_structures.xml
- data: TN1_MILLED_RICE_1.0_-_with_additional_and_non_ordered_column.csv
- ref metadata: TN1_MILLED_RICE_1.0-metadata.csv
Second example that should also be solved and tested with this ticket:
Example files:
- metadata structures: OECD-MSD_TEST-1.0-all_1_.xml
- data structures: OECD-DF_KEI-1.0-all_2_.xml,
- data: OECD_DF_KEI_1.0-datetime-period_data_2_.csv
- ref metadata: OECD_DF_KEI_1.0-datetime-period_metadata_1_.csv
- current qa:stable DE view: https://de-qa.siscc.org/vis?lc=en&df[ds]=qa%3Astable&df[id]=DF_KEI&df[ag]=OECD&df[vs]=1.0&av=true&pd=2006%2C&dq=...A
Actions:
- upload structures with MSD, DSD with MSD link and with
SUPPORT_DATETIME
annotation - upload data for an observation with hour, minute, second, milli-second
- upload 2 referential metadata (dataflow-level and time_period-attachment)
- check that the query https://nsi-qa-stable.siscc.org/rest/V2/data/dataflow/OECD/DF_KEI/1.0/B6BLTT02.ARG.ST.A?attributes=msd&measures=none still works and returns the uploaded 2 upper-level ref metadata.
- using the dataflow-level query https://nsi-qa-stable.siscc.org/rest/V2/data/dataflow/OECD/DF_KEI/1.0/...?attributes=msd&measures=none with
Accept=application/vnd.sdmx.data+csv;version=2.0;urn=true
andX-Level=upperOnly
check that only the first ref metadata value is returned and not both as currently:
STRUCTURE,STRUCTURE_ID,SUBJECT,LOCATION,MEASURE,FREQUENCY,TIME_PERIOD,STRING_TYPE,STRING_MULTILANG_TYPE,ALPHANUMERIC_TYPE,ALPHANUMERIC_MULTILANG_TYPE,BOOLEAN_TYPE,XHTML_TYPE,XHTML_MULTILANG_TYPE,INTEGER_TYPE,INTEGER_MULTILANG_TYPE,DECIMAL_TYPE,DECIMAL_MULTILANG_TYPE,DATETIME_TYPE,TIME_TYPE,GREGORIANDAY_TYPE,GREGORIAN_YEAR_TYPE,GREGORIAN_YEARMONTH_TYPE,CONTACT.CONTACT_NAME,CONTACT.CONTACT_EMAIL,CONTACT.CONTACT_PHONE,CONTACT.CONTACT_ORGANISATION
DATAFLOW,OECD:DF_KEI(1.0),,,,,,,,,,,,,,,,,,,,,,Jens,jens@oecd.org,,OECD
DATAFLOW,OECD:DF_KEI(1.0),,,,,2006-03-26T21:15:20.1000,,,,,,,,,,,,,,,,,Jens 2006-03-26T21:15:20.1000,jens@oecd.org 2006-03-26T21:15:20.1000,,OECD 2006-03-26T21:15:20.1000
The last metadata attachment (,,,,2006-03-26T21:15:20.1000
) should not be returned.
Edited by Jens Dossé