Issue when uploading CSV files with French separators
When uploading SDMX-CSV 1.0 or 2.0 files with French separators (column: ;
, decimal: ,
) then the transfer returns the following error: The format of value '1585,754' at observation 1 (for CSV file imports located at row 2) is not valid Double. Correct the value and re-submit the request.
Example
- structures: OECD-DF_JENS-1.1-all.xml
- SDMX-CSV V1: OECD_DF_JENS_1.1_small_french_separators.csv
- SDMX-CSV V2: OECD_DF_JENS_1.1_small_V2_french_separators.csv
Technical details
The transfer can identify the column separator by checking the first character in the first line:
- in V1 after the starting
DATAFLOW
- in V2 after the starting
STRUCTURE
orSTRUCTURE[x]
PS. How could the transfer know the decimal separator? By checking the character used in the first available value for a numeric-type component? If that is too complicated should we repurpose the x
character in STRUCTURE[x]
that was originally foreseen in SDMX as "sub-field separator"? In this case, we would need to ask to change the standard.
Wrong previous test files:
- OECD_DF_JENS_1.1_small_french_separators.csv - OECD_DF_JENS_1.1_small_V2_french_separators.csvEdited by Jens Dossé