Change primary key from PERIOD_SDMX to PERIOD_START and PERIOD_END
Change the database model to modify the series identifier (database primary key) from PERIOD_SDMX to PERIOD_START and PERIOD_END. This will improve performance for data filtering on time dimension.
-
Change the Primary key of the FACT_{DSD ID}_{A/B}
from using the columns[SID],[PERIOD_SDMX]
to[SID],[PERIOD_START],[PERIOD_END]
-
Create SQL migration scripts for existing users. When duplicated rows (based on the time format), are found, store the error in the log table, to notify the system administrator, that the DSD should be re-created.
-
-
Modify the full validation logic of the transfer service to deny imports when there are duplicate observations using the same series with different time format. COUNTRY:AUS,SUBJECT:X,FREQ:Q,TIME_PERIOD:2000-Q1
is the same coordinate asCOUNTRY:AUS,SUBJECT:X,FREQ:Q,TIME_PERIOD:2000-Q01
, it should be detected as a duplicate row during the import/validation process. -
Data imports should be able to update the value of the PERIOD_SDMX
to allow the users to harmonize the time format.-
Change the SQL merge statement to use the PERIOD_START
&PERIOD_END
as row identifiers. -
Change the SQL merge statement to enagle the update of the PERIOD_SDMX
value.
-
Edited by Pedro Carranza