Table performance test and repair
Run a test of performance of the DE table between the table version from Release .Stat Suite JS 11.0.0 and the current version.
Compare results with the latest outcomes:
Table content & layout | JS 10.0.0 | JS 11.0.0 | Diff. |
---|---|---|---|
250 observations | 468 ms | ~200 ms | - 260 ms |
2,500 observations | 4207 ms | ~100 ms | - 4,1 s |
240 observations - No column | 751 ms | ~400 ms | - 350 ms |
2,500 observations - No column | 5499 ms | ~2500 ms | - 3 s |
2,500 observations - 3 Columns | 4860 ms | ~1500 ms | - 3,3 s |
2,500 observations - 1 Row section - 1 Row | 4747 ms | ~2300 ms | - 2,4 s |
2,500 observations - 3 Row sections - 1 Row | 15498 ms | ~4000 ms | - 11,5 s |
--> Repair the performance decrease.
Test example
I can see a huge performance decrease when visualising the same table in staging and qa (using the MAX_TABLE_DATA = 10000 annotation, but not always reaching this limit).
Default view, 4878 observations
Staging (around 5 seconds): https://de-demo-oecd.siscc.org/vis?lc=en&df[ds]=OECD-staging&df[id]=FDI_DSD%40FDI_POS_CTRY&df[ag]=OECD.DAF.INV&df[vs]=1.0&av=true&pd=2020%2C&dq=DNK.LE_FA_F.USD_EXC.......IMC..A&ly[rw]=COUNTERPART_AREA&ly[cl]=MEASURE_PRINCIPLE%2CTYPE_ENTITY%2CACCOUNTING_ENTRY&vw=tb
Extended view, 21 951 observations with 10 000 limit applied
Staging (around 15 seconds) https://de-demo-oecd.siscc.org/vis?lc=en&df[ds]=OECD-staging&df[id]=FDI_DSD%40FDI_POS_CTRY&df[ag]=OECD.DAF.INV&df[vs]=1.0&av=true&pd=2020%2C&dq=DNK..USD_EXC.........A&vw=tb&ly[rw]=COUNTERPART_AREA&ly[cl]=MEASURE_PRINCIPLE%2CMEASURE%2CTYPE_ENTITY%2CACCOUNTING_ENTRY
QA (a bit less than 2 minutes): https://de-qa.siscc.org/vis?lc=en&df[ds]=OECD-staging&df[id]=FDI_DSD%40FDI_POS_CTRY&df[ag]=OECD.DAF.INV&df[vs]=1.0&av=true&pd=2020%2C&dq=DNK..USD_EXC.........A&vw=tb&ly[rw]=COUNTERPART_AREA&ly[cl]=MEASURE_PRINCIPLE%2CMEASURE%2CTYPE_ENTITY%2CACCOUNTING_ENTRY