SP-4214 ska low calculator speedup
Hi team Button,
This is a MR from https://gitlab.com/ska-telescope/ost/ska-ost-senscalc/-/issues, which I will close shortly. JIRA ticket is https://jira.skatelescope.org/browse/SP-4214.
Briefly, @sarrvesh.ss reported that the execution speed of SEFDTable
was a bottleneck for the sensitivity calculator. I had a look at the code, and noted it was using a sqlite database where a numpy-style array could be used instead. So I wrote a script to convert the database into a HDF5 file, and then refactored SEFDTable
to use the HDF5 code instead.
My code changes are in this snippet:
https://gitlab.com/-/snippets/3702267
The HDF5 file can be created with the convert_AAVS2_db_to_hdf5.py
script, or can be downloaded from here:
https://www.dropbox.com/s/80ba1iommbsjfmn/ska_station_sensitivity_AAVS2.h5?dl=0
Advantages:
- Smaller database: 894.7 MB -> 36.8 MB
- Faster runtime: Orders of magnitude faster
🚀 - Bug fix / improved behaviour for multiple LST steps
Thanks!
Danny