Skip to content

SP-4214 ska low calculator speedup

Danny Price requested to merge sp-4214-ska-low-calculator-speedup into master

Hi team Button,

This is a MR from https://gitlab.com/ska-telescope/ost/ska-ost-senscalc/-/issues, which I will close shortly. JIRA ticket is https://jira.skatelescope.org/browse/SP-4214.

Briefly, @sarrvesh.ss reported that the execution speed of SEFDTable was a bottleneck for the sensitivity calculator. I had a look at the code, and noted it was using a sqlite database where a numpy-style array could be used instead. So I wrote a script to convert the database into a HDF5 file, and then refactored SEFDTable to use the HDF5 code instead.

My code changes are in this snippet:

https://gitlab.com/-/snippets/3702267

The HDF5 file can be created with the convert_AAVS2_db_to_hdf5.py script, or can be downloaded from here:

https://www.dropbox.com/s/80ba1iommbsjfmn/ska_station_sensitivity_AAVS2.h5?dl=0

Advantages:

  • Smaller database: 894.7 MB -> 36.8 MB
  • Faster runtime: Orders of magnitude faster 🚀
  • Bug fix / improved behaviour for multiple LST steps

Thanks!

Danny

Edited by Danny Price

Merge request reports