Skip to content

Draft: feat(db-logs): added new db logs

Josep Maria Viñolas Auquer requested to merge db-logs into main
  • Prior to merging this, the backups should be updated so there is a dump of db-logs and a borg of that folder.

TESTS TO BE DONE:

  • New installation
  • Migrate from existing installation
  • Migrate from existing installation with thousands of entries in logs_desktops/logs_users and checking while doing the upgrade times, cpu and in special the memory consumption increase. The memory is critical in this test as here and here everything in both tables will be loaded in ram and then inserted in new database. If problems arise, we will need to do a migration with blocks of data and a progress to inform the user...

TODO:

  • New isard-db-logs database
  • Update isardvdi.cfg.example with new connection and add variables to api.yml. Not added to engine.yml, just waiting for new environment yml refactor MR.
  • Add new populate and upgrade (and fix old one's) to create new tables and migrate old one's
  • Add new Flask app.context rethinkdb class to be used with with app.app_context block.
  • Move queries in logs_desktops insert/update to new database
  • Move queries in logs_users insert/update to new database
  • Move queries in analytics to new database for logs_users and logs_desktops
  • Review if being used in other code and update
  • Add connection to tasks feedback (if needed)
Edited by Josep Maria Viñolas Auquer

Merge request reports