attachments_to_file command consume too much memory
Hello,
The "mailman-aweb attachments_to_file" command consumes too much memory to be used on a standard server or instance.
For 4Go of attachments in database mailman3web, the script consumes 8.5Go of RAM.
For 12Go of attachments in database mailman3web, the script consumes 13Go of RAM. The database contains around 110,000 files.
MiB Mem: 32103.4 total, 17250.0 free, 13396.9 used, 1854.9 buff/cache
I had to use a 8 cores / 32G to run it successfully. And 45 minutes.
Do we have a way to have a script using less memory or which would not be dependent on the number of files.
Sincerely,
System:
Debian bullseye
ii mailman3 3.3.3-1 all Mailing list management system
ii mailman3-doc 3.3.3-1 all Mailing list management system documentation
ii mailman3-full 3.3.3-1 all Full Mailman3 mailing list management suite (metapackage)
ii mailman3-web 0+20200530-2 all Django project integrating Mailman3 Postorius and HyperKitty
ii python3-django-mailman3 1.3.5-2 all Django library to help interaction with Mailman3 (Python 3 version)
ii python3-mailman-hyperkitty 1.1.0-10 all Mailman3 plugin to archive emails with HyperKitty
ii python3-mailmanclient 3.3.2-1 all Python bindings for Mailman3 REST API (Python 3 version)
ii python3-django-hyperkitty 1.3.4-4 all Web user interface to access GNU Mailman3 archives
ii python3-mailman-hyperkitty 1.1.0-10 all Mailman3 plugin to archive emails with HyperKitty
Edited by stefaweb