Server crashes with big models
I installed the Transcription plugin (tested in 1.7.2 1.8 1.8.1) on a Peertube 4.2.2. If I use a basic model like vosk-model-small-fr-pguyot-0.3 everything is fine but with heavier models like vosk-model-fr-0.22 or vosk-model-fr-0.6-linto the server crashes when starting a video transcription. The logs show that the model files are not present:
oct. 14 10:24:12 kimsufi peertube[486697]: [peertube.caylat.fr:443 peertube-plugin-transcription] 2022-10-14 10:24:12.911 info: Created mark 29499-started.
oct. 14 10:24:12 kimsufi peertube[486697]: [Worker n°3] 2022-10-14 10:24:12.942 info: Processing transcription request for video "ffc38140-4069-454a-a227-eba64bb49a2e" in "fr".
oct. 14 10:24:12 kimsufi peertube[486697]: [Worker n°3] 2022-10-14 10:24:12.988 info: From /var/www/peertube/storage/streaming-playlists/hls/ffc38140-4069-454a-a227-eba64bb49a2e/e46d1131-f117-4d3c-be66-865cb722e13b-480-fragmented.mp4 to /var/www/peertube
/storage/plugins/data/peertube-plugin-transcription/captions/ffc38140-4069-454a-a227-eba64bb49a2e-fr.vtt
oct. 14 10:24:13 kimsufi peertube[486697]: ERROR (VoskAPI:Model():model.cc:122) Folder '/var/www/peertube/storage/plugins/data/peertube-plugin-transcription/models/fr' does not contain model files. Make sure you specified the model path properly in Model
constructor. If you are not sure about relative path, use absolute path specification.
oct. 14 10:24:13 kimsufi systemd[1]: peertube.service: Main process exited, code=killed, status=11/SEGV
oct. 14 10:24:13 kimsufi systemd[1]: peertube.service: Failed with result 'signal'.
oct. 14 10:24:13 kimsufi systemd[1]: peertube.service: Consumed 1min 12.672s CPU time.
oct. 14 10:24:13 kimsufi systemd[1]: peertube.service: Scheduled restart job, restart counter is at 5.
oct. 14 10:24:13 kimsufi systemd[1]: Stopped PeerTube daemon.
Looking at the /storage/plugins/data/peertube-plugin-transcription/models folder during installation, I can see the model files loading into a folder with the same name as the model. Then, this template folder is renamed to fr. The files are indeed present in the fr folder but a few minutes later, they disappear...
During installation :
# ls storage/plugins/data/peertube-plugin-transcription/models/fr
am conf graph ivector README rescore rnnlm
After :
# ls storage/plugins/data/peertube-plugin-transcription/models/fr
conf ivector
For a model that displays 1.5GB in the plugin interface, I see that the folder occupancy rises to 2.3GB before the files are deleted.
An idea ?