gsutil shows warning during <ENV>-assets job
Problem Statement
We are provided a warning that we are not using the full potential of gsutil rsync
:
WARNING: gsutil rsync uses hashes when modification time is not available at both the source and destination. Your crcmod installation isn't using the module's C extension, so checksumming will run very slowly. If this is your first rsync since updating gsutil, this rsync can take significantly longer than usual. For help installing the extension, please see "gsutil help crcmod".
Solution
-
Determine if modification time
is set on the files where we've created the assets and where our assets live in object storage
If we're missing it, then we should be able to see some improvements. Similar to gitlab-org/gitlab-build-images!315 (merged)
If we aren't missing it, then this is probably a warning that we can ignore.