Unable to update image rootfs
For a kernel built like this:
tuxmake \
--runtime podman \
--target-arch riscv \
--toolchain gcc-8 \
--kconfig defconfig \
--kconfig-add make:kselftest-merge \
--kconfig-add CONFIG_DEBUG_INFO_BTF=n \
debugkernel headers kernel kselftest modules
and then trying to run this test:
tuxrun \
--runtime podman \
--device qemu-riscv64 \
--boot-args rw \
--tuxmake /home/ddiaz/.cache/tuxmake/builds/1 \
--parameters KSELFTEST=/home/ddiaz/.cache/tuxmake/builds/1/kselftest.tar.xz
the following failure can be seen:
2023-07-18T19:06:48 lava-dispatcher, installed at version: 2023.06
2023-07-18T19:06:48 start: 0 validate
2023-07-18T19:06:48 Start time: 2023-07-18 19:06:48.518017+00:00 (UTC)
2023-07-18T19:06:48 Validating that file:///home/ddiaz/.cache/tuxmake/builds/1/Image.gz exists
2023-07-18T19:06:48 Validating that file:///home/ddiaz/.cache/tuxrun/assets/https___storage.tuxboot.com_buildroot_riscv64_rootfs.ext4.zst exists
2023-07-18T19:06:48 Validating that file:///home/ddiaz/.cache/tuxmake/builds/1/modules.tar.xz exists
2023-07-18T19:06:48 qemu, installed at version: 7.2.2, host architecture: x86_64
2023-07-18T19:06:48 Missing image arg for rootfs.modules
2023-07-18T19:06:48 validate duration: 0.10
2023-07-18T19:06:48 {'case': 'validate', 'definition': 'lava', 'result': 'pass'}
2023-07-18T19:06:48 start: 1 deployimages (timeout 00:05:00) [common]
2023-07-18T19:06:48 start: 1.1 download-retry (timeout 00:05:00) [common]
2023-07-18T19:06:48 start: 1.1.1 file-download (timeout 00:05:00) [common]
2023-07-18T19:06:48 downloading file:///home/ddiaz/.cache/tuxmake/builds/1/Image.gz
2023-07-18T19:06:48 saving as /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/kernel/Image
2023-07-18T19:06:48 total size: 10127177 (9 MB)
2023-07-18T19:06:48 Using gunzip to decompress gz
2023-07-18T19:06:48 progress 0 % (0 MB)
2023-07-18T19:06:48 progress 5 % (0 MB)
2023-07-18T19:06:48 progress 10 % (0 MB)
2023-07-18T19:06:48 progress 15 % (1 MB)
2023-07-18T19:06:48 progress 20 % (1 MB)
2023-07-18T19:06:48 progress 25 % (2 MB)
2023-07-18T19:06:48 progress 30 % (2 MB)
2023-07-18T19:06:48 progress 35 % (3 MB)
2023-07-18T19:06:48 progress 40 % (3 MB)
2023-07-18T19:06:48 progress 45 % (4 MB)
2023-07-18T19:06:48 progress 50 % (4 MB)
2023-07-18T19:06:48 progress 55 % (5 MB)
2023-07-18T19:06:48 progress 60 % (5 MB)
2023-07-18T19:06:48 progress 65 % (6 MB)
2023-07-18T19:06:48 progress 70 % (6 MB)
2023-07-18T19:06:48 progress 75 % (7 MB)
2023-07-18T19:06:48 progress 80 % (7 MB)
2023-07-18T19:06:48 progress 85 % (8 MB)
2023-07-18T19:06:48 progress 90 % (8 MB)
2023-07-18T19:06:48 progress 95 % (9 MB)
2023-07-18T19:06:48 progress 100 % (9 MB)
2023-07-18T19:06:48 9 MB downloaded in 0.16 s (59.16 MB/s)
2023-07-18T19:06:48 end: 1.1.1 file-download (duration 00:00:00) [common]
2023-07-18T19:06:48 {'case': 'file-download', 'definition': 'lava', 'duration': '0.16', 'extra': {'label': 'kernel', 'md5sum': 'eea1d451a402daca32c9c12c29556fb4', 'sha256sum': '89ff78e43a3d115c592ff00a7083b8eadfc734f0d5402c05fbcb2e3f0869c0a2', 'sha512sum': '0e0a2d47ef8c1e0bc208cdb63bb3fc4b08df658a44a9aac4bf6e32bdc2015e5d865461ed59fdec4b56ea94d2283e4747d8d3931c49155b675435a6a6d2a0d9ab', 'size': 10127177}, 'level': '1.1.1', 'namespace': 'common', 'result': 'pass'}
2023-07-18T19:06:48 end: 1.1 download-retry (duration 00:00:00) [common]
2023-07-18T19:06:48 start: 1.2 download-retry (timeout 00:05:00) [common]
2023-07-18T19:06:48 start: 1.2.1 file-download (timeout 00:05:00) [common]
2023-07-18T19:06:48 downloading file:///home/ddiaz/.cache/tuxrun/assets/https___storage.tuxboot.com_buildroot_riscv64_rootfs.ext4.zst
2023-07-18T19:06:48 saving as /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/rootfs/https___storage.tuxboot.com_buildroot_riscv64_rootfs.ext4
2023-07-18T19:06:48 total size: 59861853 (57 MB)
2023-07-18T19:06:48 Using unzstd to decompress zstd
2023-07-18T19:06:48 progress 0 % (0 MB)
2023-07-18T19:06:48 progress 5 % (2 MB)
2023-07-18T19:06:48 progress 10 % (5 MB)
2023-07-18T19:06:48 progress 15 % (8 MB)
2023-07-18T19:06:48 progress 20 % (11 MB)
2023-07-18T19:06:48 progress 25 % (14 MB)
2023-07-18T19:06:48 progress 30 % (17 MB)
2023-07-18T19:06:48 progress 35 % (20 MB)
2023-07-18T19:06:48 progress 40 % (22 MB)
2023-07-18T19:06:48 progress 45 % (25 MB)
2023-07-18T19:06:48 progress 50 % (28 MB)
2023-07-18T19:06:48 progress 55 % (31 MB)
2023-07-18T19:06:48 progress 60 % (34 MB)
2023-07-18T19:06:49 progress 65 % (37 MB)
2023-07-18T19:06:49 progress 70 % (39 MB)
2023-07-18T19:06:49 progress 75 % (42 MB)
2023-07-18T19:06:49 progress 80 % (45 MB)
2023-07-18T19:06:49 progress 85 % (48 MB)
2023-07-18T19:06:49 progress 90 % (51 MB)
2023-07-18T19:06:49 progress 95 % (54 MB)
2023-07-18T19:06:49 progress 100 % (57 MB)
2023-07-18T19:06:49 57 MB downloaded in 0.53 s (107.03 MB/s)
2023-07-18T19:06:49 end: 1.2.1 file-download (duration 00:00:01) [common]
2023-07-18T19:06:49 {'case': 'file-download', 'definition': 'lava', 'duration': '0.53', 'extra': {'label': 'rootfs', 'md5sum': '60f8113160e6ab8b361010d6539d016d', 'sha256sum': '200edbf8308ae51c819cbecd0ccf59201741e11412d2f5ca85114c264a545533', 'sha512sum': '71e180ae3a1524d3328f32e4dda225aee725877d784342cd20fd31c6248a87ea56ae1dfa68e2198469b4e5ab31454fb2285f06bd45cc4c18c20637e5a71466ff', 'size': 59861853}, 'level': '1.2.1', 'namespace': 'common', 'result': 'pass'}
2023-07-18T19:06:49 start: 1.2.2 download-retry (timeout 00:04:59) [common]
2023-07-18T19:06:49 start: 1.2.2.1 file-download (timeout 00:04:59) [common]
2023-07-18T19:06:49 downloading file:///home/ddiaz/.cache/tuxmake/builds/1/modules.tar.xz
2023-07-18T19:06:49 saving as /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/rootfs.modules/modules.tar
2023-07-18T19:06:49 total size: 12592112 (12 MB)
2023-07-18T19:06:49 Using unxz to decompress xz
2023-07-18T19:06:49 progress 0 % (0 MB)
2023-07-18T19:06:49 progress 5 % (0 MB)
2023-07-18T19:06:49 progress 10 % (1 MB)
2023-07-18T19:06:49 progress 15 % (1 MB)
2023-07-18T19:06:49 progress 20 % (2 MB)
2023-07-18T19:06:49 progress 25 % (3 MB)
2023-07-18T19:06:49 progress 30 % (3 MB)
2023-07-18T19:06:49 progress 35 % (4 MB)
2023-07-18T19:06:49 progress 40 % (4 MB)
2023-07-18T19:06:49 progress 45 % (5 MB)
2023-07-18T19:06:49 progress 50 % (6 MB)
2023-07-18T19:06:49 progress 55 % (6 MB)
2023-07-18T19:06:49 progress 60 % (7 MB)
2023-07-18T19:06:49 progress 65 % (7 MB)
2023-07-18T19:06:49 progress 70 % (8 MB)
2023-07-18T19:06:49 progress 75 % (9 MB)
2023-07-18T19:06:49 progress 80 % (9 MB)
2023-07-18T19:06:49 progress 85 % (10 MB)
2023-07-18T19:06:49 progress 90 % (10 MB)
2023-07-18T19:06:49 progress 95 % (11 MB)
2023-07-18T19:06:49 progress 100 % (12 MB)
2023-07-18T19:06:49 12 MB downloaded in 0.68 s (17.74 MB/s)
2023-07-18T19:06:49 end: 1.2.2.1 file-download (duration 00:00:01) [common]
2023-07-18T19:06:49 {'case': 'file-download', 'definition': 'lava', 'duration': '0.68', 'extra': {'label': 'rootfs.modules', 'md5sum': '0ac3be7a0bc02d881c34ad78802f6acf', 'sha256sum': 'cb719a44fe7650ebcdf02e2dd7e22e438b37f45dcf477273087b66cd3cd920f6', 'sha512sum': 'aa27176ba5b8908731198a2d1d79c059813ef684087542a0f7f3cc29653d3c1d8203891def0daf964101e4ac1d47a9419b7950fea031654d35deb03759aee600', 'size': 12592112}, 'level': '1.2.2.1', 'namespace': 'common', 'result': 'pass'}
2023-07-18T19:06:49 end: 1.2.2 download-retry (duration 00:00:01) [common]
2023-07-18T19:06:49 start: 1.2.3 append-overlays (timeout 00:04:59) [common]
2023-07-18T19:06:49 Modifying '/var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/rootfs/https___storage.tuxboot.com_buildroot_riscv64_rootfs.ext4'
2023-07-18T19:06:50 /usr/bin/supermin exited with error status 1.
To see full error messages you may need to enable debugging.
Do:
export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1
and run the command again. For further information, read:
http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs
You can also run 'libguestfs-test-tool' and post the *complete* output
into a bug report or message to the libguestfs mailing list.
2023-07-18T19:06:50 Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\nTo see full error messages you may need to enable debugging.\nDo:\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again. For further information, read:\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list."
2023-07-18T19:06:50 end: 1.2.3 append-overlays (duration 00:00:00) [common]
2023-07-18T19:06:50 {'case': 'append-overlays', 'definition': 'lava', 'duration': '0.11', 'extra': {'fail': 'Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\\nTo see full error messages you may need to enable debugging.\\nDo:\\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\\nand run the command again. For further information, read:\\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\nYou can also run \'libguestfs-test-tool\' and post the *complete* output\\ninto a bug report or message to the libguestfs mailing list."'}, 'level': '1.2.3', 'namespace': 'common', 'result': 'fail'}
2023-07-18T19:06:50 download-retry failed: 1 of 1 attempts. 'Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\nTo see full error messages you may need to enable debugging.\nDo:\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again. For further information, read:\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list."'
2023-07-18T19:06:50 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/rootfs
2023-07-18T19:06:50 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/rootfs.modules
2023-07-18T19:06:50 Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\nTo see full error messages you may need to enable debugging.\nDo:\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again. For further information, read:\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list."
2023-07-18T19:06:50 end: 1.2 download-retry (duration 00:00:01) [common]
2023-07-18T19:06:50 {'case': 'download-retry', 'definition': 'lava', 'duration': '1.41', 'extra': {'fail': 'Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\\nTo see full error messages you may need to enable debugging.\\nDo:\\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\\nand run the command again. For further information, read:\\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\nYou can also run \'libguestfs-test-tool\' and post the *complete* output\\ninto a bug report or message to the libguestfs mailing list."'}, 'level': '1.2', 'namespace': 'common', 'result': 'fail'}
2023-07-18T19:06:50 Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\nTo see full error messages you may need to enable debugging.\nDo:\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again. For further information, read:\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list."
2023-07-18T19:06:50 end: 1 deployimages (duration 00:00:02) [common]
2023-07-18T19:06:50 {'case': 'deployimages', 'definition': 'lava', 'duration': '1.57', 'extra': {'fail': 'Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\\nTo see full error messages you may need to enable debugging.\\nDo:\\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\\nand run the command again. For further information, read:\\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\nYou can also run \'libguestfs-test-tool\' and post the *complete* output\\ninto a bug report or message to the libguestfs mailing list."'}, 'level': '1', 'namespace': 'common', 'result': 'fail'}
2023-07-18T19:06:50 Cleaning after the job
2023-07-18T19:06:50 Cleaning up download directory: /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1/deployimages-0pfajnpa/kernel
2023-07-18T19:06:50 start: 3.1 power-off (timeout 00:00:30) [common]
2023-07-18T19:06:50 end: 3.1 power-off (duration 00:00:00) [common]
2023-07-18T19:06:50 start: 3.2 read-feedback (timeout 00:05:00) [common]
2023-07-18T19:06:50 No connection for namespace common
2023-07-18T19:06:50 end: 3.2 read-feedback (duration 00:00:00) [common]
2023-07-18T19:06:50 Root tmp directory removed at /var/lib/lava/dispatcher/tmp/tuxrun-v8h8xb3m-1
2023-07-18T19:06:50 JobError: Your job cannot terminate cleanly.
2023-07-18T19:06:50 {'case': 'job', 'definition': 'lava', 'error_msg': 'Unable to update image rootfs: "/usr/bin/supermin exited with error status 1.\\nTo see full error messages you may need to enable debugging.\\nDo:\\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\\nand run the command again. For further information, read:\\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\\nYou can also run \'libguestfs-test-tool\' and post the *complete* output\\ninto a bug report or message to the libguestfs mailing list."', 'error_type': 'Job', 'result': 'fail'}
I shared this with Anders and it worked for him.
This is with latest Tuxmake (1.14.0) and latest Tuxrun (0.45.0) available. Host kernel is 5.15.0.76-lowlatency from Ubuntu 22.04.