SSH connection refused with the alpine 3.19 builder-image

Issue Description

Dropbear (same for sshd) does not accept connections when building with env DEFAULT_DROPBEAR_ENABLED=true on branch 3.19 for aarch64 and raspberry pi zero w 2.
Not tested on different architecture. I tried replacing dropbear with sshd from package openssh with same result.

Steps to reproduce

1. Clone and checkout branch 3.19
2. Build image with docker build -t builder .
3. Create empty build directory somewhere and cd into it.
4. Enable and configure wifi with input script according to input/stages/60/06-wifi.sh
5. Create output directory
6. Create test.env with content

   DEFAULT_KERNEL_MODULES=*
   DEFAULT_DROPBEAR_ENABLED=true
   ARCH=aarch64
   RPI_FIRMWARE_BRANCH=alpine
   ALPINE_BRANCH=v3.19

7. Build with docker run --rm -it -v $PWD/output:/output -v $PWD/input:/input --env-file test.env localhost/builder
8. Extract output/sdcard.img.gz and flash image to SD-card.
9. Boot RPi with flashed SD-card.
10. Try to connect with ssh root@<IP-ADDRESS> and get response ssh: connect to host <IP-ADDRESS> port 22: Connection refused