SVT-AV1 2.3.0 and newer fail to build with SVE

Trying to build SVT-AV1 2.3.0 and newer (3.0.2) with SVE support it fails to build with Clang.

LLVM ERROR: Invalid size request on a scalable vector.

I tried with Clang 16 (system compiler), 18, and 19 and they all fail in the same manner.