Mark aarch64 jobs optional

Our aarch64 runners have been quite flaky recently, and with the large number of jobs, we are seeing the transient errors quite often. This MR aims to minimize the fallout from that so that we don't affect all the other x86_64 jobs.