Just doublechecked the sequence: get 430 error -> sleep/idle -> try to connect to backup server -> download or get another error on backup -> connect to primary and repeat. I also tried it without Astra, but that did not change anything.
If I connect to both servers with different threads without setting one of those as backup to the other, it works fine (move on to next part immediately and retry according to settings).