Packer tries to connect over ssh and gives up

Inspired by this thread Packer connecting to Ubuntu "too early", how to enforce a delay? I was able to make it work by stopping the ssh service altogether through early-commands in autoinstall:

early-commands:
  systemctl stop ssh