Possibly, Vagrant or Packer running from WSL try to connect to 127.0.0.1 which is WSL IP and not Windows host running VirtualBox, see Windows11 Host + WSL + ansible to provision Windows Server/Client - #2 by mloskot
Possibly, Vagrant or Packer running from WSL try to connect to 127.0.0.1 which is WSL IP and not Windows host running VirtualBox, see Windows11 Host + WSL + ansible to provision Windows Server/Client - #2 by mloskot