VM can't connect to http server for kickstart script

I am deploying to proxmox with proxmox-iso and my kickstart script works when I put it on a public code sharing platform like gist and use that but not with my local. The machine that I am running packer on is windows 11.

  boot_command = [
    "<tab> inst.text inst.ks=http://{{ .HTTPIP }}:{{ .HTTPPort }}/ks.cfg<enter>"
  http_directory = "http"


It looks like {{ .HTTPIP }} is the wrong ip, I checked with the ip address assigned by my router and it works using that ip.