Nomad ghost job

Hi,

I’m running a nomad 0.11.0 and consul 1.7.2 cluster. I have issues with an old job that I can’t completely remove.

  • nomad job doesn’t show up in nomad ui
  • associated services are visible in consul ui
  • services removed with consul services deregister -id=.. are restarted
  • docker container associated with old nomad job is automatically restarted if manually stopped.
  • If I issue the nomad job again, the docker part of the job is shown as failing in nomad ui.

I would greatly appreciate help with troubleshooting this strange situation.