Hello,
I’m encountering an issue when deploying new jobs to a brand new cluster. Is there a way to find out why it is failing to register the job?
Thanks!
Vince-
$nomad version
Nomad v1.0.0-beta3 (fcb32ef7ba037b2b83e7a0fd1c53c7410a2990db)
$nomad run job.hcl
==> Monitoring evaluation "3f2b710c"
Evaluation triggered by job "activemq3"
Evaluation within deployment: "e8319163"
Evaluation status changed: "pending" -> "failed"
==> Evaluation "3f2b710c" finished with status "failed"
$nomad eval-status -verbose -json 3f2b710c
{
"AnnotatePlan": false,
"BlockedEval": "433ef4ce-4387-0b2b-1fd3-752e7256906b",
"ClassEligibility": null,
"CreateIndex": 28541,
"CreateTime": 1607018174084852699,
"DeploymentID": "e8319163-0913-467e-b9c0-6997c68e6877",
"EscapedComputedClass": false,
"FailedTGAllocs": null,
"ID": "3f2b710c-bedb-11a2-1b92-f2e56ccb4f19",
"JobID": "activemq3",
"JobModifyIndex": 28444,
"ModifyIndex": 28543,
"ModifyTime": 1607018174107649344,
"Namespace": "default",
"NextEval": "",
"NodeID": "",
"NodeModifyIndex": 0,
"PreviousEval": "",
"Priority": 70,
"QueuedAllocations": {
"job": 2
},
"QuotaLimitReached": "",
"SnapshotIndex": 28541,
"Status": "failed",
"StatusDescription": "maximum attempts reached (5)",
"TriggeredBy": "job-register",
"Type": "service",
"Wait": 0,
"WaitUntil": null
}
Server logs:
2020-12-03T17:56:14.090Z [DEBUG] worker: dequeued evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.090Z [DEBUG] worker.service_sched: reconciled current state with desired state: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default results="Total changes: (place 2) (destructive 0) (inplace 0) (stop 0)
Desired Changes for "activemq2": (place 2) (inplace 0) (destructive 0) (stop 0) (migrate 0) (ignore 0) (canary 0)"
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=19d9bfd9-526e-2d57-0709-339a1bb60f51 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=4f2744cd-c875-a25c-d50d-8ff1b93c36c4 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: submitted plan for evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: refreshing state: refresh_index=28476 eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: refresh forced: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: reconciled current state with desired state: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default results="Total changes: (place 2) (destructive 0) (inplace 0) (stop 0)
Desired Changes for "activemq2": (place 2) (inplace 0) (destructive 0) (stop 0) (migrate 0) (ignore 0) (canary 0)"
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=19d9bfd9-526e-2d57-0709-339a1bb60f51 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=4f2744cd-c875-a25c-d50d-8ff1b93c36c4 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: submitted plan for evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: refreshing state: refresh_index=28476 eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: refresh forced: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: reconciled current state with desired state: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default results="Total changes: (place 2) (destructive 0) (inplace 0) (stop 0)
Desired Changes for "activemq2": (place 2) (inplace 0) (destructive 0) (stop 0) (migrate 0) (ignore 0) (canary 0)"
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=19d9bfd9-526e-2d57-0709-339a1bb60f51 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] nomad: plan for node rejected: node_id=4f2744cd-c875-a25c-d50d-8ff1b93c36c4 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: submitted plan for evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker: refreshing state: refresh_index=28476 eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: refresh forced: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default
2020-12-03T17:56:14.091Z [DEBUG] worker.service_sched: reconciled current state with desired state: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default results="Total changes: (place 2) (destructive 0) (inplace 0) (stop 0)
Desired Changes for "activemq2": (place 2) (inplace 0) (destructive 0) (stop 0) (migrate 0) (ignore 0) (canary 0)"
2020-12-03T17:56:14.094Z [DEBUG] nomad: plan for node rejected: node_id=19d9bfd9-526e-2d57-0709-339a1bb60f51 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.094Z [DEBUG] nomad: plan for node rejected: node_id=4f2744cd-c875-a25c-d50d-8ff1b93c36c4 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.094Z [DEBUG] worker: submitted plan for evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.094Z [DEBUG] worker: refreshing state: refresh_index=28476 eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.094Z [DEBUG] worker.service_sched: refresh forced: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default
2020-12-03T17:56:14.094Z [DEBUG] worker.service_sched: reconciled current state with desired state: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default results="Total changes: (place 2) (destructive 0) (inplace 0) (stop 0)
Desired Changes for "activemq2": (place 2) (inplace 0) (destructive 0) (stop 0) (migrate 0) (ignore 0) (canary 0)"
2020-12-03T17:56:14.096Z [DEBUG] nomad: plan for node rejected: node_id=4f2744cd-c875-a25c-d50d-8ff1b93c36c4 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.096Z [DEBUG] nomad: plan for node rejected: node_id=19d9bfd9-526e-2d57-0709-339a1bb60f51 reason="reserved port collision" eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.096Z [DEBUG] worker: submitted plan for evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.096Z [DEBUG] worker: refreshing state: refresh_index=28476 eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.096Z [DEBUG] worker.service_sched: refresh forced: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default
2020-12-03T17:56:14.107Z [DEBUG] worker: created evaluation: eval="<Eval "433ef4ce-4387-0b2b-1fd3-752e7256906b" JobID: "activemq3" Namespace: "default">"
2020-12-03T17:56:14.107Z [DEBUG] worker.service_sched: setting eval status: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 job_id=activemq3 namespace=default status=failed
2020-12-03T17:56:14.112Z [DEBUG] worker: updated evaluation: eval="<Eval "3f2b710c-bedb-11a2-1b92-f2e56ccb4f19" JobID: "activemq3" Namespace: "default">"
2020-12-03T17:56:14.112Z [DEBUG] worker: ack evaluation: eval_id=3f2b710c-bedb-11a2-1b92-f2e56ccb4f19
2020-12-03T17:56:14.743Z [DEBUG] http: request complete: method=GET path=/v1/evaluation/3f2b710c-bedb-11a2-1b92-f2e56ccb4f19 duration=239.788µs
2020-12-03T17:56:15.350Z [DEBUG] http: request complete: method=GET path=/v1/evaluation/3f2b710c-bedb-11a2-1b92-f2e56ccb4f19/allocations duration=284.266µs