Ceph-csi allocation error

Nomad
1

When restarting the Nomad agent on a node where a Ceph volume is mounted I noticed that the job which uses a ceph volume doesn’t get restarted.

failed to setup alloc: pre-run hook "csi_hook" failed: node plugin returned an internal error, check the plugin allocation logs for more information: rpc error: code = Internal desc = rbd image nomad-volumes/csi-vol-756e6ab6-cd72-11ed-907b-0242ac110004 is still being used

What is the “proper” way to get this solved. Also what steps do we need to do when using CSI driver(s) within Nomad cluster (e.g.) when updating the node.

FYI, we are running Nomad version 1.5.2 with Consul 1.15.2

2

I’m also interested in Ceph-csi settings, although it’s not clear in docs. I haven’t found any tutorial for testing myself either. They just say ‘if it works in k8s it will work in nomad’. That’s it.

Could you share your settings or some steps to reproduce the error?

Thanks!

3

I have used the Block Devices and Nomad documentation.