Ceph CSI and snapshots

Nomad
1

Hi.
I’m using ceph-csi to manage both rbd and cephfs volumes for Nomad workloads. I can create/delete/use volumes without issue, but can’t take or list snapshots with nomad cli. When trying to create a snapshot

[dbd@laptop-103 ceph-csi]$ nomad volume snapshot create device-services-data test
Error snapshotting volume: Unexpected response code: 500 (rpc error: 1 error occurred:
	* could not create snapshot: controller create snapshot: CSI.ControllerCreateSnapshot: controller plugin returned an internal error, check the plugin allocation logs for more information: rpc error: code = Internal desc = clusterID must be set)
[dbd@laptop-103 ceph-csi]$

My ceph-csi config includes the clusterID (else, it couldn’t even create volumes)

[
  {
    "cephFS": {
      "subvolumeGroup": "nomad-dev"
    },
    "clusterID": "yyyyyyy-461a-4577-9be1-xxxxxxxxxxxxx",
    "monitors": [
      "10.11.255.7",
      "10.11.255.8",
      "10.11.255.2",
      "10.11.255.3",
      "10.11.255.12"
    ],
    "rbd": {
      "radosNamespace": "nomad-dev"
    }
  }
]

When trying to list snapshots, the error is

[dbd@laptop-103 ceph-csi]$ nomad volume snapshot list -plugin cephfs.ceph-csi
Error querying CSI external snapshots for plugin "cephfs.ceph-csi": Unexpected response code: 500 (rpc error: plugin does not support listing snapshots)
[dbd@laptop-103 ceph-csi]$

Which seems surprising.

I’ve made my own Nomad job for Ceph CSI heavily inspired by Ceph documentation

Anyone using Ceph CSI ? Do you also have this issues ?

Regards,
Daniel