Get Device Stats with API call

Nomad
1

I am looking for a way of getting GPU utilization through Nomad API. I see that when I run nomad alloc status <alloc-id> i get the following:

Device Stats
nvidia/gpu/NVIDIA GeForce RTX 3090[GPU-c9a105f9-528b-6e05-18da-fe41dce03ec8] 5173 / 24576 MiB

Is there a way of retrieving this information with an API call?

I also see that when I call nomad node status <node_id> I get:

Device Resource Utilization
nvidia/gpu/NVIDIA GeForce RTX 3090[GPU-89d42421-7cbe-3f2e-f815-d1b1eb819c0d] 319 / 24576 MiB
nvidia/gpu/NVIDIA GeForce RTX 3090[GPU-c9a105f9-528b-6e05-18da-fe41dce03ec8] 5173 / 24576 MiB

Same question, can I get this data with an API call?

Thank you!

2

I don’t have workloads with GPUs, but I believe the allocation & node read APIs should return this.

3

Unfortunately, they do not.