Nomad cluster on prem, autoscale to cloud

Nomad
1

I have a nomad/consul cluster on prem.

I am running on a number parametrized jobs. However when the queue gets long, i would like to set up the autoscaler to provision more clients.

I have tried successful the aws centric demos.
However, I would like to set up my autoscaler to scale on aws, while keeping my non temporary cluster on prem.

Is it possible in the first place? Do you have a guidance document on the specific topic?

Best!
M

2

Hi @michimau.

This is a really interesting problem and I believe not only is this possible, but that we have an existing demo and blog post describing this type of autoscaling. Cloud Bursting with Nomad and Consul written by Erik Veld details a method of utilising cloud providers to run workload which exceeds the capacity of your on-premise clusters.

I hope this post helps the scenario you are currently trying to solve. Please let me know if you have any follow-up questions.

Thanks,
jrasell and the Nomad team

1 Like
3

Dear @jrasell, this is cool indeed.

Did you move the demo in github?
This is not valid any longer: https://github.com/shipyard-run/blueprints/tree/main/nomad-burst

4

Hi @michimau. It seems the demo got moved here and is known not to be fully currently working. It should, however, provide a great base along with the blog post to resolve the current issue you’re facing.

Thanks,
jrasell and the Nomad team