How to schedule 1000s jobs effectively?

“HashiCorp Nomad scheduled 2,000,000 Docker containers on 6,100 hosts in 10 AWS regions in 22 minutes”

However, calling POST /v1/job/<jobname> from API from Python takes me ~200ms per request. Scheduling high number of jobs in order will just take a lot of time.

Is my setup ok and the POST request takes around that much time? Or should I be using a different API endpoint? Is it advised or ok to call POST /v1/job/<jobname> 1000 times in parallel to post 1000 jobs? Or is it better to do it sequentially and suffer the delay? What are your experiences with that?

1 Like