I’m trying to use nomad to perform batch processing jobs. in these kind of jobs, there is a “process” phase, where you would run 10-100 indexes on a set of data, followed by a “reduce” phase, where you aggregate the data and summarize it.
ideally, i would use groups for that. i’d declare a process group (with count=n), and a single reduce group (with count=1), which will summarize the calculation.
the problem is that i cannot enforce order/dependency of the reduce so it will always run after the process group.
is there a way to do it, or is there another composition i can make to make it work?