Trying to get RedPanda set up

insanitybit · July 24, 2023, 3:39am

I’m trying to get RedPanda set up in Nomad and having trouble. My ideal scenario would be that the RedPanda instances can all talk to each other however they want (I don’t care about Consul Connect there) and clients can then communicate with different endpoints using Consul Connect for service discovery.

Here are the nomad files.

gist.github.com

https://gist.github.com/insanitybit/6beafeda2137fe4ae1796dc4fcd1a2e8

redpanda-test1.nomad

job "connectivity-test" {
  datacenters = ["dc1"]
  type = "batch"
  
  group "test-group" {
    network {
      mode = "bridge"
    }
    
    task "test-task" {

This file has been truncated. show original

redpanda-test3.nomad

job "redpanda-test" {
  datacenters = ["dc1"]
  type = "batch"

  group "redpanda-test-group" {
    network {
      mode = "bridge"
    }

    service {

This file has been truncated. show original

redpanda.nomad

job "redpanda-cluster" {
  datacenters = ["dc1"]
  type        = "service"

  group "redpanda0" {
    network {
      mode = "bridge"

      port "redpanda-nomad" {
        static = 19092

This file has been truncated. show original

The cluster seems to start up fine but I’m not sure if that’s even true - for all I know the nodes can’t even talk to each other.

Also, while my ‘netcat’ test seems to pass my ‘rpk’ based test does not.

As you can see I’ve tried adding an expose to redpanda0 but that is not working.

Help would be greatly appreciated.

Topic		Replies	Views
Installing redpanda on nomad cluster Nomad consul-nomad	0	331	December 7, 2023
Consul Connect Connection Reset By Peer Errors Nomad	13	4211	October 5, 2023
Nomad - Consul Networking Nomad connect	0	297	August 11, 2022
Consul Networking Consul	3	595	August 18, 2022
Nomad consul connect failing seperate nodes Nomad	4	896	February 24, 2022

Trying to get RedPanda set up

Related topics