I’m trying to get a repeatable k8s setup working and running into a bit of a dead end. I had everything set up and working and thought I had copied everything I had done into my Terraform config that is setting this all up but when I went to tear it down and make sure everything still worked I’ve hit a wall. Here are the on-demand runner logs when I try to kick off a build:
2022-05-24T23:00:10.689Z [INFO] waypoint: waypoint version: full_string="v0.8.2 (5b8885480+CHANGES)" version=v0.8.2 prerelease="" metadata="" revision=5b8885480+CHANGES
2022-05-24T23:00:10.689Z [DEBUG] waypoint: home configuration directory: path=/root/.config/waypoint
2022-05-24T23:00:10.689Z [INFO] waypoint.server: attempting to source credentials and connect
2022-05-24T23:00:10.689Z [DEBUG] waypoint.serverclient: connection information: address=waypoint-server:9701 tls=true tls_skip_verify=true send_auth=true has_token=true
2022-05-24T23:00:10.692Z [DEBUG] waypoint.server: connection established with sourced credentials
2022-05-24T23:00:10.695Z [INFO] waypoint: server version info: version=v0.8.2 api_min=1 api_current=1 entrypoint_min=1 entrypoint_current=1
2022-05-24T23:00:10.695Z [INFO] waypoint: negotiated api version: version=1
2022-05-24T23:00:10.695Z [INFO] waypoint.runner.agent: sourcing credentials and connecting to the Waypoint server
» Runner configuration:
Server address: waypoint-server:9701
Type: on-demand
» Runner logs:
2022-05-24T23:00:10.700Z [INFO] waypoint.runner.agent: initializing the runner
2022-05-24T23:00:10.700Z [DEBUG] waypoint.runner.agent.runner: Created runner: id=01G3W4S53K3AZ8RJ8K41XDT0VN
2022-05-24T23:00:10.700Z [INFO] waypoint.runner.agent: starting runner: id=01G3W4S53K3AZ8RJ8K41XDT0VN
2022-05-24T23:00:10.700Z [WARN] waypoint.runner.agent.runner: cookie not set for runner, will skip adoption process
2022-05-24T23:00:10.700Z [DEBUG] waypoint.runner.agent.runner: starting RunnerConfig stream
2022-05-24T23:00:10.700Z [DEBUG] waypoint.runner.agent.runner: waiting for registration
2022-05-24T23:00:10.700Z [DEBUG] waypoint.runner.agent.runner.config: registering instance, requesting config
2022-05-24T23:00:10.704Z [DEBUG] waypoint.runner.agent.runner.config_recv: first config received, switching config state to true
2022-05-24T23:00:10.704Z [INFO] waypoint.runner.agent.runner.config_recv: new configuration received
2022-05-24T23:00:10.704Z [DEBUG] waypoint.runner.agent.runner.config.watcher.watchloop: new config variables received, scheduling refresh
2022-05-24T23:00:10.704Z [DEBUG] waypoint.runner.agent.runner: runner registered, waiting for first config processing
2022-05-24T23:00:11.204Z [DEBUG] waypoint.runner.agent.runner.config.watcher.watchloop: new configuration computed
2022-05-24T23:00:11.204Z [INFO] waypoint.runner.agent.runner: runner registered with server and ready
2022-05-24T23:00:11.204Z [DEBUG] waypoint.runner.agent.runner: opening job stream: retry=false
2022-05-24T23:00:11.205Z [INFO] waypoint.runner.agent.runner: waiting for job assignment
2022-05-24T23:00:11.208Z [INFO] waypoint.runner.agent.runner: job assignment received: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build
2022-05-24T23:00:11.208Z [INFO] waypoint.runner.agent.runner: starting job execution: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build
2022-05-24T23:00:17.562Z [DEBUG] waypoint.runner.agent.runner: job data downloaded (or local): job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build pwd=/kaniko/tmp/waypoint1412584410 ref="&gen.Job_DataSource_Ref{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), Ref:(*gen.Job_DataSource_Ref_Git)(0xc00ae47240)}"
2022-05-24T23:00:17.562Z [DEBUG] waypoint.runner.agent.runner: sending download event: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build
2022-05-24T23:00:17.564Z [DEBUG] waypoint.runner.agent.runner: plugin search path: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build path=["/kaniko/tmp/waypoint1412584410", "/kaniko/tmp/waypoint1412584410/.waypoint/plugins", "/root/.config/waypoint/plugins", "/root/.config/.waypoint/plugins"]
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: searching for plugin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=docker
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: plugin found as builtin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=docker
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=docker type=Builder nil=false
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=docker type=Mapper nil=false
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: searching for plugin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=aws-ecr
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: plugin found as builtin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=aws-ecr
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=aws-ecr type=Mapper nil=false
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=aws-ecr type=Registry nil=false
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: searching for plugin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=helm
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: plugin found as builtin: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=helm
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=helm type=Platform nil=false
2022-05-24T23:00:17.565Z [INFO] waypoint.runner.agent.runner: register: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build plugin_name=helm type=Mapper nil=false
2022-05-24T23:00:17.565Z [DEBUG] waypoint.runner.agent.runner: looking to see if there are dynamic variable default values to load: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build
2022-05-24T23:00:17.567Z [DEBUG] waypoint.runner.agent.runner: cleaning up downloaded data: job_id=01G3W4S53KXCJ9A1H5BS6NWA79 job_op=*gen.Job_Build
panic: value is null
goroutine 37 [running]:
github.com/zclconf/go-cty/cty.Value.AsString({{{0x3987d38, 0xc000077011}}, {0x0, 0x0}})
/go/pkg/mod/github.com/zclconf/go-cty@v1.8.4/cty/value_ops.go:1259 +0x125
github.com/hashicorp/waypoint/internal/config/variables.getJobValues(0x0, 0xc004522960, {0xc00af736c0, 0x1d})
/tmp/wp-src/internal/config/variables/variables.go:755 +0x94d
github.com/hashicorp/waypoint/internal/config/variables.EvaluateVariables({0x3a129b0, 0xc00069bd00}, {0xc00ae47518, 0x1, 0x0}, 0x0, {0xc00af736c0, 0x1d})
/tmp/wp-src/internal/config/variables/variables.go:701 +0x16f6
github.com/hashicorp/waypoint/internal/runner.(*Runner).executeJob(0xc0008119e0, {0x3985760, 0xc0005dff40}, {0x3a129b0, 0xc00069bd00}, {0x39dc400, 0xc0008d3440}, 0xc000656780, {0xc0009c4940, 0x1e}, ...)
/tmp/wp-src/internal/runner/operation.go:260 +0x134d
github.com/hashicorp/waypoint/internal/runner.(*Runner).prepareAndExecuteJob(0xc000b87f00, {0x3985760, 0xc0005dff40}, {0x3a129b0, 0xc00069bd00}, {0x39dc400, 0xc0008d3440}, 0xc0008c9698, {0x39dc3a8, 0xc0008d33e0}, ...)
/tmp/wp-src/internal/runner/accept.go:574 +0x8e8
github.com/hashicorp/waypoint/internal/runner.(*Runner).accept(0xc0008119e0, {0x3985760, 0xc0005de440}, {0x0, 0x0})
/tmp/wp-src/internal/runner/accept.go:430 +0x1a50
github.com/hashicorp/waypoint/internal/runner.(*Runner).Accept(...)
/tmp/wp-src/internal/runner/accept.go:78
github.com/hashicorp/waypoint/internal/cli.(*RunnerAgentCommand).Run.func2()
/tmp/wp-src/internal/cli/runner_agent.go:231 +0x96
created by github.com/hashicorp/waypoint/internal/cli.(*RunnerAgentCommand).Run
/tmp/wp-src/internal/cli/runner_agent.go:227 +0x1527
Clearly I’m missing some bit of configuration but I’m not entirely sure how to figure out what it could be. All it seems like I can really tell is that it’s a string of some kind.