Rpc error: code = Unavailable desc = connection error: desc = "transport: authentication

Hi,

ERROR: Error: rpc error: code = Unavailable desc = connection error: desc = “transport: authentication handshake failed: context deadline exceeded”

Past couple of days I facing issue with terraform.

  1. It is super slow and delay response
  2. Keep on getting below error
    ERROR:
    Error: rpc error: code = Unavailable desc = connection error: desc = “transport: authentication handshake failed: context deadline exceeded”

Terraform Version

I tried both version
0.13.0
0.13.4

Debug output:
2020/10/12 17:12:51 [INFO] Terraform version: 0.13.4
2020/10/12 17:12:51 [INFO] Go runtime version: go1.14.7
2020/10/12 17:12:51 [INFO] CLI args: string{"/awsops/opt/hashicorp/terraform/bin/v0.13.4/terraform", “validate”}
2020/10/12 17:12:51 [DEBUG] Attempting to open CLI config file: /home/jenkins/.terraformrc
2020/10/12 17:12:51 [DEBUG] File doesn’t exist, but doesn’t need to. Ignoring.
2020/10/12 17:12:51 [DEBUG] ignoring non-existing provider search directory terraform.d/plugins
2020/10/12 17:12:51 [DEBUG] ignoring non-existing provider search directory /home/jenkins/.terraform.d/plugins
2020/10/12 17:12:51 [DEBUG] ignoring non-existing provider search directory /home/jenkins/.local/share/terraform/plugins
2020/10/12 17:12:51 [DEBUG] ignoring non-existing provider search directory /usr/local/share/terraform/plugins
2020/10/12 17:12:51 [DEBUG] ignoring non-existing provider search directory /usr/share/terraform/plugins
2020/10/12 17:12:51 [INFO] CLI command args: string{“validate”}
2020/10/12 17:12:51 [TRACE] providercache.fillMetaCache: scanning directory .terraform/plugins
2020/10/12 17:12:51 [TRACE] getproviders.SearchLocalDirectory: .terraform/plugins is a symlink to .terraform/plugins
2020/10/12 17:12:51 [TRACE] getproviders.SearchLocalDirectory: found registry.terraform.io/hashicorp/aws v3.10.0 for linux_amd64 at .terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64
2020/10/12 17:12:51 [TRACE] getproviders.SearchLocalDirectory: found registry.terraform.io/hashicorp/template v2.2.0 for linux_amd64 at .terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64
2020/10/12 17:12:51 [TRACE] providercache.fillMetaCache: including .terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64 as a candidate package for registry.terraform.io/hashicorp/aws 3.10.0
2020/10/12 17:12:51 [TRACE] providercache.fillMetaCache: including .terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64 as a candidate package for registry.terraform.io/hashicorp/template 2.2.0
2020/10/12 17:13:22 [TRACE] providercache.fillMetaCache: using cached result from previous scan of .terraform/plugins
2020/10/12 17:13:22 [DEBUG] checking for provisioner in “.”
2020/10/12 17:13:22 [DEBUG] checking for provisioner in “/awsops/opt/hashicorp/terraform/bin/v0.13.4”
2020/10/12 17:13:22 [INFO] Failed to read plugin lock file .terraform/plugins/linux_amd64/lock.json: open .terraform/plugins/linux_amd64/lock.json: no such file or directory
2020/10/12 17:13:22 [TRACE] terraform.NewContext: starting
2020/10/12 17:13:22 [TRACE] terraform.NewContext: loading provider schemas
2020/10/12 17:13:22 [TRACE] LoadSchemas: retrieving schema for provider type “registry.terraform.io/hashicorp/aws
2020-10-12T17:13:22.502-0400 [INFO] plugin: configuring client automatic mTLS
2020-10-12T17:13:22.635-0400 [DEBUG] plugin: starting plugin: path=.terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64/terraform-provider-aws_v3.10.0_x5 args=[.terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64/terraform-provider-aws_v3.10.0_x5]
2020-10-12T17:13:22.667-0400 [DEBUG] plugin: plugin started: path=.terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64/terraform-provider-aws_v3.10.0_x5 pid=7756
2020-10-12T17:13:22.667-0400 [DEBUG] plugin: waiting for RPC address: path=.terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64/terraform-provider-aws_v3.10.0_x5
2020-10-12T17:13:22.823-0400 [INFO] plugin.terraform-provider-aws_v3.10.0_x5: configuring server automatic mTLS: timestamp=2020-10-12T17:13:22.822-0400
2020-10-12T17:14:20.089-0400 [DEBUG] plugin: using plugin: version=5
2020-10-12T17:14:20.090-0400 [DEBUG] plugin.terraform-provider-aws_v3.10.0_x5: plugin address: address=/tmp/plugin142119824 network=unix timestamp=2020-10-12T17:14:20.089-0400
2020/10/12 17:14:20 [TRACE] GRPCProvider: GetSchema
2020-10-12T17:14:20.414-0400 [TRACE] plugin.stdio: waiting for stdio data
2020/10/12 17:15:37 [TRACE] GRPCProvider: Close
2020-10-12T17:15:37.810-0400 [WARN] plugin.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2020-10-12T17:15:37.815-0400 [DEBUG] plugin: plugin process exited: path=.terraform/plugins/registry.terraform.io/hashicorp/aws/3.10.0/linux_amd64/terraform-provider-aws_v3.10.0_x5 pid=7756
2020-10-12T17:15:37.815-0400 [DEBUG] plugin: plugin exited
2020/10/12 17:15:37 [TRACE] LoadSchemas: retrieving schema for provider type “registry.terraform.io/hashicorp/template
2020-10-12T17:15:37.815-0400 [INFO] plugin: configuring client automatic mTLS
2020-10-12T17:15:37.924-0400 [DEBUG] plugin: starting plugin: path=.terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64/terraform-provider-template_v2.2.0_x4 args=[.terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64/terraform-provider-template_v2.2.0_x4]
2020-10-12T17:15:37.948-0400 [DEBUG] plugin: plugin started: path=.terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64/terraform-provider-template_v2.2.0_x4 pid=961
2020-10-12T17:15:37.948-0400 [DEBUG] plugin: waiting for RPC address: path=.terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64/terraform-provider-template_v2.2.0_x4
2020-10-12T17:15:37.970-0400 [INFO] plugin.terraform-provider-template_v2.2.0_x4: configuring server automatic mTLS: timestamp=2020-10-12T17:15:37.970-0400
2020-10-12T17:15:38.075-0400 [DEBUG] plugin: using plugin: version=5
2020-10-12T17:15:38.075-0400 [DEBUG] plugin.terraform-provider-template_v2.2.0_x4: plugin address: address=/tmp/plugin343782303 network=unix timestamp=2020-10-12T17:15:38.074-0400
2020/10/12 17:15:38 [TRACE] GRPCProvider: GetSchema
2020-10-12T17:15:38.207-0400 [TRACE] plugin.stdio: waiting for stdio data
2020/10/12 17:15:38 [TRACE] No provider meta schema returned
2020/10/12 17:15:38 [TRACE] GRPCProvider: Close
2020-10-12T17:15:38.222-0400 [WARN] plugin.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2020-10-12T17:15:38.245-0400 [DEBUG] plugin: plugin process exited: path=.terraform/plugins/registry.terraform.io/hashicorp/template/2.2.0/linux_amd64/terraform-provider-template_v2.2.0_x4 pid=961
2020-10-12T17:15:38.245-0400 [DEBUG] plugin: plugin exited
2020/10/12 17:15:38 [TRACE] terraform.NewContext: complete