Whats the recomended way to get docker logs into both the nomad cli & gui and an external logging facility like ELK? The following works, but breaks nomad logs cli and the nomad gui logging { type = "syslog" config { "syslog-address" = "udp://127.0.0.1:514" …

Hey Spencer, We use SumoLogic in our environment, so for now I’m using the vendor provided Docker image for logging containers. I run it as a system job on all Nomad clients. The config basically mounts the docker socket, so the container can gets logs via docker’s API. This approach lets me confi…

Hello! One approach that I have successfully implemented is to use Filebeat installed in the Nomad client node machine. In this context Filebeat uses the Docker input to capture logs of all the containers running in that node: https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-d…

Another option is to run nomad_follower as a system job – I did some work on it recently to allow it to work on locked down clusters, use temporary vault credentials to fetch allocations and so forth. Since it uses a Nomad token rather than the docker socket it’s a little more secure and it write …

We have been using for a few weeks filebeat to ship the logs of several Nomad clusters into Elasticsearch. We wrote a custom module that is currently being contributed back to filebeat. It is implemented as an autodiscover provider, this allows us to specify certain tags in the meta stanza to custom…

Hi @jorgelbg , Your filebeat nomad module sounds very interesting and something that we could leverage as well. Do you have any info as to if this will be included with filebeat? Or if this will be an opensource module we could leverage? Thanks for any info!

Hi @codyja we’re contributing back to filebeat our code. Currently, we have opened this PR https://github.com/elastic/beats/pull/14954 that includes the autodiscover module and the processor(s) for Filebeat (as described in my previous comment). The response from the beats maintainers has been very…

That’s awesome news @jorgelbg ! Let me know if I can help in any way. I may see if I can figure out how to test it out myself.

If you want to give it a try I can push the internal docker image that we’ve been using to a public registry and you could give it a try. We’re still going through certain edge cases that we’ve found, but we’re still using it in our production clusters.

Sure I’d like to give it a spin, that would be great. Thanks

I pushed a private image into docker’s registry. Do you have a docker ID for me to add you as a collaborator so that you can pull the image?

Get Nomad job logs into Splunk/Elasticsearch

Nomad

akshatgit February 7, 2020, 11:13am 12

@jorgelbg
I was also searching for a similar solution. Can you share a small doc explaining how to setup?

Topic		Replies	Views
Nomad ship logs to ELK Nomad	4	2044	February 2, 2023
Filebeat only harvesting its own logs and not every other jobs running on the same machine Nomad	4	529	June 4, 2024
General recommendations for logging Nomad	2	2405	September 22, 2022
Logging collection in docker and let datadog agent to collect to display in datadog Nomad	11	2415	January 10, 2023
Export Nomad logs with Elastic fleet processor Nomad	0	50	April 21, 2025

Get Nomad job logs into Splunk/Elasticsearch

Related topics