Is there a tool for downloading module sources per the syntaxes listed here ? My use case: I have a complex terragrunt structure, lots of hcl files which reference lots of modules. I am auditing them to: Pull out the various module source lists (and summarizing them by depth of directory tree) Dow…

I managed to get somewhere by using some of the OSS terraform code and gohcl library, at least to parse the source module ref. Almost all of this is inside internal/ in hashicorp/terraform, unfortunately. so no library surface. I am at a point where: I do not quite know how to use that to downlo…

Hi @deitch , Due to the history and compatibility constraints present in Terraform, CLI itself is the reference implementation for how it will download modules. For non-registry modules however, the special source formats are for the most part handled by the github.com/hashicorp/go-getter package.

The module installation behavior in Terraform CLI has a long legacy at this point and isn’t really well defined aside from its current implementation, and so it isn’t really a suitable interface for third-party integration. Depending on what your goal is, you might find the newer sourcebundle packa…

Hi @jbardin , thanks for the response :slight_smile: Due to the history and compatibility constraints present in Terraform, CLI itself is the reference implementation for how it will download modules. Is there a command that says, “download this module to this dir”? I know that tf init does that…

[image] apparentlymart: Depending on what your goal is, Hi @apparentlymart ; I always appreciate your detailed responses. I thought I had put it in the original question, but I might have missed some of it. I am auditing dependencies. That means: Going through a source tree and finding .h…

Somewhat relatedly, I notice that each download from git protocols clones the entire target repo, then checks out the specific ref. In the case of a large repo, that can be very expensive. It looks like a regular tf init does something similar in the .terraform/modules/ dir. Is that correct?

Thinking more about what you shared before and what you’ve added here, unfortunately I think the main thing you’re looking for here lives in the gaps that the sourcebundle package delegates to its calling application. Specifically: DependencyFinder delegates the problem of analyzing an already-fe…

[image] apparentlymart: It sounds like you already wrote something that could be turned into an implementation of DependencyFinder. heh, you give my crude work too much credit. But, yes, in a very limited sense, that is what I did. [image] apparentlymart: For RegistryClient there isn’t r…

So there isn’t anything nowadays that is the equivalent of go-getter for registry, i.e. registry-getter? The code we’re using in the only-currently-existing caller of sourcebundle inside Terraform Cloud is more-or-less a copy of the registry.Client implementation in Terraform CLI , with its API tw…

Got it, ok. Thanks for explaining, Martin. I don’t really know Stacks. I used to have access to TFC back when I consulted to companies that used it. I don’t think any of my current ones have access, so no way to look at it now.

How to parse and download module source formats?

Terraform

deitch November 21, 2023, 12:31pm 12

I will start a separate thread for the terraform versions question.

Topic		Replies	Views
How to download specific module as zip file? Terraform	3	1982	June 5, 2023
Build a private module registry directly on S3 Terraform	1	331	August 10, 2024
How to generate terraform HCL code Terraform terraform-enterprise	17	10351	September 30, 2022
Module Custom source Terraform	3	507	July 1, 2022
Is it possible to get data from the terraform registry via an API in some way? Terraform	1	481	February 9, 2023

How to parse and download module source formats?

Related topics