Help with copying multiple files/folders from GitHub repo to S3

mk-87 · September 9, 2022, 10:01pm

Hello,

I’m trying to figure out a way to copy all files/folders from a GitHub repro to an AWS S3 bucket using Terraform.

I came across the github_repository_file data source, but I believe it is limited to a single file vs multiple files and directories.

Any help would be appreciated!

maxb · September 10, 2022, 9:25am

Terraform is not the right tool for this job.

Use a general programming language of your choice, or shell scripting to combine usage of Git and any tool that will sync a local file tree with S3, such as rclone.

mk-87 · September 10, 2022, 6:13pm

Thank you for the response. What would be an appropriate usecase for the github_repository_file data source in Terraform?

Topic		Replies	Views
Setting up an infrastructure build pipeline in GitHub using Terraform Cloud HCP Terraform	2	324	January 18, 2023
How do I move resources from one state file in S3 to another state file in S3? Terraform	0	349	September 5, 2019
How to copy a file from one folder in a s3 bucket to another folder in s3 bucket ,cross - region , using AWS GLUE TERRAFORM AWS	0	246	July 3, 2023
Download Files from S3 bucket - subfolder - Locally Terraform	1	1141	May 3, 2020
What would be an equivalent to a --force-no-copy option to terraform init command Terraform	1	879	February 12, 2020

Help with copying multiple files/folders from GitHub repo to S3

Related topics