Provisioning a Terraform Module
Example configuration resource
On the consumption side the only resource required is the Configuration CRD. Below is an example:
# ssh example: git::ssh://firstname.lastname@example.org/foo/bar
# An optional reference to a secret containing credentials to retrieve
# the git repository
# Terraform variables used to populate the module
# -- The name of the bucket. If omitted, Terraform will assign a random, unique name
# -- The canned ACL to apply
# -- Map containing versioning configuration
# --Whether Amazon S3 should block public ACLs for this bucket
# -- Whether Amazon S3 should block public bucket policies for this bucket
# -- Whether Amazon S3 should ignore public ACLs for this bucket
# -- Whether Amazon S3 should restrict public bucket policies for this bucket
# -- Map containing server-side encryption configuration
Sections of the configuration resource
The configuration resource is comprised of the following sections.
The module reference defines the source of the terraform module to run.
The source reference uses the exact same format as terraform itself (the same library is used). For full details take a look at hashicorp/go-getter.
For quick reference:
- Using SSH the format would look like this:
- Using HTTPS the format would be:
You can also extract specific folders or files from the downloaded module by using the double slash:
The provider reference is what links a configuration to the credentials used to speak to the cloud. Depending on the Kubernetes RBAC you currently posses you can retrieve a list of the current providers via
$ kubectl get providers -n [NAMESPACE]
Once you have the provider
name you use the reference in the configuration:
The variables section
spec.variables is a freeform map used to define all the variables the module can consume. These are converted to HCL and provided into the workflow via
-var-file on the
For variables that are sensitive such as passwords it would be better to use the
spec.valueFrom field. This is a collection of references to kubernetes secrets that hold the values.
ValueFrom fields is available from version >= v0.1.6
An example for an RDS module can be
- secret: db_password
Connection secret reference
The connection secret
spec.writeConnectionSecretToRef is the name of a secret within the namespace where you want any Terraform outputs to be written. These outputs are converted to environment variable format, i.e., upper-cased and ready to be consumed by workloads using env and envFrom.
By default when a secret is defined all the outputs produced are written in environment variable form. If you want to filter this and only select specific keys from the terraform output you can include the
spec.writeConnectionSecretToRef.keys field as shown below.
We use the resource outputs as the keys in the connection secret, so if a resource has a
database_endpoint output the secret will have a key named
DATABASE_ENDPOINT. You might want to rename one or more outputs for convenience however, for example change the
mysql_host. You can change the key like below
- database_endpoint:mysql_host # is renamed to MYSQL_HOST
- database_port # is unchanged as DATABASE_PORT
Viewing the changes
As a Configuration transitions through its plan, apply and destroy phases, a job is created in the namespace, and used to feedback the execution of the change. The jobs follows the naming format
[RESOURCE]-[GENERATION]-[plan|apply|destroy]. You can easily view the execution of a change by inspecting the pod's logs (
kubectl logs [POD]).
Approving a plan
By default, unless the
spec.enableAutoApproval is set to true, all Configurations require a manual approval. You can do this by toggling an annotation on the Configuration itself.
To approve the Configuration
$ kubectl -n apps annotate configurations bucket "terraform.appvia.io/apply"=true --overwrite
Deleting the resource
You can delete the resource like any other Kubernetes resource (
kubectl delete configuration [NAME]). One extra feature is the ability to orphan the cloud resources (i.e., delete the Kubernetes representation but DO NOT delete the cloud resources themselves).
For instance, you may need to migrate the configuration to another cluster. In that case:
- Annotate the Configuration with
kubectl annotate configuration [NAME] "terraform.appvia.io/orphan"=true
- Delete the Configuration resource as per normal. The resource will disappear but the cloud resources will remain.