Commit Graph

348 Commits

Author SHA1 Message Date
Paddy
ac73bebb15
Rename instead of removing.
Rename all ID fields to {resource_noun}_id instead of removing them
outright. This means people can still get at the info.

Leave project's id deleted. It has been marked as Removed for months.
I'm fine with cleaning it up before 1.0.0.

Also, update website docs.
2017-10-31 16:27:37 +00:00
Radek Simko
c3da024d7e
Remove 'id' fields from schemas 2017-10-31 16:27:36 +00:00
Nicki Watt
96ac8fc8a4 Add google_dataproc_cluster resource (#252)
* Add google_dataproc_cluster resource

* Add google_dataproc_cluster tests

* Add google_dataproc_cluster docs

* Removed google_dataproc_job ref (to be added in separate PR)

* Added delete_autogen_bucket attribute

* Refactored / simplified wait mechanism

* Changes based on review

* go fmt

* Add  cluster_config enclosing config block

* Review updates - primarily re restructuring hierarchy

* Removed rogue import

* docs - alignment

* Changes for review

* Refactoring into expandXXX methods

* Refactoring of flattenXXX methods to be explicit
2017-10-30 16:41:37 -07:00
Dana Hoffman
7b69c31f6a
Add labels to google_storage_bucket (#652)
* revendor storage

* revendor gensupport

* revendor bigquery

* add support for storage bucket labels

* bucket label docs
2017-10-30 15:48:26 -07:00
sebasrobert
d3b8482388 Subscription with topic in different project (#640)
Right now we can't create subscription on a topic in a different gcp
project since it assume the project from the subscription. The provider
always create the full topic name string
projects/{project}/topics/{topic} with the received topic property.
Using a regexp we validate if the string is already in
the format projects/{project}/topics/{topic} and if it's the case
we don't wrap it again and take it directly. The original functionality
is maintained but it's possible to specify a different project for the
topic.
2017-10-30 13:12:14 -07:00
Dana Hoffman
adbb5dd4fb
Update GKE docs to match actual schema; reorder fields in schema (#637)
* reorder schemas and update docs

* initial_node_count is optional

* clarify when initial_node_count must be set
2017-10-27 15:18:34 -07:00
Dana Hoffman
48192d62dc
Quick simplification for resource_compute_firewall logic (#631)
* simplify firewall logic

* fix whitespace
2017-10-27 15:08:22 -07:00
Michael Parker
f2fc78d082 Adds support for creating KMS KeyRing resources (#518)
* Instantiate the cloudkms client

* Implement Create and Read for the kms key ring resource

* Expose the kms key ring resource

* Create acceptance test for creating a KeyRing, fix read to use KeyRing ID

* Add cloudkms library to vendor

* Address style comments

* Use fully-qualified keyring name in read operation

* Remove call to SetId during read operation

* Set ID as entire resource string

* Spin up a new project for acceptance test

* Use Getenv for billing and org environment variables

* And test and logs around removal from state

* Add comments

* Fixes formatting

* Log warning instead of info

* Use a single line for cloudkms client actions

* Add resource import test

* Add ability to import resource, update helper functions to use keyRingId struct

* Use shorter terraform ID for easier import

* Update import test to use the same config as the basic test

* Update KeyRing name regex to be consistent with API docs

* Add documentation page for resource

* Add KeyRing documentation to sidebar

* Adds unit tests around parsing the KeyRing import id

* Allow for project in id to be autopopulated from config

* Throw error in import if project provider is not provided for location/name format

* Consistent variable names

* Use tabs in resource config instead of spaces

* Remove "-x" suffix for docs

* Set project attribute on import if different from the project config
2017-10-27 09:40:01 -07:00
David Quarles
1a8f3b8d18 Add support for CPU Platform in google_container_node_pool (#622)
* update container/v1 API

* add support for CPU Platform in `google_container_node_pool`

* fix broken links
2017-10-25 14:08:48 -07:00
Sébastien GLON
1f954e0131 Add sort on google_container_cluster auth_scopes (#506)
* replalce TypeList by TypeSet

* Add migrate function and test

* CORRECT

* remove migrate

* fix tests
2017-10-25 13:41:42 -07:00
Sébastien GLON
94e0b746df Add support for google_service_account_key (#472)
* Initial support for google service account keys

* Add vendor for vault and encryption

* Add change for PR comment

* Add doc and improvement fo public key management

* adding waiter for compatibility with issue google/google-api-go-client#234

* improvement

* Add test with pgp_key

* Perform doc anf format

* remove test if public_key exists

* Add link on doc

* correct pr
2017-10-25 12:43:20 -07:00
Patrick Decat
3d1e11023d Make google_service_account resource importable (#606)
* Make google_service_account resource importable

* Add google_service_account testcase with default project

* Mark google_service_account.project as computed to ensure the project id is always stored in the state, defined in configuration or not. Add corresponding test cases

* Inline variables with single usage

* Replace tabs with spaces in configuration strings

* Ensure service account is not recreated when the default project is explicitely added to the configuration

* camelcase
2017-10-25 12:33:21 -07:00
Paddy
0e2fa2e38f Address comments.
Fix typo, add log line, and document what we're doing on the website.
2017-10-24 14:43:35 -07:00
Patrick Decat
16611cb3ac Make google_project_services resource importable (#601)
* Make google_project_services resource importable

* Reuse testAccGoogleProjectAssociateServicesBasic() from resource_google_project_services_test.go
2017-10-23 14:23:51 -07:00
Dana Hoffman
c577ad6e8d Allow setting boot and attached disk sources by name or self link (#605)
* disk cleanup

* fix attached disk test

* allow disk sources from name or url

* parse disk source better on read

* update docs

* fix boot disk source url
2017-10-23 13:26:59 -07:00
Dana Hoffman
be0525885e post-migration disk cleanup (#600)
* disk cleanup

* fix attached disk test
2017-10-23 12:53:41 -07:00
Dana Hoffman
3a442a81a2 add prefix to instance name (#593) 2017-10-20 09:48:00 -07:00
Dana Hoffman
7c2bf7f4a7 make addons_config updatable (#597) 2017-10-20 09:47:07 -07:00
Dana Hoffman
62eb5ceedf Allow updating google_container_cluster.monitoring_service (#598) 2017-10-20 09:46:21 -07:00
Dana Hoffman
081e675d3d migrate boot disk initialize params (#592) 2017-10-20 09:45:05 -07:00
Joe Selman
2765290724 Add label support to google_compute_snapshot (#570)
* Add label support to google_compute_snapshot
* Refactor operation polling code to use client directly
2017-10-13 15:36:03 -07:00
Vincent Roseberry
3f3fa868c7 Fix import for compute_route (#565)
* Reorder fields in schema for style consistency
* Add reusable ZonalFieldValue
* Fix import and read state from API for compute route
* Generate network link without calling the API
2017-10-13 11:05:22 -07:00
Vincent Roseberry
66f876e6ae Add new resource google_compute_target_ssl_proxy (#569)
* Add target ssl proxy
* Add documentation
2017-10-13 11:02:42 -07:00
Radek Simko
25869fa5c8 Merge pull request #567 from terraform-providers/f-ds-lb-ip-ranges
d/compute_lb_ip_ranges: Add new data source
2017-10-13 07:09:09 +01:00
Joe Selman
4b77dca918 Revert "Revert "Add t.Parallel to all acceptance tests (#558)""
This reverts commit 8ab9d96d25 and revives
the original commit that adds t.Parallel to all acceptance tests. It
turns out test failures were unrelated to this change (rather, they were
related to quota issues).
2017-10-12 15:07:29 -07:00
Dana Hoffman
811530f145 Fix cluster version upgrades (#577)
* wait for running status on a cluster on read

* add min_master_version field

* respond to comments

* add docs

* no node_version on create
2017-10-12 11:21:33 -07:00
Dana Hoffman
ea909a3409 Change group back to Optional in google_compute_backend_service (#576)
* change group back to optional

* fix build
2017-10-12 09:21:35 -07:00
Paddy
0183e26999 Give bucket unique name in tests.
This will stop the test failure from the dangling resource.
2017-10-11 16:52:37 -07:00
Peter Milley
fe01f7fdd6 Copy network_interface attributes to Terraform state. (#536) 2017-10-11 13:33:58 -07:00
Vincent Roseberry
eb88e6d40d Fix org policies update test to actually update instead of doing a create/delete/create/delete cycle (#573) 2017-10-11 13:31:24 -07:00
Vincent Roseberry
e5d9fe6163 Add support for shared VPC (#572)
* Add VPC host project resource
* Add VPC service project resource
* Add combined acceptance test for shared VPC
* Add docs for shared VPC
* Increase deadline for project services operation
2017-10-11 12:51:09 -07:00
Joe Selman
8ab9d96d25 Revert "Add t.Parallel to all acceptance tests (#558)"
This reverts commit 42de44592f. It appears
there might be thread-safety issues as panics have started occuring when
parallism is ramped up. Reverting for now while investigating.
2017-10-10 17:55:34 -07:00
Joe Selman
42de44592f Add t.Parallel to all acceptance tests (#558) 2017-10-10 16:28:00 -07:00
Radek Simko
80ca6c26b1
d/compute_lb_ip_ranges: Add new data source 2017-10-10 22:07:21 +01:00
Radek Simko
31dc9d3790 Merge pull request #566 from terraform-providers/b-inst-tpl-device-name-computed
r/compute_instance_template: Make disk.device_name computed
2017-10-10 20:37:26 +01:00
Radek Simko
8378b58bdf
r/compute_instance_template: Make disk.device_name computed 2017-10-10 19:43:59 +01:00
Radek Simko
96ac8255d1 Merge pull request #561 from terraform-providers/f-compute-vpn-tunnel-secret-sensitive
r/compute_vpn_tunnel: Mark 'shared_secret' as sensitive
2017-10-10 18:24:33 +01:00
Radek Simko
44f477326d Merge pull request #560 from terraform-providers/b-ds-dns-mz-404
d/dns_managed_zone: Error out if zone is not found
2017-10-10 18:21:56 +01:00
Vincent Roseberry
45c1d723e5 Create a reusable GlobalFieldValue and support reading project from schema (#550) 2017-10-10 09:53:57 -07:00
Radek Simko
4bbce17bee
d/dns_managed_zone: Error out if zone is not found 2017-10-10 13:13:42 +01:00
Radek Simko
0e5b4b0597
r/compute_vpn_tunnel: Mark 'shared_secret' as sensitive 2017-10-10 12:57:52 +01:00
Vincent Roseberry
3d4c517ce8 Fix crash because missing error check before waiting on operation (#556) 2017-10-09 14:12:05 -07:00
Scott Stevenson
d574c6a910 Add resource_compute_region_autoscaler (#544)
* Add resource_compute_region_autoscaler
* Add import acceptance tests, reuse zonal autoscaler code
* Enforce single autoscaling policy requirement at terraform plan time
2017-10-09 10:59:38 -07:00
Joe Selman
e3ca8fbe59 Add labels to google_compute_instance_template (#515) 2017-10-09 10:17:15 -07:00
Dana Hoffman
d67bf7b3fc add master_version to container cluster (#538) 2017-10-06 15:48:01 -07:00
Vincent Roseberry
306b3d66b4 Forwarding rule network field supports name in addition of self_link (#487)
* Forwarding rule network field supports name in addition of self_link
* Update documentation
2017-10-06 09:33:42 -07:00
Vincent Roseberry
c94cbde1f6 Add import support to google_compute_target_tcp_proxy (#534) 2017-10-05 14:29:53 -07:00
Vincent Roseberry
87f3a58cb2 Add support for org policies at the organization level (#523)
* Fetch latest resource manager client
* Add new resource to manage Org Policy at the organization level.
* Update documentation
2017-10-05 13:20:16 -07:00
Alberto
2f94ff9ad4 Add support for target_tcp_proxy (#528) 2017-10-05 10:27:56 -07:00
Dana Hoffman
754e6daceb Fix BackendService group hash when instance groups use beta features (#522)
* change backend hash function

* update if statement
2017-10-04 16:49:02 -07:00
Dana Hoffman
5b3bd3455c Fix crash when creating node pools with name_prefix (#531) 2017-10-04 16:41:35 -07:00
Vincent Roseberry
0ba267dafc Use NetworkFieldValue in google_compute_subnetwork (#529) 2017-10-04 15:21:49 -07:00
Vincent Roseberry
10aeb9cd47 Improve VPN gateway and router to generate network link without calling network API (#527)
* Router network fields supports name in addition of self_link
* Improve VPN Gateway network field support
2017-10-04 14:01:38 -07:00
Dana Hoffman
bb0ab8e1f6 Merge the schemas and logic for the node pool resource and the node pool field in the cluster to aid in maintainability (#489) 2017-10-03 17:09:34 -07:00
Vincent Roseberry
e9436964bd Network peering gets network project from network self_link (#498) 2017-10-03 13:30:31 -07:00
Vincent Roseberry
7d65b3ed04 Firewall uses v1 API if the priority is unset or has the default value. (#500)
* api_versions supports default value
* Firewall use v1 API if the priority is set to default value (1000)
2017-10-03 13:24:02 -07:00
Vincent Roseberry
5f887b6568 Add update support for pubsub subscription push config field (#512) 2017-10-03 13:14:51 -07:00
Dana Hoffman
2db85e8e75 Add new retry wrapper fn, retry sql database instance operations that commonly 503 (#417)
* Retry sql database instance operations that commonly 503

* use new retry wrapper fn in resource_storage_bucket.go
2017-10-03 12:41:04 -07:00
Joe Selman
475ddb1b5b Add kubernetes dashboard addon (#464)
* Update google.golang.org/api/container/v1

* Add support for kubernetes_dashboard addon

* Fix tab/spaces issue in string
2017-10-03 09:29:27 -07:00
Joe Selman
ef543b20c5 Add google_logging_folder_sink resource (#470)
* Fix bad page title

* Add resource logging_folder_sink

* Use proper parse function and string format

* Remove unused strings
2017-10-03 09:26:19 -07:00
Paddy
33b526aa10 Skip migrations if we're not running acc tests. 2017-10-02 12:49:49 -07:00
Paddy
300bae3244 Fix compute_instance migration bug.
`compute_instance`'s StateVersion was set to 2. Then we released a
migration to v3, but never updated the StateVersion to 3, meaning the
migration was never run. When we added the migration for disks, we
bumped to 4, bypassing 3 altogher. In theory, this is fine, and is
expected; after all, some people may have state in version 0 and need to
upgrade all the way to 4, so our schema migration function is supposed
to support this.

Unfortunately, for migrations to v2, v3, and v4 of our schema, the
migration _returned_ after each migration, instead of falling through.
This meant that (in this case), version 2 would see it needs to be
version 4, run the state migration to version 3, then _return_, setting
its StateVersion to _4_, which means the migration from 3->4 got skipped
entirely.

This PR bumps the version to 5, and adds a migration from 4->5 such that
if there are still disks in state after 4, re-run 4. This will fix
things for people that upgraded to 1.0.0 and had their StateVersion
updated without the migration running.

I also updated the tests @danawillow wrote to start from state version 2
instead of state version 3, as the state would never be in version 3.

I also duplicated those tests, but started them from state version 4
(assuming the migration hadn't run) and verifying that the migration
from 4->5 would correct that.
2017-10-02 12:34:09 -07:00
Dana Hoffman
bbad89afe6 Fix failing tests: instance templates still use disk (#504)
* instance templates still use the disk field

* more fixes
2017-09-30 19:42:15 -07:00
Paddy
fccae61d61 1.0.0 Deprecations, pt 2
Fix the CI tests we broke with the deprecations for 1.0.0, and update
the docs we missed. Also, update the examples.
2017-09-29 16:04:52 -07:00
Paddy
3db816d686 Merge pull request #491 from terraform-providers/paddy_1.0_deprecations
Remove deprecated resources for 1.0.0.
2017-09-29 11:32:14 -07:00
Paddy
136a176e7e Deprecate disable_project on google_project_iam_policy. 2017-09-29 11:13:44 -07:00
Paddy
fe83578d33 Merge pull request #494 from terraform-providers/paddy_revert_shared_vpc
Revert Shared VPC.
2017-09-29 09:53:16 -07:00
Paddy
02512af271 Revert Shared VPC.
We want to talk about the design of Shared VPC a little bit more before
it ships, so this PR removes it, to be added back at a later date.
2017-09-29 04:59:41 -07:00
Paddy
50ad10a513 Address comments. 2017-09-29 04:57:47 -07:00
Paddy
b1fa2a4702 AccTest fixes. 2017-09-29 04:54:24 -07:00
Dana Hoffman
f31e34cad9 Mark certificate as sensitive within google_compute_ssl_certificate (#490) 2017-09-28 17:45:36 -07:00
Paddy
e4d920b774 Remove disks field. 2017-09-28 17:22:29 -07:00
Paddy
5aca4468ac Update tests that use deprecated resources. 2017-09-28 17:08:55 -07:00
Paddy
edad00bf4b Replace variable we actually needed. 2017-09-28 15:44:21 -07:00
Paddy
19b2a3550a Undelete initial_node_count.
This was just deprecated recently, don't remove it.
2017-09-28 15:40:24 -07:00
Paddy
a76fa3bd6a Merge branch 'master' into paddy_1.0_deprecations 2017-09-28 15:37:19 -07:00
Paddy
a586429bd7 Deprecate our authoritative stuff. 2017-09-28 15:36:40 -07:00
Paddy
f2f276ea0b Remove deprecated resources for 1.0.0.
In advance of 1.0.0, let's take the opportunity to remove the fields on
resources that have been deprecated for a while.
2017-09-28 14:38:38 -07:00
Dana Hoffman
6d947cd20e Add state migration from disk to boot_disk/scratch_disk/attached_disk (#329)
* Add state migration from disk to boot_disk/scratch_disk/attached_disk

* get rid of test for now

* update schema version

* add tests for migration

* fix travis errors

* actually fix travis errors

* fix logic when project is set, also remove some log statements

* add tests for reading based on encryption key and image

* use as much of the image URL as we can for matching on image

* read project from config if it wasn't set in the attribute

* update resolveImage call
2017-09-28 14:37:03 -07:00
Vincent Roseberry
bc25c02cbf Firewall network field now supports self_link in addition of name (#477) 2017-09-28 12:02:39 -07:00
Vincent Roseberry
39a858894a Remove alias ip range from beta feature for compute subnetwork 2017-09-28 10:48:28 -07:00
Vincent Roseberry
b5e1bf4a82 Remove alias ip range from beta feature for compute instance 2017-09-28 10:48:28 -07:00
Vincent Roseberry
764fb6b86c Rewrite api versions tests as table driven tests (#476) 2017-09-27 15:25:10 -07:00
Dana Hoffman
cc8ea81117 Fix a few instances where we read the project from the provider config and not using the helper function (#469) 2017-09-26 17:01:52 -07:00
Vincent Roseberry
ace5dffcc8 Remove project if it has been deleted from outside of Terraform (#466) 2017-09-26 16:55:32 -07:00
Dana Hoffman
617ad7362b allow min node counts of 0 for node pool autoscaling (#468) 2017-09-26 15:57:51 -07:00
Vincent Roseberry
5874819e21 Remove beta code path in compute_global_address 2017-09-26 15:57:22 -07:00
Vincent Roseberry
d35b92086a global_address ipv6 uses v1 api
global_forwarding_rule ipv6 uses v1 api
Update documentation
2017-09-26 15:57:22 -07:00
Vincent Roseberry
27a99c7dab Don't crash if node config is nil in google_container_cluster (#467) 2017-09-26 15:32:12 -07:00
Joe Selman
8231d6a83a Add resource_logging_billing_account_sink resource (#457)
* Add resource_logging_billing_account_sink resource

* Fix bad style
2017-09-26 15:26:54 -07:00
Vincent Roseberry
5e44df5199 Pubsub subscription read state from API and import support (#456) 2017-09-26 13:44:13 -07:00
Vincent Roseberry
20929eb468 Assign IAM policy to folder. (#447)
* Assign IAM policy to folder.
* Add documentation for google_folder_iam_policy
2017-09-25 11:30:45 -07:00
Paddy
c31bfdc4df Merge pull request #439 from terraform-providers/paddy_undeletable_bucket_acls
Deal with undeletable bucket ACLs in storage.
2017-09-25 10:29:15 -07:00
Paddy
5060f07926 Pull ProjectNumber off bucket, not getProject.
Use the project reported by the bucket, not the one Terraform is
configured to use.
2017-09-25 06:02:36 -07:00
Manoj Srivastava
c1d0e716d9 Folder support: Assign/Reassign a google project to a folder. (#438)
+ Make the org_id optional when creating a project. Closes #131
+ Mark org_id as computed to allow for GCP automatically assigning the org.
+ Add an acceptance test for project creation without an organization.
+ Skip TestAccGoogleProject_createWithoutOrg if GOOGLE_ORG is set.
+ Add a folder_id to the google_project resource, optionally
  specifying the ID of the GCP folder in which the GCP project should
  live.
+ Document how one can provision a project into a folder, and added a
  sample configuration to create a project into an existing folder.
* Skip test without org if service account is used
* Support folders/* or id only for the folder id field
2017-09-22 13:03:08 -05:00
Paddy
a6df85d809 Merge pull request #440 from terraform-providers/paddy_fix_object_acl_predefined
Fix failing test on storage_object_acl.
2017-09-16 16:23:17 -07:00
Paddy
6b1b727449 Fix failing test on storage_object_acl.
The `predefined_acl` test for `storage_object_acl` was failing. This is
because we removed the state-setting portion of the `predefined_acl`
field from `storage_bucket_acl`, and due to what I can only assume is a
copy/paste error, `storage_object_acl` was calling the Read function of
`storage_bucket_acl` instead of its own when using `predefined_acl`.

Updating to use `storage_object_acl`'s Read function makes the tests
pass.
2017-09-15 13:08:37 -07:00
Paddy
b343829d22 Stop fighting with the test framework.
Project number is now set through an environment variable instead of
being inferred at runtime using the API.
2017-09-15 12:53:44 -07:00
Paddy
755edf6d79 Fix make test.
Because we were instantiating a client outside of resource.TestCase, it
was being instantiated even for unit tests, which have no credentials,
causing the unit tests to fail. Sadly, this is the only way I could
figure out how to get a client inside resource.TestCase, which is very
sad making, but works.
2017-09-15 12:28:29 -07:00
Paddy
72114636da Deal with undeleatable bucket ACLs in storage.
When GCS buckets are created, they're created with a set of default
ACLs:

* `OWNER:project-owners-{project_number}`
* `OWNER:project-editors-{project_number}`
* `READER:project-viewers-{project_number}`

Normally, this would be fine, or a minor inconvenience. Terraform could
either delete them itself, or the first apply of a user would overwrite
them.

However, trying to remove the `OWNER:project-owners-{project_number}`
ACL yields an API error that the bucket owner must maintain OWNER access
to the bucket. This breaks things like `terraform destroy`, but also
means any config without that line in it will fail to apply, not just
overwrite the value.

To make matters worse, trying to *add* the
`OWNER:project-owners-{project_number}` ACL to any bucket that already
has it _also_ yields the same error about not being able to remove it.

To get around this, the storage_bucket_acl resource has been updated to
largely ignore _just this_ ACL. It will not try to add it if it already
exists, will not try to remove it at all. This does mean that Terraform
is incapable of removing this ACL from a bucket, but I'm not sure it's
possible to do that with the API, anyways.

Tests were also updated to keep the default ACLs as part of the config,
and to change the email addresses to addresses we actually own. I tried
changing to non-existant hashicorp.com email addresses, but was
rejected; only email addresses that are backed by actual Google accounts
can be used, sadly.
2017-09-15 12:03:03 -07:00