Commit Graph

27 Commits

Author SHA1 Message Date
The Magician
5582d8ea5a Fix encryption config in dataproc (#2854)
<!-- This change is generated by MagicModules. -->
/cc @rileykarson
2019-01-10 09:04:43 -08:00
The Magician
cbfef5e68c Contributor: dataproc encryption (#2840)
<!-- This change is generated by MagicModules. -->
/cc @chrisst
2019-01-09 16:13:42 -08:00
The Magician
91a513ab83 clean up operation code (#2734) 2018-12-26 17:42:37 -08:00
The Magician
9406c61e43 Add num local ssds and boot disk types to preemptible worker config (#2696) 2018-12-20 17:22:22 -08:00
The Magician
29c665d865 Various linter cleanups (conversions, unused, misspellings) (#2681)
<!-- This change is generated by MagicModules. -->
/cc @rileykarson
2018-12-20 17:22:22 -08:00
The Magician
c605b0bc4b [Terraform]: Apply gofmt -s to all files managed by MM (#2676)
<!-- This change is generated by MagicModules. -->
/cc @rileykarson
2018-12-20 17:22:22 -08:00
The Magician
99f9d71a31 convert dataproc_cluster.cluster_config.gce_cluster_config.tags into a set (#2633) 2018-12-20 17:22:22 -08:00
The Magician
fb1fd69cc6 Add 'image_uri' to dataproc cluster definition. (#2548) 2018-12-20 17:22:22 -08:00
The Magician
3564890812 Add to state before we send the create call. (#2527) 2018-12-20 17:22:22 -08:00
The Magician
b6029d7f74 make fmt on resource_dataproc_cluster.go (#2435) 2018-12-20 17:22:22 -08:00
The Magician
c4793e3aa5 Add support for accelerators to dataproc (#2411) 2018-12-20 17:22:22 -08:00
Chris Stephens
a0e2d50331 Change deprecated fields back to 'Removed' (#2241)
* Change deprecated fields back to 'Removed'

To provide a better user experience we're going to mark the fields as removed
so that users will get a more accurate error message. We will follow up a while
later to actually remove them from schema.
2018-12-20 17:22:22 -08:00
Chris Stephens
a93c57e76a Don't allow destroying backend buckets in dataproc (#2224)
Removing the delete_autogen_bucket property
Buckets will not be deleted when a dataproc resource is destroyed
2018-12-20 17:22:22 -08:00
Riley Karson
8506527a80 Add support for boot_disk_type to google_dataproc_cluster (#1855) 2018-08-15 23:00:11 -07:00
Walker
c810e4b408 provider: Ensures schema.TypeMap elements are schema.Schema (#1835) 2018-08-14 16:53:39 -07:00
Paddy Carver
aefef54ab0 Fix our calls to d.Set that returned errors.
We had several calls to `d.Set` that returned errors we weren't
catching, that turning on the panic flag for the tests caught. This PR
addresses them, and fixes the one test that was not safe to run in
parallel because it relied on a hardcoded name being unique.

This is largely just removing calls to `d.Set` for fields that don't
exist in the Schema, fixing how Sets get set, correcting typos, and
converting types.
2018-03-19 09:47:33 -07:00
Paddy Carver
c223521d31 Remove commented out code.
We don't really need dead code, and this is breaking our `make fmt` test
because it gets indented differently in go 1.10 from in go 1.9.
2018-03-15 13:30:01 -07:00
Dana Hoffman
99860f39e4
Dataproc autogen bucket changes (#1171)
* add extra wait for storage bucket object deletion

* make timeout for object deletion 5 minutes, make it succeed 3 times

* delete the cluster before deleting the bucket

* deprecate delete_autogen_bucket

* improve deprecation message
2018-03-13 11:46:27 -07:00
Dana Hoffman
33626a1e33
add metadata to gce cluster config in dataproc (#999) 2018-01-23 16:08:51 -08:00
Vincent Roseberry
3e900a3e6b
Bump up defaults timeout for dataproc (#979) 2018-01-18 11:12:14 -08:00
Vincent Roseberry
d0f5fec463
Standardize resource name extraction from self_link/uri (#939)
* Standardize resource name extraction from self_link/uri

* remove rebase artifact

* style improvement

* Fix merge issue
2018-01-17 10:45:28 -08:00
James McGill
bc266979d4 Revert "Ensure Elem is always either a *Schema or *Resource (#929)" (#950)
This reverts commit a3352655ac.
2018-01-12 10:09:06 -08:00
Vincent Roseberry
3690926170
Support self_link from different project in dataproc network and subnetwork fields (#935) 2018-01-10 11:05:24 -08:00
James McGill
a3352655ac Ensure Elem is always either a *Schema or *Resource (#929)
* Ensure Elem is always either a *Schema or *Resource

* Revert vendor file
2018-01-08 12:48:26 -08:00
Nick Jacques
46cc5b7d84 WIP: Add "internal IP only" support for Dataproc clusters (#837)
* Add internalIpOnly support for Dataproc clusters

* Add internal_ip_only to dataproc cluster docs

* Add default/basic dataproc internal ip test case

* Add test for dataproc internal_ip_only=true

* fixup cluster_config.gce_cluster_config to include .0.

* Remove redundant depends_on

* Add %s rnd to network and subnetwork

* Use variable for subnet CIDR and reference via source_ranges

* Add depends_on back to dataproc cluster test

* Fix cluster attribute refs (.0. again)
2017-12-22 13:24:05 -08:00
Vincent Roseberry
6c5d6b72e0
Store project and region in state (#784)
* Store project and region in state

* Delete unused project in runtimeconfig_variable
2017-11-27 16:32:20 -08:00
Nicki Watt
96ac8fc8a4 Add google_dataproc_cluster resource (#252)
* Add google_dataproc_cluster resource

* Add google_dataproc_cluster tests

* Add google_dataproc_cluster docs

* Removed google_dataproc_job ref (to be added in separate PR)

* Added delete_autogen_bucket attribute

* Refactored / simplified wait mechanism

* Changes based on review

* go fmt

* Add  cluster_config enclosing config block

* Review updates - primarily re restructuring hierarchy

* Removed rogue import

* docs - alignment

* Changes for review

* Refactoring into expandXXX methods

* Refactoring of flattenXXX methods to be explicit
2017-10-30 16:41:37 -07:00