Commit Graph

1106 Commits

Author SHA1 Message Date
James Phillips c01a3871c9 Adds support for snapshots and restores. (#2396)
* Updates Raft library to get new snapshot/restore API.

* Basic backup and restore working, but need some cleanup.

* Breaks out a snapshot module and adds a SHA256 integrity check.

* Adds snapshot ACL and fills in some missing comments.

* Require a consistent read for snapshots.

* Make sure snapshot works if ACLs aren't enabled.

* Adds a bit of package documentation.

* Returns an empty response from restore to avoid EOF errors.

* Adds API client support for snapshots.

* Makes internal file names match on-disk file snapshots.

* Adds DC and token coverage for snapshot API test.

* Adds missing documentation.

* Adds a unit test for the snapshot client endpoint.

* Moves the connection pool out of the client for easier testing.

* Fixes an incidental issue in the prepared query unit test.

I realized I had two servers in bootstrap mode so this wasn't a good setup.

* Adds a half close to the TCP stream and fixes panic on error.

* Adds client and endpoint tests for snapshots.

* Moves the pool back into the snapshot RPC client.

* Adds a TLS test and fixes half-closes for TLS connections.

* Tweaks some comments.

* Adds a low-level snapshot test.

This is independent of Consul so we can pull this out into a library
later if we want to.

* Cleans up snapshot and archive and completes archive tests.

* Sends a clear error for snapshot operations in dev mode.

Snapshots require the Raft snapshots to be readable, which isn't supported
in dev mode. Send a clear error instead of a deep-down Raft one.

* Adds docs for the snapshot endpoint.

* Adds a stale mode and index feedback for snapshot saves.

This gives folks a way to extract data even if the cluster has no
leader.

* Changes the internal format of a snapshot from zip to tgz.

* Pulls in Raft fix to cancel inflight before a restore.

* Pulls in new Raft restore interface.

* Adds metadata to snapshot saves and a verify function.

* Adds basic save and restore snapshot CLI commands.

* Gets rid of tarball extensions and adds restore message.

* Fixes an incidental bad link in the KV docs.

* Adds documentation for the snapshot CLI commands.

* Scuttle any request body when a snapshot is saved.

* Fixes archive unit test error message check.

* Allows for nil output writers in snapshot RPC handlers.

* Renames hash list Decode to DecodeAndVerify.

* Closes the client connection for snapshot ops.

* Lowers timeout for restore ops.

* Updates Raft vendor to get new Restore signature and integrates with Consul.

* Bounces the leader's internal state when we do a restore.
2016-10-25 19:20:24 -07:00
James Phillips 104b12040a Merge pull request #2383 from hashicorp/jbs-1462
Clarify retry_join addresses for #1462
2016-10-20 11:40:03 -07:00
Brian Shumate 17dfb0b196
Reworded and applied to -retry-join also 2016-10-20 14:14:55 -04:00
James Phillips fa8cd7f833 Merge pull request #2381 from bluefeet/master
Add the Perl Consul client library to the list of SDKs on the web site.
2016-10-20 09:39:39 -07:00
James Phillips 41f1764434 Adds a version note for the consul kv command.
Closes #2410.
2016-10-13 08:02:20 -07:00
Michel Lebeau 2397c75856 Fix typo
The double "to" was distracting
2016-10-11 15:51:49 +01:00
James Phillips b073ec72f3 Adds a note about child process reaping going away. 2016-10-06 21:38:29 -07:00
James Phillips 55a00d4d1b Update community.html.erb 2016-10-06 17:38:34 -07:00
Adrián López Gómez e25efedcc2 Doc fix - allow_stale enabled by default in v0.7 2016-10-06 15:00:28 +02:00
Andreas Böttger cb8deabdc3 json syntax corrected 2016-10-04 15:40:53 +02:00
Brian Shumate 320b07c025
Clarify retry_join addresses for #1462
- Initial pass at adding note about address formats for retry_join;
  IPv4 is a list of IPs only, whereas IPv6 are bracketed IPs + port
2016-10-03 12:15:24 -04:00
Aran Deltac 28277d35e7 Add the Perl Consul client library to the list of SDKs on the web site. 2016-10-01 17:52:45 -07:00
James Phillips 9fc0c0ede2 Merge pull request #2369 from hashicorp/jbs-2204
Update getting started/join to address #2204
2016-09-30 07:51:30 -07:00
Brian Shumate ba5bbf8ca2
Update variable value information as port must also be specified, fixes #2210 2016-09-29 12:50:00 -04:00
Brian Shumate d8080c27d5
correction 2016-09-29 12:42:22 -04:00
Brian Shumate 38e45f9641
Update getting started/join to address #2204 2016-09-28 12:20:36 -04:00
Brian Shumate 775c32539f
Finalize update for -bind 2016-09-27 18:36:19 -04:00
Brian Shumate 59a90d68a9
Clarification 2016-09-27 12:38:32 -04:00
Brian Shumate 49a410a2da
Correct inaccurate bind reference, closes #2234 2016-09-27 12:05:22 -04:00
James Phillips 4dc526afed Merge pull request #2362 from mckennajones/cliflagformatting
Making CLI flag formatting consistent in the docs
2016-09-27 07:51:56 -07:00
James Phillips 1e318db830 Update operator.html.markdown 2016-09-27 06:25:51 -07:00
McKenna Jones 34043357da cli flag formatting for agent docs and one guide 2016-09-26 21:22:01 -07:00
McKenna Jones 865e9ea5c3 updating cli formatting for intro docs 2016-09-26 19:28:39 -07:00
Seth Vargo f381d19221
Update cas docs 2016-09-26 16:15:27 -07:00
Seth Vargo 28de64c7f0
Remove base64 comment entirely 2016-09-26 16:10:22 -07:00
Seth Vargo 39fb70ff67
Fix CAS operations for put 2016-09-26 16:06:56 -07:00
Seth Vargo 85350a4329
Update kv get docs 2016-09-26 16:06:56 -07:00
Seth Vargo c7496c5652
Change delete CAS behavior to require ModifyIndex 2016-09-26 16:06:55 -07:00
Seth Vargo b3c280772f
Gemfile was wonky 2016-09-26 16:06:54 -07:00
Seth Vargo de7fc2c7ac
Fix styles 2016-09-26 16:06:54 -07:00
Seth Vargo a6262c863b
Add top-level docs command 2016-09-26 16:06:54 -07:00
Seth Vargo 297a22383f
Add kv delete command 2016-09-26 16:06:53 -07:00
Seth Vargo 82bddd7f9b
Add kv put command 2016-09-26 16:06:53 -07:00
Seth Vargo c8fdc5c50d
Add kv get 2016-09-26 16:06:53 -07:00
Seth Vargo afd0e58c24
Update middleman 2016-09-26 16:06:52 -07:00
JF Bibeau ee008bcc2d Docs: Update command to create sample service
Since the previous command creates /etc/consul.d with sudo, a regular user won't have permission to echo and redirect a file to the directory. Switch to using tee with sudo to ensure the file gets created.
2016-09-26 16:36:10 -04:00
James Phillips cfa66a62ab
Updates middleman-hashicorp. 2016-09-23 16:13:12 -07:00
James Phillips c4c409be44 Update keyring.html.markdown 2016-09-23 16:00:05 -07:00
Seth Vargo e1c8b14a6b
Clarify that hostname defaults to localhost for tcp 2016-09-21 12:20:36 -04:00
Brian Shumate 2c9501a1b0
Remove references to the 'unknown' state.
- Remove reference to 'unknown' state in catalog endpoint docs
- Remove reference to 'unknown' state in health endpoint docs
2016-09-21 09:50:12 -04:00
James Phillips b2e867454a Updates getting started to remove broken links.
Fixes #2293.
2016-09-16 15:58:01 -07:00
James Phillips 6f0a3b9bf5 Adds Operator endpoint link. 2016-09-15 13:13:09 -07:00
Brian Shumate 1ee4ba2db6
Restore command line. 2016-09-15 10:37:08 -04:00
Brian Shumate 1654de6184
Command output updates.
- Updated starting agent example to show new output/timestamps
- Updated curl example to show TaggedAddresses
- Updated dig example to return 127.0.0.1
2016-09-15 10:25:23 -04:00
James Phillips f57b84b807 Tweaks wording in lifeguard section. 2016-09-14 10:17:23 -07:00
James Phillips c591d86dd5
Adds a section about lifeguard. 2016-09-14 10:09:23 -07:00
James Phillips d60c985f8f Updates website to version 0.7.0. 2016-09-14 09:27:31 -07:00
Pawel Szymczyk d97f389805 remove reference to localhost in operator.html.markdown 2016-09-14 12:12:27 +02:00
James Phillips 0a34741d72 Adds version note to near parameter. 2016-09-06 07:50:06 -07:00
James Phillips 08d6bfbc9b Tweaks options doc after latest merges. 2016-09-01 22:18:34 -07:00