The rank of Envoy was short for "Envoy Extraordinary and Minister Plenipotentiary", and was more commonly known as Minister. For example, the Envoy Extraordinary and Minister Plenipotentiary of the United States to the French Empire was known as the "United States Minister to France" and addressed as "Monsieur le Ministre."
- How to play
- Map to Consul
- Consul to Map
- Watch for key/value changes
- Consul CRUD
- Clone and Teleport
- Merging Configurations
- Options
- License
In order to follow all the docs below, bring envoy in:
$ boot repl
boot.user=> (require '[envoy.core :as envoy :refer [stop]])
nilSince most Clojure configs are EDN maps, you can simply push the map to Consul with preserving the hierarchy:
boot.user=> (def m {:hubble
{:store "spacecraft://tape"
:camera
{:mode "color"}
:mission
{:target "Horsehead Nebula"}}})
boot.user=> (envoy/map->consul "http://localhost:8500/v1/kv" m)
nildone.
you should see Consul logs confirming it happened:
2016/11/02 02:04:13 [DEBUG] http: Request PUT /v1/kv/hubble/mission/target? (337.69µs) from=127.0.0.1:39372
2016/11/02 02:04:13 [DEBUG] http: Request GET /v1/kv/hubble?recurse&index=2114 (4m41.723665304s) from=127.0.0.1:39366
2016/11/02 02:04:13 [DEBUG] http: Request PUT /v1/kv/hubble/camera/mode? (373.246µs) from=127.0.0.1:39372
2016/11/02 02:04:13 [DEBUG] http: Request PUT /v1/kv/hubble/store? (1.607247ms) from=127.0.0.1:39372and a visual:
In case a Clojure map with config read from Consul is needed it is just consul->map away:
boot.user=> (envoy/consul->map "http://localhost:8500/v1/kv/hubble")
{:hubble
{:camera {:mode "color"},
:mission {:target "Horsehead Nebula"},
:store "spacecraft://tape"}}you may notice it comes directly from "the source" by looking at Consul logs:
2016/11/02 02:04:32 [DEBUG] http: Request GET /v1/kv/hubble?recurse (76.386µs) from=127.0.0.1:54167You may also read from consul at a certain :offset by specifying it in options.
Let's say we need to get everything that lives under the hubble/mission:
boot.user=> (envoy/consul->map "http://dev-server:8500/v1/kv" {:offset "hubble/mission"})
{:target "Horsehead Nebula"}Specifying an offset is really useful for multiple environments or teams living in the same consul / acl.
Watching for kv changes with envoy does not require to run a separate Consul Agent client or Consul Template and boils down to a simple function:
(watch-path path fun)fun is going to be called with a new value each time the path's value is changed.
boot.user=> (def store-watcher (envoy/watch-path "http://localhost:8500/v1/kv/hubble/store"
#(println "watcher says:" %)))creates a envoy.core.Watcher and echos back the current value:
#'boot.user/store-watcher
watcher says: {:hubble/store spacecraft}it is an envoy.core.Watcher:
boot.user=> store-watcher
#object[envoy.core.Watcher 0x72a190f0 "envoy.core.Watcher@72a190f0"]that would print to REPL, since that's the function provided #(println "watcher says:" %), every time the key hubble/store changes.
let's change it to "Earth":
once the "UPDATE" button is clicked REPL will notify us with a new value:
watcher says: {:hubble/store Earth}same thing if it's changed with envoy/put:
boot.user=> (envoy/put "http://localhost:8500/v1/kv/hubble/store" "spacecraft tape")
watcher says: {:hubble/store spacecraft tape}
{:opts {:body "spacecraft tape", :method :put, :url "http://localhost:8500/v1/kv/hubble/store"}, :body "true", :headers {:content-length "4", :content-type "application/json", :date "Wed, 02 Nov 2016 03:22:41 GMT"}, :status 200}envoy.core.Watcher is stoppable:
boot.user=> (stop store-watcher)
"stopping" "http://localhost:8500/v1/kv/hubble/store" "watcher"
trueIn case you need to watch a hierarchy of keys (with all the nested keys), you can set a watcher on a local root key:
boot.user=> (def hw (envoy/watch-path "http://localhost:8500/v1/kv/hubble"
#(println "watcher says:" %)))notice this watcher is on the top most / root /hubble key.
In this case only the nested keys which values are changed will trigger notifications.
Let's say we went to hubble/mission and changed it from "Horsehead Nebula" to "Butterfly Nebula":
watcher says: {:hubble/mission Butterfly Nebula}It can be stopped as any other watcher:
boot.user=> (stop hw)
"stopping" "http://localhost:8500/v1/kv/hubble?recurse" "watcher"
true There is a more visual example of envoy watchers that propagate notifications all the way to the browser:
Notification listner is just a function really, hence it can get propagated anywhere intergalactic computer system can reach.
The map from above can be done manually by "puts" of course:
boot.user=> (envoy/put "http://localhost:8500/v1/kv/hubble/mission" "Horsehead Nebula")
{:opts {:body "Horsehead Nebula", :method :put, :url "http://localhost:8500/v1/kv/hubble/mission"}, :body "true", :headers {:content-length "4", :content-type "application/json", :date "Wed, 02 Nov 2016 02:57:40 GMT"}, :status 200}
boot.user=> (envoy/put "http://localhost:8500/v1/kv/hubble/store" "spacecraft")
{:opts {:body "spacecraft", :method :put, :url "http://localhost:8500/v1/kv/hubble/store"}, :body "true", :headers {:content-length "4", :content-type "application/json", :date "Wed, 02 Nov 2016 02:58:13 GMT"}, :status 200}
boot.user=> (envoy/put "http://localhost:8500/v1/kv/hubble/camera/mode" "color")
{:opts {:body "color", :method :put, :url "http://localhost:8500/v1/kv/hubble/camera/mode"}, :body "true", :headers {:content-length "4", :content-type "application/json", :date "Wed, 02 Nov 2016 02:58:36 GMT"}, :status 200}boot.user=> (envoy/get-all "http://localhost:8500/v1/kv/hubble")
{:hubble/camera/mode "color",
:hubble/mission "Horsehead Nebula",
:hubble/store "spacecraft://tape"}
boot.user=> (envoy/get-all "http://localhost:8500/v1/kv/hubble/store")
{:hubble/store "spacecraft"}in case there is no need to convert keys to keywords, it can be disabled:
boot.user=> (envoy/get-all "http://localhost:8500/v1/kv/" {:keywordize? false})
{"hubble/camera/mode" "color",
"hubble/mission" "Horsehead Nebula",
"hubble/store" "spacecraft://tape"}boot.user=> (envoy/delete "http://localhost:8500/v1/kv/hubble/camera")
{:opts {:method :delete, :url "http://localhost:8500/v1/kv/hubble/camera?recurse"}, :body "true", :headers {:content-length "4", :content-type "application/json", :date "Wed, 02 Nov 2016 02:59:26 GMT"}, :status 200}
boot.user=> (envoy/get-all "http://localhost:8500/v1/kv/hubble")
{:hubble/mission "Horsehead Nebula", :hubble/store "spacecraft://tape"}It is often the case when configuration trees need to be copied or moved from one place to another, under a new root or a new nested path. envoy can do it with copy and move commands.
Copying configuration from one place to another is done with a copy command:
=>
(envoy/copy kv-path from to)
Let's say we need to copy Hubble's mission (i.e. a "sub" config) under a new root "dev", so it lives under "/dev/hubble/mission" instead:
boot.user=> (envoy/copy "http://localhost:8500/v1/kv" "/hubble/mission" "/dev/hubble/mission")done. Let's read from this new "dev" root to make sure the mission is there:
boot.user=> (envoy/consul->map "http://localhost:8500/v1/kv/dev")
{:dev {:hubble {:mission {:target "Horsehead Foo"}}}}great.
We can of course copy the whole "hubble"'s config under "dev":
boot.user=> (envoy/copy "http://localhost:8500/v1/kv" "/hubble" "/dev/hubble")boot.user=> (envoy/consul->map "http://localhost:8500/v1/kv/dev")
{:dev {:hubble {:camera {:mode "color"}, :mission {:target "Horsehead Nebula"}, :store "spacecraft tape"}}}copy is really handy when you need to copy configurations between environments, or just need to copy some nested portion of the config.
A move command is exactly the same as the copy, but, as you would expect, it deletes the source after the copy is done.
=>
(envoy/move kv-path from to)
The Hubble's development work is finished, and we are switching to work on the Kepler telescope. Let's say most of the configuration may be reused, so we'll just move Hubble's config to Kepler:
boot.user=> (envoy/move "http://localhost:8500/v1/kv" "/hubble" "/kepler")done.
Oh, but we'll need "dev" and "qa" environments for Kepler's development. Let's move it again to live under "dev" root:
boot.user=> (envoy/move "http://localhost:8500/v1/kv" "/kepler" "/dev/kepler")and "copy" this config to "qa" before editing it:
boot.user=> (envoy/copy "http://localhost:8500/v1/kv" "/dev/kepler" "/qa/kepler")Let's look at Kepler's Consul universe:
boot.user=> (envoy/consul->map "http://localhost:8500/v1/kv")
{:dev
{:kepler
{:mission {:target "Horsehead Nebula"},
:camera {:mode "color"},
:store "spacecraft tape"}},
:qa
{:kepler
{:mission {:target "Horsehead Nebula"},
:camera {:mode "color"},
:store "spacecraft tape"}}}Niice, universe awaits...
Often there is an internal configuration some parts of which need to be overridden with values from Consul. Envoy has merge-with-consul function that does just that:
(envoy/merge-with-consul config "http://localhost:8500/v1/kv/hubble")will deep merge (with nested kvs) config with a map it'll read from Consul.
In case a Consul space is protected by a token, or any other options need to be passed to Consul to read the overrides, they can be added in an optional map:
(envoy/merge-with-consul config
"http://localhost:8500/v1/kv/hubble"
{:token "7a0f3b39-8871-e16e-2101-c1b30a911883"})All commands take an optional map of options.
For example, in case keys are protected by ACL, you can provide a token:
boot.user=> (envoy/consul->map "http://localhost:8500/v1/kv"
{:token "4c308bb2-16a3-4061-b678-357de559624a"})
{:hubble {:mission "Butterfly Nebula", :store "spacecraft://ssd"}}or any other Consul options.
Copyright © 2016 tolitius
Distributed under the Eclipse Public License either version 1.0 or (at your option) any later version.