runs/monetize-ci/20261031T1736Z-95a34a0c/03-lake.log
Finished `release` profile [optimized] target(s) in 0.13s
bench: PASS the bench's axes: cloud mock, vendor mock (the open dummies)
bench: PASS the product block is pulled: an instance, no endpoint, no grants: [products.lake] instance = "acme"
[guest lake] lake: guest op 90 lifecycle.facts from monetize-server
bench: PASS the ONE box loads the signed Lake guest and takes its lifecycle (its own roles, no twin): lifecycle lake: taken from the guest of [products.lake] (blake3 e168fea493b5); roles ["front", "ingestor", "be", "fe", "graph"], primary fe
lake: bench.one-box from bench gRPC at http://127.0.0.1:42869
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":500,"ingestors":2,"ingestor_plan":"STARTER-2xCPU-4GB","be":3,"fe":1,"graph":false}
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":500,"ingestors":2,"ingestor_plan":"STARTER-2xCPU-4GB","be":3,"fe":1,"graph":true}
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":500,"ingestors":2,"ingestor_plan":"STARTER-2xCPU-4GB","be":4,"fe":1,"graph":false}
bench: PASS quote: no numbers is the smallest Lake (front, ingestor, be, fe): 108.00 EUR a month
bench: PASS quote: the buyer's numbers are the shape (500 GiB, 2 ingestors on STARTER-2xCPU-4GB, 3 BE, 1 FE: 7 machines, no main, no twin): ["front", "ingestor", "ingestor-2", "be", "be-2", "be-3", "fe"], 204.00 EUR a month
bench: PASS quote: a graph database is one machine more: 8 machines, 240.00 EUR a month
bench: PASS quote: grow = changing the numbers (be 3 -> 4): one backend more, a higher price: 204.00 EUR -> 240.00 EUR a month, + 4
bench: PASS quote: an order out of range is refused by name (2 frontends): [products.lake] its lifecycle's lay plan: product refused: Apache Doris has 1, 3 or 5 frontends (an odd number elects a leader); 2 is not
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=quote order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
lake: bench.sells from monetize-server the ladder priced: sells=true
lake: site.who from relay user=""
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
monetize-server: estate order estate/acme: ordered
bench: PASS buy: a visitor starts the order through the site's relay (EstateOrder.Start over gRPC): {"price_words":"648.00 EUR","state":"waiting_for_payment","url":"https://pay.mock.invalid/c/res-1","words":"Waiting for your payment on the payment page."}
bench: SAID LANDED (P3): the order rides the wire (proto EstateSizes.order, the relay's `order`), checked against the Lake's facts.form at the ONE box; this bench still buys the default order
lake: bench.vendor from buyer authorised res-1 at the mock vendor; captures so far 1
lake: bench.phase from monetize-server ordered
monetize-server: signup account:acct_93d70e575c7869db846c42f4fa14ed3f — would create acme for lake/account (0.00 EUR at account); NO principal was created (the open build's LoudSink)
monetize-server: an account at the shop was made for "acme" (account)
monetize-server: the sign-in link for "acme" was NOT mailed to bu***@mock.invalid (Refused("this deployment's signup sink sends no mail")); the account is made
monetize-server: estate order estate/acme: ordered → held
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
monetize-server: estate order estate/acme: held → laying
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
lake: dns.write from monetize-server acme.lake.mock.invalid A 198.51.100.10
monetize-server: estate order estate/acme: laying → installing
lake: dns.write from monetize-server www.acme.lake.mock.invalid A 198.51.100.10
lake: dns.write from monetize-server s3.acme.lake.mock.invalid A 198.51.100.10
lake: installer.install from monetize-server product=lake company=acme account=acme
lake: box.start from bench front listening at 127.0.0.1:40057
lake: pairing.feed from monetize company=acme instance=acme role=front
lake: box.start from bench ingestor listening at 127.0.0.1:44519
lake: pairing.feed from monetize company=acme instance=acme role=ingestor
lake: box.start from bench be listening at 127.0.0.1:36245
lake: pairing.feed from monetize company=acme instance=acme role=be
lake: box.start from bench fe listening at 127.0.0.1:42647
lake: pairing.feed from monetize company=acme instance=acme role=fe
monetize-server: estate order estate/acme: installing → paired
lake: vendor.capture from monetize-server captures=2 at phase paired
lake: bench.phase from monetize-server paired
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: installer.sale_check from monetize-server host=acme.lake.mock.invalid account=acme
lake: front.login from monetize
lake: installer.first_door from monetize-server host=acme.lake.mock.invalid
lake: front.first-login from monetize door=open
monetize-server: estate order estate/acme: paired → captured
monetize-server: ALERT estate-orders.ready estate/acme: the estate.ready mail was not sent (Refused("this deployment's signup sink sends no mail")); asked again within the hour
lake: bench.phase from monetize-server captured
bench: PASS lay → install → sale check → capture: captured
bench: PASS instantiate: the cloud laid exactly the guest's plan (front, ingestor, be, fe): front, ingestor, be, fe
bench: PASS dns: the estate's names are the ones the Lake serves (s3., no git.): 3 record(s)
bench: PASS the vendor holds the money captured: res-1 captured at the mock vendor (2 capture call(s))
lake: site.who from relay user="acme"
lake: site.ticket from relay account=acme purpose=estate: the Lake mints no actor tickets
bench: PASS buy: the signed-in buyer reads the order's state through the relay (no ticket: the Lake mints none, so the answer is the state anyone may see): {"change_status":"","change_words":"","paid_until":"","records":[],"state":"ready","url":"","words":"Your Lake is ready at https://acme.lake.mock.invalid; it is paid until 2027-04-30. Your first sign-in link is being mailed to you. The sign-in link for your new account is in your mail: open it to register your passkey, then sign in."}
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
bench: PASS ready: the first report of every role arrived: acme: front, ingestor, be, fe
bench: PASS ready: the pulled product's tenants and usage come from its primary's report (no call into the estate): tenants [TenantId("acme")], ingested_bytes=42 from the fe report
bench: SAID LANDED (P3-FACTS): facts.primary_role = `fe`, the FE leader: the core's primary (the tenants, the entitlement orders) is read off the facts, not the first data role
lake: fleet.order from monetize role=fe seq=1 kind=entitlement
bench: PASS fleet: an entitlement is a signed order the primary pulls (Fleet.Orders): the fe pulled ["entitlement"]
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
bench: PASS grow: be 1 → 2 on a standing Lake opens a plan change that lays be-2 (the product's plan for the new numbers; facts.grow may_add be), its difference held: estate/acme/change-1: a new be-2 (STARTER-4xCPU-16GB) laid beside the machines that stand (nothing that stands is stopped for it). The price becomes 144.00 EUR a month; for the 181 day(s) left of the period paid until 2027-04-30, 217.20 EUR is held now and charged when the change is done. (217.20 EUR held, 144.00 EUR a month after)
bench: SAID LANDED (P3-FACTS): a plan change that ADDS machines (be 1 → 2): the new numbers' plan, the machines it lays that are not laid, held, laid beside the estate, installed, heard and captured; taking machines away is refused by name
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[1] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
lake: installer.install from monetize-server product=lake company=acme account=acme
lake: pairing.feed from monetize company=acme instance=acme role=front
lake: pairing.feed from monetize company=acme instance=acme role=ingestor
lake: pairing.feed from monetize company=acme instance=acme role=be
lake: pairing.feed from monetize company=acme instance=acme role=fe
lake: box.start from bench be-2 listening at 127.0.0.1:43833
lake: pairing.feed from monetize company=acme instance=acme role=be-2
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
bench: PASS grow: be-2 is laid at the cloud beside the estate, paired by the estate's installer and heard on the pull channel: laid front, ingestor, be, fe, be-2
bench: PASS grow: the change is done, its hold captured, and the Lake is billed for its new machine from now on: estate/acme/change-1 done; 144.00 EUR a month (was 108.00 EUR)
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":100,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":1,"fe":1,"graph":false}
bench: PASS grow: a backend is never taken away by a buy (facts.grow may_remove names none): refused by name, nothing held: NotNow("a plan change takes no be-2 away: this product takes no machine away by a plan change; nothing was held")
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":200,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
bench: PASS grow the store: store_gib 100 → 200 on a standing Lake grows the backends' data disks whose share is bigger (no machine laid), its difference held: estate/acme/change-2: be-2's data disk grows from 50 to 100 GiB, once paid (each disk is detached for a few minutes while it grows and put back at its place; its machine is not stopped). The period is paid until 2027-04-30; nothing more is charged now, and from the renewal the price is 144.00 EUR a month. (0.00 EUR held)
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":200,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
bench: PASS grow the store: each standing backend's data disk is grown at the cloud and read back at its new size, the hold captured, the Lake billed for it: estate/acme/change-2 done: be-2 100 GiB; 144.00 EUR a month (was 144.00 EUR)
bench: PASS grow the store: the store never shrinks (facts.grow never_shrinks store_gib): 200 → 100 refused by name, nothing held: BadName("data never shrinks: store_gib is 200 now, and 100 was asked")
[guest lake] lake: guest op 91 lifecycle.lay_plan from monetize-server company=acme order={"store_gib":200,"ingestors":1,"ingestor_plan":"STARTER-1xCPU-2GB","be":2,"fe":1,"graph":false}
bench: PASS renew: EstateOrder.Renew opens the renewal's page: estate/acme/renewal-1 https://pay.mock.invalid/c/res-3
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
monetize-server: ALERT estate-orders.ready estate/acme: the estate.ready mail was not sent (Refused("this deployment's signup sink sends no mail")); asked again within the hour
bench: PASS renew: the paid renewal moves paid_until on: paid until 1809106912519 -> 1824918112519
lake: bench.release from operator release r2 fed; the ONE box restarted on it
monetize-server/update: estate/acme: the estate's firewall written again before the update
monetize-server/update: estate/acme: bench opened an update to lake-r2 (live where it can): front-keep — front waiting, ingestor waiting, fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main
bench: PASS update: UpdateEstate opens the update to r2: update to lake-r2 (live where it can): front-keep — front waiting, ingestor waiting, fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: fleet.update_take from box open=false release= live=false role= words="update to lake-r2 (live where it can): front-keep — front waiting, ingestor waiting, fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
monetize-server/update: acme.lake.mock.invalid: no keep boot of the front is waiting (none open, or one already began): nothing booted
lake: bench.front-keep from bench the shop's keep boot of the front, taken by the bench as the server loop's job would
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: fleet.update_take from box open=true release=lake-r2 live=true role=ingestor words="update to lake-r2 (live where it can): running — front done (keep), ingestor waiting, fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
monetize-server/update: estate/acme: ingestor done:live: update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main
lake: fleet.update_report from box role=ingestor outcome=done:live answer="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: fleet.update_take from box open=true release=lake-r2 live=true role=fe words="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe waiting, be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
monetize-server/update: estate/acme: fe done:live: update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main
lake: fleet.update_report from box role=fe outcome=done:live answer="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: fleet.update_take from box open=true release=lake-r2 live=true role=be words="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be waiting, be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
monetize-server/update: estate/acme: be done:live: update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be done (live), be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main
lake: fleet.update_report from box role=be outcome=done:live answer="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be done (live), be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
lake: fleet.report from be instance=acme acked=[] next_ms=30000
lake: fleet.report from be-2 instance=acme acked=[] next_ms=30000
lake: fleet.report from fe instance=acme acked=[] next_ms=30000
lake: fleet.report from front instance=acme acked=[] next_ms=30000
lake: fleet.report from ingestor instance=acme acked=[] next_ms=30000
lake: fleet.update_take from box open=true release=lake-r2 live=true role=be-2 words="update to lake-r2 (live where it can): running — front done (keep), ingestor done (live), fe done (live), be done (live), be-2 waiting — front first: the shop keep-boots the front, then the new front takes twin and main"
monetize-server/update: estate/acme: be-2 done:live: update to lake-r2 (live where it can): done — front done (keep), ingestor done (live), fe done (live), be done (live), be-2 done (live) — every box runs release lake-r2
lake: fleet.update_report from box role=be-2 outcome=done:live answer="update to lake-r2 (live where it can): done — front done (keep), ingestor done (live), fe done (live), be done (live), be-2 done (live) — every box runs release lake-r2"
bench: PASS update: the shop keep-boots the front first, then the front takes every other member; every machine runs r2: the front keep-booted by the shop, then it took ["ingestor", "fe", "be", "be-2"];
monetize-server: ALERT estate-orders.terminate estate/acme: no backup taken: none is offered at terminate
bench: PASS terminate: no backup, the estate ends: Termination { done: false, words: "acme.lake.mock.invalid is being ended now: its machines, disks and DNS records are being given back." }
lake: dns.remove from monetize-server acme.lake.mock.invalid www.acme.lake.mock.invalid s3.acme.lake.mock.invalid
monetize-server: ALERT estate-orders.terminate estate/acme: every machine, disk and DNS record given back: 7 resource(s) given back; nothing is billed under the reference; 3 name(s) printed
monetize-server: ALERT estate-orders.terminate estate/acme: the ONE box's records of it forgotten: the estate, 5 box key(s), 5 box(es) (be, be-2, fe, front, ingestor)
monetize-server: ALERT estate-orders.terminate estate/acme: terminated: nothing of it is left, and nothing more is charged
lake: bench.phase from monetize-server terminated
bench: PASS terminate: the cloud holds nothing of the estate: 0 resources left
bench: SAID LANDED (P3-FACTS): facts.roles with RoleFacts.many and optional (`be`, `be-2`, …; `graph` laid or not); the update still expands `<role>-<n>` and leaves `graph` out of the update order
bench: SAID the store as a plan member (Cloud.price/lay of an object store): the input store is the BE data disks today
bench: SAID LANDED (P3-FACTS): facts.grow (never_shrinks store_gib, may_add, may_remove): the core refuses a shrink of the store and a machine the rule does not allow, by name
bench: SAID LANDED (A4-FACTS): new numbers that grow the store over the backends that stand grow each backend's data disk at the cloud, once paid; a backend is never taken away (facts.grow names no drain and may_remove none)
bench: PASS, receipt at /backup/ci-target/monetize/lake-bench/receipt.txt
✅ the Lake bench passed; receipt: /backup/ci-target/monetize/lake-bench/receipt.txt