Craft.

Is it ready? We iroh'ed out the basics

“Have we ironed out the basics? We iroh'ed them out — and now I get to go build the thing this whole substrate was always just an excuse for.”

A certificate that rides the gossip — and why I moved it

“The tidy, clever mechanism — trust that rides the gossip and survives a relay — lost to the boring one that checks the credential where it gets spent.”

Extending the mesh with node caches

“A cache that only learns is a leak. It has to forget on the same clock the mesh forgets.”

Keeping a node's name across a restart

“The data dir isn't where the node keeps its identity. The data dir IS the identity — which is why the scariest bug was a five-second timer.”

The bug that wasn't in the mesh

“Write your root cause as a sentence you'd be willing to have your own logs contradict. Mine did, and the cure was 30 seconds of debug logging — not another rebuild.”

Kill by message, not by ownership — and a node is a state

“Which OS process happens to own a node should have nothing to do with who's allowed to operate on it. A kill is a message, not a syscall.”

The relay is a postbox, not a peer

“The relay is an untrusted postbox: you trust it to forward, not to read or vouch. The keys do the vouching, point to point, direct or relayed alike.”

Make the cross-mesh view honest

“A dependency graph is only as honest as the spans under it. If a service name is too coarse, nodes merge; if a receiver emits nothing, edges vanish; if you cc the observer, fake edges appear. Fix the emission, not the picture.”

Watching a node boot, then a second mesh with no bridge

“A node that does work without leaving a trace is a bug. Start with the trace; everything else hangs off the spine it gives you.”

Hunting a connection leak the soak test wouldn't explain

“When a leak resists reasoning, stop reasoning and instrument it. A spawned-vs-finished counter found in minutes what hours of reading the reap path missed.”

Chaos-pass replaces tests-pass

“Steady-state-only passing is insufficient. The cluster has to survive being broken.”

Four days into the soak, the RAM was still climbing

“The worst CPU offenders had zero active peers. That's the fingerprint of dead-state accumulation.”

Flamegraphing your way out of "this can't possibly be right"

“Comments lie. Flamegraphs don't.”

When 18 nodes pegged my 80-core box at 100%

“Three obvious wins got the host from 100% to 35%. Still wrong, just less wrong.”

Why I'm building a distributed mesh substrate in Rust

“I want to feel where the iroh-as-substrate story breaks at small scale before betting a real product on it.”

4.5 years of connected products — what I'd do again

“I had the v1 OTA post on my desk when I scoped v2. I knew exactly what it cost on v1 to ship without OTA. I deferred it anyway. The mistake wasn't ignoring the lesson — it was assuming the cost curve was the same.”

Thirteen years on — the long-arc smart-home retrospective

“The smart home I have now isn't a continuous evolution of the one I started with. It's three architectures stacked on top of each other, the seams still visible if you look. That's not a failure. It's the most honest thing in the house.”

Twelve years of pet IoT — the long-arc retrospective

“Twelve years in. Mars just divested Whistle to Tractive — the empire that bought the device leg in 2016 sold it back nine years later. Cloud-dependency lesson written. DIY response just starting. The pet-IoT category is the smart-home category five years behind — same arc, smaller scale, higher stakes.”

How ITIL's “Focus on Value” transforms a frustrating UX

“We’ve all been there. Staring at a frozen computer screen, deadline looming, frustration mounting. You call IT support, only to be met with a robotic script and a long wait time. This isn&#82…”

Atom's last year — what the data told us, and what I missed

“I read the data for six months. The signal was there. I was watching the wrong metric. The metric a healthy dog tracks is not the same metric a sick dog tracks. Different dashboards for different stages.”

Two years on medical IoT — the platform retrospective

“The connected health portfolio was where I learned that 'API team' and 'IoT team' are two names for the same job. The hardware ships once. The platform supports it forever.”

What is Lean Innovation?

“Lean innovation is being embraced by everyone — from the smallest start-ups to the largest global organizations. But in most cases, it’s still falling well short of its full potential because…”