24 newsletters today.
Abandoned Futures
2026-09-04
In July 1971, Chile's newly-elected socialist government hired British cybernetician Stafford Beer to solve an impossible problem: how do you manage a rapidly-nationalizing economy of ~500 firms in real time without turning into the Soviet Union's paper-choked Gosplan? Beer's answer was Project Cybersyn (Spanish: SYNCO) β a distributed nervous system for a national economy, running on hardware so modest it would embarrass a modern smart thermostat.
The architecture was radical. Beer applied his Viable System Model β a five-tier recursive control structure derived from neurophysiology β to the state. Every nationalized factory got a telex machine. Daily production data (raw inputs, output, absences, breakdowns) was punched onto tape and transmitted to Santiago over a repurposed satellite-tracking network called Cybernet. A single IBM System/360 Model 50 β later a Burroughs 3500 β ran the software stack:
The system's proving moment came in October 1972, when a CIA-backed truck owners' strike tried to strangle Chile. Cybersyn's telex network β normally used for daily reports β became an ad-hoc logistics coordinator, routing the ~200 loyal trucks around blockades to keep Santiago fed. It worked. The economy stayed alive.
Eleven months later, on September 11, 1973, Pinochet's tanks rolled. Soldiers occupied the Opsroom in La Moneda and, reportedly baffled by what they were looking at, smashed it. Beer, in London, escaped. Fernando Flores, the project's Chilean lead, went to a concentration camp. The Burroughs mainframe was carted off. The system was gone.
Why it failed: Not technology. Cybersyn ran on 1970s telex and a mainframe with less RAM than a modem's firmware today. It failed because the government it served was overthrown. The Nixon administration had explicitly ordered the economy be "made to scream." Beer's project made it not scream β which was, ironically, unforgivable.
Why now: Every capability Cybersyn strained to deliver is now trivial. Real-time factory telemetry is what Kafka, MQTT, and OPC-UA do at millions of events per second. Statistical anomaly detection is a Prometheus alert. CHECO's dynamic modeling is what agent-based economic simulators like MESA run on laptops. CYBERFOLK's citizen polling is literally every social platform's dashboard. Amazon's supply chain, Walmart's Retail Link, and China's Golden Shield are each recognizable descendants of Cybersyn β just privately owned and opaque.
What we haven't built is Beer's actual innovation: a transparent, democratically-accountable version, where the algedonic signals flow both ways and citizens hold the dials. The tools are sitting on GitHub. The political imagination isn't. A modern Cybersyn could run on a Raspberry Pi cluster; the reason nobody has built one is that the question "who decides the setpoints?" is harder in 2026 than the software was in 1972.
ArXiv Paper Digest
2026-09-04
If you've ever asked an AI to "fix this one bug" and gotten back a file where half the code has been quietly rewritten β different variable names, restructured loops, a new helper function you didn't ask for β this paper is about you. The authors call this behavior over-editing, and they set out to measure exactly how bad it is.
Here's the setup. Correctness is the usual bar for AI code repair: does the fixed code pass the tests? But in real software work, that's not enough. A good fix is also minimal β it changes only what needs to change. Minimal patches are easier to review, easier to trust, and less likely to introduce sneaky new bugs in code that wasn't broken in the first place. When a model rewrites a working function while fixing a bug in a nearby one, it's burning your reviewer's time and adding risk.
To study this rigorously, the authors built a clever benchmark. They took 400 problems from BigCodeBench (a well-known coding benchmark), and for each one they took the correct reference solution and injected a small, controlled bug at the syntax-tree level β say, flipping a comparison operator or swapping two arguments. Because they know exactly what corruption they introduced, they also know exactly what the minimal fix looks like: undo that one change. This gives them a ground-truth "smallest possible patch" to compare against.
Then they ran a range of LLMs on these repair tasks and measured two things: did the model fix the bug (correctness), and how much extra code did it touch beyond the minimal patch (fidelity)?
The findings, based on the abstract:
The deeper insight is that we've been evaluating code-editing models on the wrong thing. "Did the tests pass?" hides a lot of sloppy behavior that matters enormously in practice β especially as these tools get folded into pull-request workflows where humans have to read every changed line. If your AI reviewer's diff is three times bigger than it needs to be, the human on the other end starts rubber-stamping, and that's where bugs slip through.
Daily Automotive Engines
2026-09-04
A camshaft lobe has two flanks: the opening ramp that lifts the valve off its seat, and the closing ramp that sets it back down. For decades, cam grinders treated these as mirror images β symmetric lobes were simple to design, easy to grind, and predictable. But modern performance cams almost universally use asymmetric profiles, where the opening flank is aggressive and the closing flank is gentler. Understanding why reveals a fundamental truth about valvetrain dynamics.
Why open aggressively? The opening event happens when the valve spring is at its shortest, most-preloaded state. Spring force is high, valvetrain mass is under compression, and the follower is firmly loaded against the lobe. You can accelerate the valve hard here without losing contact β the spring will keep the follower planted no matter how violently you ramp lift. Fast opening means more area under the lift curve, which means more airflow during the critical mid-lift portion of the event.
Why close gently? The closing event is where valvetrain chaos lives. As the valve decelerates and approaches the seat, spring pressure is dropping (spring is longer, less preloaded), but the valve still carries kinetic energy. If you decelerate too hard, the follower can separate from the lobe β valve float β and the valve slams the seat at uncontrolled speed. Even without float, an aggressive closing ramp causes valve bounce: the valve hits the seat, rebounds, and reseats a second time. Bounce burns seats, breaks valves, and destroys power at high RPM.
Real-world example: Comp Cams' Xtreme Energy series uses asymmetric lobes with roughly 8β12% more area on the opening side than the closing side. Their XE274H hydraulic flat-tappet lobe opens at ~0.008" per degree during the aggressive ramp phase but closes at ~0.006" per degree β same duration, but the valve spends more time at high lift. That extra area under the curve is worth 10β15 horsepower on a small-block Chevy compared to a symmetric lobe of the same specs.
Rule of thumb: Asymmetry is measured by the ratio of opening-side area to closing-side area. Street cams run 1.02β1.05 (mildly asymmetric). Race cams run 1.08β1.15. Beyond 1.20, you're fighting valvetrain stability more than you're gaining airflow β the closing side becomes so gentle it eats duration without adding meaningful area.
The asymmetry also shifts the peak lift point slightly toward the closing side, which is why intake centerlines on asymmetric cams don't match the geometric center of the lobe. Degreeing a cam requires knowing which measurement method the grinder used.
Daily Debugging Puzzle
sync.Pool Reset Trap: The Response Buffer That Leaks Yesterday's Data2026-09-04
This helper renders a small JSON response. To avoid allocating a fresh bytes.Buffer per request, it pools them with sync.Pool. Handlers hammer it under load, latency looks great, and unit tests pass. Then a security engineer files a ticket: users are occasionally seeing other users' data prepended to their responses.
var bufPool = sync.Pool{
New: func() any { return new(bytes.Buffer) },
}
// renderJSON returns a JSON payload for the given user.
func renderJSON(u *User) string {
buf := bufPool.Get().(*bytes.Buffer)
defer bufPool.Put(buf)
fmt.Fprintf(buf, `{"id":%d,"name":%q,"email":%q}`,
u.ID, u.Name, u.Email)
return buf.String()
}
func handler(w http.ResponseWriter, r *http.Request) {
u := lookupUser(r)
io.WriteString(w, renderJSON(u))
}
Alice hits /me, gets {"id":1,"name":"Alice","email":"[email protected]"}. Bob hits it right after and sees:
{"id":1,"name":"Alice","email":"[email protected]"}{"id":2,"name":"Bob","email":"[email protected]"}
PII from another user, leaked into Bob's response. What went wrong?
sync.Pool.Get() makes no promise about the state of the object it returns. It hands back whatever was put in β with all its bytes, length, and capacity intact. The New function only fires when the pool is empty; on a hot path, Get almost always returns a recycled object, which means it comes back with the previous caller's data still in it.
The idiomatic bytes.Buffer gives you Write*, which appends. So the flow is:
New, writes her JSON, calls String(), defers Put.Get, and receives Alice's buffer β still containing her JSON.Fprintf appends Bob's JSON to Alice's. String() returns both, concatenated.It's not just a cosmetic bug. The buffer's underlying byte array is user-controlled state that survives across goroutines and across requests. This is exactly the class of bug that leaked memory contents in Cloudbleed β reused buffers spilling one tenant's data into another's response.
Tests miss it because pools appear empty in isolation: the first call always hits New, returning a pristine buffer. You need concurrent load β enough traffic that Put gets called before the next Get β before the recycled state shows up.
Reset the buffer immediately after Get, before any writes:
func renderJSON(u *User) string {
buf := bufPool.Get().(*bytes.Buffer)
buf.Reset() // β wipe whatever the previous caller left
defer bufPool.Put(buf)
fmt.Fprintf(buf, `{"id":%d,"name":%q,"email":%q}`,
u.ID, u.Name, u.Email)
return buf.String()
}
Reset is O(1) β it just sets the length back to zero, keeping the capacity β so you get the allocation win without the data-leak risk. Wrap it in a helper if you use pools often:
func getBuf() *bytes.Buffer {
b := bufPool.Get().(*bytes.Buffer)
b.Reset()
return b
}
Two related landmines to avoid: don't return buf.Bytes() from a pooled buffer β the returned slice aliases storage that another goroutine will overwrite. And put an upper bound on buffer size before returning to the pool, or a single 50MB request pins 50MB forever.
sync.Pool.Get returns objects in whatever state the previous user left them β always reset pooled state before use, or you're serving stale bytes to the next request.
Daily Digital Circuits
2026-09-04
A DAC converts an N-bit digital code into a proportional analog voltage. The naive approach β a binary-weighted resistor network with values R, 2R, 4R, 8R, ..., 2^(N-1)Β·R β falls apart fast. For a 12-bit DAC, you'd need resistors spanning a 4096:1 range, and they'd all need to match to within 1 part in 4096 (~0.025%). Silicon resistors can't hit that. The R-2R ladder solves this by using only two resistor values, R and 2R, and lets ratiometric matching do the work.
The structure: a repeating ladder where each "rung" has a switch that connects a 2R resistor either to ground or to the output node. The horizontal series resistors are all R, the vertical arms are all 2R. Every node in the ladder sees a Thevenin equivalent of 2R looking left and 2R looking right β so the impedance at every node is identical, and each bit position contributes exactly half the weight of the bit above it.
Why this is magical: the absolute value of R doesn't matter. What matters is that all your Rs match each other and all your 2Rs are exactly twice them. On silicon, you build the 2Rs as two Rs in series with identical geometry, orientation, and adjacent placement. Layout matching to 0.01% is routine even when the absolute resistance drifts 20% over process and temperature.
Concrete example: An 8-bit R-2R DAC with V_ref = 5V and R = 10kΞ©. Digital code 10110100 (180 decimal) produces V_out = 5V Γ 180/256 = 3.516V. The switches route bits 7,5,4,2 to V_ref and bits 6,3,1,0 to ground. Each bit's contribution is halved by the ladder's binary attenuation as it propagates toward the output node.
Where you'll find them: Audio codecs, older 8-16 bit DACs in microcontrollers (PIC, AVR), oscilloscope calibration circuits, and β famously β the classic AD7541 12-bit DAC that lived in a million pieces of test equipment through the 80s and 90s. Modern high-resolution converters use sigma-delta or SAR architectures, but R-2R still dominates when you need moderate resolution with fast settling (nanoseconds, not microseconds) and no oversampling latency.
Rule of thumb: R-2R ladders scale well to about 14 bits before matching requirements become impractical. Beyond that, either segment the DAC (use R-2R for LSBs and thermometer coding for MSBs) or switch to a fundamentally different architecture. INL and DNL are dominated by the matching of the MSB switches β the top few bits get all the attention during layout.
Daily Electrical Circuits
2026-09-04
The common-base (CB) amplifier is the forgotten sibling of common-emitter and common-collector. You rarely build one standalone, but it's everywhere in RF front ends, cascode stages, and current-buffer applications. Understanding why matters when you need low input impedance, excellent high-frequency response, or a near-unity current gain with high voltage gain.
The topology: signal enters the emitter, exits the collector, and the base is grounded (or AC-grounded via a bypass capacitor). Because the base is held fixed, the input signal directly modulates VBE, driving collector current through the transconductance gm = IC/VT.
Key characteristics:
Real-world example β 50 Ξ© RF preamp at 500 MHz: Bias a 2N5179 at IC = 5 mA. Then gm = 5 mA/26 mV β 192 mS, so Zin = 1/gm β 5.2 Ξ©. Add a small emitter resistor RE β 45 Ξ© in series with the input to bring the total to ~50 Ξ© for antenna matching. With RL = 200 Ξ© at the collector, voltage gain β gmΒ·RL β 38 (31 dB) β and because there's no Miller multiplication of CCB (~1 pF), the β3 dB point stays above 1 GHz.
Rule of thumb: If you need Zin close to 50 Ξ© and you're biasing your transistor at IC (mA), set IC β 0.5 mA for a natural 50 Ξ© match, or add a series RE to pad up from a higher-bias, higher-gm stage.
The cascode connection: Stack a CB stage on top of a common-emitter stage. The CE provides voltage gain into the CB's low input impedance (so the CE sees a low collector load and has no Miller multiplication either), and the CB delivers the output swing. This is the topology inside virtually every wideband op-amp input stage and RF amplifier IC.
Watch out: CB stages need a solid AC ground at the base β a large bypass cap and short trace. Base inductance turns your amplifier into an oscillator with terrifying speed.
Daily Engineering Lesson
2026-09-04
Base isolation decouples a building from ground shaking by inserting a soft horizontal layer between the structure and its foundation. You've already seen elastomeric bearings and friction pendulums β the third major family is the flat sliding bearing, typically a polished stainless steel plate against a PTFE (Teflon) puck. Simple, cheap, and fundamentally different from the others: it has no restoring force.
The mechanics are pure Coulomb friction. Below a threshold horizontal force, the bearing is locked and the building moves with the ground. Above it, the PTFE slides on the steel and transmits only the friction force β no matter how hard the ground shakes. That transmitted force is:
F = ΞΌ Β· W
where ΞΌ is the sliding coefficient (typically 0.05β0.15 for lubricated PTFE, higher at low velocity and low temperature) and W is the vertical load on the bearing. A 5,000 kN column on a bearing with ΞΌ = 0.08 will never see more than 400 kN of lateral force transmitted to the superstructure, regardless of ground acceleration.
The catch: no restoring force. A flat slider that displaces 200 mm during an earthquake stays displaced. This is why pure flat sliders are almost never used alone β they're paired with elastomeric bearings or rubber springs elsewhere in the isolation plane to provide re-centering. The sliders carry gravity load and limit force; the elastomers pull the building back to center.
Real-world example: The Utah State Capitol seismic retrofit (completed 2008) uses 265 flat PTFE sliders under the perimeter columns paired with lead-rubber bearings under the interior columns. The sliders handle high vertical loads cheaply where re-centering isn't critical for that column, while the interior LRBs provide the restoring force and damping for the whole isolated mass. Split the job: some bearings carry load and limit shear, others re-center.
Design considerations:
Rule of thumb: Design isolation displacement is roughly D β SD1 Β· Teff / (4ΟΒ² Β· B), where Teff is the effective isolated period (typically 2.5β4 seconds) and B is a damping reduction factor. For a typical building, expect 150β400 mm of displacement in a design-level event β plan bearing plate size and moat clearance accordingly.
Forgotten Books
2026-09-04
Book: The value of science in the smithy and forge by Cathcart, William Hutton, Stead, John Edward, 1851- (1916)
Read it: Internet Archive
The very title of this 1916 volume is a small revolution. That a book had to argue for "the value of science in the smithy and forge" tells you exactly what the smiths of the era thought about scientists β and what the scientists thought about the smiths. The book was co-edited by John Edward Stead, a metallurgist so influential that a chemical etchant still bears his name (Stead's reagent, used to reveal phosphorus banding in steel).
The front matter reads like a recruiting pamphlet for a new priesthood, listing companion volumes a working smith was expected to own. Among them:
The MICROSCOPIC ANALYSIS of METALS. BY FLORIS OSMOND AND J. E. STEAD, D.MET., F.R.S. "Of all the hooks [sic] which have dealt with this subject in its many aspects, surely this one remains supreme." β Chemical World.
Pause on that. A blacksmith in 1916 β a man whose predecessors had for four thousand years judged steel by its color, its sound on the anvil, and the shower of sparks it threw on a grinding wheel β was being told he ought to polish a specimen, etch it with reagents, and examine its grain structure under a microscope. The book recommends 195 photo-micrographs as study material.
This was not crank advice. Floris Osmond, working in France in the 1880s and 90s, had essentially founded the discipline we now call metallography. He identified the crystalline phases of iron (austenite, martensite, pearlite β names still on every materials-science syllabus) decades before X-ray diffraction confirmed them. Stead extended the work in Britain. By 1916, they were trying to push their microscopes down out of the university laboratory and into the village forge.
It largely didn't take. The village smith was already an endangered species; within a generation, mass-produced pressed steel and the automobile finished him off. The microscope migrated instead into the quality-control lab of the steelworks, where it remains today β every automotive supplier and aerospace foundry still runs metallographic samples on essentially the workflow Osmond and Stead codified.
What's genuinely forgotten is the ambition of that moment: the idea that a tradesman standing at a coal fire should also be a scientist with a polished puck of steel and a bottle of nitric-acid-in-alcohol at his elbow. Modern readers may recognize the pattern. It's the same argument being made today about auto mechanics reading OBD-II data streams, or farmers interpreting soil-microbiome assays, or line cooks running sous-vide with a thermocouple. Every generation has its "the trades must now also be laboratories" book. In 1916, for the smiths, the answer turned out to be: no, the laboratory will simply eat the trade.
Forgotten Patent
2026-09-04
In the autumn of 1941, a Swiss electrical engineer named Georges de Mestral came back from an alpine hunting trip near Commugny covered in burdock burrs β the little brown seed pods that cling to trouser cuffs and dog fur with maddening tenacity. Most people would pull them off and swear. De Mestral put one under a microscope.
What he saw would sit in his head for a decade: the burr wasn't sticky, wasn't magnetic, wasn't glued. It was a forest of tiny, elastic hooks, each one snagging into the loops of natural fibers in his clothes and his dog's coat. Pull them off and they sprang back, undamaged, ready to hook again. Nature had invented a reusable fastener.
It took de Mestral eight years, a small loan, and a stubborn refusal to listen to textile mills that told him it was impossible before he cracked the manufacturing problem: weave nylon under infrared light so the loops become stiff enough to be sliced into hooks. He filed his first Swiss patent in 1951 (CH 295,638), and in 1958 he filed the definitive US application. It issued on November 21, 1961 as US Patent 3,009,235, "Separable Fastening Device."
He named it Velcro β a portmanteau of the French velours (velvet) and crochet (hook).
The patent itself is a beautifully clean piece of engineering. Claim 1 describes two mating strips: one carrying "a multiplicity of hooks," the other "a multiplicity of loops," designed such that pressing them together produces "engagement between said hooks and loops" that resists shear but yields cleanly to a peel force. That single trade-off β strong against sliding, weak against peeling β is the reason Velcro works the same on a sneaker, a blood-pressure cuff, and the outside of a spacesuit.
NASA adopted it almost immediately. Apollo astronauts had Velcro sewn into their gloves, food trays, and helmets so tools wouldn't float away. The Space Shuttle carried hundreds of Velcro patches in the crew compartment. Every ISS cargo bag today still uses hook-and-loop closures for exactly the reason de Mestral identified in 1955: it works one-handed, in a pressure suit, in zero-g, with no batteries.
But the deeper legacy is intellectual. De Mestral's patent is arguably the founding artifact of biomimicry as an engineering discipline β the idea that 3.8 billion years of evolution has already solved most problems, and the job of the engineer is to read the answer key. From that lineage:
De Mestral's company sold the patent rights, and Velcro Industries became a global brand. But the more valuable legacy isn't the fastener β it's the method. A hunter with an itchy pair of trousers looked at the problem the wrong way (annoyance) and then, crucially, looked at it the right way (design specification). Modern soft robotics labs and materials-science departments now do this on purpose, with electron microscopes and funding lines. De Mestral did it with a hand lens and a dog.
Daily GitHub Zero Stars
2026-09-04
Language: Rust
pokegreet is a delightful little Rust project that appears to be a PokΓ©mon-themed shell greeter β the kind of terminal candy that makes opening a new shell session feel less like work and more like booting up a Game Boy. Think of it as a spiritual cousin to pokemon-colorscripts or neofetch, but written in Rust for that satisfying "instant startup, zero runtime cost" experience.
While the repo is fresh and description-less, the name and language choice tell a compelling story: someone decided that their MOTD or shell prompt needed a Pikachu, and they were going to do it properly β no Python interpreter warmup, no shell script sprawl, just a fast native binary that prints ANSI-art PokΓ©mon on demand.
Why it's interesting:
Who might find it useful:
.bashrc/.zshrc greeterGive it a clone, drop it into your shell startup, and enjoy a small burst of nostalgia every time you open a new pane. Sometimes the best software isn't the most useful β it's the most joyful.
Daily Hardware Architecture
2026-09-04
Every load and store your CPU issues has an address, and every access has a natural alignment: a 4-byte load "wants" to sit on a 4-byte boundary, an 8-byte store on an 8-byte boundary. What happens when it doesn't? That depends on the ISA, the memory type, and a bit in a control register you probably didn't know existed.
Three ISA philosophies:
The AC flag nobody uses: x86 has an Alignment Check bit (EFLAGS.AC) plus CR0.AM. Set both and every unaligned user-mode access raises #AC. Nobody enables it because glibc's memcpy is full of intentional misalignment.
The SIMD wrinkle: Old SSE required 16-byte alignment for MOVAPS β misaligned access faulted. MOVUPS tolerated it but was slower. Since Nehalem (2008), MOVUPS on aligned data has the same throughput as MOVAPS, so the distinction is mostly historical. AVX-512 loads/stores tolerate misalignment but a cache-line split still costs a port cycle and doubles the load queue entry.
Concrete example β the 4KB page split penalty: An unaligned 8-byte load crossing a 4KB page boundary requires two TLB lookups plus two cache lookups. On Skylake this costs ~100 cycles versus ~4 for an aligned load. A struct like {char pad[4093]; uint64_t counter;} straddles the boundary; increment it in a hot loop and you'll see it in perf stat -e ld_blocks_partial.address_alias.
Rule of thumb:
Align hot atomics and lock words to their natural size β the compiler does this for _Atomic and std::atomic, but packed structs and network protocol parsers routinely defeat it. When __attribute__((packed)) shows up in a hot path, count the alignment cost before shipping.
Hacker News Deep Cuts
2026-09-04
Link: https://purplesyringa.moe/blog/guest/the-nx-bit-is-not-just-about-security/
HN Discussion: 1 points, 0 comments
Ask any systems programmer what the NX (No-eXecute) bit does and you'll get a confident, one-sentence answer: it marks memory pages as non-executable so an attacker can't jump into a buffer they've filled with shellcode. Case closed, DEP/W^X, move on. This post β hosted on purplesyringa's guest blog, a domain that consistently publishes some of the sharpest low-level writing on the internet β argues that this framing sells the NX bit dramatically short.
The title is a promise: there's a second life for this humble page-table bit that has nothing to do with stopping stack smashing. Based on the venue and framing, the likely territory includes:
What makes this worth the click is that the NX bit sits at a beautiful abstraction seam. It's one bit in a PTE, backed by silicon since the mid-2000s, and its intended use has become so canonical that most engineers never think past it. But every page-protection primitive the MMU exposes is really a general-purpose fault-on-access mechanism, and clever runtimes have been quietly repurposing them for decades β mprotect for GC write barriers, PROT_NONE for guard pages and stack overflow detection, and now, apparently, NX for something more than defense.
The kind of post that makes you look at a familiar mechanism sideways and see a whole new set of uses.
HN Jobs Teardown
2026-09-04
Source: HN Who is Hiring
Posted by: JessQuinn
Of the ten postings, Scrapinghub is the most strategically revealing because it exposes an entire business built on a technical gray zone that most companies pretend doesn't exist: industrial-scale web scraping as a service.
The product portfolio tells the story. Four distinct offerings β AutoExtract (ML-powered extraction API), Crawlera (smart proxy), Scrapy Cloud (spider hosting), and Data on Demand (turn-key services) β represent a full vertical stack. This isn't a scraping tool company; it's a scraping platform company that has productized every layer of the pipeline from proxy rotation to ML extraction to managed services. That progression from tools β infrastructure β ML β done-for-you is the classic maturity arc of a category-defining vendor.
The tech stack is implicit but loud. Scrapinghub is the commercial steward of Scrapy, the dominant open-source Python scraping framework. The mention of "thousands of millions of records" (an unusual phrasing that suggests the writer is non-native English, consistent with a distributed team) implies serious data engineering: distributed queues, headless browsers at scale, and now ML models for schema-less extraction. AutoExtract is the interesting bet β moving from "we run your scrapers" to "you don't need scrapers, just tell us what you want" is an attempt to escape the treadmill of per-site maintenance.
Stage and direction signals:
Green flags: Fully remote before it was cool, product diversification hedging against any single offering's decline, and betting on ML extraction (the right technical direction as sites get harder to scrape via brittle CSS selectors).
Red flags: The posting is vague β no roles listed, no stack details, no comp band. For a 180-person company, this reads like a recruiting funnel rather than a real technical pitch. Also worth noting: the entire business depends on the ongoing legal ambiguity of scraping (post-hiQ v. LinkedIn), and on target sites not deploying effective anti-bot measures. That's an existential risk they can't advertise.
Daily Low-Level Programming
2026-09-04
You already know the vDSO turns clock_gettime() into a user-space memory read of a kernel-maintained page. What's less advertised is that the vDSO code is a conditional β it reads a clocksource identifier, and if the identifier isn't one it knows how to handle, it falls through to a real syscall instruction. Your "zero-syscall" clock call can silently become a 300ns syscall depending on what your kernel picked as the clocksource at boot.
The mechanism: the kernel exposes a vdso_data page containing the current time, a sequence counter (for lockless reads), a multiplier/shift for TSC-to-nanoseconds conversion, and a vclock_mode field. The vDSO's __vdso_clock_gettime switches on vclock_mode: VCLOCK_TSC reads RDTSC and does the math inline; VCLOCK_PVCLOCK (KVM paravirt) and VCLOCK_HVCLOCK (Hyper-V) have their own inline paths; VCLOCK_NONE means "I can't do this in user space" and jumps to the syscall fallback.
When does the kernel pick VCLOCK_NONE? Any time the current clocksource isn't safe to read from user space. Common triggers:
clocksource=hpet or tsc=unstable.Real-world example: A trading firm benchmarks clock_gettime(CLOCK_MONOTONIC) at 20ns on a dev box and deploys to a four-socket production server. Latency jumps to ~350ns per call β 17Γ slower. Cause: the four-socket box failed the TSC sync check at boot and fell back to HPET. Fix: echo tsc > /sys/devices/system/clocksource/*/current_clocksource after confirming synchronization, or boot with tsc=reliable.
Rule of thumb: before trusting vDSO performance, check cat /sys/devices/system/clocksource/clocksource0/current_clocksource. If it says tsc (or kvm-clock/hyperv_clocksource in a VM), you get the fast path. Anything else β hpet, acpi_pm, jiffies β and every call costs a syscall.
You can confirm the fallback empirically: strace -c ./your_program. If clock_gettime shows up in the syscall count at all, your vDSO isn't doing what you think it is.
RFC Deep Dive
2026-09-04
In 1995, "always-on" internet was a luxury. Many enterprise sites connected to the corporate backbone via demand circuits β ISDN lines, dial-up modems, or X.25 SVCs that charged by the minute or by the packet. The economic model was clear: keep the circuit down unless there's actual user traffic to send. But there was a problem. If you ran OSPF (the shiny new link-state routing protocol) over such a link, the circuit would never go idle. OSPF chatters constantly: Hello packets every 10 seconds, LSA refreshes every 30 minutes, database synchronization on every neighbor adjacency. Your ISDN bill would be ruinous.
John Moy β the author of OSPF itself (RFC 2328) β wrote RFC 1793 to fix this. The trick is elegant: make OSPF pretend that periodic maintenance traffic isn't necessary on demand circuits, while still guaranteeing that the routing database stays converged.
Three mechanisms make this work:
MaxAge (3600s), the LSA must be refreshed by its originator, forcing traffic on the wire. RFC 1793 defines a high bit in the LSA age field β the DoNotAge bit, value 0x8000 β that freezes the age. An LSA flooded across a demand circuit with DNA set stays valid indefinitely, no periodic refresh required.The subtle part is correctness. If Hellos are suppressed and ages are frozen, how do you ever notice a topology change? The answer: real changes still flood normally. A link going down, a new LSA being originated, an SPF-relevant event β these all trigger flooding across the demand circuit, which brings it up briefly. It's only the periodic maintenance that's suppressed. Event-driven routing, not timer-driven.
There's a lovely piece of trivia in the design: the DNA bit lives in the high-order bit of the 16-bit LSA age. Since normal ages max out at 3600 (well under 0x8000 = 32768), this bit was effectively free β a clever piece of protocol archaeology exploiting unused encoding space.
Why should you care in 2026? ISDN is dead, but the pattern lives on. RFC 1793's DoNotAge mechanism inspired similar "quiet the routing protocol" work throughout the IETF: IS-IS added analogous extensions, BGP has its route-refresh and graceful-restart machinery, and modern IoT routing protocols like RPL (RFC 6550) borrowed the philosophy wholesale β event-driven updates over battery-powered links where every transmitted packet costs joules. Anywhere you have an expensive or metered link β cellular backup, satellite, LPWAN, even cloud-provider egress with per-GB charges β the RFC 1793 mindset applies: protocols should stop talking when nothing has changed.
It's also a case study in graceful capability negotiation. The DC-bit's "all-or-nothing per area" rule prevents subtle inconsistency bugs β a design pattern later echoed in TLS extensions, HTTP/2 SETTINGS, and countless other protocols.
Daily Software Engineering
2026-09-04
Classic Paxos requires that any two quorums intersect in at least one node. The standard way to guarantee this is majority quorums: with 5 nodes, both phase 1 (prepare) and phase 2 (accept) need 3 nodes. Flexible Paxos (Howard, Malkhi, Spiegelman, 2016) proves this is stricter than necessary. The real safety requirement is that every phase 1 quorum intersects every phase 2 quorum β phase 1 quorums don't need to intersect each other, and phase 2 quorums don't need to intersect each other.
The rule of thumb: if you have N nodes and choose phase 1 quorum size Q1 and phase 2 quorum size Q2, safety holds as long as Q1 + Q2 > N. Majority Paxos is just one point on that line (Q1 = Q2 = β(N+1)/2β).
Why this matters: in steady-state Multi-Paxos, phase 1 (leader election) happens rarely β only when a leader dies. Phase 2 (replicating each command) happens on every write. So shrinking Q2 at the cost of a larger Q1 is a great trade.
Concrete example. You run a 5-node Paxos cluster across three availability zones. Under classic majority, every write waits for 3 acks β meaning at least one cross-AZ round trip is almost always on the critical path. With Flexible Paxos, set Q2 = 2 and Q1 = 4. Now steady-state writes need only 2 acks β the leader plus its nearest replica, often in the same AZ. Cross-AZ p99 latency drops from ~8ms to ~2ms. The cost: leader elections need 4 nodes instead of 3, so if two nodes are down you can't elect a new leader. But leader elections happen once an hour at most; writes happen 10,000 times a second.
You can push this further with grid quorums: arrange N nodes in a βN Γ βN grid, make phase 1 quorums pick any full row, phase 2 quorums pick any full column. Every row intersects every column in exactly one node. For N=16, Q1 = Q2 = 4 instead of 9 β smaller than majority for both phases.
The catch: availability degrades asymmetrically. With Q2 = 2 out of 5, you tolerate 3 replica failures for writes β but only 1 failure for leader election (need 4). Model your failure scenarios: if a whole AZ can go down, make sure Q1 still fits in the remaining AZs.
Tool Nobody Knows
2026-09-04
Facebook open-sourced osquery in 2014 and it's still the least-appreciated ops tool of the last decade. The pitch: every piece of live OS state β running processes, listening sockets, kernel modules, cron jobs, logged-in users, USB devices, browser extensions, launchd/systemd units, the ARP table β is exposed as a virtual SQLite table. You SELECT from it. That's it. The same query works on Linux, macOS, Windows, and FreeBSD.
Interactive shell:
$ osqueryi
osquery> .tables
osquery> .schema processes
A malware-hunter's favorite one-liner β processes whose executable has been unlinked from disk (a classic persistence trick where a rootkit deletes its own binary after mmap'ing it):
SELECT pid, name, path FROM processes WHERE on_disk = 0;
Every listening socket, joined against its owning process, filtered to non-localhost. This replaces roughly forty characters of ss+awk+lsof glue that never quite works the same on two boxes:
SELECT p.pid, p.name, p.cmdline, l.address, l.port, l.protocol
FROM processes p
JOIN listening_ports l USING (pid)
WHERE l.address NOT IN ('127.0.0.1', '::1', '0.0.0.0');
Find every user with a real login shell, plus which ones actually logged in this month:
SELECT u.username, u.shell, l.time
FROM users u
LEFT JOIN last l ON l.username = u.username
WHERE u.shell NOT LIKE '%nologin%' AND u.shell != '/bin/false';
Failed systemd units, sorted by unit name, without ever touching systemctl --failed --no-legend | awk:
SELECT id, load_state, active_state, sub_state
FROM systemd_units WHERE active_state = 'failed';
SUID/SGID binaries not owned by root under /usr/local β the kind of audit that's a shell script from hell otherwise:
SELECT path, uid, gid, mode FROM file
WHERE path LIKE '/usr/local/%%' AND (mode LIKE '%4___' OR mode LIKE '%2___')
AND uid != 0;
Cross-referencing tables is where it stops being cute and starts being irreplaceable. "Which crontabs execute a binary that isn't owned by root?" is one query. "Which kernel modules were loaded after the last reboot from a path outside /lib/modules?" is one query. Try writing either in bash without introducing three bugs.
The daemon side. osqueryd runs scheduled queries on an interval, diffs the result set against last run, and emits JSON deltas to a log file or syslog. That means "new listening port appeared" becomes a two-line config entry with a query and an interval β no watchdog script, no state file, no cron. Feed the JSON into Splunk/Elastic/Loki and you have host-based intrusion detection built on SELECT statements. Facebook ships query packs (incident-response, vuln-management, hardware-monitoring) as starting points.
Why it beats the alternative. Every ops tribe eventually writes the same twelve shell scripts to inventory hosts β and every one of them parses ps differently, breaks when ss changes its column headers, and disagrees on macOS. osquery replaces all of them with one binary, one query language, one JSON schema. And because it's SQLite under the hood, you get subqueries, CTEs, and JSON functions for free.
Install: apt install osquery, brew install osquery, or grab the MSI for Windows. Run osqueryi and try .tables β the list alone will change how you think about your machine.
ps | awk scripts with joins.
What If Engineering
2026-09-04
Vapor-compression AC is a chemistry problem β refrigerants leak, warm the planet, and require compressors that scream. The magnetocaloric effect offers a solid-state alternative: certain alloys heat up when magnetized and cool down when demagnetized. No gases, no compressor, just a wheel of metal spinning through a magnetic field. Let's scale it to cool Phoenix.
Gadolinium exhibits an adiabatic temperature change (ΞTad) of roughly 3 K per tesla near its Curie point (293 K β conveniently room temperature). Modern La(Fe,Si)13-H alloys push this to ~6 K/T. In an active magnetic regenerator (AMR), a porous bed of alloy is alternately magnetized and demagnetized while heat-transfer fluid shuttles through it, cascading temperature differences into a useful lift of ~20β30 K per stage.
Phoenix's peak summer cooling load is roughly 15 GW thermal (5 million people Γ ~3 kW/person at 45 Β°C outdoor). A magnetocaloric heat pump running at COP ~5 (theoretical Carnot for a 25β45 Β°C lift is 15, and lab prototypes hit ~30% of Carnot) needs 3 GW of electrical input to move that heat.
The specific cooling power of the best AMR beds is around 2 kW per kg of gadolinium at 2 Hz cycling in a 1.5 T field. So:
Gd mass required = 15 Γ 10βΉ W Γ· 2000 W/kg = 7,500 tonnes
At $60/kg (bulk Gd, 2026 pricing after China loosened rare-earth export controls), that's $450 million in refrigerant alloy alone. Manageable β until you look at the magnets.
To sustain 1.5 T across a bed volume matching 7,500 tonnes of Gd (density 7.9 g/cmΒ³ β ~950 mΒ³), you need a magnetic circuit surrounding roughly that volume. NdFeB permanent magnets store ~400 kJ/mΒ³ of field energy at 1.5 T, and Halbach arrays typically need magnet mass equal to the working volume mass. That's another ~7,000 tonnes of NdFeB β about 3% of global annual production, dedicated to one building.
A superconducting solenoid is more compact but demands cryocooling: a 1.5 T bore 20 m across draws ~50 kW just for cryogenics, plus quench-protection infrastructure that occupies its own multi-story hall.
Package it as a 300 m tower with 40 floors, each holding a 15 m diameter wheel of segmented Gd plates rotating at 120 rpm through a stationary Halbach array. Water-glycol loops carry heat to a rooftop dry cooler (200 m tall stack for buoyant plume dispersal) and cold to a district chilled-water network. Total heat rejected: 18 GW β enough to raise the temperature of a 500 m column of desert air by 4 Β°C, creating a permanent thermal plume visible on satellite IR.
Modern centrifugal chillers hit COP 6β7 on paper. Magnetocaloric wins on three fronts: no refrigerant leaks (huge for GWP compliance post-Kigali), quiet operation (no compressor), and higher part-load efficiency because you just spin the wheel slower. It loses on capital cost by roughly 4Γ, and the rare-earth supply chain becomes a single point of failure.
The killer detail: Gd's Curie point drifts. As outdoor temperature climbs past 40 Β°C, you need a layered bed of alloys with staggered Curie points (Gd, GdEr, GdTb) to maintain ΞT across the cascade. Each layer is a separate procurement contract with a different mine.
Wikipedia Rabbit Hole
2026-09-04
Wikipedia: Read the full article
Every crisp, otherworldly image you've ever seen from a scanning electron microscope β the compound eye of a fruit fly, the jagged crystalline landscape of a snowflake, the alien topology of a virus β almost certainly passed through a device invented in 1960 by two graduate students at Cambridge. It's called the EverhartβThornley detector, and for over six decades it has been the workhorse eye of electron microscopy. Nearly every SEM sold today has one bolted inside it.
The problem Thomas Everhart and Richard Thornley set out to solve was deceptively simple. When you fire a focused electron beam at a specimen, the sample kicks out low-energy secondary electrons β the particles that carry topographic information about the surface. But these secondaries are feeble. They wander off in random directions with almost no energy, and any attempt to collect them tends to disturb the very electron beam you're trying to image with.
Their elegant solution nests three technologies inside one another like Russian dolls:
That last part is the quiet genius of the design. Most amplifiers add noise proportional to their gain. Photomultipliers don't β they multiply signal cleanly by factors of a million or more. By converting fragile electrons into photons before amplification, Everhart and Thornley sidestepped a fundamental physics problem that had bedeviled earlier detectors. The signal you see on screen is, in a very real sense, individual electrons being counted one at a time.
There's a subtle aesthetic consequence too. Because the detector sits off to one side of the specimen, features facing it appear brighter while features facing away appear shadowed. This is why SEM images look so uncannily three-dimensional despite being fundamentally 2D projections β your visual cortex reads the asymmetric collection as raked lighting, and you perceive depth. The detector is, in effect, a virtual sun hanging over a microscopic landscape.
Thomas Everhart went on to become president of Caltech. His detector, meanwhile, quietly powered the visual revolution of modern biology, materials science, and semiconductor manufacturing. Every time Intel inspects a chip die, every time a forensics lab examines a gunshot residue particle, every time a paleontologist images pollen trapped in amber β an EverhartβThornley detector is likely doing the looking.
Daily YT Documentary
2026-09-04
Channel: T Hawkins (11 subscribers)
Beneath the bustling dwarven capital of Ironforge lies a hidden chamber that players could glimpse but were never meant to reach. This mini-documentary explores Old Ironforge, one of World of Warcraft's most famous "off-limits" spaces β a room that has fascinated players since the game's earliest days.
What makes this video worth watching isn't just nostalgia. It's a study in environmental storytelling and game design archaeology. Old Ironforge represents the kind of unfinished lore hook that Blizzard's designers left in the world map as breadcrumbs β spaces built with intention but withheld from normal gameplay, later becoming the subject of glitch exploration, wall-jumping communities, and eventual official acknowledgment through expansion content.
T Hawkins' channel focuses on these overlooked corners of Azeroth with a calm, documentary-style pacing that treats a virtual world as a legitimate object of historical study. For anyone interested in how open-world games build atmosphere through inaccessible geography, or how player communities generate meaning around developer easter eggs, it's a thoughtful watch. At 11 subscribers, this is exactly the kind of niche craft channel that rewards early discovery β the production feels considered rather than churned out.
Daily YT Electronics
2026-09-04
Channel: AkashWave RF (2030 subscribers)
The DHT11 and DHT22 are the entry-point temperature/humidity sensors that nearly every Arduino tutorial reaches for β cheap, easy, and "good enough" for a first blink-a-light project. But once you start caring about repeatability, response time, or long-term calibration drift, their limits show up fast. This video puts the popular DHT22 head-to-head with Sensirion's SHT41, an IΒ²C sensor built for industrial and lab use.
Expect a real side-by-side comparison: accuracy specs (Β±0.2 Β°C and Β±1.8% RH for the SHT41 vs. the DHT22's Β±0.5 Β°C / Β±2β5% RH), sampling rate, self-heating behavior, and how each responds when the environment actually changes. The presenter also walks through wiring the SHT41 over IΒ²C, which is a useful skill jump for hobbyists who've only ever used the DHT's one-wire protocol.
What makes it worth the time is the framing: it's not just "which sensor wins," but when the extra cost of an industrial part is justified. If you're building anything that logs data for analysis β greenhouses, HVAC monitoring, weather stations, calibration references β this is the kind of comparison that saves you from rebuilding the project six months later.
Daily YT Engineering
2026-09-04
Channel: EngineeringTheCurriculum (2390 subscribers)
Statically indeterminate structures are one of the conceptual walls that separates intro statics from real structural analysis. When a beam has more reactions than equilibrium equations can resolve, you need a compatibility-based approach β and the Flexibility Method (also called the Force Method) is the classical route.
This lecture walks through the theory first β choosing a primary (released) structure, identifying redundants, and writing compatibility equations in terms of flexibility coefficients β then grounds it with a full worked example. That two-part structure is what makes it worth watching. A lot of structural analysis content on YouTube either hand-waves the theory or drops straight into a numerical problem without explaining why the steps work. Doing both in sequence is how the method actually clicks: you see the redundant force treated as an unknown, the deflection at the release calculated via unit load, and superposition tying it all together.
It's also a foundational technique. Understanding the Flexibility Method makes the Stiffness Method (and by extension, the matrix formulation behind every FEA package) meaningfully easier to reason about. If you've ever used Robot, SAP2000, or ETABS and wanted to understand what the solver is actually doing, this is the layer beneath.
Daily YT Maker
2026-09-04
Channel: Next Wave CNC (3620 subscribers)
The spoil board is one of those pieces of CNC infrastructure that beginners underestimate and experienced operators obsess over. It's the sacrificial surface between your workpiece and the machine bed, and if it isn't dead flat and perfectly parallel to the spindle's Z plane, every engraving job inherits that error β a shallow letter here, a gouged edge there, especially on wide pieces where a few thousandths of an inch of tilt becomes visible depth variation.
This video from Next Wave CNC looks at a specific spoil board design aimed at solving that problem for engraving work, where depth consistency matters far more than in through-cutting. Worth watching if you've ever pulled a finished piece off your machine and noticed that the letters on one side are crisp while the other side looks faded β that's almost always a spoil board flatness issue, not a bit or feed problem.
Note: This is admittedly a short-form clip and the batch overall was thin (lots of hashtag spam and factory montages), but the underlying topic β why your reference surface matters and how to evaluate one β is a genuinely useful concept for anyone running a hobby CNC.
Daily YT Welding
2026-09-04
Channel: WeldingHelp (224 subscribers)
Editor's note: this batch was overwhelmingly Shorts, hashtag spam, and emoji-heavy clickbait. This pick is the least-bad option β a small teaching channel that at least frames its video as part of an ongoing educational series.
Flux-cored arc welding (FCAW) is surrounded by more folk wisdom than almost any other beginner process, and the myths tend to steer new welders wrong in expensive ways. Common claims β that flux core is "just bad MIG," that it can't produce structurally sound welds, that you always run electrode-negative, that slag inclusions are inevitable, that you can't weld thin material β each contain a grain of truth wrapped in a lot of misunderstanding.
WeldingHelp is a tiny channel (224 subscribers) building out an "EP" numbered series aimed at beginners, which suggests structured curriculum rather than one-off shorts. Episode 4 zeroing in on a specific myth is the right pedagogical move: rather than dumping every FCAW parameter on a novice, isolate one belief, explain where it came from, and show what's actually true. That format tends to stick.
Worth watching if you're a beginner who has heard conflicting advice about self-shielded vs. gas-shielded flux core, polarity, or when to reach for FCAW over MIG. Supporting a small channel doing patient, episode-based instruction is a bonus.
