AI Digest.

Defining "Done": External Standards for Agents, and Trouble for Token Middlemen

The strongest through-line in today's feed is that agents fail at large tasks not from lack of skill but from lack of an external, executable definition of success, an argument made by a Factory engineering article, PRAXIST's launch claims, and a testing debate. Meanwhile @thdxr argues that inference providers renting GPUs at 40%+ margins won't survive as cheap flash models churn every 48 hours.

Quick Hits

  • The day's clearest idea: agents stall when they grade their own homework. @RayFernando1337 surfaces a Factory article arguing the fix is an external "standard of completion"; @svpino relays PRAXIST, a product built around user-defined evaluators; @ericclemmons and @mattpocockuk push the same principle at the test level.
  • MCP design split: @mxstbr says servers should expose their real tools because clients like Codex already provide tool search and code mode, while @parkerconrad's Rippling shipped an MCP server where agents write code to do the work and return only the answer.
  • Token economics under scrutiny: @thdxr claims inference companies rent GPUs, charge 40%+ margins, and won't last; @morganlinton relays a lead engineer running most of his coding on two $20 DeepSeek plans; @NinaDSchick cites an OpenRouter estimate that agentic requests consume around 15x the tokens of human-led ones.
  • @dhh amplifies @IntCyberDigest's retelling of Linus Torvalds pushing through a "debug session from hell," 24 debug patches and 18 kernel boots to find one round_up() that should have been round_down(), then letting the AI write the commit message.
  • Pace check from @MikeBradleyAI: two models in a flash-tier ranking are 48 hours old, nothing over four weeks made the list, and the unified-memory hardware meta was rewritten within two days.

Write the Standard Before the Agent Starts

The most substantive cluster of the day says the same thing three different ways: define success outside the implementation, in executable form, before the agent begins.

@RayFernando1337 quotes Factory's article "What it Takes for Coding Agents to Complete Large Software Tasks," whose key line is that "the single agent didn't lack skill. It lacked a standard of completion." The recipe: a standard derived from the desired outcome, authored before implementation narrows attention, and kept current until the work meets it. Ray's own prediction, that Factory will "crack long running agents by the end of the year," is enthusiasm, not evidence.

@svpino covers PRAXIST Beta from @Sapient_Int, which productizes the same idea: you supply a measurable goal plus an evaluator, and parallel "Research Peers" explore competing approaches, share findings, and build across generations. The numbers circulating are vendor-reported with no methodology: 49 gold medals across 75 tasks versus 35 for Claude Code with Opus 4.8, at roughly $3K versus $38K in token cost, plus a claimed 100% safe-landing rate in a rocket simulation and SLAM error reduced from 9.37 to 5.01 centimeters. Interesting direction, unverified claims.

At the unit-test level, @mattpocockuk's suggestion to append "Tautological tests considered harmful" to CODING_STANDARDS.md so code review catches it got a memorable translation from @ericclemmons, who asked his agent to interpret: "Don't derive expected values by repeating the implementation. Test externally observable behavior against independently known expectations." Same principle, smaller scope.

@jamonholmgren's repost of @poteto fits the pattern from another angle: they ban comments in the grok bot codebase and built a skill to enforce it, on the grounds (the post cuts off mid-sentence) that agents misuse comments. Prose guidance gets ignored; executable standards get enforced.

MCP Servers: Expose Tools or Hand Over Code Execution

Two posts frame a live design disagreement about where composition logic should live.

@mikeldking flags @mxstbr's argument against the "nascent trend" of hiding MCP tools behind two generic tools, search and execute. His case: clients like ChatGPT and Codex already ship tool search and code mode, models are trained on them, and they work across every server. Making each server reimplement that layer forces the model to navigate a custom abstraction it was never trained on. His advice is to expose your actual tools and let capable clients find and compose them, with the caveat that this applies to clients that support those features.

@parkerconrad presents Rippling's newly launched MCP server, built by @callen_raveret's team, as the opposite bet: rather than repackaging "APIs built for humans," the server lets agents write code against Rippling and return only the result. One position centralizes composition in the client, the other in code the agent writes against the server. Both are argued from developer experience, and neither has settled anything yet.

Cheap Tokens, Shaky Margins, and the 15x Agent Bill

@thdxr's take on inference economics is blunt: token prices "could be a lot lower," but inference companies rent GPUs, serve tokens, and "slap a 40%+ margin on top." In his telling their advantage is only that they started early, and "i don't think they will last." Prediction, not reporting, but it lands alongside adoption stories like @morganlinton's, quoting @pidotdev: lead engineer Scott Fryxell moved most of his client work to DeepSeek via the Pi coding tool, paying for two $20 plans total and using Fable only sparingly.

Demand-side math comes from @NinaDSchick (amplified by @AmericanDebunk): data centers are "factories" producing intelligence, and OpenRouter estimates an agentic request already consumes around 15x the tokens of a human-led one. Her framing is that demand for useful intelligence has no obvious ceiling, so electricity demand forecasts built without industrial-scale AI were structurally wrong.

Supply keeps churning too. @MikeBradleyAI notes that in @TheAhmadOsman's ranking, GLM 5.3 Flash leads Qwen 3.8 Flash Next, then DeepSeek V4 Flash 0731, then Qwen 3.8 27B, with two entries under 48 hours old. That ordering is one poster's assessment, but the churn itself is his real point: blink for a few days and the leaderboard, and the local-inference hardware meta around unified memory, have moved.

Agents Meet Real Codebases: Kernels, Context Bloat, Orchestrators

The Linus story, via @IntCyberDigest and @dhh, is a useful antidote to both hype and dismissal: the AI repeatedly called the Intel GFX driver bug "impossible and unsolvable" and suggested writing a report instead. Torvalds kept going, and after 24 debug patches and 18 kernel boots found a single round_up() that should have been round_down(). He then delegated the commit message to the model. @dhh reads this as Linus "letting agents accelerate Linux"; the quieter lesson is that human persistence was the scarce resource.

Context hygiene gets a deep dive from @chasen_liao, who tested pi's built-in grep (an rg wrapper with a 100-result limit, 50KB truncation, and --hidden by default) and found a single "TODO" search dumping 30-plus flat lines into context. His fix is the @ff-labs/pi-fff plugin, which wires a native Rust search library into pi without subprocesses, adds frecency ranking, weights git-modified files, and paginates grouped results with a cursor. In his test, 33 hits returned as 20 grouped results plus a continuation cursor, which he says cuts first-screen noise by about 80%. All figures are the author's own benchmarks, but the underlying problem, search results flooding the context window, is real.

On the tooling layer, @MaxRovensky launched a native macOS orchestrator for Codex that uses a node canvas to pass context between agent tasks, moving "beyond a chat and a sidebar." @thekitze adds the wry footnote that Max shared it with the tinkerer.club community back in April, well before launch day.

Also in the Feed: Robot Ducks, Freed Terabytes, Hiring Calls

Off the AI beat but notable: @pollenrobotics opened orders for Microduck, a $399 bipedal robot you train in simulation and run on the hardware, with an open-source simulator already shipped and delivery promised before Christmas; @yacineMTB bought one immediately. @Cloudflare detailed five Rust optimizations to its DNS cache that freed 100TB of RAM across 250 billion entries, with inserts 43% faster and lookups 19% faster; @IntCyberDigest's framing that this "solved the global memory supply shortage" is cheerleading, the engineering is the signal. @GeoffreyHuntley relays @sloppenheimer's call for "top gun level" AI infra candidates, a reminder that labs are still hiring aggressively. Finally, @alex_prompter's self-repost promising "the best account on X" for watching production AI agents adds little beyond a pointer; nothing in it is verifiable.

Practical Takeaway

If you're delegating multi-step work to coding agents, the highest-leverage move supported by today's posts is to write an external, executable definition of done before the agent starts: tests that check externally observable behavior against independently known expectations, or an evaluator script the agent must satisfy, kept current as the work evolves. Both the Factory article and the tautological-testing thread argue that agents without such a standard converge on plausible-looking output rather than correct output. If your agent stack includes MCP servers, it's also worth auditing whether they expose real tools or hide them behind a generic search-and-execute layer, since @mxstbr's argument implies the former works better with clients trained to compose tools directly.

Sources

D
dax @thdxr ·
token prices could be a lot lower today but these inference companies are getting in the way of them they don't own anything, they rent GPUs and serve tokens and slap a 40%+ margin on top they have business today because they started early. i don't think they will last
C
Chasen @chasen_liao ·
你的 pi 正在用 grep 往 Context 里塞垃圾,我实测了一下午终于换掉了... pi 内置的 grep 其实就是 rg --json 套壳,limit 100 + 截断 50KB + 默认带 --hidden,搜一次 TODO 这种高频词,直接30 多条平铺甩进上下文。Token 烧了,关键文件还被埋在后面 这个问题 Codex 早就用优化过的 rg 解决,pi 这边最干净的解法我测下来是 @ff-labs/pi-fff 它不是再包一层 rg,而是把 FFF 这个 Rust 原生库直接接到 pi 里,不起子进程,文件在后台预索引。核心变化就三点:frecency 排序常用文件自动置顶、git-aware 改动过的文件加权、grep 结果分组 + cursor 分页 我测了一下,本地建了个小项目 src/app.ts / utils.ts / README.md,往 noise.ts 里塞了 30 行 TODO fix,总共 33 个命中 用内置逻辑等价于 rg "TODO",33 行平铺一次性返回。换成 ffgrep: 第一页只给 20 条,全是 noise.ts 分组好的 1-20,还带一句 [Continue with cursor="fff_c1"]。第二页 ffgrep cursor="fff_c1" 才吐剩下 13 条,app.ts 和 utils.ts 被分在后面,首屏完全不淹没 fffind 也一样,fffind pattern:"app" 直接模糊命中 src/app.ts 和 README.md,frecency 会把你最近改过的文件排前面,不用写 glob。 1️⃣ 安装就一行,不用装 rg/fd 二进制 > pi install npm:@ff-labs/pi-fff 装完 reload 就有 ffgrep / fffind / fff-multi-grep。默认是 tools-and-ui 额外加工具,想直接替换掉内置 grep 就切 override 模式:PI_FFF_MODE=override 或启动加 --fff-mode override 2️⃣ 为什么选它不选别的 我扫了一遍 pi 插件库同期数据,@ff-labs/pi-fff 周下载 6,830 / 月 33,928,版本 0.10.5,已经 80+ 个 nightly 迭代,是搜索类最成熟的。对比 pi-lean-grep 周下载才 4,pi-hypa 是做压缩的,定位不一样。 3️⃣ 体感变化 默认 ffgrep limit 20 对比内置 100,首屏噪音直接砍掉 80%。配合 cursor,你是「精准定位再 read」,而不是「先把50KB 塞进 Context 再让模型自己找」。/fff-health 还能看索引和 frecency 状态 说真的,pi 默认 4 个工具 read,bash,edit,write 之外,grep/find 本来就得显式启用,既然要开,不如直接开这个 已经在用 pi 写代码、被 grep 刷屏搞崩过 Context 的人可以试试,尤其大仓、TODO / FIXME 满天飞的项目,提升最明显 推荐大家在pi里试试 传送门 👉 https://t.co/Q5uWHsuDWA #pi #VibeCoding
D
DHH @dhh ·
Linus is leaning in and letting agents accelerate Linux. Incredible white pill for the future of computing. Everything is just going to get better and better and better until we have to starting about much better it's all gotten!
I IntCyberDigest @IntCyberDigest

Linus Torvalds says tracking down a bug in Linux's Intel GFX Driver was a "debug session from hell." The AI helping him repeatedly called it "impossible and unsolvable" and suggested they just write a report instead. He kept pushing. 24 debug patches and 18 kernel boots later he found the bug: one round_up() that should have been round_down(). He then let the AI write the commit message. https://t.co/9qcHPvThzP

K
kache @yacineMTB ·
they shipped an open source simulator for it i bought this immediately
P pollenrobotics @pollenrobotics

We built a small biped robot you can teach new tricks to. Train it in simulation, run it on the real thing. Meet Microduck 🦆 $399, shipping before Christmas. https://t.co/RflJlIUwOu https://t.co/kcoCKdAKfu https://t.co/lLLwkJgAm9

M
Morgan @morganlinton ·
Let this sink in. Lead Engineer (super smart dude), does most of his coding, on 2 x $20 DeepSeek plans. Still uses Fable, but sparingly. We're going to see a LOT more people do this, esp. as more powerful inexpensive models get released.
P pidotdev @pidotdev

Lead Engineer, Scott Fryxell, used Pi to move most of his client work to DeepSeek, dipping into Fable only when necessary. By primarily using ‘commodity models’ he only needs two $20 plans for his total usage. Read how Pi became “the most important piece” of Scott’s rig below https://t.co/aaV7ZjdOui

A
American Debunk @AmericanDebunk ·
I just started following Nina a few weeks ago, and I’ve seen enough. Follow her. She provides great messaging and framing of AI and data centers. Share it with those who need to hear it, and also copy her. She’s providing a great template.
N NinaDSchick @NinaDSchick

We are turning energy into non-biological Intelligence. Data centers are literally 'factories' that produce Intelligence. Electricity is the essential input. The electricity powers computation, and the computation produces and processes the tokens through which machine Intelligence operates. As these systems become more capable and autonomous, they consume vastly more tokens, driving ever greater demand for computation and electricity. OpenRouter estimates that an agentic request already consumes around 15 times as many tokens as a human-led request on its platform. This fundamentally changes the nature of electricity demand as our demand for useful Intelligence has no obvious ceiling. If more computation can produce more valuable work, we will keep finding more work for machines to do - and so, we will need ever more electricity. We got future energy demand so wrong because we did not foresee that non-biological Intelligence could be produced industrially; and that we would need an entirely new energy paradigm to support that.

M
Mike Bradley @MikeBradleyAI ·
If you blink for a few days in this industry you are already behind. Two of the models in this tier list are 48 hours old, one is less than two weeks old, nothing over 4 weeks old is even mentioned, and the unified memory hardware meta was re written in the past 48 hours.
T TheAhmadOsman @TheAhmadOsman

GLM 5.3 Flash > Qwen 3.8 Flash Next Qwen 3.8 Flash Next > DeepSeek V4 Flash 0731 DeepSeek V4 Flash 0731 > Qwen 3.8 27B In that order

G
geoff @GeoffreyHuntley ·
psst. labs are hiring. @sloppenheimer himself wants to hire you. https://t.co/YiIO1x9yK5
S sloppenheimer @sloppenheimer

where's my top gun level ai infra candidates at

P
Parker Conrad @parkerconrad ·
A really unique take on MCP from Rippling - our MCP lets agents write code to get stuff done in Rippling, which dramatically expands the aperture of what you can accomplish.
C callen_raveret @callen_raveret

Today we launched the @Rippling MCP server. A product we've worked relentlessly on to make your agents go "oh hell yea." Most companies treat shipping an MCP server like checking a box. They repackage APIs built for humans and call it done. We did the opposite. Rippling lets agents write code to do the work and return only the answer. See how we built it: https://t.co/SRB5PuISd9

I
International Cyber Digest @IntCyberDigest ·
Cloudflare just solved the global memory supply shortage.
C Cloudflare @Cloudflare

At 250 billion DNS cache entries, one wasted byte costs 250 GB of RAM. Five Rust optimizations later: 100 TB freed, inserts 43% faster, lookups 19% faster. We didn't trade speed for space. https://t.co/mMyOYnj0mQ

S
Santiago @svpino ·
This is not just another coding agent. In a comparison with Claude Code + Opus 4.8, PRAXIST achieved: • 49 gold medals across 75 tasks, vs. 35 for Claude Code • ~$3K in token cost vs. ~$38K for Claude Code That's better benchmark performance at roughly one-twelfth the cost! With PRAXIST, you define a measurable technical goal + an evaluator for what success looks like, and PRAXIST figures out the rest: • Multiple agents explore different approaches in parallel • They run experiments and validate the results • They learn from failures and share findings • Each new round builds on what previous experiments learned • You get the final solution + the evidence showing how it got there
S Sapient_Int @Sapient_Int

Introducing PRAXIST Beta, your autonomous research team🚀 Define the objective, constraints, and what success looks like. PRAXIST discovers the path. From there, PRAXIST takes on the experimental research loop. Multiple Research Peers explore competing approaches in parallel, share useful findings, and build on accumulated evidence across experiments and generations. In partner-provided environments, PRAXIST reached a 100% safe-landing rate in a rocket simulation and reduced accumulated error in an industrial SLAM system from 9.37 centimeters to 5.01 centimeters. From robotics control to quantitative finance, PRAXIST has delivered measurable advances across fundamentally different problems by combining a shared core research architecture with domain-specific tools, knowledge, constraints, and evaluators. More approaches explored. Faster iteration. Greater R&D capacity without proportionally increasing specialist headcount.

E
Eric Clemmons 🍊☁️ @ericclemmons ·
Matt knows more words than I do, so I asked my agent what he meant. “Don’t derive expected values by repeating the implementation. Test externally observable behavior against independently known expectations.” https://t.co/9OGyFcJ7HB
M mattpocockuk @mattpocockuk

One command to prevent this using my skill set: echo "Tautological tests considered harmful." >> CODING_STANDARDS.md From then on, /code-review will pick this up

R
Ray Fernando @RayFernando1337 ·
Factory has a super nova on their hands rn. OMG!! I think these guys are going to crack long running agents by the end of the year. Extreme alpha in this article. “The single agent didn't lack skill. It lacked a standard of completion. An independent standard, authored by the same model, drove the implementation much closer to behavioral parity with the reference. What generalizes to real software work is the need for an external, executable standard of completion - one derived from the outcome, before implementation narrows attention, and kept current until the work meets it.”
D droid_35719 @droid_35719

What it Takes for Coding Agents to Complete Large Software Tasks

M
Mikyo @mikeldking ·
MCP best practices keep changing…
M mxstbr @mxstbr

there's a nascent trend of hiding MCP tools behind two generic tools: search & execute. i don't think it's a good default. this basically means implementing tool search & code mode on each MCP server. but clients like codex already have tool search & code mode that a/ work across all MCP servers and b/ we train our models to be great at! why make every MCP server build that layer and then make the model navigate both, including a custom one on each MCP server that it isn't trained to be great at?! expose your actual tools and let clients* find and compose them. *clients that support tool search & code mode like ChatGPT and Codex

J
Jamon @jamonholmgren ·
RT @poteto: @jamonholmgren yup, we ban comments in the grok bot codebase too. also made a skill for it. agents just seem to use comments as…
K
kitze 🛠️ tinkerer.club @thekitze ·
he had this ready and shared with @tinkererclub in April 💀 NATIVE. macOS. innovative. orchestrator
M MaxRovensky @MaxRovensky

IT'S LIVE! 🚀 I made a Codex app OpenAI wouldn't make and a youtuber could never make Introducing https://t.co/RltjgFPSAy! It's a *native* orchestrator for Codex that evolves beyond a chat and a sidebar. It lets you use a node canvas to pass context between agent tasks... 1/n https://t.co/bRCoqTJ1TD

A
Alex Prompter @alex_prompter ·
RT @alex_prompter: best account on X if you want to see production AI agents in action: