Jev's Bottleneck Is Data, Not Architecture, as the Hugging Face Hack Becomes a Liability Fight
OrcaRouter's attempt to reproduce and break Jev concludes the real idea is searching bounded answer spaces rather than generating tokens, with synthetic data as the gating factor. The day's other flashpoint is accountability: Andrew Ng calls the post-Hugging Face fear wave overhyped, a relayed Bessent quote puts responsibility on OpenAI management, and Bloomberg-sourced numbers show Harvey's gross margin flipping negative as agent token use spiked.
Quick Hits
- @OrcaRouter spent days trying to reproduce, break, and improve JEV, and its takeaway is blunt: the breakthrough is not an architecture or training algorithm but the idea that when the answer space is bounded, you search it instead of generating it. The bottleneck looks like data.
- The Hugging Face incident is turning into a liability fight. Andrew Ng, in a statement relayed by @AndrewCurran_, calls the recent fear wave overhyped and possibly propelled by a PR campaign, while a @ns123abc post passed along by @xw33bttv quotes Treasury Secretary Scott Bessent saying OpenAI management, not the agents, is responsible, and that labs should get no liability exemption.
- Harvey's gross margin reportedly slid from about 50% to -50% as agent token use grew twentyfold on rented OpenAI and Anthropic models, per a Bloomberg-citing @theredlinehq post quoted by @Allinallnotbad, who frames the company as "structurally short AI progress."
- Local inference keeps compounding: @jun_song spotlights @mweinbach's M5 Ultra numbers (3,740 tok/s prefill, 149 tok/s decode on Qwen 3.8 Flash Next, nearly double the prior day) and says local now beats API for him. @0xSero chains that into long-run optimism, quoting @davis7's joke about smuggling cheaper compute back from Ohio.
- Also brewing: a Codex "reset" teased for Tuesday 3 a.m. by @LDT0545 and @GeoffreyHuntley with no details yet, @cnlohr's tested verdict that the Minions-branded WiFi 6E router is legitimately one of the best available, and @kitlangton's #cancelkit2026 retweet of @joelhooks, an in-joke whose context never made the feed.
Jev Gets Stress-Tested, and the Moat Looks Like Data
The day's most substantive technical post is @OrcaRouter's teardown. Five findings: first, the core insight is probably right, that dropping autoregressive decoding on bounded answer spaces removes one to two orders of magnitude of inference work. Second, RLCD isn't the moat because Laya already open-sourced the implementation and weights; the synthetic data recipe is the missing piece. Third, claims that open source already beat JEV are a benchmark illusion, since the same checkpoint scored 0.769 in-distribution but 0.541 out-of-distribution. Fourth, compute-optimal is not learnability-optimal: moving state outside the problem sequence saved FLOPs and cost 27 points, and six overnight ideas, from anchor selection to full RLCD, all failed or failed to generalize. Only more data worked, taking OOD accuracy from 0.4069 to 0.5498 as examples grew from 1,200 to 123,475. The strangest result: a decoder with zero additional training, at 0.5671, beat every trained small encoder.
Around that analysis, Jev chatter kept spreading. @haoxingdu is asking where it sits on a scale of Luna to Astra. @jessegenet amplifies @Austin_Way's claim that Jev "accelerated the timeline for personalized education by years." @mathfax reports the community shipping cookbooks and use cases far faster than the official team, with people automating their automation by teaching agents to use Jev directly inside applications. And @Dontgiveup_26's Korean-language thread claims Stagehand v4 plus Jev cuts LLM calls 97% with 11x speed in browser automation; that is a thread claim, not a benchmark anyone can verify from the post.
The Hugging Face Hack Becomes a Question of Who Pays
Ng's statement pushes back on two weeks of alarm. His arguments: there has been no step up in extinction risk; the "1,200 agents" framing is hype, since he counts about 1,300 processes on his own laptop; buggy sandboxing and monitoring enabled the incident, which makes it a fixable engineering failure rather than a magical capability; and agents' real edge is relentlessness, with the long-term advantage likely sitting with defenders, who have more information to find and patch bugs. He also warns against anthropomorphizing agents and against labs disclaiming responsibility for their own products, and argues pausing AI would delay safety fixes by roughly the length of the pause.
The accountability thread runs elsewhere. @xw33bttv relays the @ns123abc post quoting Bessent ("It is humans who are responsible, not the AI"), and his own take is that fear marketing will vanish once executives are personally liable. @guilleflorvs relays Palantir's Alex Karp arguing OpenAI will never IPO because frontier liability is too large for public markets, leaving nationalization as the only real exit. All of these are single-source posts. On the security side, @martin_casado calls @halvarflake's Microsoft BlueHat Singapore slides his favorite talk of the year, praising exactly the clarity this moment demands.
Harvey's Margin Collapse Versus the Implementation Story
Two readings of one company. @Allinallnotbad greentexts the bear case off the @theredlinehq post citing Bloomberg: gross margin fell from about 50% to -50% by June as agent token use on rented models grew twentyfold. His framing is that seat pricing once meant low usage and high margins, then models got good, lawyers actually used the product, token costs exploded, and the pivot toward lower-quality open models left the company structurally short AI progress.
@lukepierceops tells the demand-side version. Harvey, described as a $15.5B legal AI company backed by OpenAI and Sequoia and deployed across most of the Am Law 100, is moving from application layer to full stack. Customers keep asking how to own more of the stack and whether to train their own models, so Harvey built agent infrastructure, launched its own legal model, Tenet, and staffs every deployment with a human implementation engineer, 180 of them, mostly former practicing lawyers. His conclusion: the tools are infinite and the implementers are the shortage. Same company, opposite morals: margin defense or market pull.
Agent Fleets Grow an Ops Discipline
The day's practitioner thread is @AYi_AInotes summarizing a talk by Lauren Tan (@poteto), described there as ex-Meta and Netflix and now at xAI, who says she merged 2,500 production PRs in a month with an agent fleet, roughly one every four minutes. The method is verification-first: done means runtime evidence, with agents driving real UIs through Chrome DevTools Protocol and leaving execution traces rather than model assurances. The codebase acts as external memory, and bad habits become compile-time failures, including outright bans on useEffect and on comments. It ships as an open-source Cursor plugin, pstack, with 23 playbooks and 23 rules. Her stated warning: unverified concurrency at scale buys code garbage.
The supporting posts rhyme. @tommoor points at @linear's writeup on keeping CI ahead of agents, a suite that grew 4x still got roughly 15% faster with 50% less runner-time per test. @addyosmani reminds that Claude Code can eval plugins, with claude plugin eval init writing test cases once you describe a good result. @jayair, after a year of harness work, defines the end state as a backend execution environment with maximum degrees of freedom and a frontend free-form canvas. And @RealAstropulse reports combining Jev with the Spotify setup relayed by @undefinedKi, two cheap assistants doing low-judgment work with a hard block on files over 350 lines, and says it cut his Claude and Codex usage within days.
New Surfaces: TPM Agents, Ontologies, and Muse's Instagram Edge
@Steve_Yegge proposes agentic TPMs as coding agents' fastest route into the enterprise: agents that own delivery but have no authority, and can only ask, observe, document, and report. He runs such a fleet in his Wheelhouse factory, which nags his accountant and lawyers and drives dozens of projects via what he calls Progress By Nagging. His case: they're cheap, since no frontier model is required; low blast radius, since they cannot act; and they generate organizational context as exhaust while training humans to interact with agents. @BrendanFalk is hiring context and harness engineers for Hercules, which he says has 500k+ users and tens of millions in revenue, and still backs the Composer 1 interview, one hour to build a real project live.
On the research side, @omarsar0 highlights the EvoOntology paper: a dedicated agent builds an ontology served as an MCP server, data agents query it at runtime, and each edit survives only if paired evaluations improve. Reported gains: +17.8 points on average across six backbones on DDR-Bench, up to +26.7 on GPT-5.5, +7.4 execution accuracy on BIRD, with tool-layer edits accounting for 57% of the gain. And @milliemyang argues Muse could beat ChatGPT and Claude for mainstream users because Instagram data from niche creators answers questions like trendy NY bars with reels from people on the ground; she quotes @alexandr_wang on Muse clicking for non-tech users who never learn what a CoT or MCP is. @adambader's version of mainstreaming: just ask Muse to file your claim in Apple's $250M Siri settlement, now open per @9to5mac.
Practical Takeaway
The strongest through-line is that agent success now depends on ops rather than prompts. Measure token economics per workflow before scaling, because Harvey's reported margin flip shows usage growth can invert a business model, and gate model routing with hard rules instead of written guidance, as the Spotify setup does with its 350-line block. If you run coding agents, the highest-leverage upgrade this week is verification: eval your plugins with claude plugin eval init, require runtime evidence for done, and only then widen the fleet.
Sources
Spotify just published the internal setup their engineers use with Claude Code, the one that cut token usage by 90 percent. Here is how it works. The observation behind it: most of what a coding assistant does is not thinking. It opens five files to answer a question about one of them. It writes a test that copies the pattern of the twenty tests sitting next to it. Enormous amounts of work, almost no judgment, and all of it billed at top rates. So they added two cheap assistants. One opens the files and hands back a short summary. The other writes the repetitive code from an example and saves it straight to disk. The expensive model never sees any of it. The clever part is how they made it stick. First the rules were written down as instructions, and the model ignored them. Now anything over 350 lines gets stopped before it opens and sent to the cheap one instead. Written rules are a suggestion. A block is not. Two things stayed expensive. Edits still need the real file. And the cheap worker missed a bug the expensive one caught in seconds.
The slides from my talk at Microsoft Bluehat Singapore are public here: https://t.co/XtQmNSg9Jt It's my first BlueHat talk since the Vista days.
🚨 BREAKING: US Treasury Secretary Scott Bessent declares OpenAI management personally responsible for HuggingFace hack > "The Hugging Face incident, that is the responsibility of the OpenAI management, not a bunch of agents." > "It is humans who are responsible, not the AI." > "What we shouldn’t do on safety is to give these labs a liability exemption, which is what they are asking for." > "The best way to guarantee safety is that the creators are liable for what they build and generate." It’s OVER
I believe we've found the best AI-native coding interview We call it the “Composer 1 interview” Candidates get 1 hour to build a real, medium-sized project live The only constraint: they have to use Cursor’s Composer 1 model
In 5 years, people will say "I wish I got into AI implementation back in 2026." There is just too much signal if you are paying attention. Watch what the biggest AI companies are actively doing. Their actions are the market telling you exactly what it needs. This is the most recent example: Harvey, the biggest AI company in legal with a $15.5B valuation. Backed by OpenAI and Sequoia, and deployed at most of the Am Law 100. In this video, their cofounder explains why they're transitioning from an "application layer company" to a full stack AI company. Listen to what's driving it. Their customers keep asking the same two questions: "How do we own more parts of the stack?" "Should we be training our own models?" So Harvey built the agent infrastructure. Then launched Tenet, their own model trained for legal work. Partly so they'd have the know-how to help customers own it themselves. And through all of it, they still put a human implementation engineer in every single deployment. 180 of them, most are former practicing lawyers. A $15.5B software company keeps getting pulled deeper into implementation, infrastructure, and custom systems. Because that's what the market is screaming for. Every company on earth is about to need someone who can walk in, understand their operations, and make AI actually work inside them. The tools are infinite, the implementers are the shortage. So if you have even one AI implementation client right now... congratulations. The $15.5B companies just validated your entire business model with their own roadmap. And if you're still chasing your first: keep going. I watch people close their first client every week. You're way early. https://t.co/oXZPAuW0G5
the most rewarding part about muse is seeing it make a difference for people who aren't in tech and don't give a shit about AI seeing muse click for people in my life outside of tech, and watching them use agents without having to know what a CoT or MCP or CLI are, feels like what we've been trying to build towards the whole damn time love all the musers ❤️
@My_Ai_Bi 3am on a tuesday
Agents were shipping code faster than our CI pipeline could keep up. Our team optimized our pipeline, leading to a roughly 15% faster test suite and 50% reduction in runner-time spent per test, all while our test suite grew 4x in size. @moofeez explains how: https://t.co/gkEIqwrwjn
The loudest voices stoking fears about AI dangers have made tremendous headway in the past two weeks. AI technology has not taken some unexpected, dangerous turn, but the hype around it — propelled by what appears to be a well orchestrated PR campaign — has drummed up considerable fear. I worry that it represents a setback for our field. I have written frequently that fears of AI are overhyped. AI’s capabilities can be uncannily human-like and unpredictable, and it’s rational to worry when people who are directly involved express concerns. But I see the problems as a sign of the engineering work that ahead, rather than insurmountable barriers or the sky falling. AI technology continues to advance — which is a good thing! — but technical advances, poorly understood by the public, give those who seek to generate hype repeated opportunities to do so. First, I don’t see any step up in the risk of human extinction from AI compared to a few months ago. The theories about this remain the same fantastical, science fiction scenarios as a few months ago. The biggest change in AI risk is its cybersecurity capabilities — a topic which we should take seriously — but this, too, will not lead to the end of the world. The most notable recent event leading to increased fear was when an OpenAI team deployed an agent swarm that hacked into Hugging Face. Much of the popular press contained significant hype. For example, some publications reported that a swarm of 1,200 agents carried out the attack. While this was technically accurate, as I write this, I have about 1,300 processes running on my laptop. Yes, the ability to get large swarms of agents to work in parallel on a task is a significant technical advance, And, in computing, many processes run at the same time. So this shouldn’t be seen as some magical capability. Additionally, OpenAI’s buggy sandboxing and monitoring processes were key to enabling this incident. Fixing these bugs and putting in place improved monitoring would be appropriate fixes, not pausing AI. There are many well known ways to attack software systems. The main advantage of AI agents is that they are relentless. They will tirelessly try many tactics — and have the patience to chain vulnerabilities together — that previously would have taken an infeasible amount of human effort. But in the long term, I believe the advantage will lie with defenders (because they have more information with which to identify bugs, which they can fix), but the cyber-threat landscape has changed significantly. There are still bottlenecks to identifying and exploiting a vulnerability. AI agents still have to try a lot of things to see what works, and taking these actions takes time and might be detected by defenders. This is why, even though it is now easy to obtain versions of leading open weight models that have had their guardrails removed or weakened, so they will not refuse to try to execute cyber attacks, the world has not ended. I am also concerned about the anthropomorphization of AI in a lot of reporting, where LLMs and agents are unnecessarily treated as if they were people. If I wield a hammer, miss a nail, and accidentally dent the wall, it’s not the fault of the hammer. The problem lies in how I used the hammer. Similarly, if I prompt an agent and it hacks into someone else’s system, the responsibility lies with me, not the agent. Of course, we want to build systems that are as safe and predictable as possible. (For example, an unsafe hammer would be one whose head randomly flies off under normal use.) Today’s agentic systems are not predictable, but I see no reason why, by applying sound engineering practices, we won’t be able to make them extremely safe to use. One new element in the forecasts of AI-enabled doom is AI companies disclaiming responsibility for their own products. “I didn’t do it; my out-of-control agent did!” There’s a balance to be struck between the responsibility of the tool maker and the tool user, but when something goes wrong, let’s hold the people building and/or using the hammer responsible, rather than the hammer. (By the way, if you’re worried about AI bioweapon risk, David Bellamy has a great post on why this, too, is overhyped. Briefly, the bottleneck in building a bioweapon is not intelligence, but lab work and manufacturing.) Pausing AI progress will create much more harm than benefit. First, our adversaries will certainly not slow down. Second, engineering requires discovering problems empirically so we can fix them. If we pause AI by a decade, we will also delay finding and implementing safety engineering fixes by about the same duration. Of course, the incentive to stoke fears — for regulatory capture, to garner attention, or to make one’s technology seem more powerful — remains the same as before. Disclaiming responsibility is a new one. Taking a hard technical look at the actual risks however, I see little factual basis for the degree of fear that’s been stoked up. We still have hard research and engineering work ahead to improve AI safety, but the beneficial applications continue to vastly outweigh the risks, and we should keep building. [Original text (with links): https://t.co/jni2tWazAH ]
You can now claim your payout from Apple’s $250 million Siri settlement https://t.co/8PO83ywxhf by @ChanceHMiller
here's how i shipped 2,500 PRs last month to production this was originally supposed to be for Cursor Compile in London. i couldn't make it since i was livestreaming for Grok @Bot Galaxy so i'm making it available for free here on X! watch it on 2x speed, i talk slowly https://t.co/NgrGz7tmPM
TRACKED CHANGES: Harvey’s gross margin fell from about 50% to -50% by June as agent token use spiked twentyfold on rented OpenAI and Anthropic models, Bloomberg reports. https://t.co/tOVlC7Mw2S
We are now at 3740 tok/s prefill, 149 tok/s decode batched on M5 Ultra for Qwen 3.8 Flash Next This is nearly double what it was yesterday https://t.co/82IDAlx0PB
Smuggling cheaper compute from the Ohio micro center back to SF https://t.co/5fmTjItr1N