AI Digest.

AMD Outperforms NVIDIA on Kimi K3 Inference as RLVR Degrades Frontier Model Usability

AMD's MI355X server delivers nearly 4x the per-node throughput of NVIDIA's B200 for Kimi K3 inference, with ROCm working largely out of the box. Meanwhile, a detailed analysis of modern LLM training pipelines argues that reinforcement learning with verifiable rewards is systematically making frontier models less pleasant to interact with, and Uber open-sources its agentic AI security framework.

Quick Hits

  • @ChiragAsarpota reports AMD's MI355X server hits 952 tok/s aggregate and 118 tok/s single-stream on Kimi K3, roughly 4x the throughput of a 16x B200 NVIDIA setup, with better performance per dollar than both B200 and B300. The key advantage: AMD's higher HBM capacity per GPU means one MI355X node replaces two NVIDIA servers.
  • @kunchenguid traces why newer frontier models feel worse to talk to, arguing that the shift from RLHF (training to be likable by humans) to RLVR (training to pass machine-verified checks) optimizes for benchmarks at the cost of user experience. @NickADobos connects this to Claude's tendency to add unnecessary tests and bloat that RLVR never penalizes.
  • Uber open-sources Agentic Detection and Response (ADR), per @praveenTweets, capturing the full causal chain of AI agent sessions across Cursor, Claude Code, and Codex. After 10+ months in production across 50,000+ daily sessions, it achieved 97.2% precision on credential leak prevention and detected every attack on the AgentDojo prompt injection benchmark.
  • @jun_song predicts DeepSeek will dominate global AI market share because 4+ billion people earn under $450/month and cannot afford $200 frontier subscriptions. @quxiaoyin agrees the token usage market will shift overwhelmingly to DeepSeek.
  • @thsottiaux, a former DeepMind engineer, says the team had a ChatGPT-like product called LMChat roughly a year before OpenAI shipped ChatGPT, but Google blocked DeepMind from releasing products that could disrupt its business. @xikhar observes that Google's real loss was Tibo's departure.

AMD's HBM Bet

Sources

J
Jared Friedman @snowmaker ·
Graphify Labs is the first YC company to hit 100K github stars during the batch.
S safishamsii @safishamsii

100,000 stars on @graphify First Indian developer to ship a 100k-star repo. Only the 5th @ycombinator -backed open-source project to ever hit 100k. Stars are vanity until they aren’t. 100k is where they stop being vanity. https://t.co/HuRwwtedBg

C
Chirag Asarpota @ChiragAsarpota ·
Bro, this is actually a huge AMD moment. Kimi K3 is so massive that it needs 16x B200s across two NVIDIA servers, but it fits inside one 8x MI355X AMD server because AMD gives you much more HBM memory per GPU. That single AMD node hit: - 952 tok/s total throughput - 118 tok/s for a single user - Nearly 4x the throughput per node of the 16× B200 setup - Better performance per dollar than both B200 and B300 But the craziest part is that ROCm mostly worked out of the box. @wafer_ai only had to make a few relatively small fixes. No months of kernel engineering. No custom kernels at all. Even the slow time-to-first-token problem came down mostly to one attention kernel not loading because Kimi had 12 heads instead of a supported shape. They simply padded 12 to 16, used AMD’s fast existing kernel, and cut cold-prefill time by roughly 2–3x AMD’s bet on packing more HBM into each server is going to become extremely important as frontier open models keep getting larger. If AMD keeps improving ROCm and day-one model support, data-center operators will have to seriously consider these GPUs. The CUDA moat isn’t dead yet, but this definitely puts a big dent in it.
W wafer_ai @wafer_ai

🚨 BREAKING: these engineers figured out how to serve Kimi K3 on @AMD MI355X at 952 tok/s/node and 118 tok/s single stream! this crushes B200 by 3.8x in aggregate throughput/node and 1.3x in single stream decode + beats B300 on performance per dollar (48 vs 33 tok/s/$) See how in the thread.

O
orph @orphcorp ·
relatedly, a core adhd failure mode is Building A System While Avoiding The Task providing & engineering context for an agent turns the Building A System part into a reward loop by getting the agent to act on context & produce an output this plays right into adhd strengths
O orphcorp @orphcorp

cc/codex are such a boon to people with adhd by means of decreasing activation energy & holding context/intention for them, that even if your org is tokenminning, extra usage should be included as part of adhd accommodations

M
Matt Van Horn @mvanhorn ·
Fun seeing @slashlast30days next to @firecrawl and Exa as your stack, @EXM7777 !
E EXM7777 @EXM7777

your research workflow is the most important layer of your business... it's very simple to turn an agent from slop factory into a narrow expert, and it all comes down to homemade training this is my current research stack: > i replaced all my deep research tools with Exa > Firecrawl for specific websites and markdown/pdf analysis reports > /last30days for the current best way to do anything then the architecture: a fleet of subagents that verify findings and cut the slop, then launch reruns with fresh keyword sets the loop is engineered: draft a research plan, run it once, review the outputs, delete what's useless, redraft around what's missing the last quality gate is another provider's agent scoring it, low scores go back around any other tool i should consider in my stack?

👩
👩‍💻 Paige Bailey @DynamicWebPaige ·
🚀🙌 Run our tiny @googlegemma models for $8 (or less) on an ESP32! 👇@github linked in the article below: https://t.co/Mq0Lsio4hi
H Hacksterio @Hacksterio

A developer borrowed a trick from Google's Gemma models to fit a 28.9M parameter LLM on an $8 ESP32 chip. https://t.co/0U8wkW6vO3

D
dex @dexhorthy ·
fight slop with slop - keep your core clean but vibe everything you can to understand how your system is changing and create novel forms of feedback for both models and humans. Great talk
S swyx @swyx

one of my curses as organizer is i rarely get to attend the conference i run. so i basically 24/7 watch back talks with everyone else after the show this one was VERY well paced and argued: fighting slop with slop — @vaibcode, Boundary https://t.co/vRckyyntm6 @btaylor asked for an ai native programming language on our pod. as a PL fan I’m really glad someone is rethinking how code runs from first principles. Being slop-tolerant is 100x more valuable than being anti- slop

S
Shikhar @xikhar ·
Google actually lost when Tibo left https://t.co/ZN5GysknwT
T thsottiaux @thsottiaux

@_chenglou I was part of that team. Basically ChatGPT one year before it came out. Called LMChat and then another codename. Google was too nervous to release it and DeepMind was blocked from shipping products that could disrupt Google. I think about this a lot.

A
Aaron Levie @levie ·
We’re going to be in for a strange dynamic which is that some of the “hardest” work in the world is actually prone to automation first, particularly due to its verifiability. Math, cyber, and code -while being insanely hard and high value fields- have the benefit of being able to be tested that it’s correct objectively. This has two immediate benefits: the training of the models offers clearer reward signals, and then the running of the models allows you to know that it’s working properly because you can test the results in a scalable way. Conversely, in other domains of work, there’s much less instant verifiability. Which legal clauses your client will agree to, what marketing campaign to run with based on changing sentiment, which message your sales prospect will want to hear, what financial targets and budget to set for a business, and so on. All of these domains have changing internal and external factors, they don’t have “one right answer”, they rely on the opinions and risk levels of the operators, they’re highly sensitive to getting the right input context first, and in many cases the right answer can’t even be known for quite some time after the model generates the results. The implications of this distinction are that -even as model capability continues to increase exponentially- there will be a lot done at the applied AI layer than just the the model itself, and much of the processes themselves will even need to change over time to get the full gains from automation. We may even need all new capabilities to be able to “test” knowledge work over time as we have had with software.
M max_spero_ @max_spero_

In my view we have a few different tiers of verifiability 1) programatically verifiable (near-free) - games, coding, math, cybersecurity, chip design 2) real-world verifiable (cost-or time bounded) - sciences: biology, chemistry, physics -physical world: material science, energy, aerospace, robotics, agriculture, pharma -forecasting: trading, weather 3) verifiable with human preference - writing, design, comedy, charisma, persuasion I expect most low-hanging fruit in (1) to be solved very quickly. Not sure how much longer before more solved math conjectures are simply uninteresting. I’m least certain about chip design being in this category, perhaps we hit a ceiling and require physics or materials breakthroughs to continue progress. My guess is we will quickly run into the limits of how well we can simulate each domain in (2). The time-bounded nature of real world verification may be the reason we don’t hit fast takeoff. Sim2real remains an elusive problem to solve when real-world data is limited. Part of the reason I don’t expect to live multiple hundreds of years is simply that I expect pharmaceutical progress to be time-bounded by the physical world. I expect the items in (3) to never really get solved to a superhuman degree, as success relies on an ever-shifting plane of cultural preference. People adapted to “good” AI writing and became annoyed at new stylistic tics that, in a vacuum, are not necessarily bad.

A
Andreas Stuhlmüller @stuhlmueller ·
few people have had more foresight than wei dai: 1. he's been writing about the singularity since the 90s, back then on extropians/sl4 mailing lists. i remember reading his stuff when i was 16 back in germany 2. he invented b-money. it's the first citation in the bitcoin whitepaper. ethereum's unit wei is named after him 3. he anticipated covid's exponential rise early in Feb 2020, and bought S&P puts before the market crashed 4. he passed on anthropic's first round to avoid contributing to x-risk. this itself required a lot of foresight about scaling - this was gpt-3 time, no chatgpt, no codex, very very far from huggingface/openai type incidents his point now is that long-horizon strategic competence barely exists in humans. and that it's a tricky situation because if you make AI more strategic that also increases takeover risk from AI. long-horizon RL might make AI more strategic but probably makes the overall situation worse. same for basic scaling why aren't there more projects that are about getting competent strategic & philosophical advice out of AIs? because (a) first you have to recognize this as an important project, which is exactly what we're bad at and (b) then you have to measure progress and do evals, which also requires the very ability we're bad at
W weidai11 @weidai11

"I don't have any good ideas for what to do in light of all this. Just wanted to post an update on my current thinking, my own 'situational awareness', if you will." https://t.co/l345HNhKsj

I
i²cjak @i2cjak ·
Eight Amps is an actual gem that has saved my ASS when I needed short term PCB assembly. Luke is going to win
L lukebayes @lukebayes

This! All of this! It's as if someone is reading our playbook. Eight Amps is developing a 100% domestic, vertically-integrated hardware, software and systems stack that allows us to take orders of magnitude off the CapEx and OpEx required to produce small-batch, fast-turn printed circuit board assemblies (PCBAs). We've taken zero outside capital and we're using revenue from sales to drive growth at a pace we can provably handle. We deliver multiple first-time orders in < 24 hours every single week. Gen 2 automation is coming online later this month. Hit me up to join our next cohort of customer invites!

N
Nikesh Arora @nikesharora ·
This is cool. Opensourcing detection is great. As we get AI agents operating at machine speed, we are going to need inline prevention. Interestingly we were using Koi for this an year ago and their roadmap was headed in this direction. We welcomed the Koi team to PANW a few months ago, the combination of detection and inline prevention from XDR is what is going to be required in the longer term - detection and inline prevention. Looking forward to launching prevention as a compliment to your efforts.
P praveenTweets @praveenTweets

AI agents are everywhere at @Uber. It’s great to see, but the thing that keeps me up at night is how we are going to secure them. This is something that I have been thinking about for a while. Today, our agents run 50,000+ sessions per day across thousands of endpoints. And this isn't just engineering anymore. Employees across the company use agents that read code, run commands, call internal tools, analyze data, and act on real systems. That scale forced us to confront an important question: How do you secure agents when your security tools can't even see them? Traditional Endpoint Detection & Response (EDR) sees the file write, but not the prompt that triggered it. It sees the network call, but not the agent's reasoning. The intent, the thing that separates malicious from benign, is invisible. So we built Agentic Detection and Response (ADR): • Capture the full causal chain: prompt → reasoning → tool call → outcome, across Cursor, Claude Code, Codex, and every agent our employees use. • Triage cheaply: a fast, high-recall first pass handles the flood of benign sessions. • Reason deeply: only suspicious events get expensive LLM analysis, enriched with source code, threat intel, and policy context. • Red-team continuously: an offline explorer evolves hard attack variants before attackers find them. After 10+ months in production, the results speak for themselves: • Hundreds of credential exposures detected across 26 categories. • Shift-left prevention blocking secrets at 97.2% precision, before they ever leave the laptop. • Zero false positives on our enterprise benchmark, with 2-4x the F1 score of state-of-the-art baselines. • Every attack detected on AgentDojo, the public prompt injection benchmark. Just as valuable as the detections are the lessons from running this in production: • The workflow is the unit of security, not the individual tool call. Attacks hide in causally-linked chains that look benign step by step. • Credential leakage is a far more common operational issue than prompt injection. • Approval fatigue is real: when users approve 50+ actions per session, human oversight becomes a rubber stamp. You can't secure agents you can't observe. And nobody can solve this alone. That is why we recently joined the Open Secure AI Alliance (OSA), and why today we're taking the next step: open-sourcing ADR. The release includes the ADR Sensor, the detection framework, and ADR-Bench, the first enterprise agentic AI security benchmark: 302 tasks derived from real production telemetry and full coverage of all 17 attack techniques across 5 tactics, so the community can rigorously evaluate their own defenses. Code: https://t.co/tmI0oQ1F2U Paper: https://t.co/0xbswUbiF5 The future of AI security won't be built behind closed doors. Excited to see what the community builds on it, and what we all learn together! @UberEng

B
Ben (no treats) @andersonbcdefg ·
wow this is like a fantastic advertisement to never buy a dgx spark lol
S sudoingX @sudoingX

if you own a dgx spark and you are not sure what to actually run on it, here is every serious model i have put on one box, ranked, with real single-stream numbers. > DeepSeek V4 Flash 0731, 284b / 13b active, 3bit, 16.5 tok/s. the slowest here and still my number one. it is the biggest brain that loads on 128gb, and you feel the 284b weights in every answer. a pro thinker, worth the wait when the problem is hard. > Laguna S 2.1, 117b / 8.5b active, NVFP4, 19.8 tok/s, up to 37 on code with DFlash. number two, the one i trust for real agent work. it opens a todo list before it writes a line, tracks every step to done, and runs long without losing the thread. built for the jobs that take hours. > Qwen 3.5 122b, 122b / 10b active, NVFP4, 28.2 tok/s, 35 with MTP. number three, the fast heavyweight. clean and quick, spec-decode is a free 25%. size when you still want speed. > the rest that run great on one spark: StepFun 3.7 Flash 198b, ~25 tok/s Ornith 35b-a3b, 78 tok/s Qwen 3.6 35b-a3b, 58.6 tok/s Qwen 3.6 27b dense, 55 tok/s Nemotron Omni 31b-a3b, 264 tok/s, the speed king my honest order right now: deepseek for the depth, laguna for the long agent runs, qwen when i want it fast. all local, all on one box you can set on a shelf.

J
jack friks @jackfriks ·
RT @marclou: My favorite media made a video of my favorite indie hacker. Go watch this.
T
Todd Dailey @twid ·
This is how I work too: - one main Mac at home holds all repos. - Claude code and codex and Hermes all talk to it - Tailscale connects them all I’ve got a work Hermes, a personal Hermes, a Hermes that runs bots and security cams and home integration, and a Hermes for my partner all running on individual Macs, and the main Mac is the beefiest and does all development.
A AlexFinn @AlexFinn

You need to set up this Codex system I have Been taking advantage of their new remote features and my productivity has 1000x'd I have one device (Mac Studio 1) as my main dev machine. That's where all code is written Then all my other devices (iPad, iPhone, other Mac Studios) ALWAYS remote into that Mac Studio 1 to do their work I never do local work on any of them. They're always remotely controlling the Mac Studio No matter which device I'm on, no matter where I am in the world (could be at the grocery store, in bed, Japan, on the toilet, by the pool, on the road using FSD) I have code written in one place Made coding big projects SO much easier Here's what I'd do if I were you Choose one device you have (preferably a desktop device like Mac Mini or Mac Studio that is always on) Make this your main dev device. Make sure it never turns off and never goes to sleep Go into Codex app then settings on that device. Go to connections > control this Mac. Turn that on Then go into every other device you have, mobile, desktop, whatever, and go into Codex settings and enable control other devices Also download Tailscale on every device. This will allow you to create a private network that will allow your other agents (OpenClaw or Hermes) to jump between computers and make changes when necessary You now have a super powered AI private network where you can code or get work done from any device anywhere in the world Promise this 1000x's your productivity

X
Xiaoyin Qu @quxiaoyin ·
I agree. DeepSeek will present serious danger to OpenAI and anthropic’s market share. Anthropic might keep high margins but the token usage market share will go to DeepSeek overwhelmingly.
J jun_song @jun_song

Prediction: Deepseek will soon take the number one AI market share globally. The reason is simple: the global median annual income is only around $5,000. That’s the median, not the average. That means at least 4 billion people make less than $450 a month, and they can’t afford a $200 subscription for a frontier AI. The only AI they’ll be able to afford is Deepseek.

D
Dillon Mulroy @dillon_mulroy ·
RT @lumendriada: i still sometimes can’t comprehend that a tool i built for my own needs a few months ago reached this many people, and now…
C
chiller @chillerlol ·
totally agree, and grok-4.5 is the equivalent of the dunnit kid from school. fukin anything I give it instantly says dunnit and output is total shit
T Tech_girl @Tech_girl

Unpopular opinion: Claude Fable 5 is better than gpt 5.6 sol. I don’t care how many reset Tibo does.

N
Nick Dobos @NickADobos ·
AI is going to get harder and harder to read and understand What Kun describes here is also why Claude fable and opus 5 goes off the rails so often RLVR doesn’t care if Claude added 100 bullshit tests as long as the final check worked.
K kunchenguid @kunchenguid

if you've been using latest frontier LLMs, it's almost certain that you would have noticed by now the newer models have become worse to talk to they're more robotic, they speak jargons, they spits out verbose text, and do stuff you didn't ask for how did that happen? well, i'm not the person who trained those models so i can't speak for certain, but i've known enough evidence that gives me a well-educated guess, and i thought it's interesting to share as a crash course of modern LLM training pipelines so here we go let's wind back to 2020. GPT-2 and GPT-3 already came out and were widely available, but they could only predict one token at a time - that's what LLMs are at their core token prediction was offered via API, but there was nothing you could "talk to". so while it generated a lot of excitement in the academic field due to the emergent intelligence, it didn't have any wide adoption in 2022, ChatGPT changed all that. the research work that led to ChatGPT was a model initially named "InstructGPT". it took GPT-3 as the intelligent base, and used reinforcement learning with human feedback (RLHF) to teach the models how to "chat" the core idea of RLHF is that you ask the model to generate a few responses, and then let real humans pick which one they like. do this over and over again, and you get a model that knows how to talk worth noting even as early as InstructGPT, research found that making the model more pleasant to talk to will reduce their pure academic capabilities. this was called "alignment tax", which is an interesting thing we'll come back to in a bit there were various techniques done to minimize the reliance on humans, but ultimately the reward is modeled after human preference, making these AI assistants easy to talk to so remember this: RLHF = training the model to be likable by humans in 2024, there was an inflection point introduced by claude sonnet 3.5 which was the first model that can kind of autonomously finish coding tasks. it led to the first wave of viable "coding agents" the way sonnet 3.5 achieved this was by training the model with a harness (now it's called an agent) that has bash and file editing tools, throw the agent into a virtual machine, give it a task, and let it try to complete it. these tasks all have a machine-verifiable outcome predefined, mostly via test cases, that can validate whether the model really finished the task or not then you let the model do billions and billions of attempts in such virtual environments, and some of them would succeed by chance. you keep the successful agent sessions, and use reinforcement learning to teach the model to do that more, and boom - you get a coding agent that is called reinforcement learning with verifiable rewards (RLVR). if you look closely, you'll see that in this RLVR process, the final text response from the model doesn't matter AT ALL, as long as the code written by the agent could pass the test. it could talk like a jerk and it would still be rewarded so remember this: RLVR = training the model to be accepted by machines late 2024 and early 2025, we saw o1 and deepseek R1 came out as the first wave of "reasoning models". this article is getting long so i'm not diving into reasoning models now, but just know that reasoning models also relied heavily on RLVR to scale the training process - let the model think before taking action, and if the thinking led to a machine verifiable outcome, reward the thinking trace and teach the model to think like that more often the biggest difference between RLVR and RLHF is that RLVR is more scalable. human feedback is expensive to get, especially in domains where only an expert can have a valid opinion on which result is good with RLHF, if we let the model generate 100 responses, then a human has to review all 100 responses to pick which is good with RLVR, the human (or sometimes an AI) would define a task and verifier only once, and the model can generate a million responses - the machine verifier will pick which responses are good in an automated way so as a result, RLVR is becoming more and more dominant in newer models' training pipeline if you put all these things together: - RLHF = training the model to be likable by humans - RLVR = training the model to be accepted by machines - RLVR is more scalable - "alignment tax" says "likable by humans" makes the model do worse on verifiable tasks now you see why the newer models are becoming less and less likable? this is not just a "frontier labs screwed up their model training" problem - this is a war between machines and humanity, and humanity is losing we chased after benchmarks, when none of the benchmarks measure whether humans actually enjoy working with the model we use machines to decide which AI response is better because that's easier and cheaper, when we have no way of making sure those machines actually represent what we humans want we let AI go dark in a virtual environment on its own and complete predefined tasks at all costs, when in reality we often cannot define a verifiable outcome upfront, and need AI to work with us along the way i don't have a good solution to this, but i want to call for awareness that we're starting to witness a failure in aligning super intelligence right in front of our eyes this war between machines vs humanity is one we really can't afford to lose

M
Matt Pocock @mattpocockuk ·
RT @lucasmeijer: Mini review of @mattpocockuk /wayfinder and associated skills:
S
Steve Yegge @Steve_Yegge ·
Engineers and CTOs on X: I wrote this for you. https://t.co/GGFPWEWElg Models and devs on X: I wrote this for you both. https://t.co/5gfieOFBsx Enjoy. Or not. Some of you definitely won't. But I invite you to debate it. The world's changing very fast now.