Anthropic's Mythos Leaks Ahead of Launch as Apple Ships 20B On-Device Model and Agent Frameworks Multiply
A security researcher shares the first detailed hands-on with Anthropic's powerful new Mythos model, Apple reveals an innovative 20B parameter on-device architecture at WWDC, and the AI agent ecosystem rapidly matures with LangChain's Fleet launch leading a wave of new tools.
Daily Wrap-Up
Today's AI conversation was shaped by three major currents: the first substantive hands-on review of Anthropic's upcoming Mythos model, Apple's dual announcements of a new AI VP and a clever on-device architecture, and a growing chorus of developers arguing that the real work of AI has almost nothing to do with AI itself.
The Mythos leak from @zekramu deserves attention because it offered something rare in AI discourse: genuine, unvarnished technical impressions from someone who actually used the model for a full day on real work. Their company found roughly 800 major security threats across widely-used products. The model is apparently expensive enough to make enterprise customers wince, and Anthropic is so concerned about safety that they ship a custom "harness" to sandbox it. Yet the reviewer also watched Mythos get confused by a Bazel build system, a reminder that even frontier models have mundane limitations.
Meanwhile, Apple's WWDC brought news of a 20B parameter model running on-device through an elegant architectural trick: a small model predicts which experts to load from NAND into RAM once per query, rather than swapping experts on every token like a traditional Mixture of Experts setup. It is exactly the kind of clever engineering that makes you wonder why nobody thought of it sooner. @awnihannun broke down the technical details, noting that you simply cannot fit 20B parameters in RAM at any reasonable precision without this kind of approach. The most practical takeaway for developers: the skills premium is shifting fast. Between @businessbarista's 10-step transformation framework (where only step 4 is actually AI), @zarazhangrui's electricity analogy, and the growing consensus around context engineering over prompt engineering, today's posts signal that the developers who will thrive are the ones who can design systems around AI, not just talk to it. Learn evaluation design, retrieval architecture, and inference optimization. The prompt is the easy part.
Quick Hits
- @elonmusk shared an interview with SpaceX's CFO covering the company's financial trajectory
- @Oxylabs_io highlighted ISP-backed proxy networks for more reliable data collection and web scraping workflows
- @dakshgup captured the San Francisco tech zeitgeist with a sharp joke about productivity influencers and the speed of trend-chasing in the Bay
- @RayFernando1337 spotlighted @pontusab's open-source iMessage agent framework built with Hono, SendBlue, and Vercel
- @romainhuet resurfaced Sam Altman's post outlining OpenAI's current strategic plan and roadmap
- @grok announced faster video and image generation capabilities under the new Grok Imagine feature
Anthropic's Mythos: The First Real Look
The AI community has been buzzing about Anthropic's next model for weeks, and today brought both a launch rumor and a detailed first impression. @PolymarketMoney reported that Anthropic will release "Mythos" as soon as tomorrow, based on market intelligence. But the real substance came from @zekramu, a security researcher whose company was part of a pilot program and who spent an entire day working with the model on production systems.
Their assessment was surprisingly balanced. On capability, Mythos appears genuinely exceptional at security research, finding approximately 800 major vulnerabilities across products that most people interact with regularly. It significantly outperforms current top-tier models on security-specific tasks. On cost, it is eye-wateringly expensive. Their enterprise cost estimate ran well above a million dollars for the pilot, compared to two million for their entire company's inference spend the previous month. On safety, Anthropic apparently ships a custom "harness" separate from Claude Code, focused heavily on containment. @zekramu described it as "largely AI generated" and "pretty shit/restrictive," with half the guardrails not working properly. This "Project Glasswing" harness seemed more like a stopgap than a polished product.
The nuanced conclusion was perhaps the most valuable part: "It's not an existential threat to humanity as Anthropic might lead you to believe, but it's genuinely good." The model struggled with a Bazel build system, needed human help to compile code, and only produces dangerous outputs when wielded by a genuinely skilled engineer. It is a powerful tool in the right hands, not a Pandora's box that opens itself. That distinction matters enormously for how we regulate and deploy these systems.
Apple's AI Strategy Takes Shape
Apple made two significant AI moves today, one organizational and one architectural. First, @alexocheema highlighted that Lilian has joined Apple as VP of Product Management for AI, sharing her first WWDC experience from inside the company. Her post emphasized Apple's philosophy of combining "technology, design, and human-centered thinking with relentless attention to detail." It is a signal that Apple is building out the leadership layer needed to turn AI capabilities into shipped products, not just research papers.
The more technically interesting revelation came from @awnihannun, who broke down how Apple managed to ship a 20B parameter model that runs on-device. The architecture uses a variation of Mixture of Experts that is distinct from the standard approach: a small model analyzes the query once and predicts which experts to load from NAND storage into RAM. Those experts stay loaded for the entire generation, rather than being swapped on every token. This is a clever solution to a fundamental constraint. You physically cannot fit 20B parameters in device RAM at useful precision levels. By loading only the relevant experts once and generating all tokens with that fixed set, Apple sidesteps the constant memory shuffling that would make traditional MoE impractical on mobile hardware. It is a pragmatic engineering decision that prioritizes real-world usability over theoretical elegance, and it is exactly the kind of thing Apple tends to excel at.
The Agent Framework Gold Rush
If there was one dominant theme across today's posts, it was the rapid maturation of AI agent tooling. Five separate posts touched on building, managing, or improving autonomous agents, suggesting the ecosystem is hitting a critical mass of both tooling and philosophy.
@caspar_br introduced LangChain's Fleet, a platform for creating and managing multiple specialized agents. Each agent can have custom instructions, skills, tools, subagents, and memory, and they improve with feedback over time. The notable design decision is the "channels" concept: agents communicate through your existing tools like Slack or Teams rather than forcing you into a separate UI. Fleet agents can also run on schedules and export their context files for self-hosting. @nateberkopec cut through the agent complexity with a blunt directive: "Stop babysitting the model. Build a non-interactive AI application instead." The argument is that developers should focus on autonomous loops rather than interactive chat. Your task, they wrote, should be to "build the thing that builds the thing."
This autonomous-building theme continued with @gkisokay, who shared a guide for making Hermes agents that auto-build: they intake ideas, create multi-phase build plans, execute each phase with QA checks, and iterate until completion. @0xSero demonstrated a practical agent prompt for repository cleanup, asking an agent to review every file, identify incomplete abstractions and duplicate logic, then produce a consolidation task list. And @melvynx amplified an important empirical finding from @kunchenguid: do not ask your agents to do test-driven development, as there is now evidence it produces worse results than alternative approaches. Together, these posts paint a picture of an ecosystem rapidly moving from "can we build agents?" to "how do we build them well?"
AI Engineering: Beyond Prompt Writing
A substantive thread emerged today about what AI engineering actually entails, and the answer has very little to do with writing clever prompts. @adxtyahq expanded on a comprehensive list from @ByteMohit, adding crucial areas like dataset engineering, context engineering, agent memory and context lifecycle, MCP and tool ecosystems, observability and tracing, and inference optimization including KV cache and PagedAttention. The closing observation was telling: "A surprising number of AI engineers spend more time debugging retrieval, context, caching, queues, permissions, and analytics than they do writing prompts."
The original list from @ByteMohit was even more granular, covering everything from prefill versus decode latency optimization to structured output failure handling to multi-tenant cache isolation. It is essentially a syllabus for a discipline that did not exist two years ago. @thdxr reshared an update to OpenCode where file search now uses a system called "fff" that ranks files higher based on what the agent has previously opened. It is a small but illustrative example: the intelligence is not in the model's reasoning, it is in the engineering of the information retrieval layer that feeds the model. This is the unglamorous work that determines whether an AI application actually works in production.
Real AI Adoption Means Redesigning Everything
Two of today's most thoughtful posts tackled the same problem from different angles: why do so many companies adopt AI and see nothing change?
@businessbarista laid out a 10-step framework for AI transformation that is remarkable for where AI falls in the sequence: step 4 out of 10. The first three steps are identifying the problem, understanding the existing workflow, and collecting the data. Steps 5 through 10 cover testing, integration, rollout, adoption, contribution, and measurement. The AI part, building the prototype, is sandwiched in the middle. The harder work is mapping how people actually work today, which means "you either need to have the business context yourself or absorb it through osmosis." @zarazhangrui reinforced this with a historical analogy from a 1990 paper about electricity adoption. When factories first got electric power, they simply swapped the steam engine for an electric one and changed nothing else. Productivity barely improved. The real gains came decades later when factory layouts were redesigned around individual electric motors for each machine, rather than a single central drive shaft. "AI is the same. Bolting it onto your existing process gets you a faster steam engine. The payoff comes when you redesign the work itself."
Claude as Personal Health Investigator
In one of the most compelling personal AI stories we have seen, @hosseeb shared how Claude diagnosed his sleep disorder after years of worsening rest and failed interventions. After buying an Oura ring that showed his sleep was bad but could not explain why, he used Claude Code to pull data from the Oura API and run statistical analysis across heart rate, SpO2, wake events, and sleep stages. The model identified a pattern pointing to UARS (upper-airway resistance syndrome), a milder cousin of sleep apnea that often goes undiagnosed in healthy, normal-weight people who do not fit the typical apnea profile.
Claude's approach was methodical. It explained that UARS causes airway narrowing during REM sleep, which fragments sleep as the brain wakes you up before oxygen drops to dangerous levels. It correctly noted that the Oura data was not dispositive, recommended a specific FDA-approved at-home sleep study device, and the clinical results confirmed the diagnosis. The broader point resonates beyond sleep health: 10 to 15 percent of adults have some form of sleep apnea, and over 80 percent are undiagnosed. But the deeper insight is about how AI can serve as an investigative partner that synthesizes across data sources, medical knowledge, and personal observations in ways that neither a fitness tracker nor a single doctor visit can match. @hosseeb's advice to "run your fitness tracker data through your neighborhood frontier LLM" might be the most immediately actionable health tip of the year.
Sources
I want some kind of LLM workflow tool. • Ability to manage a set of input files (Markdown or similar), plus other general-purpose context. • With real-time collaboration. (And maybe some concept of snapshots or VCS integration.) • And the ability to create/manage a inference workflows and a stored set of prompts. • Access to general-purpose coding agents (and not just chat models). • Some concept of compiled outputs/inference results (which ideally can be shared externally). Many projects have this feeling: "there is all this stuff, which I want to process/compute over in this iterated way, with some build artifacts being important/worth saving." GNU Autotools x Notion or something. Is anyone building this?
As an AI Engineer. Please learn >Harness engineering, not just prompt engineering >Context engineering, not just long prompts >Prompt caching vs. semantic caching tradeoffs >KV cache management, eviction, reuse, and memory pressure at scale >Prefill vs. decode latency and why they optimize differently >Continuous batching, paged attention, and throughput optimization >Speculative decoding vs. quantization vs. distillation tradeoffs >INT8, INT4, FP8, AWQ, GPTQ, and when quantization hurts quality >Structured output failures, schema validation, repair loops, and fallback chains >Function calling reliability, tool contracts, argument validation, and idempotency >Agent guardrails, loop budgets, tool budgets, and termination conditions >Model routing, graceful fallback logic, and degraded-mode UX >RAG architecture: chunking, embeddings, hybrid search, reranking, and freshness >Retrieval evals: recall, precision, grounding, attribution, and citation quality >Evals: golden sets, regression tests, adversarial tests, LLM-as-judge, and human evals >LLM observability as a first-class discipline: traces, spans, tokens, latency, errors, and drift >Cost attribution per feature, workflow, tenant, and user journey not just per model >Safety engineering: prompt injection defense, data leakage prevention, and permission boundaries >Multi-tenant isolation, cache safety, and cross-user context contamination prevention >Fine-tuning vs. in-context learning vs. RAG vs. distillation and when each is the wrong tool >Latency, quality, cost, and reliability tradeoffs across the full inference stack >Production failure modes: hallucinated tool calls, malformed JSON, stale retrieval, runaway agents, and silent eval regressions
I have it on good word (from Anthropic) that mythos is in fact dropping this summer… get to play with it next week… my current expectations are that it’s shit and Anthropic is selling hot garbage but we will see
Open-source poke iMessage framework: @honojs - API framework @sendbluehq - iMessage provider @aisdk - Agent + tools @upstash - db + rate limits @workflowsdk - background jobs @vercel - hosting Link ⬇️🧵 https://t.co/2rV54Z76S1
A few months ago, I joined Apple as VP of PM for AI. Today, I got to experience my first WWDC from inside the company. The keynote reflected something I’ve already come to appreciate deeply: extraordinary products happen when technology, design, and human-centered thinking come together with relentless attention to detail. Feeling grateful for the warm welcome, inspired by the people around me, and excited for the future we’re building. #wwdc
How to Build a Hermes Agent That Finds Important Work and Builds It Autonomously