Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – July 15, 2026
Transcript
- 0:00Project
- 0:00Muteki
- 0:01is
- 0:01the
- 0:01kind
- 0:01of
- 0:01thing
- 0:01that
- 0:01keeps
- 0:02red-teamers
- 0:02up
- 0:02at
- 0:02night
- 0:03—
- 0:03not
- 0:03because
- 0:03it's
- 0:04novel
- 0:04in
- 0:04concept,
- 0:05but
- 0:05because
- 0:05it
- 0:05actually
- 0:05works
- 0:06at
- 0:06scale.
- 0:07This
- 0:07heterogeneous
- 0:07multi-model
- 0:08AI
- 0:08agent
- 0:08swarm
- 0:09coordinates
- 0:09Claude
- 0:09Code,
- 0:10Codex,
- 0:10and
- 0:10Cursor
- 0:11through
- 0:11a
- 0:11shared
- 0:11blackboard
- 0:11architecture
- 0:12with
- 0:12a
- 0:124-phase
- 0:12solve
- 0:13pipeline:
- 0:13reconnaissance,
- 0:14exploitation,
- 0:15privilege
- 0:16escalation,
- 0:17and
- 0:17flag
- 0:17extraction.
- 0:18The
- 0:18numbers
- 0:18speak
- 0:19for
- 0:19themselves:
- 0:20200
- 0:20out
- 0:20of
- 0:20200
- 0:21on
- 0:21NYU
- 0:21CTF
- 0:22Bench,
- 0:228th
- 0:23place
- 0:23at
- 0:23RIFFHACK
- 0:252026
- 0:26with
- 0:27zero
- 0:27human
- 0:27intervention
- 0:28over
- 0:28three
- 0:28hours,
- 0:29and
- 0:29first
- 0:29blood
- 0:29on
- 0:30a
- 0:30penetration-testing
- 0:30range
- 0:31that
- 0:31had
- 0:31seen
- 0:31zero
- 0:31solves
- 0:32in
- 0:32three
- 0:32months.
- 0:33Total
- 0:33cost
- 0:33for
- 0:33the
- 0:33full
- 0:33benchmark
- 0:34run:
- 0:34approximately
- 0:34$214.
- 0:36What
- 0:36makes
- 0:36Muteki
- 0:37architecturally
- 0:37interesting
- 0:38is
- 0:38the
- 0:38heterogeneous
- 0:39engine
- 0:39design.
- 0:40Rather
- 0:40than
- 0:40running
- 0:41multiple
- 0:41instances
- 0:41of
- 0:42the
- 0:42same
- 0:42model,
- 0:43it
- 0:43dispatches
- 0:43different
- 0:43challenge
- 0:44types
- 0:44to
- 0:44different
- 0:44AI
- 0:45backends
- 0:45based
- 0:45on
- 0:45their
- 0:46strengths
- 0:46—
- 0:47Claude
- 0:47Code
- 0:47for
- 0:47complex
- 0:48reasoning
- 0:48chains,
- 0:49Codex
- 0:49for
- 0:49rapid
- 0:50code
- 0:50generation,
- 0:51Cursor
- 0:51for
- 0:51interactive
- 0:52debugging
- 0:52loops.
- 0:53The
- 0:53shared
- 0:53blackboard
- 0:54is
- 0:54the
- 0:54central
- 0:54coordination
- 0:55mechanism:
- 0:56facts
- 0:56discovered
- 0:57by
- 0:57one
- 0:57agent
- 0:57are
- 0:57immediately
- 0:58available
- 0:58to
- 0:58all
- 0:59others,
- 0:59dead
- 1:00ends
- 1:00are
- 1:00never
- 1:00retried
- 1:01by
- 1:01a
- 1:01different
- 1:01worker,
- 1:02and
- 1:02flags
- 1:02are
- 1:02accepted
- 1:03only
- 1:03when
- 1:03they
- 1:03appear
- 1:04verbatim
- 1:04in
- 1:04real
- 1:04execution
- 1:05output
- 1:05—
- 1:06a
- 1:06provenance
- 1:06gate
- 1:07that
- 1:07eliminates
- 1:07hallucinated
- 1:08solutions.
- 1:09A
- 1:09periodic
- 1:09review
- 1:10mechanism
- 1:10checks
- 1:10recorded
- 1:11facts
- 1:11and
- 1:11corrects
- 1:12course,
- 1:12preventing
- 1:13the
- 1:13dead-loop
- 1:13problem
- 1:13that
- 1:14plagues
- 1:14single-agent
- 1:14CTF
- 1:15solvers.
- 1:16The
- 1:16coordination
- 1:17loop
- 1:17runs
- 1:17at
- 1:17roughly
- 1:17one
- 1:18lap
- 1:18every
- 1:18two
- 1:18seconds,
- 1:19with
- 1:19each
- 1:19tick
- 1:19following
- 1:20a
- 1:20read-reason-intent-execute-write
- 1:21cycle.
- 1:22When
- 1:22one
- 1:23agent
- 1:23gets
- 1:23stuck,
- 1:24the
- 1:24swarm
- 1:24scheduler
- 1:24reassigns
- 1:25the
- 1:25problem
- 1:25to
- 1:25a
- 1:25different
- 1:26engine
- 1:26with
- 1:26fresh
- 1:26context.
- 1:28This
- 1:28is
- 1:28not
- 1:28a
- 1:28research
- 1:28demo;
- 1:29it
- 1:29ships
- 1:30as
- 1:30AGPL-3.0
- 1:32with
- 1:32full
- 1:33benchmark
- 1:33reproduction
- 1:34scripts
- 1:34and
- 1:34a
- 1:35web
- 1:35command
- 1:35deck
- 1:35for
- 1:35real-time
- 1:36monitoring.
- 1:37The
- 1:37broader
- 1:37tooling
- 1:37ecosystem
- 1:38around
- 1:38offensive
- 1:39AI
- 1:39continues
- 1:39to
- 1:39proliferate
- 1:40at
- 1:40a
- 1:40pace
- 1:41that
- 1:41should
- 1:41concern
- 1:41anyone
- 1:42responsible
- 1:42for
- 1:42defending
- 1:43networks.
- 1:44A
- 1:44repository
- 1:44called
- 1:45recon-skills
- 1:45catalogs
- 1:46169
- 1:48distinct
- 1:48offensive
- 1:49security
- 1:49skills
- 1:49spanning
- 1:50browser
- 1:50fingerprint
- 1:51evasion,
- 1:51SCADA
- 1:52enumeration,
- 1:53hardcoded
- 1:53credential
- 1:53hunting,
- 1:54and
- 1:54cloud
- 1:54metadata
- 1:55harvesting
- 1:55—
- 1:56tested
- 1:56across
- 1:57600+
- 1:57domains
- 1:58and
- 1:5880+
- 1:59vulnerable
- 1:59companies
- 2:00in
- 2:0045+
- 2:01sectors.
- 2:02This
- 2:02is
- 2:02essentially
- 2:03a
- 2:03machine-readable
- 2:04playbook
- 2:04for
- 2:04penetration
- 2:05testing
- 2:05automation,
- 2:06ready
- 2:07to
- 2:07be
- 2:07consumed
- 2:07by
- 2:08any
- 2:08agentic
- 2:08framework.
- 2:09Meanwhile,
- 2:10the
- 2:10local
- 2:11model
- 2:11community
- 2:11is
- 2:11already
- 2:12asking
- 2:12whether
- 2:13specialized
- 2:13cybersecurity
- 2:14models
- 2:15can
- 2:15run
- 2:15on
- 2:15consumer
- 2:16hardware,
- 2:17though
- 2:17the
- 2:17conversation
- 2:17remains
- 2:18speculative
- 2:18rather
- 2:19than
- 2:19practical
- 2:19at
- 2:19this
- 2:20stage.
- 2:22The
- 2:22coding
- 2:23agent
- 2:23landscape
- 2:24is
- 2:24shifting
- 2:24from
- 2:24"can
- 2:25AI
- 2:25write
- 2:25code"
- 2:26to
- 2:26"how
- 2:26do
- 2:26humans
- 2:27actually
- 2:27work
- 2:27alongside
- 2:28AI
- 2:28agents."
- 2:29Juggler,
- 2:29from
- 2:30JUCE
- 2:30creator
- 2:30Julian
- 2:31Storer,
- 2:31makes
- 2:31this
- 2:31explicit:
- 2:32it
- 2:33is
- 2:33an
- 2:33open-source
- 2:33GUI
- 2:33coding
- 2:34agent
- 2:34built
- 2:34in
- 2:34Go/Wails
- 2:35with
- 2:35a
- 2:35Miller-column
- 2:36tree
- 2:36UI
- 2:37and
- 2:37Yjs-based
- 2:37document
- 2:38model.
- 2:39The
- 2:39design
- 2:39philosophy
- 2:40is
- 2:40that
- 2:40coding
- 2:41agents
- 2:41need
- 2:41a
- 2:41proper
- 2:42visual
- 2:42interface
- 2:42—
- 2:44one
- 2:44that
- 2:44shows
- 2:44the
- 2:44project
- 2:45tree,
- 2:45the
- 2:45agent's
- 2:46conversation
- 2:46stream,
- 2:46and
- 2:46the
- 2:47edited
- 2:47files
- 2:47in
- 2:47a
- 2:47single
- 2:48coherent
- 2:48layout
- 2:48—
- 2:49not
- 2:49just
- 2:49a
- 2:49terminal
- 2:50scroll.
- 2:50The
- 2:51plugin
- 2:51architecture
- 2:51allows
- 2:52extending
- 2:52the
- 2:52agent's
- 2:52capabilities,
- 2:53and
- 2:54the
- 2:54Yjs
- 2:54foundation
- 2:55enables
- 2:55real-time
- 2:55collaborative
- 2:56editing
- 2:56between
- 2:56human
- 2:56and
- 2:57agent,
- 2:57with
- 2:58CRDT-based
- 2:58conflict
- 2:59resolution
- 2:59when
- 2:59both
- 3:00parties
- 3:00modify
- 3:00the
- 3:00same
- 3:01file
- 3:01simultaneously.
- 3:02The
- 3:02AGPL-3.0
- 3:05license
- 3:06follows
- 3:06a
- 3:06pattern
- 3:06we
- 3:06are
- 3:07seeing
- 3:07more
- 3:07frequently
- 3:07in
- 3:07agent
- 3:08tooling:
- 3:09open
- 3:09source
- 3:09with
- 3:09a
- 3:09copyleft
- 3:10boundary
- 3:10that
- 3:11prevents
- 3:11proprietary
- 3:12resale
- 3:12without
- 3:12contribution
- 3:13back.
- 3:14On
- 3:14the
- 3:14quality
- 3:15control
- 3:15front,
- 3:15Taste
- 3:16Skill
- 3:16tackles
- 3:16the
- 3:16"AI
- 3:17slop"
- 3:17problem
- 3:17head-on.
- 3:18It
- 3:19is
- 3:19a
- 3:19portable
- 3:19agent
- 3:19skill
- 3:20framework
- 3:20with
- 3:20adjustable
- 3:21VARIANCE,
- 3:21MOTION,
- 3:22and
- 3:22DENSITY
- 3:23dials
- 3:23that
- 3:23constrain
- 3:24AI-generated
- 3:24frontend
- 3:25code
- 3:25toward
- 3:25intentional
- 3:26design
- 3:26rather
- 3:26than
- 3:26boilerplate
- 3:27output.
- 3:28The
- 3:28v2
- 3:28rewrite
- 3:29introduces
- 3:29brief
- 3:29inference,
- 3:30design-system
- 3:31mapping,
- 3:31an
- 3:31em-dash
- 3:32ban,
- 3:32canonical
- 3:33GSAP
- 3:33code
- 3:34skeletons,
- 3:34and
- 3:35a
- 3:35strict
- 3:35pre-flight
- 3:35check
- 3:35—
- 3:36essentially
- 3:37codifying
- 3:37design
- 3:38taste
- 3:38into
- 3:38machine-readable
- 3:39rules.
- 3:40Vercel
- 3:40sponsors
- 3:41the
- 3:41project,
- 3:41and
- 3:42the
- 3:42skill
- 3:42works
- 3:42across
- 3:42Codex,
- 3:43Cursor,
- 3:43and
- 3:43Claude
- 3:44Code.
- 3:45Two
- 3:45Claude
- 3:45Code
- 3:45plugins
- 3:46address
- 3:46different
- 3:46knowledge
- 3:47gaps.
- 3:48Engram
- 3:48implements
- 3:49spaced
- 3:49repetition
- 3:50learning
- 3:50using
- 3:51the
- 3:51FSRS-4.5
- 3:54scheduling
- 3:54algorithm
- 3:55with
- 3:55a
- 3:55separation-of-powers
- 3:56architecture:
- 3:57the
- 3:57tutor
- 3:57teaches
- 3:58(forcing
- 3:58the
- 3:58user
- 3:59to
- 3:59predict
- 3:59and
- 3:59explain
- 4:00back,
- 4:00not
- 4:01just
- 4:01passively
- 4:01read),
- 4:02the
- 4:02assessor
- 4:03grades
- 4:03blindly
- 4:03(0
- 4:04out
- 4:04of
- 4:04198
- 4:05grades
- 4:05were
- 4:05inflated
- 4:06in
- 4:06testing
- 4:06—
- 4:07verified
- 4:08against
- 4:08a
- 4:08gold
- 4:09standard
- 4:09dataset),
- 4:10and
- 4:10the
- 4:10coach
- 4:10plans
- 4:11review
- 4:11schedules
- 4:11timed
- 4:12to
- 4:12the
- 4:12forgetting
- 4:12curve.
- 4:13The
- 4:13engine
- 4:13runs
- 4:14on
- 4:14stdlib
- 4:14Python
- 4:15with
- 4:15zero
- 4:15network
- 4:16code
- 4:16(enforced
- 4:16by
- 4:16a
- 4:17permanent
- 4:17self-test),
- 4:18and
- 4:18all
- 4:18state
- 4:19lives
- 4:19as
- 4:19plain
- 4:19JSON
- 4:20files
- 4:20on
- 4:20your
- 4:20machine.
- 4:21The
- 4:21214
- 4:23self-tests
- 4:23and
- 4:23commons
- 4:24data
- 4:24contribution
- 4:25model
- 4:25suggest
- 4:25serious
- 4:26engineering,
- 4:27not
- 4:27a
- 4:27weekend
- 4:27hack.
- 4:28RuvNet
- 4:28Brain
- 4:29takes
- 4:29a
- 4:29different
- 4:29approach,
- 4:30bundling
- 4:30512MB
- 4:32of
- 4:32knowledge
- 4:33across
- 4:3336
- 4:33repositories
- 4:34with
- 4:34dual
- 4:34embeddings
- 4:35(MiniLM-384
- 4:36and
- 4:36BGE-768)
- 4:38plus
- 4:38cross-encoder
- 4:39reranking.
- 4:40A
- 4:40UserPromptSubmit
- 4:41grounding
- 4:41hook
- 4:42intercepts
- 4:42every
- 4:42prompt
- 4:43and
- 4:43augments
- 4:43it
- 4:43with
- 4:43relevant
- 4:44context
- 4:44before
- 4:45execution.
- 4:46Version
- 4:462.5
- 4:47ships
- 4:47a
- 4:47substitution
- 4:48CI
- 4:48gate,
- 4:49a
- 4:49job-proof
- 4:49registry,
- 4:50and
- 4:50a
- 4:50subagent
- 4:51model
- 4:51gate
- 4:51—
- 4:52features
- 4:52that
- 4:53reflect
- 4:53a
- 4:53maturing
- 4:53understanding
- 4:54of
- 4:54how
- 4:54plugins
- 4:55fail
- 4:55in
- 4:55production.
- 4:56The
- 4:56mundane
- 4:57reality
- 4:57of
- 4:57multi-agent
- 4:58development
- 4:58surfaces
- 4:59in
- 4:59a
- 4:59report
- 4:59about
- 5:00port
- 5:00collisions
- 5:00when
- 5:00running
- 5:01two
- 5:01Claude
- 5:01Code
- 5:01agents
- 5:02in
- 5:02parallel
- 5:02worktrees.
- 5:04Both
- 5:04agents
- 5:05tried
- 5:05to
- 5:05bind
- 5:05the
- 5:05same
- 5:06port
- 5:06for
- 5:06their
- 5:06dev
- 5:06servers,
- 5:07crashing
- 5:07each
- 5:07other.
- 5:09The
- 5:09solution
- 5:09—
- 5:10a
- 5:10deterministic
- 5:11CLI
- 5:11tool
- 5:12called
- 5:12Winter
- 5:12that
- 5:12assigns
- 5:13reserved
- 5:13port
- 5:13blocks
- 5:14per
- 5:14feature
- 5:14environment
- 5:14—
- 5:15is
- 5:15exactly
- 5:16the
- 5:16kind
- 5:16of
- 5:16infrastructure
- 5:17problem
- 5:17that
- 5:17emerges
- 5:18when
- 5:18"just
- 5:19spin
- 5:19up
- 5:19another
- 5:19agent"
- 5:20meets
- 5:20real
- 5:20development
- 5:21workflows.
- 5:24Voicebox
- 5:24consolidates
- 5:25seven
- 5:25TTS
- 5:26engines
- 5:26—
- 5:27Qwen3-TTS,
- 5:28Chatterbox,
- 5:29Kokoro,
- 5:29TADA,
- 5:30and
- 5:30others
- 5:30—
- 5:31into
- 5:31a
- 5:31single
- 5:32open-source
- 5:32desktop
- 5:32application
- 5:33supporting
- 5:3323
- 5:34languages,
- 5:35voice
- 5:35cloning,
- 5:36an
- 5:36MCP
- 5:36server
- 5:37for
- 5:37programmatic
- 5:37access,
- 5:38and
- 5:38system-wide
- 5:39global
- 5:39dictation.
- 5:40Built
- 5:41in
- 5:41Tauri/Rust
- 5:42rather
- 5:42than
- 5:42Electron
- 5:43(a
- 5:43meaningful
- 5:43performance
- 5:44difference
- 5:44when
- 5:44running
- 5:44inference
- 5:45locally),
- 5:45it
- 5:46represents
- 5:46the
- 5:46strongest
- 5:47attempt
- 5:47yet
- 5:47to
- 5:47make
- 5:48voice
- 5:48synthesis
- 5:48a
- 5:48first-class
- 5:49local
- 5:49development
- 5:50tool
- 5:50rather
- 5:50than
- 5:50an
- 5:51API
- 5:51dependency.
- 5:52On
- 5:52the
- 5:52integration
- 5:53side,
- 5:53Cicero
- 5:54offers
- 5:54bidirectional
- 5:55voice
- 5:55for
- 5:55any
- 5:56AI
- 5:56agent
- 5:56harness
- 5:56—
- 5:57Claude
- 5:57Code,
- 5:58Codex,
- 5:58Gemini
- 5:59CLI
- 5:59—
- 6:00via
- 6:00ACP
- 6:01(Agent
- 6:01Communication
- 6:02Protocol).
- 6:03The
- 6:03practical
- 6:03insight
- 6:03from
- 6:04the
- 6:04community:
- 6:05barge-in
- 6:05detection
- 6:05requires
- 6:06a
- 6:06proper
- 6:06speech
- 6:07model,
- 6:07not
- 6:08simple
- 6:08energy-based
- 6:08VAD,
- 6:09because
- 6:10keyboard
- 6:10noise
- 6:10and
- 6:10ambient
- 6:11sound
- 6:11trigger
- 6:11false
- 6:12interruptions.
- 6:13Local
- 6:13model
- 6:13benchmarking
- 6:14continues
- 6:14to
- 6:14produce
- 6:15results
- 6:15that
- 6:15challenge
- 6:15the
- 6:16assumption
- 6:16that
- 6:16bigger
- 6:16always
- 6:17means
- 6:17better
- 6:17as
- 6:17an
- 6:17agent.
- 6:18Qwen3.6-27B
- 6:21at
- 6:21INT8
- 6:22quantization
- 6:22outperformed
- 6:23the
- 6:23specifically
- 6:23agentic-tuned
- 6:24Nemotron
- 6:24Puzzle-75B-A9B,
- 6:27requiring
- 6:27only
- 6:276-9
- 6:28tool
- 6:28calls
- 6:28per
- 6:28task
- 6:29versus
- 6:29the
- 6:2975B
- 6:30model's
- 6:3013-23
- 6:31—
- 6:32suggesting
- 6:32that
- 6:32the
- 6:32smaller
- 6:33model
- 6:33was
- 6:33reasoning
- 6:33more
- 6:34efficiently
- 6:34rather
- 6:34than
- 6:34compensating
- 6:35with
- 6:35more
- 6:35attempts.
- 6:36The
- 6:36tester
- 6:37also
- 6:37discovered
- 6:38a
- 6:38prefix
- 6:38caching
- 6:38bug
- 6:39with
- 6:39fp8
- 6:39KV
- 6:40cache
- 6:40that
- 6:40caused
- 6:41incorrect
- 6:41responses
- 6:41—
- 6:42a
- 6:42reminder
- 6:43that
- 6:43quantization
- 6:44interacts
- 6:44with
- 6:44serving
- 6:45infrastructure
- 6:45in
- 6:46non-obvious
- 6:46ways.
- 6:47Separately,
- 6:48Qwen3.6's
- 6:5035B-A3B
- 6:52MoE
- 6:52variant
- 6:53ran
- 6:53a
- 6:53single-prompt
- 6:53flight
- 6:54simulator,
- 6:54with
- 6:55Q8
- 6:550
- 6:55on
- 6:55CPU
- 6:56outperforming
- 6:56Q4
- 6:57K
- 6:57M
- 6:57on
- 6:57GPU
- 6:58—
- 6:58a
- 6:58result
- 6:59that
- 6:59underscores
- 6:59how
- 6:59quantization
- 7:00quality
- 7:00can
- 7:01matter
- 7:01more
- 7:01than
- 7:01hardware
- 7:02acceleration
- 7:02for
- 7:02MoE
- 7:02architectures
- 7:03with
- 7:03small
- 7:03active
- 7:04parameter
- 7:04counts.
- 7:06Goedel-Architect
- 7:07achieved
- 7:08a
- 7:08result
- 7:08that
- 7:08formal
- 7:08methods
- 7:09researchers
- 7:09have
- 7:09been
- 7:09chasing
- 7:10for
- 7:10years:
- 7:10100%
- 7:11on
- 7:11the
- 7:11MiniF2F-test
- 7:12benchmark,
- 7:13the
- 7:13first
- 7:13system
- 7:14ever
- 7:14to
- 7:14do
- 7:14so.
- 7:15It
- 7:15also
- 7:15scored
- 7:1657.5%
- 7:17on
- 7:17PutnamBench
- 7:18and
- 7:18solved
- 7:184
- 7:18of
- 7:186
- 7:19problems
- 7:19from
- 7:19IMO
- 7:202025.
- 7:21The
- 7:21architecture
- 7:21uses
- 7:22blueprint
- 7:22dependency
- 7:23graphs
- 7:23in
- 7:23Lean
- 7:234
- 7:24with
- 7:24DeepSeek-V4-Flash
- 7:25as
- 7:25the
- 7:25backbone,
- 7:26and
- 7:26the
- 7:26authors
- 7:27claim
- 7:27approximately
- 7:28100x
- 7:28cost
- 7:29reduction
- 7:29compared
- 7:29to
- 7:29comparable
- 7:30pipelines.
- 7:31The
- 7:31key
- 7:31insight
- 7:32is
- 7:32not
- 7:32the
- 7:32language
- 7:32model
- 7:33itself
- 7:33but
- 7:33the
- 7:33structured
- 7:33decomposition:
- 7:35breaking
- 7:35proofs
- 7:35into
- 7:36blueprints
- 7:36with
- 7:36explicit
- 7:37dependency
- 7:37relationships,
- 7:38then
- 7:38refining
- 7:39each
- 7:39component
- 7:40through
- 7:40targeted
- 7:40generation
- 7:41and
- 7:41verification
- 7:41against
- 7:42the
- 7:42Lean
- 7:42type
- 7:42checker.
- 7:43Where
- 7:43brute-force
- 7:44approaches
- 7:44throw
- 7:45entire
- 7:45proofs
- 7:45at
- 7:45a
- 7:45model
- 7:46and
- 7:46hope
- 7:46for
- 7:46correctness,
- 7:47Goedel-Architect
- 7:48localizes
- 7:48each
- 7:49subgoal
- 7:49and
- 7:49verifies
- 7:49it
- 7:50independently
- 7:50—
- 7:51a
- 7:51design
- 7:51that
- 7:51scales
- 7:52sublinearly
- 7:52with
- 7:52proof
- 7:53complexity.
- 7:54A
- 7:54paper
- 7:54on
- 7:54Looped
- 7:55SSMs
- 7:55presents
- 7:55a
- 7:55counterintuitive
- 7:56finding:
- 7:57state
- 7:57space
- 7:58models
- 7:58with
- 7:58shared
- 7:58parameters
- 7:59across
- 7:59depth
- 7:59(looped
- 8:00architecture)
- 8:00match
- 8:00or
- 8:01outperform
- 8:01models
- 8:02with
- 8:02independent
- 8:02parameters
- 8:03at
- 8:03each
- 8:03layer,
- 8:04despite
- 8:04having
- 8:04a
- 8:04strictly
- 8:05smaller
- 8:05hypothesis
- 8:05space.
- 8:06Tested
- 8:06across
- 8:07LRU,
- 8:07S5,
- 8:08LinOSS,
- 8:09and
- 8:09LrcSSM
- 8:09architectures
- 8:10on
- 8:10six
- 8:10benchmarks,
- 8:11the
- 8:11results
- 8:12suggest
- 8:12that
- 8:12parameter
- 8:13sharing
- 8:13acts
- 8:13as
- 8:14a
- 8:14beneficial
- 8:14inductive
- 8:14bias
- 8:15rather
- 8:15than
- 8:15a
- 8:15limitation.
- 8:16Input
- 8:17reshaping
- 8:17techniques
- 8:17—
- 8:18concatenation
- 8:18and
- 8:18rechunking
- 8:19—
- 8:19yield
- 8:20an
- 8:20additional
- 8:201-6%
- 8:21improvement.
- 8:22This
- 8:22matters
- 8:22because
- 8:23it
- 8:23implies
- 8:23that
- 8:23the
- 8:23SSM
- 8:24scaling
- 8:24narrative
- 8:25("more
- 8:25parameters,
- 8:26more
- 8:26layers")
- 8:27may
- 8:27be
- 8:27leaving
- 8:28efficiency
- 8:28on
- 8:28the
- 8:28table.
- 8:29From
- 8:29Meta
- 8:29AI
- 8:30and
- 8:30ENS
- 8:30Paris
- 8:31comes
- 8:31a
- 8:31careful
- 8:31investigation
- 8:32into
- 8:33whether
- 8:33the
- 8:33brain
- 8:33implements
- 8:34anything
- 8:34resembling
- 8:34backpropagation.
- 8:36Using
- 8:37both
- 8:37fMRI
- 8:37(spatial
- 8:38resolution)
- 8:38and
- 8:39MEG
- 8:39(temporal
- 8:40resolution),
- 8:40the
- 8:41researchers
- 8:41found
- 8:41that
- 8:41backpropagated
- 8:42gradients
- 8:43from
- 8:43deep
- 8:43neural
- 8:43networks
- 8:44do
- 8:44predict
- 8:44brain
- 8:44activity,
- 8:45and
- 8:45that
- 8:46these
- 8:46residual
- 8:46backprop
- 8:47signals
- 8:47explain
- 8:48variance
- 8:48beyond
- 8:48what
- 8:49forward
- 8:49activations
- 8:49alone
- 8:50capture
- 8:50—
- 8:51particularly
- 8:51in
- 8:51higher-level
- 8:52visual
- 8:52cortex,
- 8:53where
- 8:53abstract
- 8:53representations
- 8:54are
- 8:54formed.
- 8:55However,
- 8:56the
- 8:56temporal
- 8:56and
- 8:57spatial
- 8:57organization
- 8:58of
- 8:58these
- 8:58gradient-like
- 8:58signals
- 8:59diverges
- 9:00from
- 9:00what
- 9:00biological
- 9:01backpropagation
- 9:01would
- 9:02predict:
- 9:03the
- 9:03timing
- 9:03is
- 9:03wrong,
- 9:04and
- 9:04the
- 9:04anatomical
- 9:05distribution
- 9:05does
- 9:05not
- 9:06follow
- 9:06the
- 9:06layer-by-layer
- 9:07backward
- 9:07pass
- 9:07that
- 9:07backprop
- 9:08requires.
- 9:09The
- 9:09conclusion:
- 9:10the
- 9:10brain
- 9:10appears
- 9:11to
- 9:11use
- 9:11a
- 9:11different
- 9:11credit-assignment
- 9:12mechanism
- 9:13that
- 9:13produces
- 9:13computationally
- 9:14similar
- 9:15outcomes
- 9:15without
- 9:15the
- 9:15same
- 9:16algorithmic
- 9:16implementation.
- 9:18This
- 9:18distinction
- 9:18matters
- 9:19for
- 9:19both
- 9:19neuroscience
- 9:20and
- 9:20AI
- 9:20architecture
- 9:21research
- 9:21—
- 9:22if
- 9:22the
- 9:22brain
- 9:22achieves
- 9:22similar
- 9:23results
- 9:23through
- 9:23a
- 9:23fundamentally
- 9:24different
- 9:24learning
- 9:25rule,
- 9:25there
- 9:25may
- 9:25be
- 9:25computational
- 9:26advantages
- 9:27that
- 9:27current
- 9:27deep
- 9:27learning
- 9:28is
- 9:28missing
- 9:28entirely.
- 9:29LeMario
- 9:30trained
- 9:30a
- 9:30JEPA
- 9:31(Joint
- 9:31Embedding
- 9:31Predictive
- 9:32Architecture)
- 9:32world
- 9:32model
- 9:33on
- 9:33Super
- 9:33Mario
- 9:33Bros
- 9:34and
- 9:34found
- 9:34that
- 9:35learned
- 9:35short-horizon
- 9:35dynamics
- 9:36did
- 9:36not
- 9:36translate
- 9:37into
- 9:37effective
- 9:37long-range
- 9:38planning
- 9:38—
- 9:39even
- 9:39when
- 9:39next-frame
- 9:40prediction
- 9:40was
- 9:40accurate.
- 9:41The
- 9:41core
- 9:42problem:
- 9:42predictive
- 9:43state
- 9:43is
- 9:43not
- 9:43the
- 9:43same
- 9:44as
- 9:44control
- 9:44state.
- 9:45A
- 9:45model
- 9:46that
- 9:46accurately
- 9:46predicts
- 9:47what
- 9:47will
- 9:47happen
- 9:47next
- 9:47can
- 9:48still
- 9:48fail
- 9:48to
- 9:48identify
- 9:49which
- 9:49actions
- 9:50lead
- 9:50to
- 9:50desirable
- 9:50outcomes.
- 9:52CEM
- 9:52(Cross-Entropy
- 9:53Method)
- 9:53search
- 9:53exposed
- 9:54the
- 9:54model's
- 9:54weaknesses,
- 9:55and
- 9:55scrolling
- 9:56camera
- 9:56movement
- 9:56broke
- 9:57embedding
- 9:57similarity
- 9:58assumptions
- 9:58—
- 9:59a
- 9:59useful
- 10:00corrective
- 10:00to
- 10:00the
- 10:00"world
- 10:01models
- 10:01will
- 10:01solve
- 10:01planning"
- 10:02narrative.
- 10:04Ray
- 10:04Myers
- 10:05published
- 10:05a
- 10:05detailed
- 10:06critique
- 10:06of
- 10:06Anthropic's
- 10:07narrative
- 10:07around
- 10:08the
- 10:08Bun
- 10:08team's
- 10:08Zig-to-Rust
- 10:09rewrite,
- 10:10arguing
- 10:10that
- 10:10the
- 10:10story
- 10:11was
- 10:11a
- 10:11marketing
- 10:11opportunity
- 10:12rather
- 10:12than
- 10:12a
- 10:13genuine
- 10:13technical
- 10:13case
- 10:14study.
- 10:14Myers
- 10:15identifies
- 10:15a
- 10:15third
- 10:16interpretation
- 10:16beyond
- 10:17the
- 10:17official
- 10:17"Zig
- 10:18wasn't
- 10:18up
- 10:18to
- 10:18the
- 10:19task"
- 10:19and
- 10:19the
- 10:20community's
- 10:20"Bun's
- 10:21engineering
- 10:21decisions
- 10:22were
- 10:22the
- 10:22problem":
- 10:23faced
- 10:23with
- 10:23legitimate
- 10:24memory
- 10:24bugs,
- 10:24management
- 10:25eagerly
- 10:25approved
- 10:26the
- 10:26Rust
- 10:26rewrite
- 10:27because
- 10:27it
- 10:27showcased
- 10:27their
- 10:28Fable
- 10:28model,
- 10:29Anthropic
- 10:29already
- 10:29had
- 10:30Rust
- 10:30expertise,
- 10:31and
- 10:31Zig
- 10:31is
- 10:31openly
- 10:32against
- 10:32using
- 10:32Anthropic's
- 10:33products.
- 10:34The
- 10:34two-month
- 10:34delay
- 10:35between
- 10:35merging
- 10:35the
- 10:35migration
- 10:36and
- 10:36publishing
- 10:36the
- 10:37rationale
- 10:37conveniently
- 10:37allowed
- 10:38headlines
- 10:38like
- 10:38"Anthropic's
- 10:39Bun
- 10:39Rust
- 10:40rewrite
- 10:40merged
- 10:40at
- 10:40speed
- 10:41of
- 10:41AI"
- 10:41to
- 10:41carry
- 10:41the
- 10:41story
- 10:42first.
- 10:42Myers
- 10:43points
- 10:43to
- 10:43TigerBeetle
- 10:43—
- 10:44a
- 10:44production
- 10:45database
- 10:45written
- 10:45in
- 10:45Zig
- 10:46with
- 10:46strong
- 10:46memory
- 10:46safety
- 10:47properties
- 10:47—
- 10:47as
- 10:48a
- 10:48counterexample
- 10:48that
- 10:48undermines
- 10:49the
- 10:49"Zig
- 10:49is
- 10:49inherently
- 10:50unsafe"
- 10:50narrative.
- 10:51He
- 10:51also
- 10:51notes
- 10:52that
- 10:52the
- 10:52AI-driven
- 10:52rewrite
- 10:53was
- 10:53"not
- 10:53powerful
- 10:53enough
- 10:53to
- 10:54catch
- 10:54a
- 10:54use-after-free"
- 10:55while
- 10:55being
- 10:55marketed
- 10:56as
- 10:56proof
- 10:56of
- 10:56AI
- 10:56superiority.
- 10:58When
- 10:58an
- 10:58AI
- 10:58company
- 10:58approaching
- 10:59a
- 10:59trillion-dollar
- 10:59IPO
- 11:00valuation
- 11:00needs
- 11:01you
- 11:01to
- 11:01believe
- 11:01coding
- 11:01is
- 11:01going
- 11:01away,
- 11:02every
- 11:03technical
- 11:03blog
- 11:03post
- 11:03is
- 11:04doing
- 11:04double
- 11:04duty
- 11:04as
- 11:04investor
- 11:05relations.
- 11:06Apple
- 11:06sued
- 11:07OpenAI
- 11:07alleging
- 11:08trade
- 11:08secret
- 11:08theft
- 11:09at
- 11:09every
- 11:09organizational
- 11:10level,
- 11:10from
- 11:10individual
- 11:11engineers
- 11:11to
- 11:11institutional
- 11:12knowledge.
- 11:13The
- 11:13community
- 11:14discussion
- 11:14has
- 11:14pivoted
- 11:15toward
- 11:15what
- 11:15this
- 11:15means
- 11:15for
- 11:16on-device
- 11:16AI:
- 11:17Apple's
- 11:18M7/M8
- 11:20chip
- 11:20trajectory
- 11:21suggests
- 11:21a
- 11:21future
- 11:22where
- 11:22models
- 11:22run
- 11:22locally
- 11:23rather
- 11:24than
- 11:24through
- 11:24API
- 11:24calls,
- 11:25which
- 11:25would
- 11:25fundamentally
- 11:26change
- 11:26the
- 11:27competitive
- 11:27landscape
- 11:28and
- 11:28make
- 11:28the
- 11:28question
- 11:29of
- 11:29who
- 11:29trained
- 11:29on
- 11:29whose
- 11:30data
- 11:30even
- 11:30more
- 11:30consequential.
- 11:32Meanwhile,
- 11:32DeepSeek
- 11:33is
- 11:33developing
- 11:34a
- 11:34custom
- 11:34ASIC
- 11:34on
- 11:347nm
- 11:35DUV
- 11:36(deep
- 11:36ultraviolet)
- 11:37lithography
- 11:37—
- 11:38a
- 11:38deliberate
- 11:38choice
- 11:39that
- 11:39avoids
- 11:39competing
- 11:40for
- 11:40TSMC's
- 11:40oversubscribed
- 11:41EUV
- 11:42capacity.
- 11:43This
- 11:43is
- 11:44a
- 11:44triple-play
- 11:44vertical
- 11:45integration:
- 11:46control
- 11:46the
- 11:46silicon,
- 11:47control
- 11:47the
- 11:47inference
- 11:48cost
- 11:48structure,
- 11:49and
- 11:49sidestep
- 11:50US
- 11:50export
- 11:50controls
- 11:51on
- 11:51advanced
- 11:51lithography
- 11:52equipment
- 11:52in
- 11:52one
- 11:53move.
- 11:54Given
- 11:54DeepSeek's
- 11:55track
- 11:55record
- 11:55of
- 11:55achieving
- 11:56competitive
- 11:56performance
- 11:57at
- 11:57a
- 11:57fraction
- 11:57of
- 11:57the
- 11:57compute
- 11:58budget
- 11:58(their
- 11:59V3
- 11:59model
- 11:59famously
- 12:00trained
- 12:00for
- 12:00$5-6M),
- 12:02custom
- 12:02silicon
- 12:02purpose-built
- 12:03for
- 12:03their
- 12:03architecture
- 12:04could
- 12:04further
- 12:05widen
- 12:05the
- 12:05cost
- 12:05gap.
- 12:06The
- 12:06cost
- 12:07externalities
- 12:07of
- 12:07AI
- 12:08infrastructure
- 12:08are
- 12:09becoming
- 12:09impossible
- 12:09to
- 12:10ignore.
- 12:11An
- 12:11analysis
- 12:11of
- 12:12the
- 12:12PJM
- 12:12interconnection
- 12:13region
- 12:13—
- 12:14the
- 12:14largest
- 12:14wholesale
- 12:15electricity
- 12:15market
- 12:16in
- 12:16the
- 12:16US,
- 12:16spanning
- 12:1714
- 12:17mid-Atlantic
- 12:18and
- 12:18Midwest
- 12:18states
- 12:19—
- 12:19projects
- 12:20$23
- 12:20billion
- 12:21in
- 12:21customer
- 12:22price
- 12:22increases
- 12:22through
- 12:232028,
- 12:24driven
- 12:24primarily
- 12:24by
- 12:24data
- 12:25center
- 12:25demand.
- 12:26The
- 12:26exploitation
- 12:27mechanism
- 12:28is
- 12:28specific:
- 12:28coincident
- 12:29peak
- 12:29demand
- 12:30billing
- 12:30allocates
- 12:30grid
- 12:31costs
- 12:31based
- 12:31on
- 12:31usage
- 12:32at
- 12:32the
- 12:32moment
- 12:32of
- 12:32system-wide
- 12:33peak
- 12:33load.
- 12:34Data
- 12:34centers
- 12:35can
- 12:35fine-tune
- 12:36their
- 12:36consumption
- 12:36minute-by-minute,
- 12:38algorithmically
- 12:39reducing
- 12:39draw
- 12:39during
- 12:40predicted
- 12:40peaks
- 12:40while
- 12:41running
- 12:41at
- 12:41full
- 12:41capacity
- 12:42the
- 12:42rest
- 12:42of
- 12:42the
- 12:42time
- 12:42—
- 12:43a
- 12:43flexibility
- 12:44residential
- 12:45customers
- 12:45cannot
- 12:46replicate.
- 12:47When
- 12:47utilities
- 12:48invest
- 12:48in
- 12:48grid
- 12:48infrastructure
- 12:49to
- 12:49serve
- 12:49data
- 12:50center
- 12:50loads
- 12:50that
- 12:50subsequently
- 12:51underperform
- 12:52projections
- 12:53or
- 12:53become
- 12:53obsolete,
- 12:54those
- 12:54costs
- 12:55get
- 12:55spread
- 12:55across
- 12:55all
- 12:55remaining
- 12:56customers.
- 12:57Every
- 12:58state
- 12:58except
- 12:58Georgia,
- 12:59Idaho,
- 12:59and
- 13:00Louisiana
- 13:00has
- 13:00a
- 13:01consumer
- 13:01advocate
- 13:01office,
- 13:03but
- 13:03these
- 13:03offices
- 13:03are
- 13:04often
- 13:04legally
- 13:04barred
- 13:05from
- 13:05advocating
- 13:05for
- 13:06one
- 13:06customer
- 13:06class
- 13:07over
- 13:07another
- 13:07—
- 13:08meaning
- 13:08nobody
- 13:08effectively
- 13:09argues
- 13:09against
- 13:10data
- 13:10centers'
- 13:10proposals
- 13:11for
- 13:11minimal
- 13:11cost
- 13:12allocation.
- 13:13The
- 13:13result
- 13:13is
- 13:13a
- 13:14regulatory
- 13:14capture
- 13:14dynamic
- 13:15where
- 13:15AI
- 13:16compute
- 13:16costs
- 13:16are
- 13:17socialized
- 13:17while
- 13:17the
- 13:18profits
- 13:18remain
- 13:18private.
- 13:20Anthropic
- 13:21published
- 13:21research
- 13:22analyzing
- 13:22310,000
- 13:23conversations
- 13:24across
- 13:24languages,
- 13:25identifying
- 13:25four
- 13:26value
- 13:26axes
- 13:27along
- 13:27which
- 13:27Claude's
- 13:27behavior
- 13:28shifts:
- 13:28compliance/caution,
- 13:30warmth/severity,
- 13:31depth/brevity,
- 13:32and
- 13:32candor/efficiency.
- 13:34Russian-language
- 13:34conversations
- 13:35produce
- 13:35the
- 13:35most
- 13:35strict
- 13:36responses;
- 13:36Hindi
- 13:37the
- 13:37warmest.
- 13:38The
- 13:38researchers
- 13:38attribute
- 13:39these
- 13:39differences
- 13:39to
- 13:39training
- 13:40data
- 13:40composition
- 13:41rather
- 13:41than
- 13:41deliberate
- 13:42tuning
- 13:42—
- 13:42which
- 13:43is
- 13:43arguably
- 13:43more
- 13:43concerning,
- 13:44because
- 13:44it
- 13:44means
- 13:44the
- 13:44biases
- 13:45are
- 13:45structural
- 13:45and
- 13:45difficult
- 13:46to
- 13:46correct
- 13:46without
- 13:46fundamentally
- 13:47changing
- 13:47the
- 13:47data
- 13:48pipeline.
- 13:48A
- 13:49Russian-speaking
- 13:49user
- 13:49asking
- 13:50for
- 13:50the
- 13:50same
- 13:50help
- 13:50as
- 13:50a
- 13:50Hindi-speaking
- 13:51user
- 13:51gets
- 13:52a
- 13:52measurably
- 13:52different
- 13:52personality,
- 13:53not
- 13:54because
- 13:54anyone
- 13:54designed
- 13:54it
- 13:54that
- 13:55way,
- 13:55but
- 13:55because
- 13:55the
- 13:55internet's
- 13:56language
- 13:56distribution
- 13:57encodes
- 13:57cultural
- 13:58assumptions
- 13:58that
- 13:58survive
- 13:58through
- 13:59training.
- 13:59For
- 14:00anyone
- 14:00deploying
- 14:00Claude
- 14:01in
- 14:01multilingual
- 14:01contexts,
- 14:02this
- 14:02is
- 14:02not
- 14:03an
- 14:03academic
- 14:03curiosity;
- 14:04it
- 14:05is
- 14:05a
- 14:05deployment
- 14:05constraint
- 14:06that
- 14:06affects
- 14:06user
- 14:06experience,
- 14:07trust,
- 14:08and
- 14:08retention
- 14:09in
- 14:09measurable
- 14:09ways.
- 14:10DoorDash's
- 14:11LLM
- 14:11jury
- 14:12system
- 14:12for
- 14:12food
- 14:12metadata
- 14:13generation
- 14:13claims
- 14:1320%
- 14:14higher
- 14:14accuracy
- 14:15than
- 14:15human
- 14:15annotators
- 14:15—
- 14:16a
- 14:16result
- 14:17worth
- 14:17examining
- 14:17given
- 14:18prior
- 14:18concerns
- 14:18about
- 14:19LLM-as-judge
- 14:19circular
- 14:20dependencies.
- 14:21Their
- 14:21approach
- 14:21uses
- 14:22multiple
- 14:22strong
- 14:22LLM
- 14:23evaluators
- 14:23with
- 14:24independent
- 14:24verdicts
- 14:24and
- 14:24rationale,
- 14:25aggregated
- 14:26into
- 14:26consensus
- 14:26decisions,
- 14:27with
- 14:27per-tag
- 14:28validation
- 14:28(protein,
- 14:29preparation,
- 14:30health
- 14:30attributes
- 14:30individually)
- 14:31rather
- 14:31than
- 14:31holistic
- 14:32item-level
- 14:32judgment.
- 14:34The
- 14:34domain
- 14:34is
- 14:34genuinely
- 14:35hard:
- 14:35the
- 14:35same
- 14:36dish
- 14:36can
- 14:36be
- 14:36described
- 14:37in
- 14:37countless
- 14:37ways
- 14:37across
- 14:38cuisines,
- 14:39and
- 14:39only
- 14:39a
- 14:39handful
- 14:40of
- 14:40human
- 14:40experts
- 14:41reliably
- 14:41distinguish
- 14:42Nepalese
- 14:42from
- 14:42North
- 14:43Indian
- 14:43preparations
- 14:44or
- 14:44interpret
- 14:45whether
- 14:45"Sichuan-style"
- 14:45implies
- 14:46a
- 14:46specific
- 14:46heat
- 14:46profile.
- 14:48A
- 14:48context
- 14:48optimization
- 14:49loop
- 14:49inspired
- 14:50by
- 14:50reinforcement
- 14:50learning
- 14:51accelerated
- 14:51prompt
- 14:52development
- 14:52tenfold
- 14:53and
- 14:53improved
- 14:53precision
- 14:54by
- 14:54over
- 14:5420%,
- 14:56driven
- 14:56by
- 14:56failure-signal
- 14:57analysis
- 14:58rather
- 14:58than
- 14:58population-based
- 14:59evolutionary
- 15:00search
- 15:00—
- 15:00the
- 15:01team
- 15:01found
- 15:01that
- 15:01weighting
- 15:02failure
- 15:02cases
- 15:02more
- 15:03heavily
- 15:03outperformed
- 15:04balanced
- 15:04sampling.
- 15:05Fine-tuned
- 15:06small
- 15:06language
- 15:06models
- 15:07match
- 15:07frontier
- 15:08LLM
- 15:08quality
- 15:09at
- 15:0910%
- 15:09of
- 15:09inference
- 15:10cost
- 15:10with
- 15:10zero
- 15:11human
- 15:11annotation
- 15:11effort.
- 15:12A
- 15:12distributed
- 15:13pipeline
- 15:13using
- 15:13Spark-based
- 15:14deduplication,
- 15:15batch
- 15:15LLM
- 15:16APIs,
- 15:17and
- 15:17result
- 15:17remapping
- 15:18cut
- 15:18backfill
- 15:19from
- 15:19over
- 15:19a
- 15:19month
- 15:19to
- 15:20days
- 15:20across
- 15:20millions
- 15:21of
- 15:21menu
- 15:21items.