Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – April 20, 2026
Transcript
- 0:00The
- 0:00gap
- 0:01between
- 0:01"security
- 0:01research"
- 0:02and
- 0:02"push-button
- 0:03offense"
- 0:03closed
- 0:04another
- 0:04notch
- 0:04this
- 0:05week.
- 0:06A
- 0:06year
- 0:06ago,
- 0:07LLM-assisted
- 0:08vulnerability
- 0:08discovery
- 0:09was
- 0:09a
- 0:09provocative
- 0:09demo.
- 0:10Today
- 0:11it
- 0:11is
- 0:11a
- 0:11documented
- 0:12pipeline
- 0:12with
- 0:12published
- 0:13false-positive
- 0:13rates,
- 0:14and
- 0:14the
- 0:14tooling
- 0:14to
- 0:14act
- 0:15on
- 0:15its
- 0:15output
- 0:15ships
- 0:15as
- 0:15Docker
- 0:16containers.
- 0:17Ken
- 0:17Huang's
- 0:17comprehensive
- 0:18survey
- 0:18of
- 0:18LLM
- 0:18zero-day
- 0:19hunting
- 0:19lays
- 0:19out
- 0:19the
- 0:19current
- 0:20state:
- 0:20Google's
- 0:21Big
- 0:21Sleep
- 0:21found
- 0:21a
- 0:21real
- 0:22exploitable
- 0:22bug
- 0:22in
- 0:22SQLite.
- 0:23Anthropic's
- 0:24Claude
- 0:24Code
- 0:24Security
- 0:25team
- 0:25claims
- 0:25over
- 0:25500
- 0:26zero-days
- 0:26with
- 0:26a
- 0:26false-positive
- 0:27rate
- 0:27under
- 0:27five
- 0:28percent.
- 0:28OpenAnt's
- 0:29five-stage
- 0:29pipeline
- 0:29—
- 0:30static
- 0:31analysis,
- 0:31LLM
- 0:32reasoning,
- 0:32symbolic
- 0:33verification,
- 0:33dynamic
- 0:34testing,
- 0:34manual
- 0:35triage
- 0:35—
- 0:36reports
- 0:3699.98
- 0:37percent
- 0:37false-positive
- 0:38elimination
- 0:38on
- 0:39a
- 0:39120,000-function
- 0:40corpus.
- 0:41The
- 0:42RAPTOR
- 0:42hybrid
- 0:42agent
- 0:42chains
- 0:43reconnaissance,
- 0:43exploit
- 0:44generation,
- 0:44and
- 0:45validation
- 0:45into
- 0:45a
- 0:45single
- 0:46loop.
- 0:47None
- 0:47of
- 0:47these
- 0:47are
- 0:47theoretical.
- 0:48They
- 0:48produce
- 0:48working
- 0:49exploits
- 0:49against
- 0:49shipping
- 0:50code
- 0:50.
- 0:50The
- 0:51defense
- 0:51side
- 0:51cannot
- 0:51yet
- 0:52absorb
- 0:52output
- 0:52at
- 0:52that
- 0:53rate.
- 0:54The
- 0:54asymmetry
- 0:54is
- 0:54structural:
- 0:55offense
- 0:55can
- 0:55parallelize
- 0:56across
- 0:56every
- 0:56function
- 0:57in
- 0:57a
- 0:57codebase
- 0:57simultaneously;
- 0:59defense
- 0:59must
- 0:59still
- 1:00reason
- 1:00about
- 1:00context,
- 1:01intent,
- 1:01and
- 1:01deployment.
- 1:02The
- 1:03ratio
- 1:03will
- 1:03get
- 1:03worse
- 1:03before
- 1:04it
- 1:04stabilizes.
- 1:05Meanwhile,
- 1:06the
- 1:06tools
- 1:07to
- 1:07exploit
- 1:07what
- 1:07gets
- 1:07found
- 1:08are
- 1:08multiplying.
- 1:09Decepticon
- 1:10fields
- 1:10sixteen
- 1:11specialist
- 1:11agents
- 1:11that
- 1:11automate
- 1:12an
- 1:12entire
- 1:12kill
- 1:12chain
- 1:13—
- 1:13from
- 1:14reconnaissance
- 1:14through
- 1:15lateral
- 1:15movement
- 1:15—
- 1:16inside
- 1:16Docker
- 1:16isolation,
- 1:17complete
- 1:18with
- 1:18generated
- 1:18rules-of-engagement
- 1:19documents
- 1:19.
- 1:20RedAI
- 1:21pairs
- 1:21a
- 1:21scanner
- 1:21agent
- 1:22with
- 1:22a
- 1:22validator
- 1:22agent
- 1:23and
- 1:23ships
- 1:23browser
- 1:23plugins
- 1:24for
- 1:24Chrome
- 1:24and
- 1:24iOS
- 1:25to
- 1:25confirm
- 1:25findings
- 1:26against
- 1:26live
- 1:26environments
- 1:27.
- 1:28RedAmon's
- 1:28SG-ReAct
- 1:29architecture,
- 1:29backed
- 1:30by
- 1:30a
- 1:30Neo4j
- 1:31knowledge
- 1:31graph,
- 1:32reportedly
- 1:32found
- 1:32five
- 1:33XSS
- 1:33vulnerabilities
- 1:34and
- 1:34a
- 1:34JWT
- 1:35secret
- 1:35leak
- 1:35in
- 1:36one
- 1:36hour
- 1:36of
- 1:36autonomous
- 1:36operation
- 1:37.
- 1:38Talon
- 1:38turns
- 1:38Claude
- 1:39Code
- 1:39itself
- 1:39into
- 1:39a
- 1:39penetration
- 1:40testing
- 1:40interface
- 1:41by
- 1:41connecting
- 1:42it
- 1:42to
- 1:42a
- 1:42Kali
- 1:42Linux
- 1:42VM
- 1:43over
- 1:43SSH
- 1:43MCP
- 1:44—
- 1:45ask
- 1:45Claude
- 1:45to
- 1:45run
- 1:45nmap,
- 1:46interpret
- 1:46the
- 1:47output,
- 1:47suggest
- 1:48next
- 1:48steps,
- 1:48and
- 1:48generate
- 1:49an
- 1:49OSCP-style
- 1:50report
- 1:50without
- 1:50leaving
- 1:51the
- 1:51editor
- 1:51.
- 1:52All
- 1:52of
- 1:52these
- 1:52projects
- 1:53emphasize
- 1:53authorized
- 1:54testing.
- 1:55All
- 1:55of
- 1:55them
- 1:55also
- 1:55ship
- 1:55with
- 1:56minimal
- 1:56access
- 1:56controls.
- 1:57The
- 1:58ethical
- 1:58guardrails
- 1:58are
- 1:58README
- 2:01paragraphs,
- 2:01not
- 2:02technical
- 2:02constraints.
- 2:03The
- 2:03architectural
- 2:04vulnerability
- 2:05that
- 2:05makes
- 2:05this
- 2:05worse
- 2:05sits
- 2:05in
- 2:06MCP
- 2:06itself.
- 2:07OX
- 2:08Security's
- 2:08disclosure
- 2:09identifies
- 2:09a
- 2:09fundamental
- 2:10design
- 2:10flaw
- 2:10in
- 2:10how
- 2:11MCP
- 2:11SDKs
- 2:12handle
- 2:12tool-description
- 2:13injection:
- 2:14because
- 2:14the
- 2:14protocol
- 2:15trusts
- 2:15server-provided
- 2:16tool
- 2:16descriptions
- 2:17that
- 2:17get
- 2:17embedded
- 2:17directly
- 2:18into
- 2:18LLM
- 2:18context,
- 2:19a
- 2:19malicious
- 2:20MCP
- 2:20server
- 2:21can
- 2:21override
- 2:21system
- 2:22prompts,
- 2:22exfiltrate
- 2:23data,
- 2:23and
- 2:23hijack
- 2:24agent
- 2:24behavior
- 2:25across
- 2:25ten
- 2:25distinct
- 2:26CVE
- 2:26patterns
- 2:27affecting
- 2:27packages
- 2:27with
- 2:27over
- 2:28150
- 2:28million
- 2:29cumulative
- 2:29downloads.
- 2:30Anthropic's
- 2:31response
- 2:31—
- 2:32that
- 2:32this
- 2:32is
- 2:32working
- 2:32as
- 2:33designed
- 2:33—
- 2:33is
- 2:33technically
- 2:34accurate
- 2:34and
- 2:34practically
- 2:35terrifying
- 2:35.
- 2:36On
- 2:36the
- 2:36other
- 2:37end
- 2:37of
- 2:37the
- 2:37sophistication
- 2:38spectrum,
- 2:38a
- 2:38Firebase
- 2:39user
- 2:39discovered
- 2:40a
- 2:40€54,000
- 2:41billing
- 2:41spike
- 2:41in
- 2:41thirteen
- 2:42hours
- 2:42caused
- 2:43by
- 2:43an
- 2:43unrestricted
- 2:43browser
- 2:44API
- 2:44key
- 2:44accessing
- 2:45Gemini
- 2:45endpoints.
- 2:46No
- 2:47abuse
- 2:47detection
- 2:47fired.
- 2:48Google
- 2:48denied
- 2:49the
- 2:49billing
- 2:49adjustment.
- 2:50The
- 2:50lesson
- 2:50is
- 2:51not
- 2:51about
- 2:51Firebase
- 2:51specifically
- 2:52—
- 2:53it
- 2:53is
- 2:53about
- 2:53the
- 2:53gap
- 2:54between
- 2:54how
- 2:54cloud
- 2:55providers
- 2:55market
- 2:55API
- 2:56keys
- 2:56as
- 2:56safe
- 2:56defaults
- 2:57and
- 2:57what
- 2:57happens
- 2:58when
- 2:58those
- 2:58defaults
- 2:59meet
- 2:59an
- 2:59adversary
- 3:00who
- 3:00reads
- 3:00documentation
- 3:00.
- 3:03CISPA
- 3:04researchers
- 3:04published
- 3:05a
- 3:05new
- 3:05transient
- 3:05execution
- 3:06variant
- 3:06against
- 3:07AMD
- 3:07processors
- 3:08spanning
- 3:08Zen
- 3:081
- 3:09through
- 3:09Zen
- 3:095,
- 3:10disclosed
- 3:10as
- 3:11AMD
- 3:11advisory
- 3:12SB-7050.
- 3:14The
- 3:14finding
- 3:15came
- 3:15from
- 3:15TREVEX,
- 3:18a
- 3:18black-box
- 3:19post-silicon
- 3:20fuzzer
- 3:20that
- 3:20runs
- 3:20attacker
- 3:21and
- 3:21victim
- 3:21processes
- 3:22on
- 3:22sibling
- 3:22SMT
- 3:23threads,
- 3:24flags
- 3:24cases
- 3:24where
- 3:25the
- 3:25cache
- 3:25footprint
- 3:25reveals
- 3:26more
- 3:26than
- 3:26one
- 3:26transient
- 3:27value
- 3:27for
- 3:27an
- 3:27architecturally
- 3:28single-valued
- 3:28operation,
- 3:29and
- 3:29does
- 3:29so
- 3:30without
- 3:30needing
- 3:30RTL
- 3:30access
- 3:31or
- 3:31an
- 3:31ISA
- 3:32emulator.
- 3:33A
- 3:3325-hour
- 3:33campaign
- 3:34across
- 3:34twenty
- 3:34microarchitectures
- 3:35produced
- 3:35the
- 3:35result:
- 3:36on
- 3:36AMD
- 3:37Zen
- 3:371
- 3:38through
- 3:38Zen
- 3:385,
- 3:39when
- 3:39a
- 3:39floating-point
- 3:40multiply
- 3:40produces
- 3:41a
- 3:41result
- 3:41too
- 3:41small
- 3:42to
- 3:42represent
- 3:42—
- 3:43catastrophic
- 3:44underflow
- 3:44—
- 3:45the
- 3:45CPU
- 3:45transiently
- 3:46forwards
- 3:46a
- 3:46non-zero
- 3:47garbage
- 3:47value
- 3:48to
- 3:48dependent
- 3:48instructions
- 3:49before
- 3:49the
- 3:49microcode
- 3:50assist
- 3:50corrects
- 3:50it.
- 3:52The
- 3:52original
- 3:522021
- 3:53FPVI
- 3:53disclosure
- 3:54framed
- 3:54the
- 3:54trigger
- 3:54as
- 3:54denormal
- 3:55inputs.
- 3:56This
- 3:56new
- 3:56variant,
- 3:57which
- 3:57the
- 3:57researchers
- 3:58label
- 3:58VVI,
- 3:59reaches
- 3:59the
- 3:59same
- 4:00transient
- 4:00window
- 4:00through
- 4:00output
- 4:01underflow
- 4:01from
- 4:01normal
- 4:02inputs.
- 4:03The
- 4:03distinction
- 4:03matters
- 4:04for
- 4:04mitigations:
- 4:05any
- 4:05defense
- 4:05that
- 4:06checks
- 4:06for
- 4:06denormal
- 4:06inputs
- 4:07will
- 4:07not
- 4:07fire,
- 4:08because
- 4:08VVI
- 4:08has
- 4:09no
- 4:09denormal
- 4:09inputs.
- 4:10Defenses
- 4:11that
- 4:11set
- 4:11MXCSR
- 4:12flush-to-zero
- 4:12globally
- 4:13still
- 4:13work.
- 4:14Mozilla's
- 4:14Firefox
- 4:15fix
- 4:15—
- 4:16masking
- 4:16NaN-boxed
- 4:17values
- 4:17at
- 4:17the
- 4:17boxing
- 4:17step
- 4:18—
- 4:18still
- 4:19works
- 4:19for
- 4:19the
- 4:19type-confusion
- 4:20exploit
- 4:20class.
- 4:21But
- 4:21JavaScriptCore
- 4:22uses
- 4:22the
- 4:22same
- 4:22NaN-boxing
- 4:23architecture
- 4:23as
- 4:24pre-mitigation
- 4:24SpiderMonkey,
- 4:25and
- 4:25no
- 4:25public
- 4:26FPVI-specific
- 4:27mitigation
- 4:27is
- 4:27documented
- 4:28in
- 4:28WebKit
- 4:28source
- 4:29or
- 4:29advisories.
- 4:30AMD
- 4:30folded
- 4:30VVI
- 4:31back
- 4:31into
- 4:31the
- 4:32existing
- 4:32CVE-2021-26314,
- 4:36classified
- 4:37it
- 4:37as
- 4:37informational
- 4:37with
- 4:37no
- 4:38new
- 4:38CVE,
- 4:39and
- 4:39stated
- 4:39that
- 4:39existing
- 4:40mitigation
- 4:40guidance
- 4:40remains
- 4:41valid.
- 4:42That
- 4:42is
- 4:42accurate
- 4:42for
- 4:42the
- 4:42guidance
- 4:43as
- 4:43written
- 4:43—
- 4:44AMD
- 4:44recommended
- 4:45MXCSR
- 4:45FTZ+DAZ
- 4:46in
- 4:462021.
- 4:47It
- 4:48is
- 4:48misleading
- 4:48for
- 4:48the
- 4:48deployment
- 4:49reality,
- 4:49because
- 4:49many
- 4:50vendors
- 4:50implemented
- 4:50narrower
- 4:51mitigations
- 4:51tied
- 4:52to
- 4:52the
- 4:52denormal
- 4:52framing.
- 4:53The
- 4:53realistic
- 4:54exploit
- 4:54path
- 4:55still
- 4:55concentrates
- 4:55on
- 4:55JIT
- 4:56environments:
- 4:57the
- 4:57attacker
- 4:57supplies
- 4:58JavaScript
- 4:58or
- 4:59WebAssembly,
- 5:00the
- 5:00JIT
- 5:00compiles
- 5:01it
- 5:01to
- 5:01a
- 5:01vector
- 5:01multiply,
- 5:02the
- 5:02attacker
- 5:03picks
- 5:03operands
- 5:03near
- 5:0310^-894
- 5:07that
- 5:07guarantee
- 5:07catastrophic
- 5:08underflow,
- 5:08and
- 5:08NaN-boxing
- 5:09type
- 5:09confusion
- 5:10turns
- 5:10the
- 5:10transient
- 5:11garbage
- 5:11into
- 5:11an
- 5:11arbitrary
- 5:12memory
- 5:12read.
- 5:13Catastrophic
- 5:13underflow
- 5:14does
- 5:14not
- 5:14happen
- 5:14in
- 5:15normal
- 5:15numerical
- 5:15code
- 5:15—
- 5:16compilers
- 5:17do
- 5:17not
- 5:17emit
- 5:17it,
- 5:18HPC
- 5:18kernels
- 5:19operate
- 5:19orders
- 5:19of
- 5:19magnitude
- 5:20above
- 5:20it,
- 5:21and
- 5:21graphics
- 5:21pipelines
- 5:22set
- 5:22FTZ
- 5:22by
- 5:22default
- 5:23for
- 5:23performance.
- 5:24Whether
- 5:24a
- 5:24given
- 5:25JavaScript
- 5:25engine
- 5:26or
- 5:26Wasm
- 5:26runtime
- 5:26is
- 5:27actually
- 5:27covered
- 5:27is
- 5:27now
- 5:28a
- 5:28code-review
- 5:28question
- 5:29per
- 5:29component,
- 5:30not
- 5:30an
- 5:30assumed
- 5:30yes
- 5:30.
- 5:31The
- 5:31security
- 5:31community
- 5:32also
- 5:32paused
- 5:33to
- 5:33mark
- 5:33the
- 5:33passing
- 5:33of
- 5:33Felix
- 5:34"FX"
- 5:34Lindner,
- 5:35whose
- 5:35work
- 5:35with
- 5:35Phenoelit
- 5:36on
- 5:36IRPAS,
- 5:37the
- 5:37Cisco
- 5:37IOS
- 5:38shellcode,
- 5:38and
- 5:38HP
- 5:39printer
- 5:39exploitation
- 5:40defined
- 5:40an
- 5:40era
- 5:40when
- 5:41hardware
- 5:41and
- 5:41protocol
- 5:41security
- 5:42research
- 5:42meant
- 5:43building
- 5:43your
- 5:43own
- 5:43tools
- 5:44from
- 5:44scratch.
- 5:45The
- 5:45tributes
- 5:45from
- 5:45thirty
- 5:45colleagues
- 5:46trace
- 5:46a
- 5:46lineage
- 5:46from
- 5:47dial-up
- 5:47BBS
- 5:47culture
- 5:48through
- 5:48the
- 5:48professionalization
- 5:49of
- 5:49offensive
- 5:49security
- 5:50—
- 5:50a
- 5:51reminder
- 5:51that
- 5:51the
- 5:51field's
- 5:51foundations
- 5:52were
- 5:52laid
- 5:52by
- 5:52people
- 5:53who
- 5:53reversed
- 5:53firmware
- 5:54because
- 5:54it
- 5:54was
- 5:54there,
- 5:55not
- 5:55because
- 5:55there
- 5:55was
- 5:56a
- 5:56bounty
- 5:56program
- 5:56.
- 5:59The
- 5:59self-improving
- 6:00agent
- 6:00is
- 6:00no
- 6:01longer
- 6:01a
- 6:01thought
- 6:01experiment.
- 6:02This
- 6:02week's
- 6:02publications
- 6:03describe
- 6:03systems
- 6:04that
- 6:04modify
- 6:04their
- 6:05own
- 6:05strategies,
- 6:05evaluation
- 6:06criteria,
- 6:06and
- 6:07—
- 6:08in
- 6:08one
- 6:08case
- 6:08—
- 6:09their
- 6:09own
- 6:09weights
- 6:10during
- 6:10operation.
- 6:11Meta
- 6:11and
- 6:11UBC's
- 6:12HyperAgents
- 6:12paper
- 6:13introduces
- 6:13DGM-Hyperagents,
- 6:15a
- 6:15framework
- 6:15where
- 6:15task-level
- 6:16and
- 6:16meta-level
- 6:17agents
- 6:17share
- 6:18a
- 6:18single
- 6:18editable
- 6:18program.
- 6:19The
- 6:19meta
- 6:20agent
- 6:20can
- 6:20rewrite
- 6:20the
- 6:21task
- 6:21agent's
- 6:21strategy,
- 6:22tool
- 6:22selection,
- 6:23and
- 6:23evaluation
- 6:24criteria
- 6:24based
- 6:24on
- 6:24performance
- 6:25feedback
- 6:25—
- 6:26metacognitive
- 6:26self-modification
- 6:27across
- 6:28any
- 6:28computable
- 6:28task
- 6:29domain.
- 6:30The
- 6:30paper
- 6:30demonstrates
- 6:30cross-domain
- 6:31transfer:
- 6:32improvements
- 6:32learned
- 6:33on
- 6:33coding
- 6:33tasks
- 6:33carry
- 6:34over
- 6:34to
- 6:34mathematical
- 6:34reasoning
- 6:35without
- 6:35retraining.
- 6:36The
- 6:36theoretical
- 6:36framing
- 6:37draws
- 6:37on
- 6:37Schmidhuber's
- 6:38Gödel
- 6:38machines:
- 6:39a
- 6:39self-referential
- 6:40system
- 6:40that
- 6:40only
- 6:40accepts
- 6:41self-modifications
- 6:42provably
- 6:42improving
- 6:43expected
- 6:43future
- 6:43performance
- 6:44.
- 6:45NousResearch's
- 6:45Hermes
- 6:45Agent
- 6:46takes
- 6:46a
- 6:46more
- 6:47pragmatic
- 6:47approach.
- 6:48It
- 6:48ships
- 6:48as
- 6:48a
- 6:48multi-platform
- 6:49messaging
- 6:50agent
- 6:50—
- 6:50Discord,
- 6:51Telegram,
- 6:52Slack,
- 6:53CLI
- 6:53—
- 6:54with
- 6:54a
- 6:54skill
- 6:54system
- 6:55that
- 6:55learns
- 6:55from
- 6:55interactions.
- 6:57Six
- 6:57terminal
- 6:57backends,
- 6:58any
- 6:58model
- 6:58provider,
- 6:59persistent
- 6:59memory.
- 7:00The
- 7:00pitch
- 7:00is
- 7:00an
- 7:00agent
- 7:01that
- 7:01starts
- 7:01generic
- 7:02and
- 7:02becomes
- 7:02specialized
- 7:03through
- 7:03use,
- 7:04accumulating
- 7:04skills
- 7:05the
- 7:05way
- 7:05a
- 7:05developer
- 7:05accumulates
- 7:06shell
- 7:06aliases:
- 7:07not
- 7:07through
- 7:08formal
- 7:08training
- 7:08but
- 7:08through
- 7:09repeated
- 7:09successful
- 7:09patterns
- 7:10.
- 7:10A
- 7:10companion
- 7:11walkthrough
- 7:11demonstrates
- 7:12the
- 7:12local-LLM
- 7:13variant
- 7:13using
- 7:14Honcho
- 7:14for
- 7:14dialectic
- 7:15memory
- 7:15management,
- 7:16consuming
- 7:16496,000
- 7:18tokens
- 7:18across
- 7:19a
- 7:19session
- 7:19while
- 7:19maintaining
- 7:20coherent
- 7:20context
- 7:21—
- 7:21proof
- 7:22that
- 7:22self-improving
- 7:22loops
- 7:23do
- 7:23not
- 7:23require
- 7:24frontier-model
- 7:24API
- 7:25budgets
- 7:25.
- 7:26Evo
- 7:26approaches
- 7:26self-improvement
- 7:27from
- 7:27the
- 7:27code
- 7:28side:
- 7:28an
- 7:28evolutionary
- 7:29optimization
- 7:30framework
- 7:30that
- 7:30uses
- 7:31tree
- 7:31search
- 7:31with
- 7:31parallel
- 7:32subagents
- 7:32in
- 7:32isolated
- 7:33git
- 7:33worktrees
- 7:34to
- 7:34explore
- 7:34solution
- 7:34variants,
- 7:35evaluate
- 7:36them
- 7:36against
- 7:36test
- 7:36suites,
- 7:37and
- 7:37propagate
- 7:37successful
- 7:38mutations.
- 7:39It
- 7:39is
- 7:39genetic
- 7:40programming
- 7:40applied
- 7:40to
- 7:41the
- 7:41agent's
- 7:41own
- 7:41tool
- 7:42implementations
- 7:42rather
- 7:43than
- 7:43to
- 7:43a
- 7:43target
- 7:43problem
- 7:44.
- 7:44The
- 7:45verification
- 7:45problem
- 7:46for
- 7:46self-improving
- 7:46systems
- 7:47is
- 7:47whether
- 7:47they
- 7:47actually
- 7:48improve
- 7:48or
- 7:48just
- 7:49drift.
- 7:50A
- 7:50detailed
- 7:50analysis
- 7:51of
- 7:51LLM-as-a-Verifier
- 7:52techniques
- 7:52shows
- 7:53that
- 7:53fine-grained
- 7:54logprob
- 7:54distribution
- 7:55scoring,
- 7:55combined
- 7:56with
- 7:56repeated
- 7:56verification
- 7:57passes
- 7:57and
- 7:58pairwise
- 7:58round-robin
- 7:59tournament
- 7:59selection,
- 8:00reaches
- 8:0077.8
- 8:01percent
- 8:01on
- 8:01SWE-Bench
- 8:02Verified.
- 8:03The
- 8:04key
- 8:04insight:
- 8:05verifying
- 8:05a
- 8:05solution
- 8:06is
- 8:06computationally
- 8:07cheaper
- 8:07than
- 8:07generating
- 8:08one,
- 8:09so
- 8:09you
- 8:09can
- 8:09afford
- 8:09to
- 8:10verify
- 8:10many
- 8:10times
- 8:11and
- 8:11select
- 8:11the
- 8:11best.
- 8:12This
- 8:12gives
- 8:13self-improving
- 8:13agents
- 8:14a
- 8:14credible
- 8:14internal
- 8:15quality
- 8:15signal
- 8:15—
- 8:16the
- 8:16missing
- 8:16piece
- 8:17that
- 8:17separates
- 8:17productive
- 8:18self-modification
- 8:19from
- 8:19random
- 8:19walks
- 8:19.
- 8:22NVIDIA
- 8:23published
- 8:23a
- 8:23position
- 8:23paper
- 8:24arguing
- 8:24that
- 8:24small
- 8:25language
- 8:25models
- 8:25—
- 8:26under
- 8:26ten
- 8:26billion
- 8:27parameters
- 8:27—
- 8:28are
- 8:28sufficient
- 8:28for
- 8:29agentic
- 8:29AI.
- 8:30Not
- 8:30as
- 8:30a
- 8:30compromise.
- 8:31As
- 8:32a
- 8:32design
- 8:32choice.
- 8:33The
- 8:33argument:
- 8:34agentic
- 8:35workloads
- 8:35decompose
- 8:36into
- 8:36tool-calling,
- 8:37planning,
- 8:37and
- 8:37domain
- 8:38reasoning
- 8:38steps,
- 8:39each
- 8:39of
- 8:39which
- 8:39can
- 8:39be
- 8:40handled
- 8:40by
- 8:40a
- 8:40specialized
- 8:41small
- 8:41model
- 8:41faster
- 8:42and
- 8:42cheaper
- 8:42than
- 8:42routing
- 8:42everything
- 8:43through
- 8:43a
- 8:43frontier
- 8:44model.
- 8:44Heterogeneous
- 8:45systems
- 8:46that
- 8:46mix
- 8:46SLMs
- 8:46with
- 8:46structured
- 8:47tool
- 8:47APIs
- 8:47outperform
- 8:48monolithic
- 8:48large
- 8:49models
- 8:49on
- 8:49latency-sensitive
- 8:50agent
- 8:50tasks.
- 8:51The
- 8:51paper
- 8:52catalogs
- 8:52LLM-to-SLM
- 8:53conversion
- 8:53techniques
- 8:54including
- 8:54pruning,
- 8:55distillation,
- 8:55and
- 8:56architecture-specific
- 8:56compression,
- 8:57framing
- 8:58them
- 8:58not
- 8:58as
- 8:58degradation
- 8:59but
- 8:59as
- 8:59deployment
- 8:59optimization
- 9:00.
- 9:01The
- 9:01intellectual
- 9:01foundation
- 9:02for
- 9:02that
- 9:02conversion
- 9:02pipeline
- 9:03is
- 9:03Hinton,
- 9:03Vinyals,
- 9:04and
- 9:04Dean's
- 9:042015
- 9:05knowledge
- 9:05distillation
- 9:06paper,
- 9:06which
- 9:06resurfaced
- 9:06in
- 9:06this
- 9:07week's
- 9:07discussions.
- 9:08The
- 9:08core
- 9:08mechanism
- 9:09—
- 9:09training
- 9:10a
- 9:10small
- 9:10student
- 9:10model
- 9:10on
- 9:10the
- 9:11soft
- 9:11probability
- 9:11distributions
- 9:12of
- 9:12a
- 9:12large
- 9:12teacher
- 9:13model
- 9:13rather
- 9:13than
- 9:13on
- 9:14hard
- 9:14labels
- 9:14—
- 9:15remains
- 9:15the
- 9:15backbone
- 9:15of
- 9:16every
- 9:16modern
- 9:16model
- 9:16compression
- 9:17technique.
- 9:18Temperature
- 9:18scaling
- 9:18during
- 9:19distillation
- 9:19lets
- 9:19the
- 9:19student
- 9:20learn
- 9:20from
- 9:20the
- 9:20teacher's
- 9:20uncertainty,
- 9:21not
- 9:21just
- 9:21its
- 9:22top
- 9:22predictions.
- 9:23The
- 9:23specialist-model
- 9:24extension,
- 9:25where
- 9:25ensemble
- 9:25members
- 9:26handle
- 9:26different
- 9:26data
- 9:26subsets,
- 9:27prefigures
- 9:28today's
- 9:28mixture-of-experts
- 9:29architectures
- 9:29.
- 9:31ByteDance's
- 9:31in-place
- 9:32test-time
- 9:32training
- 9:32takes
- 9:32a
- 9:32different
- 9:33approach
- 9:33to
- 9:33making
- 9:33small
- 9:34models
- 9:34capable:
- 9:35instead
- 9:35of
- 9:35distilling
- 9:36a
- 9:36large
- 9:36model
- 9:36into
- 9:36a
- 9:37small
- 9:37one,
- 9:37it
- 9:38updates
- 9:38the
- 9:38small
- 9:38model's
- 9:38MLP
- 9:39block
- 9:39weights
- 9:39at
- 9:39inference
- 9:40time
- 9:40using
- 9:40a
- 9:40next-token-prediction-aligned
- 9:41objective.
- 9:42A
- 9:42four-billion-parameter
- 9:43model
- 9:43extends
- 9:44to
- 9:44128K
- 9:45context
- 9:45with
- 9:45chunk-wise
- 9:46weight
- 9:46updates
- 9:46that
- 9:46persist
- 9:47only
- 9:47for
- 9:47the
- 9:47current
- 9:47input.
- 9:48No
- 9:48retraining,
- 9:49no
- 9:49architecture
- 9:50change.
- 9:51The
- 9:51fast
- 9:51weights
- 9:51adapt
- 9:52the
- 9:52model
- 9:52to
- 9:52the
- 9:52specific
- 9:52document
- 9:53it
- 9:53is
- 9:53processing
- 9:53.
- 9:54On
- 9:54the
- 9:55inference
- 9:55side,
- 9:55a
- 9:55practical
- 9:56survey
- 9:56of
- 9:56eight
- 9:56optimization
- 9:57techniques
- 9:57catalogs
- 9:58the
- 9:58current
- 9:58toolkit:
- 9:59quantization,
- 10:00speculative
- 10:01decoding,
- 10:01KV
- 10:02cache
- 10:02compression,
- 10:03PagedAttention,
- 10:04TurboQuant
- 10:04calibration-free
- 10:05methods,
- 10:06Flash
- 10:06Attention,
- 10:06continuous
- 10:07batching,
- 10:07and
- 10:08structured
- 10:08pruning.
- 10:09The
- 10:09useful
- 10:09observation
- 10:10is
- 10:10how
- 10:10these
- 10:10compose
- 10:10—
- 10:11Flash
- 10:11Attention
- 10:12plus
- 10:12PagedAttention
- 10:13plus
- 10:134-bit
- 10:13quantization
- 10:14plus
- 10:14speculative
- 10:15decoding,
- 10:15applied
- 10:16together,
- 10:16can
- 10:17deliver
- 10:17ten-times-or-more
- 10:18throughput
- 10:18improvements
- 10:18on
- 10:19commodity
- 10:19hardware
- 10:19.
- 10:20The
- 10:20most
- 10:20immediately
- 10:21actionable
- 10:21result
- 10:21is
- 10:22from
- 10:22llama.cpp:
- 10:23a
- 10:23dynamic
- 10:24expert
- 10:24cache
- 10:24that
- 10:24keeps
- 10:25hot
- 10:25MoE
- 10:25experts
- 10:26pinned
- 10:26in
- 10:26VRAM
- 10:26and
- 10:27swaps
- 10:27cold
- 10:27experts
- 10:28from
- 10:28system
- 10:28RAM
- 10:28on
- 10:28demand.
- 10:29On
- 10:29Qwen3.5-122B
- 10:33with
- 10:33a
- 10:3348GB
- 10:34GPU,
- 10:35throughput
- 10:35jumps
- 10:36from
- 10:3615.65
- 10:37to
- 10:3722.67
- 10:38tokens
- 10:38per
- 10:39second
- 10:39—
- 10:39a
- 10:3927
- 10:40percent
- 10:40improvement
- 10:40from
- 10:41a
- 10:41caching
- 10:41strategy,
- 10:42no
- 10:42quantization
- 10:43required.
- 10:44The
- 10:44implication
- 10:44is
- 10:44that
- 10:45mixture-of-experts
- 10:45models,
- 10:46which
- 10:46were
- 10:46designed
- 10:46for
- 10:47training
- 10:47efficiency,
- 10:48can
- 10:48also
- 10:48be
- 10:48made
- 10:48inference-efficient
- 10:49by
- 10:49treating
- 10:50expert
- 10:50activation
- 10:51patterns
- 10:51as
- 10:51a
- 10:51caching
- 10:52problem
- 10:52.
- 10:54Jürgen
- 10:55Schmidhuber
- 10:55published
- 10:56two
- 10:56companion
- 10:57pieces
- 10:57tracing
- 10:57the
- 10:57history
- 10:58of
- 10:58neural
- 10:58world
- 10:58models
- 10:59from
- 10:59his
- 10:591990
- 11:01FKI-126-90
- 11:04paper
- 11:04to
- 11:04the
- 11:04present.
- 11:05The
- 11:05historical
- 11:06claim
- 11:06is
- 11:06specific:
- 11:07the
- 11:071990
- 11:07work
- 11:08introduced
- 11:08a
- 11:08recurrent
- 11:08neural
- 11:09network
- 11:09trained
- 11:09to
- 11:09predict
- 11:10environmental
- 11:10observations,
- 11:11used
- 11:11by
- 11:12a
- 11:12controller
- 11:12that
- 11:12plans
- 11:13action
- 11:13sequences
- 11:13by
- 11:14simulating
- 11:14outcomes
- 11:15in
- 11:15the
- 11:15learned
- 11:15model.
- 11:16The
- 11:16same
- 11:16framework
- 11:17introduced
- 11:17adversarial
- 11:18curiosity
- 11:18—
- 11:19rewarding
- 11:19the
- 11:19controller
- 11:20for
- 11:20finding
- 11:20observations
- 11:21the
- 11:21world
- 11:21model
- 11:21cannot
- 11:22yet
- 11:22predict
- 11:22—
- 11:23which
- 11:23Schmidhuber
- 11:24identifies
- 11:24as
- 11:24the
- 11:24structural
- 11:25ancestor
- 11:25of
- 11:26GANs.
- 11:27The
- 11:27LSTM
- 11:27networks
- 11:27developed
- 11:28from
- 11:281991
- 11:29onward
- 11:29became
- 11:29the
- 11:29sequence
- 11:30modeling
- 11:30backbone
- 11:31that
- 11:31made
- 11:31these
- 11:31ideas
- 11:31practical
- 11:32.
- 11:32The
- 11:33pieces
- 11:33are
- 11:33partly
- 11:33priority
- 11:34claims
- 11:34and
- 11:34partly
- 11:34technical
- 11:35archaeology.
- 11:36The
- 11:36useful
- 11:36content
- 11:37for
- 11:37practitioners
- 11:38is
- 11:38the
- 11:38framing:
- 11:39a
- 11:39world
- 11:39model
- 11:39is
- 11:40not
- 11:40a
- 11:40language
- 11:40model
- 11:41with
- 11:41extra
- 11:41steps.
- 11:42It
- 11:42is
- 11:42a
- 11:42learned
- 11:43simulator
- 11:43that
- 11:43supports
- 11:44counterfactual
- 11:44reasoning
- 11:45—
- 11:45asking
- 11:46"what
- 11:46would
- 11:46happen
- 11:46if"
- 11:46rather
- 11:47than
- 11:47"what
- 11:47usually
- 11:47comes
- 11:48next."
- 11:49Current
- 11:49systems
- 11:49like
- 11:49Sora,
- 11:50Genie,
- 11:51and
- 11:51DeepSeek's
- 11:51planning
- 11:52components
- 11:52are
- 11:52converging
- 11:53on
- 11:53architectures
- 11:53that
- 11:53look
- 11:53structurally
- 11:54similar
- 11:54to
- 11:54what
- 11:55the
- 11:551990
- 11:55paper
- 11:55described,
- 11:56scaled
- 11:57by
- 11:57six
- 11:57orders
- 11:57of
- 11:58magnitude
- 11:58in
- 11:58parameters.
- 11:59Kurt
- 11:59Cagle's
- 12:00analysis
- 12:00of
- 12:00the
- 12:00ontology
- 12:01problem
- 12:01addresses
- 12:02the
- 12:02knowledge-representation
- 12:03layer
- 12:03that
- 12:03sits
- 12:03beneath
- 12:03world
- 12:04models.
- 12:05The
- 12:05argument:
- 12:06monolithic
- 12:06enterprise
- 12:07ontologies
- 12:07fail
- 12:08because
- 12:08they
- 12:08try
- 12:08to
- 12:09impose
- 12:09a
- 12:09single
- 12:09conceptual
- 12:10schema
- 12:10across
- 12:10organizational
- 12:11boundaries.
- 12:13The
- 12:13alternative
- 12:13is
- 12:13a
- 12:14federated
- 12:14architecture
- 12:14with
- 12:15internal
- 12:15models
- 12:16(how
- 12:16a
- 12:16bounded
- 12:16context
- 12:17represents
- 12:17its
- 12:17own
- 12:17domain)
- 12:18and
- 12:18correspondent
- 12:19models
- 12:19(translation
- 12:19layers
- 12:20between
- 12:20contexts).
- 12:20The
- 12:21parallel
- 12:21to
- 12:21REST
- 12:21API
- 12:22design
- 12:22is
- 12:22explicit
- 12:22—
- 12:23semantic
- 12:23boundaries
- 12:24should
- 12:24work
- 12:24like
- 12:24service
- 12:24boundaries,
- 12:25with
- 12:25well-defined
- 12:26interfaces
- 12:26and
- 12:27no
- 12:27shared
- 12:27internal
- 12:27state.
- 12:28For
- 12:28AI
- 12:28systems
- 12:28that
- 12:29need
- 12:29to
- 12:29reason
- 12:29across
- 12:29knowledge
- 12:30domains,
- 12:30this
- 12:30is
- 12:31the
- 12:31practical
- 12:31alternative
- 12:31to
- 12:32training
- 12:32on
- 12:32everything
- 12:32and
- 12:32hoping
- 12:33the
- 12:33model
- 12:33figures
- 12:33out
- 12:33the
- 12:33relationships
- 12:34.
- 12:37Anthropic
- 12:38launched
- 12:38Claude
- 12:38Design,
- 12:39a
- 12:39visual
- 12:39prototyping
- 12:40tool
- 12:40powered
- 12:41by
- 12:41Claude
- 12:41Opus
- 12:41that
- 12:42lets
- 12:42users
- 12:42create
- 12:42designs,
- 12:43interactive
- 12:44prototypes,
- 12:44and
- 12:45slide
- 12:45decks
- 12:45through
- 12:45conversation.
- 12:46The
- 12:46workflow:
- 12:47describe
- 12:48what
- 12:48you
- 12:48need,
- 12:49Claude
- 12:49builds
- 12:49a
- 12:49first
- 12:50version,
- 12:50you
- 12:50refine
- 12:51through
- 12:51inline
- 12:51comments,
- 12:52direct
- 12:52edits,
- 12:53or
- 12:53custom
- 12:53sliders
- 12:53that
- 12:54Claude
- 12:54generates
- 12:54on
- 12:54the
- 12:54fly.
- 12:55Teams
- 12:56can
- 12:56upload
- 12:56design
- 12:57systems
- 12:57and
- 12:57Claude
- 12:58applies
- 12:58them
- 12:58automatically.
- 12:59The
- 13:00export
- 13:00path
- 13:00goes
- 13:01to
- 13:01Canva,
- 13:01PDF,
- 13:02PPTX,
- 13:03or
- 13:03standalone
- 13:04HTML
- 13:04—
- 13:05and
- 13:05when
- 13:06a
- 13:06design
- 13:06is
- 13:06ready
- 13:06to
- 13:06build,
- 13:07Claude
- 13:07packages
- 13:08a
- 13:08handoff
- 13:08bundle
- 13:09that
- 13:09goes
- 13:09directly
- 13:09to
- 13:09Claude
- 13:10Code.
- 13:11Brilliant
- 13:11reports
- 13:11that
- 13:11pages
- 13:12requiring
- 13:12twenty-plus
- 13:13prompts
- 13:13in
- 13:13other
- 13:14tools
- 13:14need
- 13:14two
- 13:14prompts
- 13:15in
- 13:15Claude
- 13:15Design
- 13:15.
- 13:16This
- 13:16is
- 13:16Anthropic
- 13:17expanding
- 13:17from
- 13:18code
- 13:18generation
- 13:19into
- 13:19the
- 13:19visual
- 13:19layer
- 13:19that
- 13:20precedes
- 13:20code.
- 13:21The
- 13:21Claude
- 13:21Code
- 13:22handoff
- 13:22is
- 13:22the
- 13:22strategic
- 13:23move:
- 13:23design-to-implementation
- 13:25in
- 13:25a
- 13:25single
- 13:25tool
- 13:25chain,
- 13:26with
- 13:26the
- 13:26design
- 13:26system
- 13:27enforced
- 13:27at
- 13:27both
- 13:28ends.
- 13:28The
- 13:28competitive
- 13:29implication
- 13:29is
- 13:30that
- 13:30design
- 13:30tools
- 13:30like
- 13:31Figma
- 13:31now
- 13:31face
- 13:31a
- 13:31challenger
- 13:32that
- 13:32does
- 13:32not
- 13:33just
- 13:33generate
- 13:33mockups
- 13:34but
- 13:34connects
- 13:34them
- 13:34to
- 13:34the
- 13:35execution
- 13:35layer.
- 13:36If
- 13:36a
- 13:36prototype
- 13:37can
- 13:37go
- 13:37from
- 13:37conversation
- 13:38to
- 13:38code
- 13:38handoff
- 13:39without
- 13:39leaving
- 13:39the
- 13:39Anthropic
- 13:40ecosystem,
- 13:41the
- 13:41switching
- 13:41cost
- 13:42for
- 13:42teams
- 13:42already
- 13:42using
- 13:43Claude
- 13:43Code
- 13:43becomes
- 13:44very
- 13:44low.
- 13:45On
- 13:45the
- 13:45monitoring
- 13:46side,
- 13:46abtop
- 13:47is
- 13:47a
- 13:47Rust
- 13:47TUI
- 13:48that
- 13:48does
- 13:48for
- 13:49AI
- 13:49coding
- 13:49sessions
- 13:50what
- 13:50btop
- 13:50does
- 13:50for
- 13:50system
- 13:51processes.
- 13:52It
- 13:52tracks
- 13:52Claude
- 13:53Code
- 13:53and
- 13:53Codex
- 13:54CLI
- 13:54sessions,
- 13:55token
- 13:55consumption,
- 13:56rate
- 13:56limit
- 13:57status,
- 13:57and
- 13:57orphaned
- 13:58ports
- 13:58—
- 13:59the
- 13:59observability
- 14:00layer
- 14:00that
- 14:00agent-heavy
- 14:01workflows
- 14:02have
- 14:02been
- 14:02missing.
- 14:03When
- 14:03your
- 14:03coding
- 14:03agent
- 14:04is
- 14:04consuming
- 14:04tokens
- 14:05at
- 14:05scale,
- 14:05you
- 14:06need
- 14:06something
- 14:06that
- 14:06tells
- 14:06you
- 14:06where
- 14:07the
- 14:07budget
- 14:07is
- 14:07going
- 14:07.
- 14:08CodeFlow
- 14:08provides
- 14:09zero-install
- 14:10codebase
- 14:10architecture
- 14:11visualization
- 14:11—
- 14:12dependency
- 14:12graphs,
- 14:13blast
- 14:14radius
- 14:14analysis,
- 14:15and
- 14:15security
- 14:15scanning
- 14:16from
- 14:16a
- 14:16browser.
- 14:17The
- 14:17value
- 14:18proposition
- 14:18is
- 14:18for
- 14:18teams
- 14:19onboarding
- 14:19to
- 14:19unfamiliar
- 14:20codebases,
- 14:21which
- 14:21is
- 14:21increasingly
- 14:22common
- 14:22when
- 14:22AI-generated
- 14:23code
- 14:23creates
- 14:24repositories
- 14:24faster
- 14:25than
- 14:25humans
- 14:25can
- 14:25read
- 14:26them
- 14:26.
- 14:27Deep
- 14:27Blue
- 14:27Dynamics
- 14:28shipped
- 14:28four
- 14:28self-hostable
- 14:29tools
- 14:30that
- 14:30address
- 14:30the
- 14:30infrastructure
- 14:31dependencies
- 14:31keeping
- 14:32users
- 14:32tied
- 14:32to
- 14:32cloud
- 14:33AI
- 14:33providers.
- 14:34Grub
- 14:34is
- 14:34an
- 14:34open-source
- 14:35web
- 14:35crawler.
- 14:36SHIVVR
- 14:38handles
- 14:39chunking
- 14:39and
- 14:39embedding
- 14:40without
- 14:40requiring
- 14:41local
- 14:41model
- 14:41downloads.
- 14:42Nemesis
- 14:43is
- 14:43a
- 14:43CLI
- 14:44orchestrator
- 14:44for
- 14:44multi-provider
- 14:45AI
- 14:45workloads
- 14:46in
- 14:46sealed
- 14:46Docker
- 14:47containers.
- 14:48Hyperia
- 14:48is
- 14:49an
- 14:49agentic
- 14:49terminal
- 14:49where
- 14:50multiple
- 14:50LLMs
- 14:51drive
- 14:51your
- 14:51machine
- 14:51while
- 14:52you
- 14:52stay
- 14:52in
- 14:52control.
- 14:53All
- 14:53four
- 14:54run
- 14:54in
- 14:54Docker
- 14:54on
- 14:54your
- 14:54own
- 14:55hardware,
- 14:55with
- 14:55Cloud
- 14:56Run
- 14:56as
- 14:56the
- 14:56convenience
- 14:57option
- 14:57rather
- 14:57than
- 14:57the
- 14:57requirement.
- 14:59The
- 14:59pitch
- 14:59is
- 14:59blunt:
- 15:00the
- 15:00AI
- 15:00industry's
- 15:01real
- 15:01product
- 15:01is
- 15:02lock-in,
- 15:02and
- 15:02these
- 15:03tools
- 15:03are
- 15:03the
- 15:03escape
- 15:04hatch
- 15:04.