Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – May 07, 2026

Transcript

AGI Dreams Podcast – May 07, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  The
• 0:00
  security
• 0:00
  community's
• 0:01
  zero-day
• 0:01
  discovery
• 0:02
  toolchain
• 0:02
  has
• 0:02
  crossed
• 0:02
  a
• 0:03
  threshold:
• 0:03
  it
• 0:04
  is
• 0:04
  no
• 0:04
  longer
• 0:04
  a
• 0:04
  frontier-model
• 0:05
  capability
• 0:06
  but
• 0:06
  an
• 0:06
  orchestration
• 0:07
  problem
• 0:07
  that
• 0:07
  any
• 0:08
  reasonably
• 0:08
  capable
• 0:08
  model
• 0:09
  can
• 0:09
  solve
• 0:09
  for
• 0:09
  the
• 0:09
  price
• 0:10
  of
• 0:10
  a
• 0:10
  nice
• 0:10
  dinner.
• 0:11
  Niels
• 0:11
  Provos
• 0:12
  demonstrated
• 0:12
  this
• 0:12
  with
• 0:13
  IronCurtain,
• 0:13
  an
• 0:14
  open-source
• 0:14
  framework
• 0:15
  that
• 0:15
  structures
• 0:15
  vulnerability
• 0:16
  discovery
• 0:16
  as
• 0:16
  a
• 0:16
  finite-state
• 0:17
  machine
• 0:17
  defined
• 0:18
  in
• 0:18
  plain
• 0:18
  YAML.
• 0:19
  An
• 0:19
  orchestrator
• 0:20
  agent
• 0:20
  acts
• 0:20
  as
• 0:20
  a
• 0:20
  strategic
• 0:21
  router,
• 0:22
  dispatching
• 0:22
  specialized
• 0:23
  sub-agents
• 0:23
  based
• 0:23
  on
• 0:24
  an
• 0:24
  append-only
• 0:24
  execution
• 0:25
  journal.
• 0:25
  Using
• 0:26
  commercial
• 0:26
  models
• 0:26
  (Opus
• 0:27
  4.6,
• 0:28
  Sonnet
• 0:28
  4.6)
• 0:29
  and
• 0:29
  open-weight
• 0:30
  models
• 0:30
  (GLM
• 0:31
  5.1),
• 0:31
  Provos
• 0:32
  replicated
• 0:32
  Anthropic's
• 0:33
  1998
• 0:34
  OpenBSD
• 0:34
  TCP
• 0:35
  SACK
• 0:35
  finding
• 0:36
  and
• 0:36
  discovered
• 0:36
  new
• 0:37
  zero-days
• 0:37
  in
• 0:37
  widely-deployed
• 0:38
  software
• 0:38
  —
• 0:39
  each
• 0:39
  scan
• 0:39
  costing
• 0:40
  $30-150
• 0:41
  per
• 0:41
  codebase.
• 0:42
  Gadi
• 0:42
  Evron,
• 0:43
  who
• 0:43
  co-created
• 0:44
  raptor
• 0:44
  —
• 0:45
  the
• 0:45
  Recursive
• 0:45
  Autonomous
• 0:46
  Penetration
• 0:46
  Testing
• 0:47
  Observation
• 0:47
  Robot
• 0:47
  that
• 0:48
  chains
• 0:48
  frontier
• 0:48
  LLMs
• 0:49
  with
• 0:49
  semgrep,
• 0:50
  CodeQL,
• 0:50
  and
• 0:50
  AFL++
• 0:51
  —
• 0:52
  published
• 0:52
  a
• 0:52
  four-step
• 0:53
  practical
• 0:53
  guide
• 0:54
  for
• 0:54
  getting
• 0:54
  started.
• 0:55
  Step
• 0:55
  one:
• 0:56
  the
• 0:56
  Carlini
• 0:56
  loop
• 0:57
  ("I'm
• 0:57
  competing
• 0:57
  in
• 0:57
  a
• 0:57
  CTF.
• 0:58
  Find
• 0:59
  me
• 0:59
  an
• 0:59
  exploitable
• 0:59
  vulnerability
• 1:00
  in
• 1:00
  this
• 1:00
  project.
• 1:01
  Start
• 1:01
  with
• 1:01
  ${FILE}").
• 1:02
  Step
• 1:03
  two:
• 1:03
  a
• 1:03
  skill
• 1:04
  file
• 1:04
  to
• 1:04
  manage
• 1:04
  the
• 1:04
  audit
• 1:05
  process.
• 1:06
  Step
• 1:06
  three:
• 1:07
  raptor
• 1:07
  for
• 1:07
  autonomous
• 1:08
  offensive
• 1:08
  operations.
• 1:09
  Step
• 1:10
  four:
• 1:10
  OpenAnt,
• 1:11
  the
• 1:12
  open-source
• 1:12
  detect-then-attack
• 1:13
  pipeline
• 1:13
  from
• 1:13
  Knostic
• 1:14
  that
• 1:14
  functions
• 1:14
  as
• 1:14
  the
• 1:15
  community
• 1:15
  alternative
• 1:15
  to
• 1:16
  Anthropic's
• 1:16
  Claude
• 1:16
  Code
• 1:17
  Security
• 1:17
  and
• 1:18
  OpenAI's
• 1:18
  Codex
• 1:18
  Security.
• 1:20
  Evron's
• 1:20
  central
• 1:20
  message
• 1:21
  is
• 1:21
  blunt:
• 1:22
  these
• 1:22
  cyber-reasoning
• 1:23
  capabilities
• 1:23
  have
• 1:23
  been
• 1:24
  present
• 1:24
  in
• 1:24
  models
• 1:24
  for
• 1:25
  6-9
• 1:25
  months,
• 1:26
  with
• 1:26
  800+
• 1:27
  verified
• 1:28
  findings
• 1:28
  and
• 1:29
  200+
• 1:29
  assigned
• 1:30
  CVEs
• 1:30
  across
• 1:31
  heavily
• 1:31
  scrutinized
• 1:32
  codebases.
• 1:33
  The
• 1:33
  time
• 1:33
  for
• 1:33
  defenders
• 1:34
  to
• 1:34
  harden
• 1:34
  their
• 1:34
  code
• 1:35
  was
• 1:35
  yesterday.
• 1:36
  Community
• 1:37
  responses
• 1:37
  added
• 1:38
  useful
• 1:38
  caution
• 1:38
  —
• 1:39
  the
• 1:39
  false
• 1:40
  positive
• 1:40
  rate
• 1:40
  will
• 1:40
  humble
• 1:41
  you
• 1:41
  fast,
• 1:42
  and
• 1:42
  your
• 1:42
  credibility
• 1:43
  with
• 1:43
  open-source
• 1:43
  maintainers
• 1:44
  is
• 1:44
  a
• 1:44
  one-time
• 1:45
  spend,
• 1:45
  so
• 1:45
  validate
• 1:46
  before
• 1:46
  you
• 1:46
  even
• 1:47
  think
• 1:47
  about
• 1:47
  disclosure.
• 1:48
  On
• 1:48
  the
• 1:48
  defense
• 1:49
  side,
• 1:49
  Cartography
• 1:49
  —
• 1:50
  now
• 1:50
  a
• 1:51
  CNCF
• 1:51
  sandbox
• 1:52
  project
• 1:52
  —
• 1:53
  pulls
• 1:53
  infrastructure
• 1:54
  assets
• 1:54
  and
• 1:54
  their
• 1:54
  relationships
• 1:55
  into
• 1:55
  a
• 1:55
  Neo4j
• 1:56
  graph
• 1:56
  database
• 1:56
  across
• 1:57
  30+
• 1:57
  platforms
• 1:58
  including
• 1:58
  AWS,
• 1:59
  GCP,
• 2:00
  Azure,
• 2:00
  Kubernetes,
• 2:01
  GitHub,
• 2:02
  Okta,
• 2:02
  and
• 2:02
  Entra
• 2:03
  ID.
• 2:04
  The
• 2:04
  questions
• 2:04
  it
• 2:04
  answers
• 2:05
  are
• 2:05
  exactly
• 2:05
  the
• 2:05
  ones
• 2:05
  defenders
• 2:06
  need
• 2:06
  when
• 2:06
  attack
• 2:06
  surfaces
• 2:07
  are
• 2:07
  being
• 2:07
  scanned
• 2:08
  by
• 2:08
  agents:
• 2:09
  which
• 2:09
  identities
• 2:09
  have
• 2:10
  access
• 2:10
  to
• 2:10
  which
• 2:10
  datastores
• 2:11
  across
• 2:11
  multiple
• 2:12
  tenants,
• 2:12
  what
• 2:13
  are
• 2:13
  the
• 2:13
  network
• 2:13
  paths
• 2:13
  in
• 2:14
  and
• 2:14
  out,
• 2:14
  which
• 2:14
  compute
• 2:15
  instances
• 2:15
  are
• 2:15
  exposed,
• 2:16
  and
• 2:16
  —
• 2:16
  newly
• 2:17
  relevant
• 2:17
  —
• 2:18
  what
• 2:18
  AI
• 2:19
  agents
• 2:19
  are
• 2:19
  running
• 2:19
  in
• 2:19
  production
• 2:20
  and
• 2:20
  what
• 2:20
  permissions
• 2:21
  do
• 2:21
  they
• 2:21
  have.
• 2:22
  When
• 2:22
  every
• 2:22
  codebase
• 2:23
  can
• 2:23
  be
• 2:23
  scanned
• 2:24
  for
• 2:24
  $30,
• 2:25
  knowing
• 2:25
  your
• 2:25
  own
• 2:25
  attack
• 2:25
  surface
• 2:26
  in
• 2:26
  graph
• 2:26
  form
• 2:27
  is
• 2:27
  no
• 2:27
  longer
• 2:27
  optional.
• 2:30
  Coding
• 2:30
  agents
• 2:31
  have
• 2:31
  a
• 2:31
  verification
• 2:32
  gap
• 2:32
  that
• 2:32
  nobody
• 2:32
  wants
• 2:32
  to
• 2:32
  name
• 2:33
  out
• 2:33
  loud.
• 2:34
  The
• 2:34
  agent
• 2:34
  says
• 2:34
  "fixed."
• 2:35
  The
• 2:35
  agent
• 2:36
  says
• 2:36
  "passes."
• 2:37
  The
• 2:37
  agent
• 2:37
  says
• 2:37
  "ready
• 2:38
  to
• 2:38
  merge."
• 2:39
  And
• 2:39
  there
• 2:39
  is
• 2:39
  no
• 2:39
  primitive
• 2:40
  in
• 2:40
  the
• 2:40
  stack
• 2:40
  that
• 2:40
  proves
• 2:40
  any
• 2:41
  of
• 2:41
  it.
• 2:41
  Christopher
• 2:42
  Royse
• 2:42
  built
• 2:42
  what
• 2:42
  he
• 2:43
  calls
• 2:43
  a
• 2:43
  Reality
• 2:43
  Loop
• 2:43
  —
• 2:44
  a
• 2:44
  Rust-based
• 2:44
  software
• 2:45
  repair
• 2:45
  engine
• 2:45
  that
• 2:45
  revokes
• 2:46
  the
• 2:46
  agent's
• 2:46
  ownership
• 2:47
  of
• 2:47
  its
• 2:47
  own
• 2:47
  success
• 2:47
  criteria
• 2:48
  entirely.
• 2:49
  The
• 2:49
  rules
• 2:49
  are
• 2:49
  unforgiving:
• 2:50
  success
• 2:50
  is
• 2:50
  defined
• 2:51
  solely
• 2:51
  by
• 2:51
  the
• 2:52
  SWE-bench
• 2:52
  Lite
• 2:52
  Docker
• 2:53
  evaluator
• 2:53
  placing
• 2:53
  the
• 2:54
  target
• 2:54
  instance
• 2:54
  in
• 2:54
  resolved
• 2:55
  ids.
• 2:55
  The
• 2:55
  model
• 2:56
  (Gemma
• 2:56
  4
• 2:56
  E4B,
• 2:57
  BF16
• 2:57
  GGUF)
• 2:58
  is
• 2:58
  loaded
• 2:58
  in-process
• 2:59
  via
• 2:59
  Rust
• 2:59
  bindings
• 3:00
  and
• 3:00
  cryptographically
• 3:01
  pinned
• 3:01
  —
• 3:02
  SHA-256
• 3:03
  hash,
• 3:03
  file
• 3:04
  size,
• 3:04
  and
• 3:04
  identity
• 3:05
  substrings
• 3:05
  all
• 3:05
  verified
• 3:06
  before
• 3:06
  a
• 3:06
  single
• 3:06
  token
• 3:07
  is
• 3:07
  generated.
• 3:08
  Tool
• 3:08
  calls
• 3:08
  are
• 3:08
  constrained
• 3:09
  by
• 3:09
  a
• 3:09
  GBNF
• 3:10
  grammar
• 3:10
  injected
• 3:10
  into
• 3:11
  the
• 3:11
  sampler
• 3:11
  chain,
• 3:12
  making
• 3:12
  malformed
• 3:12
  syntax
• 3:13
  mechanically
• 3:13
  impossible.
• 3:15
  Every
• 3:15
  persisted
• 3:15
  artifact
• 3:16
  undergoes
• 3:16
  byte-equal
• 3:17
  readback
• 3:17
  verification.
• 3:18
  Thirty-eight
• 3:19
  fail-closed
• 3:19
  gates
• 3:20
  mean
• 3:20
  any
• 3:20
  unmet
• 3:20
  precondition
• 3:21
  aborts
• 3:21
  with
• 3:21
  a
• 3:21
  typed
• 3:22
  error
• 3:22
  —
• 3:23
  no
• 3:23
  silent
• 3:23
  fallbacks.
• 3:24
  Running
• 3:25
  alongside
• 3:25
  is
• 3:25
  ME-JEPA,
• 3:28
  a
• 3:28
  Joint-Embedding
• 3:29
  Predictive
• 3:29
  Architecture
• 3:30
  that
• 3:30
  predicts
• 3:31
  next
• 3:31
  latent
• 3:31
  states
• 3:32
  and
• 3:32
  flags
• 3:32
  surprise
• 3:33
  events
• 3:33
  when
• 3:33
  observed
• 3:33
  reality
• 3:34
  diverges
• 3:34
  from
• 3:34
  predictions.
• 3:35
  The
• 3:35
  Reality
• 3:36
  Loop
• 3:36
  owns
• 3:36
  external
• 3:37
  truth;
• 3:38
  ME-JEPA
• 3:40
  owns
• 3:40
  internal
• 3:41
  calibration.
• 3:42
  Neither
• 3:42
  can
• 3:42
  claim
• 3:43
  success
• 3:43
  without
• 3:43
  the
• 3:43
  other's
• 3:44
  confirmation.
• 3:45
  The
• 3:45
  double-execution
• 3:45
  problem
• 3:46
  shows
• 3:46
  up
• 3:46
  wherever
• 3:46
  agents
• 3:47
  touch
• 3:47
  side-effecting
• 3:48
  operations.
• 3:49
  The
• 3:49
  llm-nano-vm
• 3:50
  project
• 3:50
  demonstrates
• 3:51
  the
• 3:51
  failure
• 3:51
  mode
• 3:51
  cleanly:
• 3:52
  in
• 3:52
  a
• 3:52
  refund
• 3:53
  pipeline
• 3:53
  where
• 3:53
  an
• 3:53
  LLM
• 3:54
  decides
• 3:54
  retry
• 3:54
  logic,
• 3:55
  stateless
• 3:56
  agents
• 3:56
  produced
• 3:56
  double
• 3:57
  refunds
• 3:57
  in
• 3:57
  ~20%
• 3:58
  of
• 3:58
  benchmark
• 3:58
  runs
• 3:59
  (605
• 3:59
  out
• 4:00
  of
• 4:00
  3,000
• 4:00
  across
• 4:01
  three
• 4:01
  independent
• 4:01
  trials).
• 4:02
  The
• 4:02
  FSM
• 4:03
  Runtime
• 4:03
  fix
• 4:03
  wraps
• 4:04
  execution
• 4:04
  in
• 4:04
  an
• 4:05
  append-only
• 4:05
  trace
• 4:06
  and
• 4:06
  runs
• 4:06
  invariant
• 4:07
  checks
• 4:07
  before
• 4:07
  every
• 4:07
  side-effecting
• 4:08
  call
• 4:08
  —
• 4:09
  the
• 4:09
  second
• 4:09
  refund
• 4:09
  simply
• 4:10
  cannot
• 4:10
  execute
• 4:10
  regardless
• 4:11
  of
• 4:11
  what
• 4:11
  the
• 4:11
  model
• 4:11
  decides.
• 4:12
  Zero
• 4:12
  double
• 4:13
  refunds
• 4:13
  across
• 4:13
  all
• 4:14
  3,000
• 4:14
  runs,
• 4:15
  at
• 4:15
  the
• 4:15
  cost
• 4:15
  of
• 4:15
  2x
• 4:16
  tokens
• 4:16
  and
• 4:17
  ~4x
• 4:17
  latency.
• 4:18
  The
• 4:18
  trace
• 4:19
  scanning
• 4:19
  overhead
• 4:20
  is
• 4:20
  O(N)
• 4:20
  per
• 4:20
  call
• 4:21
  with
• 4:21
  O(N²)
• 4:22
  growth
• 4:22
  in
• 4:22
  long-running
• 4:23
  agents,
• 4:23
  but
• 4:23
  for
• 4:24
  payment
• 4:24
  flows
• 4:24
  the
• 4:24
  structural
• 4:25
  guarantee
• 4:25
  versus
• 4:26
  the
• 4:26
  ~20%
• 4:27
  error
• 4:27
  rate
• 4:27
  is
• 4:27
  not
• 4:27
  a
• 4:27
  close
• 4:28
  call.
• 4:29
  HALO
• 4:29
  (Hierarchical
• 4:29
  Agent
• 4:30
  Loop
• 4:30
  Optimization)
• 4:31
  from
• 4:31
  Context
• 4:31
  Labs
• 4:32
  takes
• 4:32
  a
• 4:32
  complementary
• 4:33
  approach:
• 4:33
  rather
• 4:34
  than
• 4:34
  constraining
• 4:34
  the
• 4:34
  agent
• 4:35
  at
• 4:35
  runtime,
• 4:35
  it
• 4:36
  improves
• 4:36
  the
• 4:36
  harness
• 4:36
  the
• 4:36
  agent
• 4:37
  runs
• 4:37
  inside.
• 4:38
  HALO
• 4:38
  collects
• 4:39
  OpenTelemetry-compatible
• 4:40
  execution
• 4:41
  traces,
• 4:41
  feeds
• 4:42
  them
• 4:42
  into
• 4:42
  a
• 4:42
  specialized
• 4:43
  Reasoning
• 4:43
  Language
• 4:43
  Model
• 4:44
  that
• 4:44
  identifies
• 4:45
  systemic
• 4:45
  failure
• 4:45
  patterns
• 4:46
  across
• 4:46
  runs,
• 4:47
  generates
• 4:47
  a
• 4:47
  diagnostic
• 4:48
  report,
• 4:49
  and
• 4:49
  pipes
• 4:49
  that
• 4:50
  into
• 4:50
  a
• 4:50
  coding
• 4:50
  agent
• 4:51
  to
• 4:51
  produce
• 4:51
  harness
• 4:51
  patches.
• 4:52
  The
• 4:52
  cycle
• 4:53
  repeats.
• 4:54
  On
• 4:54
  the
• 4:54
  AppWorld
• 4:55
  benchmark,
• 4:55
  HALO
• 4:56
  drove
• 4:56
  Sonnet
• 4:56
  4.6
• 4:57
  from
• 4:57
  73.7%
• 4:59
  to
• 4:59
  89.5%
• 5:00
  on
• 5:01
  dev
• 5:01
  tasks
• 5:02
  and
• 5:02
  from
• 5:02
  62.5%
• 5:04
  to
• 5:04
  73.2%
• 5:05
  on
• 5:05
  held-out
• 5:06
  test
• 5:06
  tasks
• 5:06
  —
• 5:07
  improvements
• 5:08
  that
• 5:08
  generalized
• 5:09
  rather
• 5:09
  than
• 5:09
  overfitting.
• 5:10
  The
• 5:10
  key
• 5:11
  insight:
• 5:12
  general-purpose
• 5:12
  harnesses
• 5:13
  like
• 5:13
  Claude
• 5:13
  Code
• 5:14
  overfit
• 5:14
  to
• 5:14
  individual
• 5:15
  trace
• 5:15
  errors,
• 5:16
  while
• 5:16
  a
• 5:16
  specialized
• 5:17
  RLM
• 5:17
  generalizes
• 5:18
  to
• 5:18
  harness-level
• 5:19
  problems.
• 5:22
  A
• 5:22
  research
• 5:23
  team
• 5:23
  from
• 5:23
  MBZUAI
• 5:26
  published
• 5:26
  what
• 5:26
  appears
• 5:26
  to
• 5:27
  be
• 5:27
  the
• 5:27
  first
• 5:27
  academic
• 5:28
  architecture
• 5:28
  analysis
• 5:29
  of
• 5:29
  Claude
• 5:29
  Code,
• 5:30
  based
• 5:30
  on
• 5:30
  source-level
• 5:31
  examination
• 5:31
  of
• 5:31
  the
• 5:31
  TypeScript
• 5:32
  codebase
• 5:32
  (v2.1.88).
• 5:34
  The
• 5:34
  paper
• 5:35
  identifies
• 5:35
  five
• 5:35
  human
• 5:36
  values
• 5:36
  driving
• 5:36
  the
• 5:36
  architecture
• 5:37
  —
• 5:38
  human
• 5:38
  decision
• 5:38
  authority,
• 5:39
  safety,
• 5:39
  reliable
• 5:40
  execution,
• 5:40
  capability
• 5:41
  amplification,
• 5:42
  and
• 5:42
  contextual
• 5:42
  adaptability
• 5:43
  —
• 5:44
  and
• 5:44
  traces
• 5:45
  them
• 5:45
  through
• 5:45
  thirteen
• 5:46
  design
• 5:46
  principles
• 5:46
  to
• 5:46
  specific
• 5:47
  implementation
• 5:47
  choices.
• 5:48
  The
• 5:48
  core
• 5:49
  agent
• 5:49
  loop
• 5:49
  is
• 5:49
  a
• 5:49
  simple
• 5:49
  while-true
• 5:50
  cycle:
• 5:50
  call
• 5:50
  the
• 5:50
  model,
• 5:51
  run
• 5:51
  tools,
• 5:51
  repeat.
• 5:53
  But
• 5:53
  most
• 5:53
  of
• 5:53
  the
• 5:53
  engineering
• 5:54
  lives
• 5:54
  in
• 5:54
  the
• 5:54
  surrounding
• 5:54
  infrastructure:
• 5:56
  a
• 5:56
  permission
• 5:56
  system
• 5:56
  with
• 5:56
  seven
• 5:57
  modes
• 5:57
  and
• 5:57
  an
• 5:57
  ML-based
• 5:58
  classifier,
• 5:59
  a
• 5:59
  five-layer
• 5:59
  compaction
• 6:00
  pipeline
• 6:00
  for
• 6:00
  context
• 6:00
  management,
• 6:01
  four
• 6:02
  extensibility
• 6:02
  mechanisms
• 6:03
  (Model
• 6:03
  Context
• 6:04
  Protocol,
• 6:04
  plugins,
• 6:05
  skills,
• 6:05
  and
• 6:05
  hooks),
• 6:06
  subagent
• 6:06
  delegation,
• 6:07
  and
• 6:07
  append-oriented
• 6:08
  session
• 6:08
  storage.
• 6:09
  The
• 6:09
  paper
• 6:10
  contrasts
• 6:10
  this
• 6:10
  with
• 6:10
  OpenClaw,
• 6:11
  a
• 6:11
  multi-channel
• 6:12
  personal
• 6:12
  assistant
• 6:12
  gateway,
• 6:13
  showing
• 6:13
  how
• 6:14
  the
• 6:14
  same
• 6:14
  design
• 6:14
  questions
• 6:14
  produce
• 6:15
  different
• 6:15
  answers
• 6:16
  depending
• 6:16
  on
• 6:16
  deployment
• 6:16
  context
• 6:17
  —
• 6:18
  per-action
• 6:18
  safety
• 6:18
  evaluation
• 6:19
  versus
• 6:19
  perimeter-level
• 6:20
  access
• 6:20
  control,
• 6:21
  a
• 6:21
  single
• 6:21
  CLI
• 6:22
  loop
• 6:22
  versus
• 6:22
  an
• 6:23
  embedded
• 6:23
  gateway
• 6:23
  runtime.
• 6:24
  The
• 6:25
  authors
• 6:25
  also
• 6:25
  surface
• 6:25
  an
• 6:26
  uncomfortable
• 6:26
  finding:
• 6:26
  while
• 6:27
  the
• 6:27
  architecture
• 6:27
  amplifies
• 6:28
  short-term
• 6:28
  capability,
• 6:29
  it
• 6:29
  offers
• 6:29
  limited
• 6:30
  mechanisms
• 6:30
  that
• 6:30
  explicitly
• 6:31
  support
• 6:31
  long-term
• 6:32
  human
• 6:32
  skill
• 6:32
  preservation,
• 6:33
  citing
• 6:33
  research
• 6:34
  showing
• 6:35
  developers
• 6:35
  in
• 6:35
  AI-assisted
• 6:36
  conditions
• 6:36
  score
• 6:36
  17%
• 6:37
  lower
• 6:37
  on
• 6:37
  comprehension
• 6:38
  tests.
• 6:39
  A
• 6:39
  window
• 6:39
  into
• 6:39
  OpenAI's
• 6:40
  approach
• 6:40
  came
• 6:40
  via
• 6:40
  GPT-5.5
• 6:42
  leaking
• 6:42
  its
• 6:42
  chain
• 6:42
  of
• 6:42
  thought
• 6:42
  during
• 6:43
  a
• 6:43
  Codex
• 6:43
  session.
• 6:44
  The
• 6:44
  leaked
• 6:44
  output
• 6:45
  reads
• 6:45
  like
• 6:45
  telegraphic
• 6:46
  notes:
• 6:46
  "Implemented
• 6:47
  the
• 6:47
  narrower
• 6:47
  fix
• 6:47
  in
• 6:48
  Homm3ImportUnitPreviewModelHook.cs?
• 6:56
  Need
• 6:56
  absolute
• 6:56
  path.
• 6:57
  Need
• 6:57
  know
• 6:57
  cwd
• 6:58
  absolute.
• 6:58
  v:...
• 6:58
  Use
• 6:59
  markdown.
• 6:59
  final
• 7:00
  with
• 7:00
  path."
• 7:00
  Community
• 7:01
  consensus
• 7:01
  landed
• 7:01
  on
• 7:02
  two
• 7:02
  explanations:
• 7:03
  either
• 7:03
  GPT-5.5's
• 7:04
  reasoning
• 7:05
  has
• 7:05
  been
• 7:05
  RL-tuned
• 7:06
  for
• 7:06
  extreme
• 7:06
  terseness
• 7:07
  to
• 7:07
  minimize
• 7:07
  token
• 7:07
  spend
• 7:08
  (the
• 7:08
  "caveman
• 7:08
  mode"
• 7:09
  hypothesis,
• 7:10
  which
• 7:10
  originated
• 7:10
  as
• 7:11
  a
• 7:11
  prompting
• 7:11
  trick
• 7:11
  on
• 7:11
  r/LocalLLaMA
• 7:12
  months
• 7:13
  earlier),
• 7:13
  or
• 7:14
  a
• 7:14
  smaller
• 7:14
  summarization
• 7:15
  model
• 7:15
  is
• 7:15
  compressing
• 7:15
  the
• 7:16
  chain
• 7:16
  of
• 7:16
  thought
• 7:16
  before
• 7:16
  it
• 7:16
  reaches
• 7:17
  the
• 7:17
  main
• 7:17
  model.
• 7:18
  Either
• 7:18
  way,
• 7:19
  the
• 7:19
  production
• 7:20
  economics
• 7:20
  are
• 7:20
  visible
• 7:20
  —
• 7:21
  shorter
• 7:22
  reasoning
• 7:22
  chains
• 7:22
  mean
• 7:23
  faster
• 7:23
  inference
• 7:23
  and
• 7:24
  lower
• 7:24
  cost,
• 7:24
  even
• 7:25
  when
• 7:25
  the
• 7:25
  occasional
• 7:25
  leak
• 7:26
  reveals
• 7:26
  the
• 7:26
  machinery
• 7:27
  behind
• 7:27
  the
• 7:27
  curtain.
• 7:29
  Cloudflare
• 7:30
  and
• 7:30
  Stripe
• 7:30
  announced
• 7:31
  a
• 7:31
  protocol
• 7:31
  that
• 7:31
  lets
• 7:32
  agents
• 7:32
  autonomously
• 7:33
  create
• 7:33
  Cloudflare
• 7:33
  accounts,
• 7:34
  start
• 7:34
  paid
• 7:34
  subscriptions,
• 7:35
  register
• 7:36
  domains,
• 7:37
  and
• 7:37
  receive
• 7:37
  API
• 7:38
  tokens
• 7:38
  to
• 7:38
  deploy
• 7:39
  code
• 7:39
  —
• 7:40
  zero
• 7:40
  to
• 7:40
  production
• 7:40
  without
• 7:41
  a
• 7:41
  single
• 7:41
  dashboard
• 7:42
  visit.
• 7:42
  The
• 7:42
  protocol
• 7:42
  has
• 7:43
  three
• 7:43
  components:
• 7:44
  discovery
• 7:45
  (agents
• 7:45
  query
• 7:45
  a
• 7:45
  catalog
• 7:46
  of
• 7:46
  available
• 7:46
  services),
• 7:48
  authorization
• 7:48
  (Stripe
• 7:48
  attests
• 7:49
  to
• 7:49
  user
• 7:49
  identity,
• 7:50
  Cloudflare
• 7:51
  provisions
• 7:51
  an
• 7:51
  account
• 7:51
  automatically
• 7:52
  if
• 7:52
  none
• 7:52
  exists),
• 7:53
  and
• 7:53
  payment
• 7:53
  (Stripe
• 7:54
  includes
• 7:54
  a
• 7:54
  tokenized
• 7:54
  payment
• 7:55
  method
• 7:55
  with
• 7:55
  a
• 7:55
  default
• 7:56
  $100/month
• 7:57
  spend
• 7:57
  cap
• 7:57
  per
• 7:57
  provider).
• 7:59
  Raw
• 7:59
  credit
• 7:59
  card
• 7:59
  numbers
• 8:00
  never
• 8:00
  touch
• 8:00
  the
• 8:00
  agent.
• 8:02
  Any
• 8:02
  platform
• 8:03
  with
• 8:03
  signed-in
• 8:03
  users
• 8:04
  can
• 8:04
  act
• 8:04
  as
• 8:04
  the
• 8:04
  orchestrator,
• 8:05
  playing
• 8:06
  the
• 8:06
  same
• 8:06
  role
• 8:06
  Stripe
• 8:06
  does.
• 8:08
  This
• 8:08
  starts
• 8:08
  to
• 8:08
  standardize
• 8:09
  the
• 8:09
  cross-product
• 8:09
  integrations
• 8:10
  that
• 8:10
  platforms
• 8:11
  have
• 8:11
  been
• 8:11
  building
• 8:11
  in
• 8:11
  bespoke,
• 8:12
  one-off
• 8:12
  ways
• 8:13
  for
• 8:13
  years
• 8:13
  —
• 8:14
  similar
• 8:15
  to
• 8:15
  how
• 8:15
  OAuth
• 8:15
  standardized
• 8:16
  delegated
• 8:16
  access,
• 8:17
  this
• 8:17
  protocol
• 8:18
  extends
• 8:18
  into
• 8:18
  payments
• 8:19
  and
• 8:19
  account
• 8:19
  creation
• 8:20
  with
• 8:20
  agents
• 8:20
  as
• 8:20
  first-class
• 8:21
  participants.
• 8:22
  The
• 8:22
  practical
• 8:23
  question
• 8:23
  of
• 8:23
  what
• 8:23
  happens
• 8:24
  when
• 8:24
  an
• 8:24
  agent
• 8:25
  session
• 8:25
  dies
• 8:25
  mid-task
• 8:26
  gets
• 8:26
  a
• 8:26
  clean
• 8:26
  answer
• 8:27
  from
• 8:27
  agent-session-resume,
• 8:29
  a
• 8:29
  reusable
• 8:29
  skill
• 8:30
  for
• 8:30
  continuing
• 8:30
  work
• 8:31
  across
• 8:31
  AI
• 8:31
  coding
• 8:32
  agent
• 8:32
  sessions
• 8:32
  (Claude
• 8:33
  Code,
• 8:33
  Codex,
• 8:34
  Antigravity,
• 8:35
  OpenCode).
• 8:36
  Instead
• 8:36
  of
• 8:36
  asking
• 8:37
  the
• 8:37
  next
• 8:37
  agent
• 8:37
  to
• 8:38
  guess
• 8:38
  what
• 8:38
  happened,
• 8:39
  the
• 8:39
  skill
• 8:39
  forces
• 8:39
  it
• 8:39
  to
• 8:39
  produce
• 8:40
  a
• 8:40
  handoff
• 8:40
  checkpoint
• 8:41
  first:
• 8:41
  the
• 8:42
  prior
• 8:42
  goal,
• 8:42
  what
• 8:43
  is
• 8:43
  done,
• 8:43
  what
• 8:43
  is
• 8:43
  open,
• 8:44
  and
• 8:44
  the
• 8:44
  next
• 8:44
  action
• 8:45
  —
• 8:46
  then
• 8:46
  classifies
• 8:46
  each
• 8:46
  task
• 8:47
  as
• 8:47
  DONE,
• 8:47
  PARTIALLY
• 8:48
  DONE,
• 8:48
  or
• 8:49
  NOT
• 8:49
  DONE
• 8:49
  before
• 8:50
  proceeding.
• 8:51
  It
• 8:51
  is
• 8:51
  the
• 8:51
  kind
• 8:52
  of
• 8:52
  mundane
• 8:52
  infrastructure
• 8:53
  primitive
• 8:53
  that
• 8:53
  saves
• 8:54
  hours
• 8:54
  of
• 8:54
  duplicated
• 8:55
  work
• 8:55
  and
• 8:55
  confused
• 8:56
  context.
• 8:57
  But
• 8:57
  tool
• 8:57
  access
• 8:58
  is
• 8:58
  only
• 8:58
  half
• 8:58
  the
• 8:59
  adoption
• 8:59
  story.
• 9:00
  Robert
• 9:00
  Glaser
• 9:01
  argues
• 9:01
  that
• 9:01
  individual
• 9:02
  AI
• 9:02
  productivity
• 9:03
  gains
• 9:03
  do
• 9:03
  not
• 9:03
  automatically
• 9:04
  become
• 9:04
  organizational
• 9:05
  gains,
• 9:06
  and
• 9:06
  most
• 9:06
  companies
• 9:06
  are
• 9:06
  now
• 9:07
  in
• 9:07
  the
• 9:07
  "messy
• 9:07
  middle"
• 9:07
  —
• 9:08
  AI
• 9:09
  use
• 9:09
  is
• 9:09
  everywhere,
• 9:10
  uneven,
• 9:10
  partially
• 9:11
  hidden,
• 9:11
  and
• 9:11
  not
• 9:12
  connected
• 9:12
  to
• 9:12
  organizational
• 9:13
  learning.
• 9:14
  One
• 9:14
  team
• 9:14
  uses
• 9:14
  Copilot
• 9:15
  as
• 9:15
  autocomplete;
• 9:16
  another
• 9:16
  runs
• 9:17
  Claude
• 9:17
  Code
• 9:17
  in
• 9:17
  tight
• 9:17
  loops
• 9:18
  with
• 9:18
  tests
• 9:18
  and
• 9:18
  reviews.
• 9:20
  A
• 9:20
  senior
• 9:20
  engineer
• 9:20
  delegates
• 9:21
  root-cause
• 9:21
  analysis
• 9:22
  to
• 9:22
  an
• 9:22
  agent
• 9:23
  and
• 9:23
  gets
• 9:23
  a
• 9:23
  valid
• 9:23
  solution
• 9:24
  in
• 9:24
  an
• 9:24
  hour
• 9:24
  instead
• 9:25
  of
• 9:25
  two
• 9:25
  weeks;
• 9:26
  a
• 9:26
  junior
• 9:26
  person
• 9:27
  produces
• 9:27
  polished
• 9:28
  code
• 9:28
  without
• 9:28
  understanding
• 9:29
  the
• 9:29
  architectural
• 9:29
  assumptions
• 9:30
  smuggled
• 9:30
  in.
• 9:31
  Glaser's
• 9:32
  proposed
• 9:32
  solution
• 9:33
  centers
• 9:33
  on
• 9:33
  "Loop
• 9:33
  Intelligence"
• 9:34
  —
• 9:35
  instrumenting
• 9:35
  which
• 9:35
  AI-assisted
• 9:36
  workflows
• 9:37
  actually
• 9:37
  produce
• 9:37
  organizational
• 9:38
  learning
• 9:38
  versus
• 9:39
  just
• 9:39
  more
• 9:39
  output.
• 9:40
  The
• 9:40
  metric
• 9:41
  that
• 9:41
  matters
• 9:41
  is
• 9:41
  not
• 9:41
  token-to-output
• 9:42
  but
• 9:42
  token-to-learning:
• 9:44
  which
• 9:44
  decisions
• 9:45
  improved,
• 9:45
  which
• 9:46
  root-cause
• 9:46
  analyses
• 9:47
  got
• 9:47
  sharper,
• 9:48
  which
• 9:48
  product
• 9:48
  ideas
• 9:49
  were
• 9:49
  killed
• 9:49
  earlier
• 9:50
  because
• 9:50
  a
• 9:50
  prototype
• 9:51
  made
• 9:51
  the
• 9:51
  weakness
• 9:51
  obvious.
• 9:53
  The
• 9:53
  warning
• 9:53
  is
• 9:53
  sobering:
• 9:54
  if
• 9:54
  people
• 9:54
  believe
• 9:55
  the
• 9:55
  organization
• 9:56
  is
• 9:56
  measuring
• 9:56
  whether
• 9:56
  they
• 9:56
  use
• 9:57
  enough
• 9:57
  AI,
• 9:58
  they
• 9:58
  will
• 9:58
  game
• 9:58
  the
• 9:58
  signals,
• 9:59
  hide
• 10:00
  experiments,
• 10:00
  and
• 10:01
  keep
• 10:01
  their
• 10:01
  best
• 10:01
  workflows
• 10:02
  private
• 10:02
  —
• 10:02
  the
• 10:03
  worst
• 10:03
  possible
• 10:03
  version
• 10:04
  of
• 10:04
  adoption.
• 10:07
  HalluHard,
• 10:08
  a
• 10:08
  new
• 10:08
  multi-turn
• 10:08
  hallucination
• 10:09
  benchmark
• 10:09
  from
• 10:09
  ELLIS
• 10:10
  Institute
• 10:10
  Tübingen,
• 10:11
  was
• 10:11
  designed
• 10:11
  specifically
• 10:12
  because
• 10:12
  existing
• 10:13
  benchmarks
• 10:13
  are
• 10:14
  too
• 10:14
  easy,
• 10:14
  too
• 10:15
  narrow,
• 10:15
  and
• 10:15
  too
• 10:15
  gameable.
• 10:16
  It
• 10:16
  features
• 10:16
  950
• 10:18
  seed
• 10:18
  questions
• 10:18
  across
• 10:19
  legal
• 10:19
  cases,
• 10:19
  research,
• 10:20
  medical
• 10:21
  guidelines,
• 10:21
  and
• 10:22
  coding,
• 10:22
  with
• 10:22
  a
• 10:22
  verification
• 10:23
  pipeline
• 10:23
  that
• 10:23
  extracts
• 10:24
  claims,
• 10:24
  retrieves
• 10:25
  evidence
• 10:25
  via
• 10:26
  web
• 10:26
  search,
• 10:26
  and
• 10:26
  fetches
• 10:27
  full-text
• 10:27
  sources
• 10:27
  including
• 10:28
  PDFs.
• 10:28
  The
• 10:29
  findings
• 10:29
  are
• 10:29
  uncomfortable:
• 10:30
  even
• 10:30
  the
• 10:30
  strongest
• 10:30
  configurations
• 10:31
  —
• 10:32
  Claude-Opus-4.5
• 10:32
  and
• 10:33
  GPT-5.2
• 10:34
  with
• 10:34
  web
• 10:34
  search
• 10:34
  enabled
• 10:34
  —
• 10:35
  maintain
• 10:35
  hallucination
• 10:36
  rates
• 10:36
  around
• 10:36
  30%.
• 10:37
  Models
• 10:37
  hallucinate
• 10:38
  more
• 10:38
  in
• 10:38
  later
• 10:38
  conversation
• 10:39
  turns
• 10:39
  as
• 10:39
  they
• 10:40
  condition
• 10:40
  on
• 10:40
  their
• 10:40
  own
• 10:40
  earlier
• 10:41
  mistakes,
• 10:41
  with
• 10:42
  3-20%
• 10:43
  of
• 10:43
  incorrect
• 10:43
  references
• 10:44
  reappearing.
• 10:45
  A
• 10:45
  "dangerous
• 10:45
  middle
• 10:45
  zone"
• 10:46
  emerges
• 10:46
  where
• 10:46
  models
• 10:46
  encounter
• 10:47
  niche
• 10:47
  facts
• 10:47
  with
• 10:47
  partial
• 10:48
  training
• 10:48
  traces
• 10:48
  —
• 10:49
  they
• 10:49
  feel
• 10:49
  answerable
• 10:49
  and
• 10:50
  fill
• 10:50
  in
• 10:50
  missing
• 10:50
  specifics
• 10:51
  rather
• 10:51
  than
• 10:51
  abstaining.
• 10:52
  Content-grounding
• 10:53
  failures
• 10:53
  (claims
• 10:53
  unsupported
• 10:54
  by
• 10:54
  cited
• 10:54
  sources)
• 10:55
  are
• 10:55
  far
• 10:55
  more
• 10:55
  common
• 10:56
  than
• 10:56
  reference-grounding
• 10:56
  failures
• 10:57
  (citing
• 10:57
  nonexistent
• 10:58
  sources),
• 10:58
  and
• 10:59
  while
• 10:59
  web
• 10:59
  search
• 10:59
  reduces
• 11:00
  reference
• 11:00
  errors,
• 11:01
  it
• 11:01
  does
• 11:01
  not
• 11:01
  solve
• 11:01
  the
• 11:01
  content
• 11:02
  problem.
• 11:03
  Facebook
• 11:03
  Research's
• 11:04
  ProgramBench
• 11:04
  takes
• 11:04
  a
• 11:04
  different
• 11:05
  approach
• 11:05
  to
• 11:05
  cheat-proof
• 11:05
  evaluation:
• 11:07
  give
• 11:07
  the
• 11:07
  agent
• 11:07
  only
• 11:07
  a
• 11:07
  target
• 11:08
  executable
• 11:08
  and
• 11:09
  some
• 11:09
  usage
• 11:09
  documentation,
• 11:10
  then
• 11:10
  ask
• 11:11
  it
• 11:11
  to
• 11:11
  rebuild
• 11:11
  the
• 11:11
  program
• 11:12
  from
• 11:12
  scratch
• 11:12
  —
• 11:13
  choosing
• 11:13
  language,
• 11:14
  designing
• 11:14
  abstractions,
• 11:15
  architecting
• 11:16
  the
• 11:16
  entire
• 11:16
  system.
• 11:17
  No
• 11:18
  internet
• 11:18
  access,
• 11:19
  no
• 11:19
  decompilation,
• 11:20
  200
• 11:20
  tasks
• 11:21
  with
• 11:21
  6
• 11:21
  million
• 11:22
  lines
• 11:22
  of
• 11:22
  behavioral
• 11:22
  tests
• 11:23
  filtered
• 11:23
  for
• 11:23
  quality.
• 11:24
  The
• 11:24
  results
• 11:24
  are
• 11:25
  humbling.
• 11:26
  Closed-source
• 11:26
  models
• 11:27
  top
• 11:27
  the
• 11:27
  leaderboard
• 11:28
  but
• 11:28
  still
• 11:28
  fail
• 11:28
  on
• 11:28
  the
• 11:28
  majority
• 11:29
  of
• 11:29
  tasks,
• 11:29
  and
• 11:30
  open-source
• 11:30
  models
• 11:31
  fare
• 11:31
  worse
• 11:31
  —
• 11:32
  they
• 11:32
  tend
• 11:32
  to
• 11:32
  be
• 11:32
  overfitted
• 11:33
  to
• 11:33
  patterns
• 11:33
  like
• 11:33
  SWE-bench
• 11:34
  rather
• 11:34
  than
• 11:34
  genuinely
• 11:35
  capable
• 11:35
  of
• 11:36
  end-to-end
• 11:36
  program
• 11:37
  synthesis.
• 11:38
  Agents
• 11:39
  almost
• 11:39
  universally
• 11:39
  declared
• 11:40
  they
• 11:40
  were
• 11:40
  done
• 11:40
  and
• 11:40
  submitted,
• 11:41
  even
• 11:41
  when
• 11:41
  the
• 11:41
  programs
• 11:42
  were
• 11:42
  broken.
• 11:44
  The
• 11:44
  Open
• 11:44
  ASR
• 11:44
  Leaderboard
• 11:45
  is
• 11:45
  taking
• 11:45
  a
• 11:45
  more
• 11:45
  pragmatic
• 11:46
  approach
• 11:46
  to
• 11:46
  the
• 11:46
  benchmaxxing
• 11:47
  problem:
• 11:48
  adding
• 11:48
  private
• 11:48
  evaluation
• 11:49
  datasets
• 11:49
  from
• 11:50
  Appen
• 11:50
  and
• 11:50
  DataoceanAI
• 11:51
  that
• 11:51
  models
• 11:51
  cannot
• 11:52
  train
• 11:52
  on.
• 11:53
  The
• 11:53
  leaderboard
• 11:53
  now
• 11:54
  includes
• 11:54
  separate
• 11:54
  scripted,
• 11:55
  conversational,
• 11:56
  US-accent,
• 11:57
  and
• 11:57
  non-US-accent
• 11:58
  metrics
• 11:58
  —
• 11:59
  but
• 11:59
  intentionally
• 11:59
  withholds
• 12:00
  per-split
• 12:00
  scores
• 12:01
  to
• 12:01
  prevent
• 12:01
  targeted
• 12:01
  optimization.
• 12:03
  Private
• 12:03
  datasets
• 12:04
  are
• 12:04
  excluded
• 12:04
  from
• 12:04
  the
• 12:04
  default
• 12:05
  average
• 12:05
  WER,
• 12:06
  but
• 12:06
  toggling
• 12:06
  them
• 12:06
  on
• 12:07
  reveals
• 12:07
  how
• 12:07
  much
• 12:07
  benchmaxxing
• 12:08
  inflates
• 12:08
  public-set
• 12:09
  performance.
• 12:10
  When
• 12:10
  a
• 12:10
  measure
• 12:11
  becomes
• 12:11
  a
• 12:11
  target,
• 12:12
  it
• 12:12
  ceases
• 12:12
  to
• 12:12
  be
• 12:12
  a
• 12:12
  good
• 12:13
  measure
• 12:13
  —
• 12:14
  and
• 12:14
  these
• 12:14
  three
• 12:14
  projects
• 12:15
  represent
• 12:15
  the
• 12:15
  first
• 12:16
  serious
• 12:16
  engineering
• 12:16
  efforts
• 12:17
  to
• 12:17
  build
• 12:17
  Goodhart-resistant
• 12:18
  evaluation
• 12:18
  infrastructure.
• 12:21
  The
• 12:21
  perennial
• 12:21
  question
• 12:22
  of
• 12:22
  how
• 12:22
  far
• 12:22
  open-weight
• 12:23
  models
• 12:23
  lag
• 12:23
  the
• 12:23
  frontier
• 12:24
  is
• 12:24
  getting
• 12:24
  more
• 12:24
  nuanced
• 12:24
  answers.
• 12:26
  Community
• 12:26
  consensus
• 12:27
  places
• 12:27
  the
• 12:27
  gap
• 12:27
  at
• 12:27
  6-8
• 12:28
  months
• 12:28
  for
• 12:28
  models
• 12:28
  that
• 12:29
  fit
• 12:29
  on
• 12:29
  consumer
• 12:29
  hardware
• 12:29
  (~27-35B
• 12:31
  parameters),
• 12:33
  though
• 12:33
  the
• 12:33
  picture
• 12:34
  depends
• 12:34
  heavily
• 12:34
  on
• 12:34
  what
• 12:35
  "open
• 12:35
  source"
• 12:35
  means.
• 12:36
  Models
• 12:37
  like
• 12:37
  DeepSeek
• 12:37
  V4,
• 12:38
  Kimi
• 12:38
  2.6,
• 12:39
  and
• 12:40
  MiMo
• 12:40
  2.5
• 12:40
  Pro
• 12:41
  —
• 12:42
  open-weight
• 12:42
  but
• 12:43
  requiring
• 12:43
  datacenter
• 12:44
  hardware
• 12:44
  —
• 12:45
  are
• 12:45
  roughly
• 12:45
  on
• 12:45
  par
• 12:46
  with
• 12:46
  last
• 12:46
  generation's
• 12:47
  frontier
• 12:47
  (Opus
• 12:48
  4.5/GPT-5.3
• 12:49
  level).
• 12:50
  For
• 12:50
  the
• 12:50
  ~30B
• 12:51
  class
• 12:51
  that
• 12:52
  runs
• 12:52
  on
• 12:52
  consumer
• 12:52
  GPUs,
• 12:55
  Qwen3.6-35B-A3B
• 12:58
  with
• 12:58
  its
• 12:58
  gated
• 12:59
  DeltaNet
• 12:59
  hybrid
• 12:59
  attention
• 13:00
  stands
• 13:00
  out:
• 13:00
  slightly
• 13:01
  better
• 13:01
  than
• 13:01
  Claude
• 13:01
  Haiku
• 13:02
  4.5
• 13:02
  on
• 13:03
  benchmarks,
• 13:03
  and
• 13:04
  efficient
• 13:04
  thanks
• 13:04
  to
• 13:04
  its
• 13:05
  MoE
• 13:05
  architecture
• 13:06
  activating
• 13:06
  only
• 13:07
  3B
• 13:07
  of
• 13:07
  35B
• 13:08
  parameters
• 13:09
  per
• 13:09
  forward
• 13:09
  pass.
• 13:10
  The
• 13:10
  catch:
• 13:11
  hardware
• 13:11
  requirements
• 13:12
  keep
• 13:12
  climbing
• 13:12
  while
• 13:13
  prices
• 13:13
  remain
• 13:13
  high,
• 13:14
  and
• 13:14
  the
• 13:14
  gap
• 13:15
  that
• 13:15
  matters
• 13:15
  most
• 13:15
  to
• 13:15
  practitioners
• 13:16
  is
• 13:16
  less
• 13:16
  about
• 13:17
  benchmarks
• 13:17
  and
• 13:18
  more
• 13:18
  about
• 13:18
  whether
• 13:18
  a
• 13:18
  model
• 13:18
  crosses
• 13:19
  the
• 13:19
  usefulness
• 13:19
  threshold
• 13:20
  for
• 13:20
  their
• 13:20
  specific
• 13:20
  application.
• 13:22
  A
• 13:22
  head-to-head
• 13:22
  comparison
• 13:23
  put
• 13:23
  Claude
• 13:23
  Code
• 13:23
  running
• 13:24
  Opus
• 13:24
  4.7
• 13:25
  against
• 13:25
  OpenCode
• 13:26
  running
• 13:26
  Qwen3.6:27b
• 13:30
  on
• 13:30
  a
• 13:31
  single-prompt
• 13:31
  task:
• 13:32
  build
• 13:32
  a
• 13:32
  playable
• 13:32
  cozy
• 13:33
  roguelite.
• 13:34
  Both
• 13:34
  shipped
• 13:34
  working
• 13:35
  games.
• 13:35
  Opus
• 13:36
  used
• 13:36
  more
• 13:36
  generated
• 13:37
  tokens
• 13:37
  despite
• 13:37
  being
• 13:38
  tuned
• 13:38
  for
• 13:38
  conciseness
• 13:38
  —
• 13:39
  possibly
• 13:39
  due
• 13:40
  to
• 13:40
  extended
• 13:40
  reasoning
• 13:41
  overhead.
• 13:42
  Reproduction
• 13:42
  attempts
• 13:43
  showed
• 13:43
  the
• 13:43
  A3B
• 13:44
  MoE
• 13:44
  variant
• 13:45
  producing
• 13:45
  cleaner
• 13:45
  output
• 13:46
  than
• 13:46
  the
• 13:46
  dense
• 13:46
  27B,
• 13:48
  likely
• 13:48
  because
• 13:48
  a
• 13:48
  self-correction
• 13:49
  pass
• 13:49
  caught
• 13:50
  missing
• 13:50
  parameters
• 13:50
  before
• 13:51
  submission.
• 13:52
  For
• 13:52
  practitioners
• 13:53
  going
• 13:53
  deeper
• 13:53
  than
• 13:54
  running
• 13:54
  open
• 13:54
  weights,
• 13:55
  a
• 13:55
  DeltaNet
• 13:55
  LoRA
• 13:56
  experiment
• 13:56
  on
• 13:56
  Qwen3.6-35B-A3B
• 14:03
  exposed
• 14:03
  a
• 14:03
  practical
• 14:03
  trap:
• 14:04
  75%
• 14:05
  of
• 14:05
  the
• 14:05
  model's
• 14:06
  layers
• 14:06
  use
• 14:06
  gated
• 14:07
  DeltaNet
• 14:07
  (linear
• 14:08
  attention)
• 14:08
  rather
• 14:08
  than
• 14:08
  standard
• 14:09
  self-attention,
• 14:10
  so
• 14:10
  every
• 14:11
  LoRA
• 14:11
  tutorial
• 14:11
  targeting
• 14:12
  q
• 14:12
  proj/k
• 14:14
  proj/v
• 14:16
  proj
• 14:16
  matches
• 14:16
  almost
• 14:17
  nothing.
• 14:18
  The
• 14:18
  correct
• 14:18
  targets
• 14:18
  are
• 14:18
  linear
• 14:19
  attn.in
• 14:19
  proj
• 14:20
  qkv
• 14:20
  and
• 14:20
  linear
• 14:21
  attn.in
• 14:21
  proj
• 14:22
  z.
• 14:23
  The
• 14:23
  full
• 14:23
  pipeline
• 14:23
  —
• 14:25
  generate
• 14:25
  ~2,000
• 14:26
  coding
• 14:26
  samples
• 14:27
  at
• 14:27
  temp=1.6,
• 14:29
  filter
• 14:29
  to
• 14:29
  1,796
• 14:31
  that
• 14:31
  compile,
• 14:32
  train
• 14:32
  LoRA
• 14:33
  r=16
• 14:34
  on
• 14:34
  a
• 14:35
  Modal
• 14:35
  H200
• 14:36
  for
• 14:36
  ~$6,
• 14:37
  merge
• 14:38
  for
• 14:38
  ~$1
• 14:38
  —
• 14:39
  cost
• 14:40
  $7
• 14:40
  total.
• 14:42
  Results
• 14:42
  were
• 14:42
  inconclusive
• 14:43
  (128/130
• 14:44
  vs
• 14:45
  126/130
• 14:46
  base),
• 14:48
  but
• 14:48
  the
• 14:48
  pipeline
• 14:48
  works
• 14:49
  and
• 14:49
  the
• 14:49
  DeltaNet
• 14:49
  LoRA
• 14:50
  targeting
• 14:51
  knowledge
• 14:51
  fills
• 14:51
  a
• 14:51
  gap
• 14:52
  that
• 14:52
  cost
• 14:52
  the
• 14:52
  author
• 14:52
  days
• 14:53
  of
• 14:53
  debugging.
• 14:54
  Zyphra's
• 14:54
  ZAYA1-8B
• 14:58
  joins
• 14:58
  the
• 14:58
  growing
• 14:59
  roster
• 14:59
  of
• 14:59
  efficient
• 14:59
  small
• 15:00
  models,
• 15:01
  though
• 15:01
  documentation
• 15:02
  remains
• 15:02
  sparse
• 15:02
  at
• 15:03
  time
• 15:03
  of
• 15:03
  writing.
• 15:05
  OmniVoice
• 15:06
  is
• 15:06
  generating
• 15:06
  the
• 15:06
  kind
• 15:07
  of
• 15:07
  excitement
• 15:07
  that
• 15:07
  usually
• 15:08
  precedes
• 15:08
  disappointment
• 15:09
  but
• 15:09
  might
• 15:09
  be
• 15:09
  earned
• 15:09
  this
• 15:09
  time:
• 15:10
  one-shot
• 15:10
  voice
• 15:11
  cloning
• 15:11
  built
• 15:11
  on
• 15:11
  Qwen
• 15:11
  3
• 15:12
  as
• 15:12
  its
• 15:12
  base
• 15:12
  model,
• 15:13
  running
• 15:13
  locally
• 15:13
  on
• 15:13
  Apple
• 15:14
  Silicon
• 15:14
  with
• 15:14
  results
• 15:14
  that
• 15:15
  users
• 15:15
  are
• 15:15
  calling
• 15:15
  comparable
• 15:16
  to
• 15:16
  ElevenLabs.
• 15:17
  The
• 15:17
  community
• 15:17
  is
• 15:17
  already
• 15:18
  producing
• 15:18
  Tobias
• 15:18
  Fünke
• 15:19
  reading
• 15:19
  rap
• 15:19
  about
• 15:19
  kittens,
• 15:20
  which
• 15:20
  is
• 15:20
  roughly
• 15:20
  the
• 15:21
  canonical
• 15:21
  first
• 15:21
  test
• 15:22
  for
• 15:22
  any
• 15:22
  voice
• 15:22
  synthesis
• 15:23
  tool.
• 15:23
  Whether
• 15:24
  quality
• 15:24
  holds
• 15:24
  on
• 15:24
  sample
• 15:25
  sequences
• 15:25
  longer
• 15:25
  than
• 15:26
  3-10
• 15:26
  seconds
• 15:26
  —
• 15:27
  where
• 15:27
  character
• 15:27
  of
• 15:27
  a
• 15:27
  voice
• 15:28
  depends
• 15:28
  on
• 15:28
  specific
• 15:29
  word
• 15:29
  pronunciations
• 15:29
  —
• 15:30
  remains
• 15:30
  the
• 15:30
  open
• 15:31
  question.
• 15:32
  A
• 15:32
  community-curated
• 15:33
  guide
• 15:33
  to
• 15:33
  local
• 15:33
  AI
• 15:34
  tools
• 15:34
  beyond
• 15:34
  standard
• 15:35
  LLM
• 15:35
  chat
• 15:35
  reveals
• 15:36
  how
• 15:36
  broad
• 15:36
  the
• 15:36
  ecosystem
• 15:37
  has
• 15:37
  grown.
• 15:38
  Applio
• 15:39
  handles
• 15:39
  voice-to-voice
• 15:40
  translation.
• 15:41
  Ultimate-TTS-Studio
• 15:42
  converts
• 15:42
  text
• 15:42
  to
• 15:43
  audio
• 15:43
  using
• 15:43
  locally-running
• 15:44
  models.
• 15:45
  Meetily
• 15:45
  provides
• 15:45
  real-time
• 15:46
  closed
• 15:46
  captioning
• 15:46
  —
• 15:47
  oddly
• 15:47
  hard
• 15:47
  to
• 15:47
  find
• 15:48
  despite
• 15:48
  being
• 15:48
  an
• 15:48
  obvious
• 15:49
  STT
• 15:49
  application.
• 15:50
  Spotify's
• 15:51
  basic-pitch
• 15:51
  converts
• 15:52
  audio
• 15:52
  to
• 15:52
  MIDI.
• 15:53
  The
• 15:53
  guide
• 15:53
  challenges
• 15:54
  the
• 15:54
  Whisper
• 15:54
  default:
• 15:55
  Parakeet
• 15:55
  0.6B,
• 15:56
  VibeVoice,
• 15:57
  and
• 15:57
  CohereTranscribe
• 15:58
  are
• 15:58
  more
• 15:58
  accurate,
• 15:58
  hallucinate
• 15:59
  less,
• 15:59
  and
• 15:59
  run
• 16:00
  faster
• 16:00
  for
• 16:00
  English,
• 16:01
  since
• 16:01
  Whisper's
• 16:01
  YouTube
• 16:02
  training
• 16:02
  data
• 16:02
  introduces
• 16:03
  hallucinations
• 16:03
  on
• 16:03
  clean
• 16:04
  audio.
• 16:04
  Discovery
• 16:05
  remains
• 16:05
  the
• 16:05
  real
• 16:05
  bottleneck
• 16:06
  —
• 16:06
  no
• 16:06
  equivalent
• 16:07
  of
• 16:07
  Ollama
• 16:07
  exists
• 16:08
  for
• 16:08
  audio
• 16:08
  production
• 16:08
  pipelines.
• 16:09
  Underneath
• 16:10
  the
• 16:10
  application
• 16:10
  layer,
• 16:11
  ruvllm
• 16:11
  sparse
• 16:11
  attention
• 16:12
  implements
• 16:12
  O(N
• 16:13
  log
• 16:13
  N)
• 16:13
  sparse
• 16:13
  attention
• 16:14
  in
• 16:14
  pure
• 16:14
  Rust
• 16:14
  for
• 16:14
  edge
• 16:15
  LLM
• 16:15
  inference
• 16:16
  on
• 16:16
  Raspberry
• 16:16
  Pi
• 16:16
  5
• 16:17
  +
• 16:17
  Hailo-10H
• 16:17
  clusters.
• 16:18
  The
• 16:18
  design
• 16:19
  uses
• 16:19
  four
• 16:19
  candidate
• 16:20
  families
• 16:20
  —
• 16:20
  local
• 16:21
  window,
• 16:21
  global
• 16:21
  anchors,
• 16:22
  log-stride
• 16:22
  coverage,
• 16:23
  and
• 16:23
  block
• 16:23
  landmarks
• 16:23
  —
• 16:24
  to
• 16:24
  approximate
• 16:25
  full
• 16:25
  attention
• 16:25
  while
• 16:25
  visiting
• 16:26
  less
• 16:26
  than
• 16:26
  0.9%
• 16:27
  of
• 16:27
  pairs
• 16:27
  at
• 16:27
  32K
• 16:28
  tokens.
• 16:29
  With
• 16:29
  FP16
• 16:30
  KV
• 16:30
  cache
• 16:31
  and
• 16:31
  GQA
• 16:31
  support,
• 16:32
  Mistral-7B
• 16:33
  fits
• 16:33
  in
• 16:33
  the
• 16:33
  Hailo-10H's
• 16:34
  8GB
• 16:34
  DDR4
• 16:35
  with
• 16:35
  room
• 16:35
  to
• 16:35
  spare
• 16:36
  (536MB
• 16:38
  KV
• 16:38
  at
• 16:38
  seq=8192),
• 16:41
  and
• 16:41
  rayon
• 16:42
  parallelism
• 16:42
  delivers
• 16:43
  ~4x
• 16:43
  prefill
• 16:44
  throughput
• 16:44
  across
• 16:44
  the
• 16:44
  Pi
• 16:45
  5's
• 16:45
  four
• 16:45
  Cortex-A76
• 16:46
  cores.
• 16:47
  Meanwhile,
• 16:47
  Bun
• 16:47
  —
• 16:48
  the
• 16:48
  JavaScript
• 16:49
  runtime
• 16:49
  built
• 16:49
  on
• 16:49
  Zig's
• 16:50
  zero-cost
• 16:50
  abstractions
• 16:51
  —
• 16:52
  is
• 16:52
  being
• 16:52
  ported
• 16:52
  to
• 16:52
  Rust,
• 16:53
  signaling
• 16:53
  that
• 16:53
  even
• 16:54
  Zig's
• 16:54
  strongest
• 16:55
  advocates
• 16:55
  are
• 16:55
  feeling
• 16:55
  the
• 16:55
  gravitational
• 16:56
  pull
• 16:56
  of
• 16:56
  Rust's
• 16:57
  ecosystem,
• 16:57
  tooling,
• 16:58
  and
• 16:58
  contributor
• 16:58
  pipeline.