Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – July 10, 2026

Transcript

AGI Dreams Podcast – July 10, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Binary
• 0:00
  pass/fail
• 0:01
  is
• 0:01
  the
• 0:01
  default
• 0:02
  metric
• 0:02
  for
• 0:02
  evaluating
• 0:03
  whether
• 0:03
  an
• 0:03
  AI
• 0:04
  agent
• 0:04
  got
• 0:04
  compromised
• 0:05
  by
• 0:05
  a
• 0:05
  prompt
• 0:05
  injection:
• 0:06
  the
• 0:06
  attack
• 0:06
  either
• 0:06
  worked
• 0:07
  or
• 0:07
  it
• 0:07
  didn't.
• 0:08
  A
• 0:08
  new
• 0:08
  paper
• 0:08
  from
• 0:08
  a
• 0:08
  team
• 0:09
  evaluating
• 0:09
  the
• 0:09
  AgentDojo
• 0:10
  workspace
• 0:10
  suite
• 0:10
  argues
• 0:11
  this
• 0:11
  single
• 0:11
  bit
• 0:11
  is
• 0:12
  "affirmatively
• 0:12
  misleading."
• 0:13
  They
• 0:13
  introduce
• 0:13
  an
• 0:14
  action-graded
• 0:14
  severity
• 0:15
  scale
• 0:15
  —
• 0:15
  seven
• 0:15
  ordinal
• 0:16
  levels
• 0:16
  (S0
• 0:17
  through
• 0:17
  S6)
• 0:17
  scored
• 0:17
  along
• 0:18
  three
• 0:18
  axes:
• 0:19
  reversibility,
• 0:20
  scope
• 0:20
  (did
• 0:20
  the
• 0:20
  damage
• 0:20
  stay
• 0:21
  local
• 0:21
  or
• 0:21
  reach
• 0:21
  another
• 0:22
  party?),
• 0:22
  and
• 0:23
  privilege
• 0:23
  escalation.
• 0:24
  The
• 0:24
  payoff
• 0:24
  is
• 0:24
  immediate.
• 0:25
  A
• 0:25
  tool-filter
• 0:26
  defense
• 0:26
  against
• 0:27
  GPT-4o
• 0:28
  mini
• 0:28
  reports
• 0:28
  a
• 0:28
  perfect
• 0:29
  0%
• 0:29
  attack-success
• 0:30
  rate
• 0:30
  under
• 0:30
  the
• 0:30
  binary
• 0:31
  metric.
• 0:32
  Under
• 0:32
  severity
• 0:32
  scoring,
• 0:33
  one
• 0:33
  episode
• 0:34
  still
• 0:34
  reaches
• 0:34
  S4
• 0:34
  —
• 0:35
  the
• 0:35
  agent
• 0:36
  routed
• 0:36
  the
• 0:36
  attacker's
• 0:37
  payload
• 0:37
  through
• 0:37
  a
• 0:37
  calendar
• 0:38
  invitation
• 0:38
  instead
• 0:38
  of
• 0:38
  the
• 0:38
  blocked
• 0:39
  email
• 0:39
  tool,
• 0:40
  a
• 0:40
  channel-substitution
• 0:41
  attack
• 0:41
  the
• 0:41
  binary
• 0:41
  check
• 0:42
  never
• 0:42
  watches.
• 0:43
  Even
• 0:43
  more
• 0:43
  uncomfortable:
• 0:44
  the
• 0:44
  spotlighting
• 0:45
  defense
• 0:45
  lowers
• 0:45
  the
• 0:46
  binary
• 0:46
  ASR
• 0:47
  from
• 0:47
  47%
• 0:48
  to
• 0:48
  33%,
• 0:49
  but
• 0:49
  the
• 0:49
  episodes
• 0:50
  it
• 0:50
  fails
• 0:50
  to
• 0:50
  stop
• 0:51
  become
• 0:51
  worse,
• 0:51
  with
• 0:52
  S5
• 0:52
  (privilege
• 0:53
  expansion)
• 0:53
  and
• 0:53
  S6
• 0:54
  (escalation
• 0:54
  chains)
• 0:55
  appearing
• 0:55
  where
• 0:55
  neither
• 0:56
  existed
• 0:56
  before.
• 0:57
  A
• 0:57
  panel
• 0:57
  of
• 0:58
  three
• 0:58
  frontier
• 0:58
  judges
• 0:59
  (GPT-5.5,
• 1:00
  Opus
• 1:01
  4.8,
• 1:02
  Gemini
• 1:02
  3.5
• 1:03
  Flash)
• 1:03
  reproduced
• 1:04
  the
• 1:04
  deterministic
• 1:04
  oracle
• 1:05
  with
• 1:05
  Krippendorff's
• 1:06
  α
• 1:06
  =
• 1:07
  0.82,
• 1:08
  but
• 1:08
  shared
• 1:08
  a
• 1:09
  blind
• 1:09
  spot:
• 1:10
  zero
• 1:10
  of
• 1:10
  them
• 1:10
  recognized
• 1:11
  escalation
• 1:11
  chains,
• 1:12
  scoring
• 1:13
  every
• 1:13
  S6
• 1:13
  as
• 1:14
  S4.
• 1:15
  The
• 1:15
  instrument
• 1:15
  is
• 1:16
  trace-grounded,
• 1:16
  portable,
• 1:17
  and
• 1:17
  cheap
• 1:17
  —
• 1:18
  it
• 1:18
  reads
• 1:18
  logs
• 1:19
  a
• 1:19
  benchmark
• 1:19
  already
• 1:20
  produces
• 1:20
  —
• 1:21
  and
• 1:21
  the
• 1:21
  code,
• 1:22
  prompts,
• 1:22
  and
• 1:22
  per-episode
• 1:23
  data
• 1:23
  are
• 1:23
  all
• 1:23
  released.
• 1:24
  The
• 1:24
  models
• 1:25
  themselves
• 1:25
  remain
• 1:26
  porous.
• 1:27
  Within
• 1:28
  days
• 1:28
  of
• 1:28
  Fable
• 1:28
  5's
• 1:29
  relaunch,
• 1:29
  Pliny
• 1:30
  the
• 1:30
  Liberator
• 1:30
  posted
• 1:30
  a
• 1:31
  thread
• 1:31
  documenting
• 1:32
  successful
• 1:32
  jailbreaks
• 1:33
  across
• 1:33
  cybersecurity,
• 1:34
  chemistry,
• 1:35
  psychological
• 1:35
  manipulation,
• 1:36
  and
• 1:36
  explosives
• 1:37
  domains.
• 1:38
  The
• 1:39
  most
• 1:39
  effective
• 1:39
  technique
• 1:40
  was
• 1:40
  decomposition
• 1:41
  and
• 1:41
  recomposition:
• 1:42
  breaking
• 1:43
  harmful
• 1:43
  knowledge
• 1:43
  into
• 1:44
  benign-looking
• 1:44
  chunks
• 1:45
  —
• 1:46
  individual
• 1:46
  reaction
• 1:47
  pathways
• 1:47
  rather
• 1:47
  than
• 1:48
  "meth
• 1:48
  recipe"
• 1:48
  —
• 1:49
  and
• 1:49
  reassembling
• 1:49
  on
• 1:50
  the
• 1:50
  backend,
• 1:51
  aided
• 1:51
  by
• 1:51
  a
• 1:51
  jailbroken
• 1:52
  Opus
• 1:52
  instance.
• 1:53
  Unicode
• 1:54
  homoglyphs,
• 1:54
  long-context
• 1:55
  reference
• 1:56
  tracking,
• 1:56
  and
• 1:56
  fiction
• 1:57
  framing
• 1:57
  all
• 1:57
  contributed.
• 1:58
  Anthropic's
• 1:59
  classifier-based
• 2:00
  guardrails,
• 2:01
  which
• 2:01
  were
• 2:01
  supposed
• 2:01
  to
• 2:02
  route
• 2:02
  dangerous
• 2:02
  queries
• 2:03
  to
• 2:03
  a
• 2:03
  hardened
• 2:03
  Opus
• 2:04
  path,
• 2:04
  apparently
• 2:05
  did
• 2:05
  not
• 2:05
  survive
• 2:05
  sustained
• 2:06
  multi-agent
• 2:07
  probing.
• 2:08
  Meanwhile,
• 2:08
  a
• 2:08
  Claude
• 2:09
  user
• 2:09
  reported
• 2:09
  receiving
• 2:10
  another
• 2:10
  person's
• 2:11
  chat
• 2:11
  content
• 2:11
  —
• 2:12
  including
• 2:12
  a
• 2:13
  distressing
• 2:13
  message
• 2:13
  fragment
• 2:14
  about
• 2:14
  self-harm
• 2:14
  —
• 2:15
  during
• 2:15
  a
• 2:15
  casual
• 2:16
  conversation
• 2:17
  about
• 2:17
  a
• 2:17
  song.
• 2:17
  Anthropic
• 2:18
  pulled
• 2:18
  the
• 2:18
  shared
• 2:18
  link
• 2:19
  and
• 2:19
  cited
• 2:19
  a
• 2:19
  usage-policy
• 2:20
  violation,
• 2:21
  but
• 2:21
  offered
• 2:21
  no
• 2:22
  explanation.
• 2:23
  Community
• 2:23
  consensus
• 2:24
  settled
• 2:24
  on
• 2:24
  a
• 2:24
  corrupted
• 2:25
  tool-call
• 2:25
  session
• 2:26
  rather
• 2:26
  than
• 2:26
  a
• 2:26
  literal
• 2:27
  cross-user
• 2:27
  data
• 2:28
  leak:
• 2:28
  the
• 2:28
  model
• 2:29
  appears
• 2:29
  to
• 2:29
  have
• 2:29
  surfaced
• 2:30
  a
• 2:30
  safety-protocol
• 2:30
  test
• 2:31
  scenario
• 2:31
  attached
• 2:32
  to
• 2:32
  an
• 2:32
  internal
• 2:32
  tool
• 2:33
  invocation.
• 2:34
  Regardless
• 2:34
  of
• 2:34
  mechanism,
• 2:35
  the
• 2:35
  failure
• 2:35
  mode
• 2:36
  —
• 2:37
  a
• 2:37
  user
• 2:37
  encountering
• 2:37
  alarming
• 2:38
  content
• 2:38
  with
• 2:38
  no
• 2:39
  provenance
• 2:39
  —
• 2:40
  is
• 2:40
  exactly
• 2:40
  the
• 2:40
  kind
• 2:41
  of
• 2:41
  trust-eroding
• 2:41
  incident
• 2:42
  that
• 2:42
  binary
• 2:42
  safety
• 2:43
  metrics
• 2:43
  miss
• 2:43
  entirely.
• 2:45
  Security
• 2:45
  failures
• 2:46
  at
• 2:46
  the
• 2:46
  other
• 2:46
  end
• 2:46
  of
• 2:46
  the
• 2:46
  stack
• 2:46
  are
• 2:47
  just
• 2:47
  as
• 2:47
  sobering.
• 2:48
  RunZero,
• 2:49
  founded
• 2:50
  by
• 2:50
  Metasploit
• 2:51
  creator
• 2:51
  HD
• 2:51
  Moore,
• 2:52
  disclosed
• 2:53
  a
• 2:53
  family
• 2:53
  of
• 2:53
  unpatched
• 2:54
  overflows
• 2:54
  in
• 2:54
  FatFS,
• 2:56
  the
• 2:56
  generic
• 2:56
  FAT/exFAT
• 2:58
  file-system
• 2:59
  library
• 3:00
  embedded
• 3:00
  in
• 3:00
  millions
• 3:00
  of
• 3:00
  microcontrollers.
• 3:02
  The
• 3:02
  bugs
• 3:03
  are
• 3:03
  exploitable
• 3:03
  by
• 3:03
  plugging
• 3:04
  in
• 3:04
  a
• 3:04
  corrupted
• 3:04
  SD
• 3:05
  card
• 3:05
  —
• 3:06
  no
• 3:06
  network
• 3:06
  required.
• 3:07
  An
• 3:07
  overflow
• 3:08
  in
• 3:08
  the
• 3:08
  get
• 3:08
  label
• 3:08
  function
• 3:09
  has
• 3:09
  no
• 3:09
  length
• 3:09
  check
• 3:09
  whatsoever;
• 3:11
  the
• 3:11
  volume
• 3:12
  label
• 3:12
  copies
• 3:12
  directly
• 3:13
  into
• 3:13
  a
• 3:13
  caller-supplied
• 3:14
  buffer
• 3:14
  with
• 3:14
  no
• 3:14
  way
• 3:15
  to
• 3:15
  bound
• 3:15
  it.
• 3:16
  STM32
• 3:17
  devices,
• 3:18
  Flipper
• 3:18
  Zero,
• 3:19
  and
• 3:19
  industrial
• 3:20
  controllers
• 3:20
  in
• 3:20
  water
• 3:21
  treatment
• 3:21
  and
• 3:21
  power
• 3:21
  plants
• 3:22
  all
• 3:22
  use
• 3:22
  this
• 3:22
  code,
• 3:23
  and
• 3:23
  most
• 3:23
  lack
• 3:24
  ASLR
• 3:24
  or
• 3:25
  NX
• 3:25
  protections.
• 3:26
  These
• 3:27
  systems
• 3:27
  rarely
• 3:27
  get
• 3:27
  updated.
• 3:29
  HD
• 3:29
  Moore
• 3:29
  published
• 3:30
  proof-of-concept
• 3:30
  exploits,
• 3:31
  and
• 3:32
  a
• 3:32
  demonstration
• 3:32
  on
• 3:33
  a
• 3:33
  Flipper
• 3:33
  Zero
• 3:34
  crashed
• 3:34
  it
• 3:34
  to
• 3:34
  a
• 3:34
  bus
• 3:35
  fault
• 3:35
  with
• 3:35
  the
• 3:35
  program
• 3:36
  counter
• 3:36
  overwritten
• 3:37
  to
• 3:37
  0x41414141.
• 3:40
  For
• 3:40
  LLM
• 3:40
  traffic
• 3:41
  specifically,
• 3:42
  a
• 3:42
  new
• 3:42
  CLIProxyAPI
• 3:43
  plugin
• 3:43
  called
• 3:43
  cpa-plugin-privacyfilter
• 3:45
  intercepts
• 3:46
  model
• 3:46
  requests
• 3:47
  before
• 3:47
  they
• 3:47
  leave
• 3:47
  the
• 3:47
  local
• 3:47
  process,
• 3:48
  scanning
• 3:49
  for
• 3:49
  API
• 3:49
  keys,
• 3:50
  tokens,
• 3:50
  emails,
• 3:51
  phone
• 3:51
  numbers,
• 3:51
  and
• 3:52
  connection
• 3:52
  strings
• 3:52
  using
• 3:53
  embedded
• 3:53
  Gitleaks
• 3:53
  rules.
• 3:55
  It
• 3:55
  builds
• 3:55
  as
• 3:55
  a
• 3:55
  native
• 3:56
  shared
• 3:56
  library
• 3:56
  and
• 3:56
  handles
• 3:57
  both
• 3:57
  OpenAI-style
• 3:58
  messages
• 3:58
  and
• 3:59
  input
• 3:59
  request
• 3:59
  bodies
• 3:59
  —
• 4:01
  a
• 4:01
  pragmatic,
• 4:02
  on-device
• 4:03
  guard
• 4:03
  against
• 4:03
  the
• 4:03
  accidental
• 4:04
  leakage
• 4:04
  that
• 4:04
  keeps
• 4:04
  security
• 4:05
  teams
• 4:05
  awake.
• 4:08
  Meta
• 4:09
  Superintelligence
• 4:09
  Labs
• 4:10
  shipped
• 4:10
  Muse
• 4:10
  Spark
• 4:11
  1.1,
• 4:12
  a
• 4:12
  significant
• 4:13
  upgrade
• 4:13
  to
• 4:13
  its
• 4:13
  first
• 4:14
  model
• 4:14
  family,
• 4:14
  alongside
• 4:15
  the
• 4:15
  public
• 4:15
  preview
• 4:16
  of
• 4:16
  the
• 4:16
  Meta
• 4:16
  Model
• 4:17
  API.
• 4:17
  The
• 4:18
  model
• 4:18
  is
• 4:18
  built
• 4:18
  for
• 4:18
  agentic
• 4:19
  work:
• 4:19
  it
• 4:20
  zero-shot
• 4:20
  generalizes
• 4:21
  to
• 4:21
  new
• 4:21
  MCP
• 4:22
  servers
• 4:22
  and
• 4:22
  custom
• 4:22
  tools,
• 4:23
  orchestrates
• 4:24
  multi-agent
• 4:24
  systems
• 4:25
  to
• 4:25
  optimize
• 4:25
  end-to-end
• 4:26
  latency,
• 4:27
  and
• 4:27
  actively
• 4:27
  manages
• 4:28
  its
• 4:28
  1M-token
• 4:29
  context
• 4:29
  window
• 4:30
  by
• 4:30
  compacting
• 4:30
  in
• 4:30
  a
• 4:30
  way
• 4:31
  that
• 4:31
  preserves
• 4:31
  critical
• 4:31
  steps.
• 4:33
  Computer
• 4:33
  use
• 4:33
  is
• 4:33
  a
• 4:33
  headline
• 4:34
  capability
• 4:34
  —
• 4:35
  rather
• 4:35
  than
• 4:35
  clicking
• 4:36
  through
• 4:36
  every
• 4:36
  desktop
• 4:37
  step,
• 4:37
  Muse
• 4:37
  Spark
• 4:38
  1.1
• 4:38
  decides
• 4:39
  when
• 4:39
  to
• 4:39
  script
• 4:39
  and
• 4:39
  when
• 4:40
  to
• 4:40
  interact
• 4:40
  directly,
• 4:41
  generating
• 4:41
  batches
• 4:42
  of
• 4:42
  actions
• 4:42
  per
• 4:42
  step.
• 4:43
  Coding
• 4:44
  performance
• 4:44
  on
• 4:44
  Meta's
• 4:44
  internal
• 4:45
  bench
• 4:45
  "significantly
• 4:46
  improves
• 4:46
  upon
• 4:47
  Muse
• 4:47
  Spark"
• 4:47
  and
• 4:48
  is
• 4:48
  "competitive
• 4:48
  with
• 4:49
  leading
• 4:49
  alternatives,"
• 4:50
  per
• 4:50
  the
• 4:50
  announcement.
• 4:51
  Replit's
• 4:51
  CEO
• 4:52
  called
• 4:52
  it
• 4:52
  "a
• 4:52
  complete
• 4:53
  agentic
• 4:53
  foundation,"
• 4:54
  and
• 4:55
  Cline's
• 4:55
  CEO
• 4:55
  noted
• 4:56
  the
• 4:56
  combination
• 4:56
  of
• 4:56
  strong
• 4:57
  tool
• 4:57
  use
• 4:58
  at
• 4:58
  a
• 4:58
  viable
• 4:58
  price
• 4:58
  point
• 4:59
  for
• 4:59
  real
• 4:59
  coding
• 4:59
  workloads
• 5:00
  at
• 5:00
  scale.
• 5:01
  The
• 5:01
  safety
• 5:01
  report
• 5:02
  documents
• 5:02
  resistance
• 5:03
  to
• 5:03
  both
• 5:03
  direct
• 5:03
  jailbreaks
• 5:04
  and
• 5:04
  indirect
• 5:04
  prompt
• 5:05
  injection
• 5:05
  from
• 5:05
  untrusted
• 5:06
  data.
• 5:07
  The
• 5:07
  community,
• 5:08
  meanwhile,
• 5:08
  is
• 5:08
  bracing
• 5:09
  for
• 5:09
  GPT-5.6
• 5:10
  SOL's
• 5:11
  reported
• 5:11
  Thursday
• 5:12
  release.
• 5:13
  Reddit
• 5:13
  discussion
• 5:14
  in
• 5:14
  r/Anthropic
• 5:15
  shows
• 5:15
  pragmatic
• 5:16
  loyalty:
• 5:16
  "I
• 5:16
  have
• 5:17
  no
• 5:17
  allegiance
• 5:17
  to
• 5:17
  AI
• 5:18
  companies.
• 5:18
  If
• 5:18
  5.6
• 5:19
  is
• 5:19
  better,
• 5:20
  I
• 5:20
  will
• 5:20
  switch."
• 5:21
  But
• 5:21
  the
• 5:21
  evidence
• 5:21
  is
• 5:22
  thin
• 5:22
  —
• 5:23
  OpenAI
• 5:23
  has
• 5:23
  reportedly
• 5:24
  claimed
• 5:24
  superiority
• 5:25
  on
• 5:25
  exactly
• 5:25
  one
• 5:26
  benchmark.
• 5:26
  The
• 5:27
  real
• 5:27
  pressure
• 5:27
  on
• 5:27
  Anthropic
• 5:28
  comes
• 5:28
  from
• 5:28
  pricing:
• 5:29
  users
• 5:29
  note
• 5:29
  that
• 5:29
  Fable
• 5:30
  5's
• 5:30
  API
• 5:30
  costs
• 5:31
  ate
• 5:31
  through
• 5:31
  $100
• 5:32
  in
• 5:32
  under
• 5:32
  30
• 5:32
  minutes
• 5:33
  during
• 5:33
  a
• 5:33
  loop,
• 5:33
  and
• 5:34
  without
• 5:34
  subscription
• 5:34
  inclusion,
• 5:35
  many
• 5:35
  plan
• 5:35
  to
• 5:35
  default
• 5:36
  to
• 5:36
  whatever
• 5:36
  Opus
• 5:36
  offers.
• 5:37
  The
• 5:37
  consensus
• 5:38
  reads
• 5:38
  less
• 5:38
  as
• 5:38
  a
• 5:38
  model
• 5:38
  horse-race
• 5:39
  and
• 5:39
  more
• 5:40
  as
• 5:40
  a
• 5:40
  pricing-and-access
• 5:40
  standoff
• 5:41
  where
• 5:41
  the
• 5:41
  second-best
• 5:42
  model
• 5:42
  at
• 5:42
  a
• 5:42
  quarter
• 5:42
  of
• 5:43
  the
• 5:43
  cost
• 5:43
  wins
• 5:43
  the
• 5:43
  daily
• 5:44
  driver
• 5:44
  slot.
• 5:44
  Then
• 5:45
  there
• 5:45
  is
• 5:45
  the
• 5:45
  subscription-arbitrage
• 5:46
  game.
• 5:47
  M365Bridge
• 5:48
  is
• 5:48
  a
• 5:48
  Go
• 5:49
  tool
• 5:49
  that
• 5:49
  converts
• 5:49
  Microsoft
• 5:50
  365
• 5:51
  Copilot's
• 5:51
  internal
• 5:52
  WebSocket
• 5:52
  (SignalR)
• 5:53
  interface
• 5:53
  into
• 5:53
  OpenAI-
• 5:54
  and
• 5:54
  Anthropic-compatible
• 5:55
  HTTP
• 5:55
  endpoints.
• 5:56
  It
• 5:57
  supports
• 5:57
  GPT-5.5,
• 5:58
  GPT-5.5-reasoning,
• 6:00
  Claude
• 6:00
  Sonnet
• 6:00
  4.6,
• 6:01
  and
• 6:01
  Claude
• 6:01
  Opus
• 6:02
  4.6
• 6:02
  —
• 6:03
  all
• 6:03
  routed
• 6:04
  through
• 6:04
  a
• 6:04
  single
• 6:04
  M365
• 6:05
  Copilot
• 6:06
  license
• 6:06
  via
• 6:06
  tone-field
• 6:07
  selection.
• 6:08
  Tool
• 6:08
  calling
• 6:09
  is
• 6:09
  simulated:
• 6:10
  the
• 6:10
  proxy
• 6:10
  embeds
• 6:11
  the
• 6:11
  full
• 6:11
  request
• 6:11
  JSON
• 6:12
  into
• 6:12
  the
• 6:12
  prompt
• 6:12
  and
• 6:12
  parses
• 6:13
  the
• 6:13
  model's
• 6:13
  response
• 6:14
  for
• 6:14
  tool-call
• 6:14
  blocks.
• 6:15
  Tokens
• 6:16
  are
• 6:16
  encrypted
• 6:16
  with
• 6:17
  AES-256-GCM,
• 6:20
  and
• 6:21
  SSO
• 6:21
  cookies
• 6:21
  enable
• 6:22
  automatic
• 6:22
  renewal
• 6:22
  past
• 6:23
  the
• 6:23
  24-hour
• 6:23
  SPA
• 6:24
  token
• 6:24
  limit.
• 6:25
  It
• 6:25
  even
• 6:25
  implements
• 6:26
  the
• 6:26
  OpenAI
• 6:26
  Responses
• 6:27
  Compact
• 6:27
  API
• 6:28
  for
• 6:28
  Codex
• 6:28
  remote
• 6:29
  compaction.
• 6:30
  The
• 6:30
  project
• 6:30
  labels
• 6:31
  itself
• 6:31
  "research
• 6:32
  only,"
• 6:33
  but
• 6:33
  the
• 6:33
  feature
• 6:33
  set
• 6:34
  —
• 6:35
  image
• 6:35
  generation,
• 6:36
  session
• 6:36
  isolation,
• 6:37
  streaming
• 6:38
  SSE
• 6:38
  —
• 6:39
  suggests
• 6:40
  ambitions
• 6:40
  well
• 6:40
  beyond
• 6:41
  a
• 6:41
  weekend
• 6:41
  experiment.
• 6:44
  Mitchell
• 6:44
  Hashimoto
• 6:45
  —
• 6:45
  co-founder
• 6:46
  of
• 6:46
  HashiCorp,
• 6:47
  creator
• 6:47
  of
• 6:47
  Ghostty
• 6:47
  —
• 6:48
  spent
• 6:48
  days
• 6:49
  testing
• 6:49
  Fable
• 6:49
  5
• 6:50
  against
• 6:50
  cheaper
• 6:50
  models
• 6:51
  on
• 6:51
  routine
• 6:51
  coding
• 6:51
  tasks.
• 6:53
  A
• 6:53
  budget
• 6:53
  model
• 6:53
  finished
• 6:54
  identical
• 6:54
  work
• 6:54
  for
• 6:55
  under
• 6:55
  a
• 6:55
  dollar.
• 6:56
  GPT-5.5
• 6:57
  cost
• 6:57
  about
• 6:58
  $1.50.
• 7:00
  Fable
• 7:00
  5
• 7:00
  cost
• 7:00
  $9
• 7:01
  and
• 7:01
  took
• 7:01
  40
• 7:02
  minutes.
• 7:02
  Same
• 7:03
  quality,
• 7:03
  same
• 7:03
  outcome.
• 7:04
  The
• 7:04
  hot
• 7:05
  take
• 7:05
  writes
• 7:05
  itself:
• 7:06
  route
• 7:06
  everything
• 7:06
  to
• 7:06
  cheap
• 7:07
  models.
• 7:07
  But
• 7:08
  Hashimoto
• 7:08
  ran
• 7:08
  one
• 7:09
  more
• 7:09
  test.
• 7:10
  He
• 7:10
  pointed
• 7:10
  Fable
• 7:10
  5
• 7:11
  at
• 7:11
  a
• 7:11
  gnarly
• 7:11
  systems-code
• 7:12
  optimization
• 7:12
  he
• 7:12
  had
• 7:13
  written
• 7:13
  himself
• 7:13
  —
• 7:14
  a
• 7:14
  problem
• 7:14
  no
• 7:14
  PM
• 7:15
  had
• 7:15
  prioritized
• 7:15
  and
• 7:15
  no
• 7:16
  backlog
• 7:16
  contained.
• 7:17
  Two
• 7:17
  hours
• 7:18
  and
• 7:18
  $40
• 7:18
  later,
• 7:19
  the
• 7:19
  model
• 7:20
  reached
• 7:20
  a
• 7:20
  performance
• 7:20
  level
• 7:21
  he
• 7:21
  says
• 7:21
  he
• 7:21
  could
• 7:21
  not
• 7:21
  have
• 7:22
  hit
• 7:22
  on
• 7:22
  his
• 7:22
  own.
• 7:23
  Nobody
• 7:23
  else
• 7:23
  was
• 7:24
  working
• 7:24
  on
• 7:24
  that
• 7:24
  problem
• 7:24
  because
• 7:25
  nobody
• 7:25
  else
• 7:25
  had
• 7:25
  imagined
• 7:26
  it.
• 7:26
  The
• 7:26
  lesson
• 7:27
  is
• 7:27
  structural:
• 7:28
  as
• 7:28
  execution
• 7:29
  commoditizes,
• 7:30
  value
• 7:30
  migrates
• 7:31
  to
• 7:31
  the
• 7:31
  imagination
• 7:32
  that
• 7:32
  decides
• 7:32
  what
• 7:32
  to
• 7:32
  execute.
• 7:34
  Cheap
• 7:34
  models
• 7:34
  multiply
• 7:35
  known
• 7:35
  work.
• 7:36
  Frontier
• 7:36
  models
• 7:37
  multiply
• 7:37
  the
• 7:37
  unknown
• 7:37
  —
• 7:38
  but
• 7:38
  only
• 7:39
  for
• 7:39
  people
• 7:39
  who
• 7:39
  know
• 7:39
  enough
• 7:40
  to
• 7:40
  ask
• 7:40
  the
• 7:40
  right
• 7:40
  question.
• 7:42
  Turning
• 7:42
  imagination
• 7:42
  into
• 7:43
  throughput
• 7:43
  requires
• 7:43
  infrastructure.
• 7:45
  A
• 7:45
  detailed
• 7:45
  guide
• 7:46
  to
• 7:46
  headless
• 7:46
  agent
• 7:46
  fleets
• 7:47
  distills
• 7:47
  hard-won
• 7:48
  operational
• 7:48
  knowledge:
• 7:49
  scaffold
• 7:49
  every
• 7:50
  repo
• 7:50
  around
• 7:50
  documentation
• 7:51
  first
• 7:51
  (for
• 7:52
  agents,
• 7:52
  "docs
• 7:53
  are
• 7:53
  literally
• 7:53
  the
• 7:54
  code"),
• 7:54
  write
• 7:55
  one
• 7:55
  plan
• 7:55
  file
• 7:56
  as
• 7:56
  ground
• 7:56
  truth
• 7:56
  workers
• 7:57
  reload
• 7:57
  every
• 7:57
  iteration,
• 7:58
  then
• 7:58
  decompose
• 7:59
  into
• 7:59
  tasks
• 8:00
  with
• 8:00
  command-verifiable
• 8:01
  acceptance
• 8:01
  criteria.
• 8:02
  Oversized
• 8:03
  tasks
• 8:03
  were
• 8:03
  the
• 8:03
  top
• 8:04
  cause
• 8:04
  of
• 8:04
  worker
• 8:04
  timeouts
• 8:04
  —
• 8:05
  roughly
• 8:06
  a
• 8:06
  fifth
• 8:06
  had
• 8:06
  escalations
• 8:07
  before
• 8:07
  the
• 8:07
  author
• 8:07
  learned
• 8:07
  to
• 8:08
  split
• 8:08
  anything
• 8:08
  with
• 8:08
  mixed
• 8:08
  concerns.
• 8:10
  The
• 8:10
  dispatch
• 8:10
  loop
• 8:10
  is
• 8:11
  deliberately
• 8:11
  boring:
• 8:12
  claim,
• 8:12
  execute,
• 8:13
  verify
• 8:14
  a
• 8:14
  commit
• 8:14
  exists,
• 8:15
  close
• 8:15
  or
• 8:15
  release.
• 8:17
  Three
• 8:17
  rules
• 8:17
  emerged
• 8:18
  from
• 8:18
  incidents:
• 8:19
  "list
• 8:19
  then
• 8:19
  claim"
• 8:20
  is
• 8:20
  a
• 8:20
  race
• 8:20
  condition
• 8:21
  at
• 8:21
  scale
• 8:21
  (four
• 8:21
  workers
• 8:22
  claimed
• 8:22
  the
• 8:22
  same
• 8:22
  task
• 8:23
  simultaneously
• 8:23
  under
• 8:23
  label-based
• 8:24
  locking);
• 8:25
  workers
• 8:25
  on
• 8:25
  the
• 8:26
  same
• 8:26
  repo
• 8:26
  share
• 8:26
  a
• 8:26
  working
• 8:27
  tree
• 8:27
  (two
• 8:27
  agents
• 8:27
  with
• 8:28
  uncommitted
• 8:28
  state
• 8:29
  collide
• 8:29
  in
• 8:29
  ways
• 8:29
  that
• 8:30
  look
• 8:30
  like
• 8:30
  model
• 8:30
  stupidity);
• 8:31
  and
• 8:31
  the
• 8:32
  agent,
• 8:32
  not
• 8:32
  the
• 8:33
  orchestrator,
• 8:33
  should
• 8:34
  close
• 8:34
  its
• 8:34
  own
• 8:34
  task
• 8:35
  against
• 8:35
  acceptance
• 8:35
  criteria.
• 8:37
  Cost
• 8:37
  routing
• 8:37
  matters:
• 8:38
  cheap
• 8:38
  models
• 8:39
  by
• 8:39
  default,
• 8:40
  frontier
• 8:40
  models
• 8:40
  for
• 8:41
  failures
• 8:41
  and
• 8:41
  gnarly
• 8:42
  tasks.
• 8:43
  Koder
• 8:44
  is
• 8:44
  a
• 8:44
  browser-based
• 8:44
  coding
• 8:45
  and
• 8:45
  computer-use
• 8:46
  harness
• 8:46
  written
• 8:46
  in
• 8:46
  Go
• 8:46
  —
• 8:47
  a
• 8:47
  single
• 8:48
  binary
• 8:48
  supporting
• 8:49
  MCP,
• 8:49
  visual
• 8:50
  models,
• 8:50
  thinking
• 8:51
  compression,
• 8:51
  and
• 8:52
  milestone-to-chat
• 8:52
  orchestration.
• 8:54
  Its
• 8:54
  author
• 8:54
  tuned
• 8:54
  it
• 8:54
  specifically
• 8:55
  for
• 8:55
  Qwen
• 8:55
  3.6
• 8:56
  27B
• 8:57
  Q8
• 8:57
  on
• 8:58
  llama.cpp
• 8:59
  and
• 8:59
  reports
• 9:00
  it
• 9:00
  "absolutely
• 9:01
  rock
• 9:01
  solid"
• 9:02
  for
• 9:02
  Linux-local
• 9:02
  workflows,
• 9:03
  noting
• 9:03
  that
• 9:04
  he
• 9:04
  built
• 9:04
  it
• 9:04
  with
• 9:04
  Codex
• 9:05
  but
• 9:05
  increasingly
• 9:05
  moves
• 9:06
  work
• 9:06
  to
• 9:06
  the
• 9:06
  local
• 9:06
  side.
• 9:07
  A
• 9:07
  complementary
• 9:08
  approach
• 9:08
  gives
• 9:08
  small
• 9:09
  models
• 9:09
  scoped
• 9:09
  "application"
• 9:10
  views
• 9:10
  —
• 9:11
  a
• 9:11
  text-only
• 9:12
  web
• 9:12
  browser
• 9:12
  and
• 9:12
  a
• 9:12
  computer-control
• 9:13
  interface
• 9:13
  —
• 9:14
  that
• 9:14
  replace
• 9:15
  20+
• 9:15
  tools
• 9:16
  with
• 9:16
  simple
• 9:16
  verb-and-number
• 9:17
  navigation
• 9:17
  menus.
• 9:18
  Running
• 9:19
  on
• 9:19
  a
• 9:19
  Gemma
• 9:19
  4
• 9:19
  E4B
• 9:20
  (the
• 9:20
  smaller
• 9:20
  variant),
• 9:21
  the
• 9:21
  system
• 9:22
  performed
• 9:22
  better
• 9:22
  than
• 9:22
  the
• 9:23
  26B
• 9:23
  version,
• 9:24
  likely
• 9:24
  because
• 9:25
  the
• 9:25
  tighter
• 9:25
  context
• 9:26
  prevents
• 9:26
  the
• 9:26
  larger
• 9:26
  model's
• 9:27
  tendency
• 9:27
  to
• 9:28
  ignore
• 9:28
  planning
• 9:28
  tools.
• 9:29
  The
• 9:29
  key
• 9:30
  insight:
• 9:30
  agents
• 9:31
  carry
• 9:31
  limited
• 9:31
  toolsets
• 9:32
  and
• 9:32
  minimal
• 9:32
  context
• 9:33
  into
• 9:33
  these
• 9:33
  scoped
• 9:33
  views,
• 9:34
  then
• 9:34
  get
• 9:34
  full
• 9:35
  context
• 9:35
  back
• 9:35
  on
• 9:35
  exit.
• 9:39
  A
• 9:39
  practitioner
• 9:40
  benchmarked
• 9:40
  13
• 9:41
  models
• 9:41
  (5
• 9:41
  dense,
• 9:42
  6
• 9:42
  MoE,
• 9:43
  1
• 9:43
  Mamba2
• 9:43
  hybrid,
• 9:44
  1
• 9:44
  MLA)
• 9:44
  from
• 9:45
  512
• 9:46
  to
• 9:46
  131K
• 9:47
  context
• 9:47
  on
• 9:48
  an
• 9:48
  RX
• 9:48
  7900
• 9:49
  XT
• 9:49
  20GB
• 9:50
  and
• 9:50
  surfaced
• 9:51
  findings
• 9:51
  that
• 9:51
  challenge
• 9:52
  conventional
• 9:52
  wisdom
• 9:53
  about
• 9:53
  local
• 9:53
  inference.
• 9:54
  At
• 9:54
  65K+
• 9:55
  context
• 9:56
  with
• 9:56
  300-token
• 9:56
  outputs
• 9:57
  —
• 9:57
  a
• 9:57
  typical
• 9:58
  agentic
• 9:58
  tool
• 9:58
  call
• 9:59
  —
• 9:59
  prefill
• 10:00
  consumed
• 10:00
  94–99%
• 10:02
  of
• 10:02
  wall-clock
• 10:03
  time.
• 10:04
  Token
• 10:05
  generation
• 10:05
  speed
• 10:05
  (tg128),
• 10:07
  the
• 10:07
  metric
• 10:08
  everyone
• 10:08
  obsesses
• 10:08
  over,
• 10:09
  was
• 10:09
  essentially
• 10:09
  irrelevant.
• 10:11
  The
• 10:11
  dominant
• 10:11
  architectural
• 10:12
  factor
• 10:12
  for
• 10:12
  long-context
• 10:13
  prefill
• 10:13
  was
• 10:13
  not
• 10:13
  parameter
• 10:14
  count
• 10:14
  or
• 10:15
  MoE-vs-dense
• 10:15
  architecture
• 10:16
  but
• 10:16
  KV
• 10:17
  head
• 10:17
  count:
• 10:18
  Ornith-9B
• 10:19
  (4
• 10:19
  KV
• 10:20
  heads,
• 10:20
  64
• 10:20
  KB/token
• 10:21
  KV)
• 10:21
  was
• 10:21
  4.4x
• 10:22
  faster
• 10:23
  at
• 10:23
  128K
• 10:23
  context
• 10:24
  than
• 10:24
  Apriel-15B
• 10:24
  (8
• 10:25
  KV
• 10:25
  heads,
• 10:26
  160
• 10:27
  KB/token)
• 10:27
  despite
• 10:28
  being
• 10:28
  half
• 10:28
  the
• 10:28
  parameter
• 10:29
  size.
• 10:30
  And
• 10:30
  in
• 10:30
  a
• 10:30
  counterintuitive
• 10:31
  twist,
• 10:31
  F16
• 10:31
  KV
• 10:32
  cache
• 10:32
  was
• 10:32
  faster
• 10:33
  than
• 10:33
  quantized
• 10:33
  KV
• 10:34
  (Q8/Q4)
• 10:35
  for
• 10:35
  MoE
• 10:36
  and
• 10:36
  small
• 10:36
  dense
• 10:36
  models
• 10:36
  —
• 10:37
  the
• 10:37
  dequantization
• 10:38
  compute
• 10:38
  at
• 10:38
  65K
• 10:39
  context
• 10:39
  exceeded
• 10:40
  the
• 10:40
  bandwidth
• 10:40
  saved
• 10:41
  by
• 10:41
  halving
• 10:41
  the
• 10:41
  cache.
• 10:42
  MoE
• 10:42
  models
• 10:43
  won
• 10:43
  the
• 10:43
  speed-times-intelligence
• 10:44
  composite
• 10:44
  for
• 10:45
  agentic
• 10:45
  work,
• 10:45
  with
• 10:45
  Qwen3.6-35B-A3B
• 10:50
  delivering
• 10:50
  87%
• 10:51
  of
• 10:51
  the
• 10:51
  top
• 10:51
  dense
• 10:51
  model's
• 10:51
  intelligence
• 10:52
  at
• 10:52
  3x
• 10:52
  the
• 10:52
  speed.
• 10:54
  IBM's
• 10:55
  Granite-4.0-H-Small
• 10:55
  (Mamba2
• 10:56
  hybrid)
• 10:57
  retained
• 10:57
  69%
• 10:58
  of
• 10:58
  its
• 10:58
  pp4K
• 10:58
  speed
• 10:59
  at
• 10:59
  131K
• 10:59
  —
• 11:00
  every
• 11:01
  transformer
• 11:01
  dropped
• 11:01
  below
• 11:02
  42%.
• 11:04
  These
• 11:04
  findings
• 11:04
  have
• 11:04
  immediate
• 11:05
  practical
• 11:05
  implications.
• 11:06
  DeepSeek
• 11:07
  V4
• 11:07
  Flash
• 11:07
  is
• 11:07
  now
• 11:08
  running
• 11:08
  on
• 11:08
  a
• 11:08
  single
• 11:08
  RTX
• 11:09
  5090
• 11:10
  at
• 11:10
  21
• 11:10
  tokens/second
• 11:11
  via
• 11:11
  a
• 11:11
  Q2
• 11:11
  K
• 11:12
  quantization
• 11:12
  and
• 11:13
  a
• 11:13
  specialized
• 11:13
  llama.cpp
• 11:14
  fork,
• 11:15
  with
• 11:15
  a
• 11:15
  million-token
• 11:16
  context
• 11:16
  window
• 11:17
  that
• 11:17
  actually
• 11:17
  fits.
• 11:18
  The
• 11:18
  setup
• 11:18
  —
• 11:19
  Ryzen
• 11:19
  9
• 11:21
  9900X3D,
• 11:22
  128GB
• 11:23
  DDR5,
• 11:25
  and
• 11:25
  the
• 11:26
  --no-mmap
• 11:26
  flag
• 11:26
  —
• 11:27
  demonstrates
• 11:27
  that
• 11:27
  consumer
• 11:28
  hardware
• 11:28
  can
• 11:28
  host
• 11:28
  genuinely
• 11:29
  frontier-class
• 11:30
  MoE
• 11:30
  models
• 11:30
  if
• 11:31
  you
• 11:31
  accept
• 11:31
  aggressive
• 11:31
  quantization.
• 11:32
  Another
• 11:33
  user
• 11:33
  reported
• 11:33
  56
• 11:34
  t/s
• 11:35
  with
• 11:35
  IQ2
• 11:35
  XXS
• 11:36
  and
• 11:36
  248K
• 11:37
  context
• 11:37
  on
• 11:37
  the
• 11:38
  same
• 11:38
  GPU.
• 11:39
  The
• 11:39
  VRAM
• 11:39
  race
• 11:39
  may
• 11:40
  be
• 11:40
  about
• 11:40
  to
• 11:40
  intensify:
• 11:41
  Seasonic's
• 11:42
  PSU
• 11:42
  calculator
• 11:43
  briefly
• 11:43
  listed
• 11:43
  RTX
• 11:44
  5080
• 11:45
  SUPER
• 11:45
  (24GB),
• 11:46
  RTX
• 11:47
  5070
• 11:48
  Ti
• 11:48
  SUPER
• 11:48
  (24GB),
• 11:49
  and
• 11:50
  RTX
• 11:50
  5070
• 11:51
  SUPER
• 11:51
  (18GB)
• 11:52
  before
• 11:52
  the
• 11:52
  entries
• 11:53
  were
• 11:53
  pulled.
• 11:54
  Community
• 11:54
  reaction
• 11:55
  is
• 11:55
  skeptical
• 11:55
  about
• 11:56
  availability
• 11:56
  and
• 11:56
  pricing
• 11:56
  —
• 11:57
  "absolutely
• 11:58
  nobody
• 11:58
  believes
• 11:59
  these
• 11:59
  will
• 11:59
  be
• 11:59
  made
• 11:59
  in
• 11:59
  any
• 11:59
  reasonable
• 12:00
  quantities"
• 12:00
  —
• 12:01
  but
• 12:01
  24GB
• 12:02
  at
• 12:02
  a
• 12:02
  sub-5090
• 12:03
  price
• 12:03
  point
• 12:03
  would
• 12:04
  dramatically
• 12:04
  expand
• 12:05
  who
• 12:05
  can
• 12:05
  run
• 12:05
  27B-class
• 12:06
  models
• 12:06
  at
• 12:06
  long
• 12:07
  context.
• 12:08
  Looking
• 12:08
  further
• 12:08
  out,
• 12:08
  ternary
• 12:09
  (1.58-bit)
• 12:10
  models
• 12:10
  could
• 12:10
  collapse
• 12:11
  the
• 12:11
  multiplication
• 12:11
  bottleneck
• 12:12
  entirely:
• 12:13
  weights
• 12:13
  constrained
• 12:14
  to
• 12:14
  -1,
• 12:14
  0,
• 12:15
  or
• 12:15
  1
• 12:16
  turn
• 12:16
  matrix
• 12:16
  math
• 12:16
  into
• 12:17
  additions
• 12:17
  and
• 12:17
  look-up
• 12:17
  tables.
• 12:18
  One
• 12:19
  estimate
• 12:19
  projects
• 12:19
  a
• 12:19
  100B
• 12:20
  ternary
• 12:20
  model
• 12:21
  running
• 12:21
  at
• 12:21
  35W
• 12:22
  on
• 12:22
  a
• 12:22
  dedicated
• 12:23
  ASIC.
• 12:24
  The
• 12:24
  community
• 12:24
  reality-check
• 12:25
  is
• 12:25
  sharper:
• 12:26
  attention
• 12:26
  still
• 12:26
  needs
• 12:27
  real
• 12:27
  multiplications
• 12:28
  (Q×K^T
• 12:28
  with
• 12:29
  dense
• 12:29
  activations),
• 12:30
  memory
• 12:30
  bandwidth
• 12:31
  eats
• 12:31
  15–20W
• 12:33
  before
• 12:33
  logic
• 12:33
  starts,
• 12:34
  and
• 12:34
  the
• 12:34
  20–25%
• 12:36
  perplexity
• 12:37
  hit
• 12:37
  stings
• 12:37
  at
• 12:37
  smaller
• 12:38
  scales.
• 12:39
  The
• 12:39
  real
• 12:39
  blocker
• 12:39
  is
• 12:40
  the
• 12:40
  chicken-and-egg:
• 12:41
  no
• 12:41
  chipmaker
• 12:41
  will
• 12:41
  build
• 12:42
  ternary
• 12:42
  silicon
• 12:43
  without
• 12:43
  a
• 12:43
  proven
• 12:43
  ecosystem
• 12:44
  of
• 12:44
  natively
• 12:44
  trained
• 12:45
  models,
• 12:45
  and
• 12:46
  nobody
• 12:46
  is
• 12:46
  training
• 12:46
  100B
• 12:47
  ternary
• 12:47
  models
• 12:47
  without
• 12:48
  the
• 12:48
  hardware.
• 12:49
  Meanwhile,
• 12:49
  Döner
• 12:49
  Bench's
• 12:50
  second
• 12:50
  round
• 12:50
  compared
• 12:50
  quantization
• 12:51
  levels
• 12:51
  on
• 12:51
  Tess-4-27B,
• 12:53
  a
• 12:53
  new
• 12:53
  Qwen3.6-27B
• 12:56
  fine-tune
• 12:56
  trained
• 12:57
  on
• 12:57
  64K-token
• 12:58
  agentic
• 12:58
  traces
• 12:58
  from
• 12:58
  Fable
• 12:59
  5
• 12:59
  with
• 12:59
  a
• 12:59
  three-model
• 13:00
  teacher
• 13:00
  ensemble
• 13:01
  (Opus
• 13:01
  4.8,
• 13:02
  GPT-5.5,
• 13:03
  GLM-5.2).
• 13:06
  A
• 13:06
  multi-scale
• 13:07
  study
• 13:07
  across
• 13:07
  Qwen3,
• 13:08
  Gemma-3,
• 13:09
  and
• 13:09
  Llama-3
• 13:09
  asks
• 13:10
  a
• 13:10
  deceptively
• 13:10
  simple
• 13:11
  question:
• 13:12
  do
• 13:12
  language
• 13:12
  models
• 13:13
  form
• 13:13
  internal
• 13:13
  plans
• 13:14
  for
• 13:14
  future
• 13:14
  tokens,
• 13:14
  and
• 13:15
  if
• 13:15
  so,
• 13:15
  where?
• 13:16
  Using
• 13:16
  rhyming-couplet
• 13:17
  completion
• 13:17
  as
• 13:17
  a
• 13:18
  clean
• 13:18
  structural
• 13:18
  test,
• 13:19
  the
• 13:19
  researchers
• 13:19
  applied
• 13:20
  linear
• 13:20
  probing
• 13:20
  and
• 13:20
  activation
• 13:21
  patching
• 13:21
  at
• 13:21
  more
• 13:22
  than
• 13:22
  ten
• 13:22
  model
• 13:22
  scales.
• 13:23
  Probing
• 13:23
  showed
• 13:24
  that
• 13:24
  future-rhyme
• 13:24
  information
• 13:25
  is
• 13:25
  linearly
• 13:26
  decodable
• 13:26
  at
• 13:26
  the
• 13:26
  line
• 13:26
  boundary
• 13:27
  (the
• 13:27
  newline
• 13:27
  token
• 13:28
  between
• 13:28
  couplet
• 13:28
  lines)
• 13:28
  and
• 13:29
  strengthens
• 13:29
  with
• 13:29
  scale
• 13:30
  across
• 13:30
  all
• 13:30
  three
• 13:30
  families.
• 13:31
  But
• 13:32
  the
• 13:32
  causal
• 13:32
  evidence
• 13:32
  tells
• 13:33
  a
• 13:33
  strikingly
• 13:33
  selective
• 13:33
  story.
• 13:34
  Only
• 13:35
  Gemma-3-27B
• 13:36
  actually
• 13:36
  uses
• 13:37
  that
• 13:37
  information
• 13:37
  during
• 13:37
  generation,
• 13:38
  exhibiting
• 13:39
  an
• 13:39
  "information
• 13:39
  routing
• 13:40
  handoff"
• 13:40
  around
• 13:40
  layer
• 13:40
  30
• 13:41
  where
• 13:41
  the
• 13:41
  causal
• 13:41
  driver
• 13:42
  migrates
• 13:42
  from
• 13:42
  the
• 13:42
  rhyme
• 13:42
  word
• 13:43
  to
• 13:43
  the
• 13:43
  newline
• 13:43
  position.
• 13:44
  Every
• 13:44
  other
• 13:45
  model
• 13:45
  —
• 13:46
  including
• 13:46
  Qwen3
• 13:46
  up
• 13:46
  to
• 13:47
  32B
• 13:47
  and
• 13:47
  Llama-3
• 13:48
  up
• 13:48
  to
• 13:48
  70B
• 13:48
  —
• 13:48
  conditions
• 13:49
  on
• 13:49
  the
• 13:49
  rhyme
• 13:49
  word
• 13:49
  throughout,
• 13:50
  with
• 13:50
  near-zero
• 13:50
  causal
• 13:51
  effect
• 13:51
  at
• 13:51
  the
• 13:51
  newline
• 13:51
  despite
• 13:52
  strong
• 13:52
  probe
• 13:52
  signal
• 13:53
  there.
• 13:53
  The
• 13:54
  handoff
• 13:54
  localizes
• 13:54
  to
• 13:55
  just
• 13:55
  five
• 13:55
  attention
• 13:55
  heads
• 13:56
  in
• 13:56
  layers
• 13:56
  28
• 13:56
  and
• 13:56
  30,
• 13:57
  which
• 13:57
  recover
• 13:57
  90%
• 13:58
  of
• 13:58
  the
• 13:58
  full-residual
• 13:59
  rhyme-routing
• 13:59
  capacity
• 14:00
  under
• 14:00
  two-stage
• 14:00
  path
• 14:01
  patching.
• 14:02
  Planning-compatible
• 14:02
  representations
• 14:03
  are
• 14:03
  common;
• 14:04
  causally
• 14:04
  active
• 14:04
  planning
• 14:05
  sites
• 14:05
  are
• 14:05
  rare
• 14:05
  and
• 14:05
  architecture-specific.
• 14:07
  The
• 14:07
  practical
• 14:07
  implications
• 14:08
  may
• 14:08
  arrive
• 14:08
  faster
• 14:09
  than
• 14:09
  the
• 14:09
  theory.
• 14:10
  An
• 14:10
  accountant
• 14:10
  (self-described,
• 14:11
  not
• 14:12
  ML
• 14:12
  engineer)
• 14:12
  reading
• 14:13
  Anthropic's
• 14:13
  J-space
• 14:13
  paper
• 14:14
  —
• 14:14
  the
• 14:14
  Jacobian-lens
• 14:15
  view
• 14:15
  of
• 14:15
  how
• 14:16
  changes
• 14:16
  to
• 14:16
  intermediate-layer
• 14:17
  vectors
• 14:17
  influence
• 14:18
  final
• 14:18
  logit
• 14:18
  distributions
• 14:19
  —
• 14:19
  asked
• 14:20
  whether
• 14:20
  this
• 14:20
  could
• 14:20
  revolutionize
• 14:21
  pruning,
• 14:21
  merging,
• 14:22
  and
• 14:22
  distillation.
• 14:23
  The
• 14:23
  intuition:
• 14:24
  instead
• 14:25
  of
• 14:25
  pruning
• 14:25
  by
• 14:25
  router-weighted
• 14:26
  expert
• 14:26
  activations
• 14:27
  (REAP/REAM),
• 14:28
  prune
• 14:28
  by
• 14:29
  Jacobian
• 14:29
  importance
• 14:29
  —
• 14:30
  the
• 14:30
  activations
• 14:31
  most
• 14:31
  influential
• 14:32
  on
• 14:32
  outputs.
• 14:33
  For
• 14:33
  distillation,
• 14:34
  J-space
• 14:35
  could
• 14:35
  denoise
• 14:35
  the
• 14:35
  larger
• 14:36
  model's
• 14:36
  reasoning
• 14:36
  signal,
• 14:37
  allowing
• 14:37
  more
• 14:37
  effective
• 14:38
  transfer
• 14:38
  of
• 14:38
  critical
• 14:39
  pathways
• 14:39
  to
• 14:39
  smaller
• 14:40
  models
• 14:40
  with
• 14:40
  potentially
• 14:41
  less
• 14:41
  compute.
• 14:42
  Community
• 14:42
  response
• 14:43
  was
• 14:43
  cautiously
• 14:43
  positive:
• 14:44
  the
• 14:44
  J-space
• 14:44
  estimator
• 14:45
  is
• 14:45
  pre-trained
• 14:46
  on
• 14:46
  ~1,000
• 14:47
  prompts,
• 14:48
  and
• 14:48
  whether
• 14:48
  it
• 14:48
  generalizes
• 14:49
  across
• 14:49
  tasks
• 14:49
  and
• 14:50
  domains
• 14:50
  is
• 14:50
  the
• 14:50
  open
• 14:51
  question.
• 14:52
  One
• 14:52
  commenter
• 14:53
  noted
• 14:53
  it
• 14:53
  could
• 14:53
  also
• 14:53
  enable
• 14:54
  J-space-aware
• 14:54
  quantization,
• 14:56
  dynamically
• 14:56
  monitoring
• 14:57
  models
• 14:57
  for
• 14:57
  degenerate
• 14:57
  loops,
• 14:58
  and
• 14:58
  even
• 14:58
  detecting
• 14:59
  manipulation.
• 15:00
  Google
• 15:01
  Research's
• 15:01
  SensorFM
• 15:02
  applies
• 15:02
  the
• 15:02
  foundation-model
• 15:03
  paradigm
• 15:03
  to
• 15:04
  an
• 15:04
  entirely
• 15:04
  different
• 15:04
  domain:
• 15:05
  wearable
• 15:06
  health.
• 15:06
  Pre-trained
• 15:07
  on
• 15:07
  over
• 15:07
  one
• 15:08
  trillion
• 15:08
  minutes
• 15:08
  of
• 15:08
  multimodal
• 15:09
  sensor
• 15:09
  data
• 15:09
  from
• 15:10
  five
• 15:10
  million
• 15:10
  consented
• 15:11
  participants
• 15:11
  across
• 15:11
  100+
• 15:12
  countries
• 15:12
  and
• 15:12
  20+
• 15:13
  Fitbit/Pixel
• 15:14
  Watch
• 15:15
  devices,
• 15:15
  SensorFM
• 15:16
  learns
• 15:16
  a
• 15:16
  single
• 15:17
  reusable
• 15:17
  representation
• 15:18
  of
• 15:18
  human
• 15:18
  physiology
• 15:19
  via
• 15:19
  self-supervised
• 15:20
  masked
• 15:20
  reconstruction.
• 15:22
  The
• 15:22
  key
• 15:22
  design
• 15:23
  choice
• 15:23
  is
• 15:23
  treating
• 15:23
  real-world
• 15:24
  data
• 15:24
  gaps
• 15:24
  —
• 15:25
  sensors
• 15:26
  powering
• 15:26
  down,
• 15:27
  devices
• 15:27
  off-wrist
• 15:27
  —
• 15:28
  as
• 15:29
  equivalent
• 15:29
  to
• 15:29
  training
• 15:29
  masks,
• 15:30
  making
• 15:30
  the
• 15:30
  model
• 15:31
  missingness-aware
• 15:31
  by
• 15:32
  construction.
• 15:33
  Frozen
• 15:33
  linear
• 15:34
  probes
• 15:34
  on
• 15:34
  SensorFM
• 15:35
  embeddings
• 15:35
  outperform
• 15:36
  feature-engineered
• 15:37
  supervised
• 15:37
  baselines
• 15:38
  on
• 15:38
  34
• 15:38
  of
• 15:38
  35
• 15:39
  discriminative
• 15:40
  health
• 15:40
  tasks
• 15:40
  spanning
• 15:41
  cardiovascular,
• 15:42
  metabolic,
• 15:43
  sleep,
• 15:43
  and
• 15:43
  mental
• 15:44
  health
• 15:44
  categories.
• 15:45
  An
• 15:45
  "agentic
• 15:46
  classroom"
• 15:47
  of
• 15:47
  competing
• 15:47
  LLM
• 15:48
  agents
• 15:48
  that
• 15:48
  iteratively
• 15:49
  generate
• 15:49
  and
• 15:49
  refine
• 15:50
  prediction-head
• 15:50
  code
• 15:51
  beat
• 15:51
  simple
• 15:51
  linear
• 15:51
  probes
• 15:52
  on
• 15:52
  28
• 15:53
  of
• 15:53
  35
• 15:53
  tasks.
• 15:54
  When
• 15:54
  integrated
• 15:55
  into
• 15:55
  a
• 15:55
  Personal
• 15:56
  Health
• 15:56
  Agent,
• 15:56
  clinician-blinded
• 15:57
  evaluation
• 15:58
  found
• 15:58
  no
• 15:58
  statistically
• 15:59
  significant
• 15:59
  difference
• 16:00
  between
• 16:00
  grounding
• 16:01
  the
• 16:01
  agent
• 16:01
  in
• 16:01
  SensorFM
• 16:02
  predictions
• 16:02
  versus
• 16:03
  actual
• 16:03
  ground-truth
• 16:04
  measurements
• 16:04
  —
• 16:05
  the
• 16:05
  model's
• 16:05
  inferences
• 16:06
  served
• 16:06
  about
• 16:06
  as
• 16:07
  well
• 16:07
  as
• 16:07
  real
• 16:07
  lab
• 16:07
  results.
• 16:10
  Big
• 16:10
  Tech's
• 16:11
  combined
• 16:11
  AI
• 16:12
  capital
• 16:12
  expenditure
• 16:12
  for
• 16:13
  2026
• 16:14
  is
• 16:14
  tracking
• 16:14
  at
• 16:14
  roughly
• 16:14
  $725
• 16:16
  billion
• 16:16
  —
• 16:17
  up
• 16:17
  77%
• 16:18
  year
• 16:18
  over
• 16:19
  year
• 16:19
  —
• 16:19
  consuming
• 16:20
  approximately
• 16:21
  45%
• 16:21
  of
• 16:21
  Amazon,
• 16:22
  Alphabet,
• 16:23
  Meta,
• 16:23
  and
• 16:23
  Microsoft's
• 16:23
  operating
• 16:24
  cash
• 16:24
  flow,
• 16:25
  up
• 16:25
  from
• 16:25
  32%
• 16:26
  in
• 16:26
  2024.
• 16:27
  Sequoia
• 16:28
  estimates
• 16:28
  the
• 16:28
  industry
• 16:29
  needs
• 16:29
  $600B
• 16:30
  in
• 16:30
  new
• 16:31
  annual
• 16:31
  revenue
• 16:31
  to
• 16:31
  justify
• 16:32
  the
• 16:32
  buildout,
• 16:33
  and
• 16:33
  that
• 16:33
  gap
• 16:33
  is
• 16:33
  widening.
• 16:34
  MIT's
• 16:35
  Project
• 16:35
  NANDA
• 16:35
  found
• 16:36
  95%
• 16:36
  of
• 16:36
  enterprise
• 16:37
  GenAI
• 16:37
  pilots
• 16:38
  produced
• 16:38
  zero
• 16:38
  measurable
• 16:39
  P&L
• 16:39
  impact.
• 16:40
  Allianz
• 16:41
  measured
• 16:41
  the
• 16:41
  capex-to-revenue
• 16:42
  divergence
• 16:42
  at
• 16:42
  46%,
• 16:44
  worse
• 16:44
  than
• 16:44
  the
• 16:44
  32%
• 16:45
  seen
• 16:45
  during
• 16:45
  the
• 16:45
  2001
• 16:46
  telecom
• 16:46
  bubble.
• 16:47
  Even
• 16:48
  Palantir's
• 16:48
  CEO
• 16:48
  went
• 16:49
  on
• 16:49
  CNBC
• 16:49
  calling
• 16:50
  the
• 16:50
  situation
• 16:50
  "irresponsibly
• 16:51
  oversold."
• 16:52
  The
• 16:52
  bear
• 16:53
  case
• 16:53
  is
• 16:53
  damning.
• 16:54
  But
• 16:54
  the
• 16:54
  counter
• 16:54
  is
• 16:54
  real:
• 16:55
  Nvidia
• 16:56
  earned
• 16:56
  ~$120B
• 16:58
  at
• 16:58
  53%
• 16:59
  margins
• 16:59
  (Cisco's
• 17:00
  dot-com
• 17:00
  peak
• 17:00
  was
• 17:00
  a
• 17:01
  fraction
• 17:01
  of
• 17:01
  that),
• 17:02
  the
• 17:02
  Nasdaq-100
• 17:03
  trades
• 17:03
  at
• 17:03
  26x
• 17:04
  forward
• 17:04
  earnings
• 17:05
  versus
• 17:05
  60x
• 17:05
  in
• 17:05
  March
• 17:06
  2000,
• 17:07
  and
• 17:07
  the
• 17:07
  Big
• 17:07
  Five
• 17:07
  generated
• 17:08
  ~$350B
• 17:09
  in
• 17:10
  free
• 17:10
  cash
• 17:10
  flow
• 17:10
  last
• 17:10
  year.
• 17:11
  These
• 17:11
  are
• 17:11
  cash-generating
• 17:12
  machines
• 17:13
  choosing
• 17:13
  to
• 17:13
  reinvest,
• 17:14
  not
• 17:14
  pre-revenue
• 17:14
  startups.
• 17:15
  Capital
• 17:16
  Economics'
• 17:16
  John
• 17:16
  Higgins
• 17:17
  framed
• 17:17
  it
• 17:17
  precisely:
• 17:18
  separate
• 17:18
  the
• 17:19
  "stock
• 17:19
  bubble"
• 17:19
  from
• 17:19
  the
• 17:19
  "fundamental
• 17:20
  bubble."
• 17:21
  Stock
• 17:21
  prices
• 17:21
  can
• 17:21
  deflate
• 17:22
  even
• 17:22
  if
• 17:22
  the
• 17:22
  technology
• 17:23
  delivers.
• 17:24
  The
• 17:24
  question
• 17:24
  was
• 17:24
  never
• 17:25
  "does
• 17:25
  AI
• 17:26
  work"
• 17:26
  —
• 17:27
  it's
• 17:27
  whether
• 17:27
  the
• 17:27
  price
• 17:27
  paid
• 17:28
  right
• 17:28
  now
• 17:28
  makes
• 17:28
  sense
• 17:29
  given
• 17:29
  how
• 17:29
  fast
• 17:29
  revenue
• 17:30
  actually
• 17:30
  materializes.
• 17:31
  The
• 17:31
  compute
• 17:32
  supply
• 17:32
  chain
• 17:32
  underneath
• 17:33
  that
• 17:33
  spending
• 17:33
  is
• 17:33
  finding
• 17:33
  its
• 17:33
  own
• 17:34
  price
• 17:34
  discovery.
• 17:35
  A
• 17:35
  spot-pricing
• 17:36
  tracker
• 17:36
  for
• 17:36
  Rackspace
• 17:37
  GPU
• 17:37
  instances
• 17:37
  shows
• 17:38
  that
• 17:38
  many
• 17:38
  less-contested
• 17:39
  regions
• 17:39
  sit
• 17:39
  at
• 17:40
  or
• 17:40
  near
• 17:40
  the
• 17:40
  $0.001/hr
• 17:42
  minimum
• 17:42
  bid
• 17:42
  for
• 17:42
  long
• 17:42
  stretches,
• 17:43
  while
• 17:44
  a
• 17:44
  standing
• 17:44
  bid
• 17:44
  at
• 17:44
  the
• 17:44
  p80
• 17:45
  percentile
• 17:45
  would
• 17:45
  hold
• 17:46
  a
• 17:46
  node
• 17:46
  through
• 17:46
  roughly
• 17:46
  80%
• 17:47
  of
• 17:47
  the
• 17:47
  sampling
• 17:48
  window
• 17:48
  —
• 17:49
  bidding
• 17:49
  the
• 17:49
  bare
• 17:49
  market
• 17:50
  price
• 17:50
  wins
• 17:50
  now
• 17:50
  but
• 17:51
  gets
• 17:51
  preempted
• 17:51
  at
• 17:51
  the
• 17:51
  next
• 17:52
  uptick.