Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – May 12, 2026

Transcript

AGI Dreams Podcast – May 12, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  A
• 0:00
  developer
• 0:00
  who
• 0:00
  goes
• 0:01
  by
• 0:01
  unix.foo
• 0:01
  published
• 0:02
  a
• 0:02
  manifesto
• 0:02
  last
• 0:03
  week
• 0:03
  that
• 0:03
  should
• 0:03
  be
• 0:03
  printed
• 0:04
  and
• 0:04
  taped
• 0:04
  above
• 0:04
  every
• 0:05
  product
• 0:05
  manager's
• 0:05
  monitor:
• 0:06
  stop
• 0:07
  shipping
• 0:07
  distributed
• 0:07
  systems
• 0:08
  when
• 0:08
  you
• 0:08
  meant
• 0:08
  to
• 0:08
  ship
• 0:08
  a
• 0:08
  feature.
• 0:09
  The
• 0:10
  argument
• 0:10
  is
• 0:10
  blunt.
• 0:11
  Most
• 0:11
  AI
• 0:12
  features
• 0:12
  in
• 0:12
  apps
• 0:12
  today
• 0:13
  —
• 0:13
  summarize
• 0:14
  this,
• 0:15
  classify
• 0:15
  that,
• 0:16
  extract
• 0:16
  the
• 0:16
  other
• 0:16
  —
• 0:17
  hit
• 0:17
  a
• 0:17
  cloud
• 0:17
  API
• 0:18
  because
• 0:18
  developers
• 0:18
  are
• 0:18
  too
• 0:19
  lazy
• 0:19
  to
• 0:19
  check
• 0:19
  whether
• 0:19
  the
• 0:19
  Neural
• 0:20
  Engine
• 0:20
  sitting
• 0:20
  idle
• 0:20
  in
• 0:21
  their
• 0:21
  user's
• 0:21
  pocket
• 0:21
  could
• 0:21
  handle
• 0:22
  it.
• 0:23
  The
• 0:23
  result
• 0:23
  is
• 0:23
  software
• 0:24
  that
• 0:24
  breaks
• 0:24
  when
• 0:24
  the
• 0:24
  server
• 0:25
  crashes,
• 0:25
  costs
• 0:26
  money
• 0:26
  per
• 0:26
  inference,
• 0:27
  and
• 0:27
  turns
• 0:27
  every
• 0:27
  UX
• 0:28
  feature
• 0:28
  into
• 0:28
  a
• 0:28
  trust
• 0:29
  exercise
• 0:29
  with
• 0:29
  a
• 0:29
  third-party
• 0:30
  data
• 0:30
  processor.
• 0:31
  The
• 0:31
  post
• 0:32
  demonstrates
• 0:32
  a
• 0:32
  concrete
• 0:33
  alternative:
• 0:34
  Brutalist
• 0:34
  Report's
• 0:34
  mobile
• 0:35
  app
• 0:35
  generates
• 0:35
  article
• 0:36
  summaries
• 0:36
  using
• 0:36
  Apple's
• 0:37
  local
• 0:37
  model
• 0:37
  APIs
• 0:38
  —
• 0:39
  no
• 0:39
  server,
• 0:39
  no
• 0:40
  prompt
• 0:40
  logs,
• 0:41
  no
• 0:41
  privacy
• 0:41
  policy
• 0:42
  needed.
• 0:42
  Apple's
• 0:43
  newer
• 0:43
  APIs
• 0:43
  even
• 0:44
  support
• 0:44
  structured
• 0:44
  output
• 0:45
  via
• 0:45
  Swift
• 0:45
  types,
• 0:46
  replacing
• 0:46
  the
• 0:46
  "ask
• 0:47
  for
• 0:47
  JSON
• 0:47
  and
• 0:47
  pray"
• 0:48
  pattern
• 0:48
  with
• 0:48
  typed,
• 0:49
  renderable
• 0:49
  objects.
• 0:50
  Local
• 0:51
  AI
• 0:51
  shines,
• 0:52
  the
• 0:52
  author
• 0:52
  argues,
• 0:53
  when
• 0:53
  the
• 0:53
  model's
• 0:53
  job
• 0:54
  is
• 0:54
  transforming
• 0:54
  user-owned
• 0:55
  data,
• 0:55
  not
• 0:56
  acting
• 0:56
  as
• 0:56
  a
• 0:56
  search
• 0:57
  engine
• 0:57
  for
• 0:57
  the
• 0:57
  universe.
• 0:58
  The
• 0:58
  economic
• 0:59
  case
• 0:59
  got
• 0:59
  its
• 0:59
  sharpest
• 1:00
  empirical
• 1:00
  backing
• 1:00
  this
• 1:01
  week
• 1:01
  from
• 1:01
  a
• 1:01
  developer
• 1:02
  who
• 1:02
  logged
• 1:02
  ten
• 1:02
  days
• 1:02
  of
• 1:03
  coding
• 1:03
  work
• 1:03
  and
• 1:03
  re-ran
• 1:04
  150
• 1:05
  tasks
• 1:05
  on
• 1:05
  both
• 1:05
  a
• 1:05
  frontier
• 1:06
  cloud
• 1:06
  model
• 1:07
  and
• 1:07
  local
• 1:07
  Qwen
• 1:08
  3.6
• 1:08
  27B
• 1:09
  on
• 1:09
  a
• 1:09
  3090.
• 1:11
  The
• 1:11
  breakdown
• 1:11
  was
• 1:12
  damning
• 1:12
  for
• 1:12
  cloud-by-default
• 1:13
  thinking:
• 1:14
  35%
• 1:15
  of
• 1:15
  tasks
• 1:15
  (file
• 1:15
  reads,
• 1:16
  code
• 1:16
  explanation)
• 1:17
  matched
• 1:17
  cloud
• 1:18
  quality
• 1:18
  97%
• 1:19
  of
• 1:19
  the
• 1:19
  time.
• 1:21
  Another
• 1:21
  30%
• 1:21
  (test
• 1:22
  writing,
• 1:23
  boilerplate)
• 1:23
  matched
• 1:23
  at
• 1:24
  88%.
• 1:25
  Only
• 1:26
  the
• 1:26
  final
• 1:26
  15%
• 1:26
  —
• 1:28
  architecture
• 1:28
  decisions,
• 1:29
  complex
• 1:30
  multi-file
• 1:30
  refactors
• 1:31
  —
• 1:32
  genuinely
• 1:32
  justified
• 1:33
  cloud
• 1:33
  pricing.
• 1:34
  API
• 1:35
  bill:
• 1:35
  $85/month
• 1:37
  down
• 1:37
  to
• 1:37
  $22
• 1:38
  by
• 1:38
  routing
• 1:39
  the
• 1:39
  first
• 1:39
  two
• 1:39
  buckets
• 1:39
  locally,
• 1:40
  with
• 1:41
  the
• 1:41
  3090
• 1:42
  already
• 1:42
  sitting
• 1:42
  there
• 1:42
  mining
• 1:43
  nothing.
• 1:44
  A
• 1:44
  30-year
• 1:44
  IT
• 1:45
  veteran
• 1:45
  pushed
• 1:46
  further,
• 1:46
  handing
• 1:47
  a
• 1:47
  Hermes
• 1:47
  Agent
• 1:47
  harness
• 1:48
  running
• 1:48
  Qwen
• 1:48
  3.6
• 1:49
  27B
• 1:50
  on
• 1:50
  a
• 1:50
  GB10
• 1:51
  DGX
• 1:51
  Spark
• 1:51
  clone
• 1:52
  a
• 1:52
  task
• 1:52
  list
• 1:53
  that
• 1:53
  would
• 1:53
  normally
• 1:53
  go
• 1:53
  to
• 1:53
  a
• 1:54
  junior
• 1:54
  sysadmin:
• 1:55
  update
• 1:55
  a
• 1:55
  system,
• 1:56
  install
• 1:57
  Docker,
• 1:57
  clone
• 1:57
  five
• 1:58
  GitHub
• 1:58
  repos,
• 1:59
  configure
• 1:59
  them
• 2:00
  for
• 2:00
  local
• 2:00
  models,
• 2:01
  start
• 2:01
  all
• 2:01
  containers.
• 2:03
  The
• 2:03
  agent
• 2:03
  completed
• 2:04
  it
• 2:04
  in
• 2:04
  90
• 2:04
  minutes
• 2:05
  versus
• 2:05
  an
• 2:06
  estimated
• 2:06
  three
• 2:06
  hours
• 2:07
  for
• 2:07
  a
• 2:07
  human
• 2:07
  —
• 2:08
  stumbling
• 2:09
  occasionally
• 2:09
  but
• 2:09
  recovering
• 2:10
  or
• 2:10
  asking
• 2:11
  for
• 2:11
  approval,
• 2:11
  exactly
• 2:12
  as
• 2:13
  a
• 2:13
  junior
• 2:13
  would.
• 2:14
  The
• 2:14
  implication
• 2:15
  isn't
• 2:15
  replacement
• 2:16
  but
• 2:16
  a
• 2:16
  shift
• 2:17
  in
• 2:17
  ratios:
• 2:18
  one
• 2:18
  admin
• 2:19
  leveraging
• 2:19
  agent
• 2:20
  harnesses
• 2:20
  to
• 2:20
  cover
• 2:20
  more
• 2:21
  ground,
• 2:21
  with
• 2:21
  the
• 2:22
  cautionary
• 2:22
  note
• 2:22
  that
• 2:23
  YOLO
• 2:23
  mode
• 2:23
  and
• 2:23
  sabotage-by-disgruntled-admins
• 2:25
  are
• 2:25
  both
• 2:26
  inevitable.
• 2:27
  Hardware
• 2:27
  keeps
• 2:27
  closing
• 2:28
  the
• 2:28
  remaining
• 2:28
  gaps.
• 2:29
  A
• 2:29
  Mac
• 2:30
  Studio
• 2:30
  user
• 2:30
  running
• 2:30
  GLM
• 2:31
  5.1
• 2:32
  reports
• 2:32
  trusting
• 2:32
  it
• 2:32
  with
• 2:33
  roughly
• 2:33
  6-out-of-10
• 2:34
  difficulty
• 2:34
  coding
• 2:34
  tasks
• 2:35
  via
• 2:35
  Claude
• 2:35
  Code,
• 2:36
  with
• 2:36
  Kimi
• 2:36
  K2.6
• 2:38
  and
• 2:38
  Qwen
• 2:38
  3.6
• 2:39
  filling
• 2:39
  adjacent
• 2:40
  roles
• 2:40
  —
• 2:41
  though
• 2:41
  at
• 2:41
  460GB
• 2:43
  memory,
• 2:44
  Kimi
• 2:44
  doesn't
• 2:45
  leave
• 2:45
  room
• 2:45
  for
• 2:45
  much
• 2:45
  else.
• 2:46
  The
• 2:46
  practical
• 2:47
  ceiling:
• 2:48
  GLM's
• 2:48
  40B
• 2:48
  active
• 2:49
  parameters
• 2:49
  is
• 2:50
  where
• 2:50
  patience
• 2:50
  ends
• 2:50
  on
• 2:51
  an
• 2:51
  M3
• 2:51
  Ultra,
• 2:52
  and
• 2:52
  DeepSeek
• 2:52
  V4
• 2:53
  Flash
• 2:53
  hasn't
• 2:53
  landed
• 2:54
  in
• 2:54
  llama.cpp
• 2:55
  or
• 2:55
  mlx-lm
• 2:56
  yet.
• 2:57
  Multi-Token
• 2:57
  Prediction
• 2:58
  support
• 2:58
  hit
• 2:58
  llama.cpp
• 3:00
  via
• 3:00
  PR
• 3:00
  #22673,
• 3:02
  and
• 3:02
  the
• 3:02
  results
• 3:02
  on
• 3:02
  AMD's
• 3:03
  Strix
• 3:03
  Halo
• 3:03
  are
• 3:03
  striking:
• 3:04
  a
• 3:04
  Qwen
• 3:05
  3.6
• 3:05
  35B
• 3:06
  MTP
• 3:07
  variant
• 3:07
  doubled
• 3:07
  decode
• 3:08
  throughput
• 3:08
  from
• 3:08
  roughly
• 3:09
  40
• 3:09
  to
• 3:09
  80
• 3:10
  tokens/second,
• 3:11
  with
• 3:11
  community
• 3:11
  members
• 3:12
  reporting
• 3:12
  similar
• 3:13
  gains
• 3:13
  on
• 3:13
  27B
• 3:14
  models
• 3:14
  across
• 3:14
  Vulkan
• 3:15
  and
• 3:15
  ROCm.
• 3:16
  Prefill
• 3:17
  speed
• 3:17
  was
• 3:17
  unchanged,
• 3:18
  but
• 3:18
  for
• 3:18
  interactive
• 3:19
  agentic
• 3:19
  loops
• 3:19
  where
• 3:19
  decode
• 3:20
  latency
• 3:20
  matters
• 3:21
  most,
• 3:21
  this
• 3:21
  is
• 3:22
  a
• 3:22
  significant
• 3:22
  unlock.
• 3:23
  At
• 3:23
  the
• 3:23
  extreme
• 3:24
  low
• 3:24
  end,
• 3:25
  Project
• 3:25
  Caroline
• 3:25
  puts
• 3:26
  Gemma
• 3:26
  3
• 3:26
  1B
• 3:27
  on
• 3:27
  a
• 3:27
  Raspberry
• 3:27
  Pi
• 3:27
  5
• 3:28
  as
• 3:28
  a
• 3:28
  persistent
• 3:28
  cyberpunk
• 3:29
  desk
• 3:29
  kiosk
• 3:29
  —
• 3:30
  near-instant
• 3:31
  responses,
• 3:32
  local
• 3:32
  chat
• 3:32
  history,
• 3:33
  intent
• 3:33
  parsing
• 3:34
  for
• 3:34
  Spotify
• 3:35
  and
• 3:35
  Hue
• 3:35
  integration,
• 3:36
  zero
• 3:36
  cloud
• 3:37
  dependency.
• 3:38
  The
• 3:38
  comments
• 3:38
  section
• 3:39
  already
• 3:39
  tells
• 3:39
  the
• 3:39
  story
• 3:40
  of
• 3:40
  how
• 3:40
  fast
• 3:40
  this
• 3:40
  space
• 3:40
  moves:
• 3:42
  multiple
• 3:42
  users
• 3:42
  pointed
• 3:43
  out
• 3:43
  Gemma
• 3:43
  4
• 3:43
  exists
• 3:44
  and
• 3:44
  is
• 3:44
  "much
• 3:44
  better."
• 3:46
  When
• 3:46
  your
• 3:46
  hardware
• 3:47
  target
• 3:47
  is
• 3:47
  a
• 3:47
  $80
• 3:48
  single-board
• 3:48
  computer
• 3:49
  and
• 3:49
  the
• 3:49
  model
• 3:49
  is
• 3:49
  outdated
• 3:49
  before
• 3:50
  the
• 3:50
  beta
• 3:50
  ships,
• 3:51
  you're
• 3:51
  in
• 3:51
  a
• 3:51
  genuinely
• 3:52
  different
• 3:52
  era
• 3:52
  of
• 3:52
  local
• 3:53
  AI.
• 3:56
  Google's
• 3:56
  Threat
• 3:56
  Intelligence
• 3:57
  Group
• 3:57
  dropped
• 3:58
  a
• 3:58
  report
• 3:58
  that
• 3:58
  moves
• 3:59
  AI-powered
• 3:59
  vulnerability
• 4:00
  discovery
• 4:00
  from
• 4:00
  theoretical
• 4:01
  concern
• 4:01
  to
• 4:01
  confirmed
• 4:02
  reality:
• 4:03
  a
• 4:03
  criminal
• 4:03
  hacking
• 4:04
  group
• 4:04
  used
• 4:04
  an
• 4:04
  AI
• 4:05
  model
• 4:05
  to
• 4:05
  find
• 4:05
  a
• 4:05
  previously
• 4:06
  unknown
• 4:06
  zero-day
• 4:07
  in
• 4:07
  a
• 4:07
  popular
• 4:07
  open-source
• 4:08
  web
• 4:08
  administration
• 4:09
  tool,
• 4:10
  then
• 4:10
  wrote
• 4:10
  a
• 4:10
  Python
• 4:11
  exploit
• 4:11
  script
• 4:11
  to
• 4:12
  weaponize
• 4:12
  it.
• 4:13
  Google
• 4:13
  detected
• 4:14
  the
• 4:14
  attack
• 4:14
  in
• 4:14
  time
• 4:14
  to
• 4:14
  coordinate
• 4:15
  a
• 4:15
  patch
• 4:15
  before
• 4:15
  any
• 4:15
  damage
• 4:16
  was
• 4:16
  done,
• 4:17
  but
• 4:17
  the
• 4:17
  implications
• 4:17
  are
• 4:17
  immediate.
• 4:18
  "We
• 4:18
  have
• 4:18
  high
• 4:19
  confidence
• 4:19
  that
• 4:19
  the
• 4:19
  actor
• 4:20
  likely
• 4:20
  leveraged
• 4:20
  an
• 4:20
  A.I.
• 4:21
  model
• 4:21
  to
• 4:21
  support
• 4:22
  the
• 4:22
  discovery
• 4:22
  and
• 4:22
  weaponization
• 4:23
  of
• 4:23
  this
• 4:23
  vulnerability,"
• 4:24
  Google
• 4:24
  stated.
• 4:25
  John
• 4:25
  Hultquist,
• 4:26
  chief
• 4:26
  analyst
• 4:27
  at
• 4:27
  Google
• 4:27
  Threat
• 4:27
  Intelligence,
• 4:28
  called
• 4:28
  it
• 4:29
  "a
• 4:29
  taste
• 4:29
  of
• 4:29
  what's
• 4:29
  to
• 4:30
  come"
• 4:30
  and
• 4:30
  "the
• 4:30
  tip
• 4:30
  of
• 4:30
  the
• 4:30
  iceberg."
• 4:32
  Rob
• 4:32
  Joyce,
• 4:33
  former
• 4:33
  NSA
• 4:33
  cybersecurity
• 4:34
  director,
• 4:35
  reviewed
• 4:35
  the
• 4:35
  findings
• 4:36
  and
• 4:36
  described
• 4:36
  the
• 4:37
  evidence
• 4:37
  as
• 4:37
  "the
• 4:37
  closest
• 4:38
  thing
• 4:38
  yet
• 4:38
  to
• 4:38
  a
• 4:38
  fingerprint
• 4:39
  at
• 4:39
  the
• 4:39
  crime
• 4:39
  scene,"
• 4:39
  while
• 4:40
  noting
• 4:40
  the
• 4:40
  fundamental
• 4:41
  attribution
• 4:41
  challenge:
• 4:42
  "A.I.-authored
• 4:42
  code
• 4:43
  does
• 4:43
  not
• 4:43
  announce
• 4:43
  itself."
• 4:45
  The
• 4:45
  exploit
• 4:45
  would
• 4:45
  have
• 4:45
  bypassed
• 4:46
  two-factor
• 4:47
  authentication,
• 4:48
  though
• 4:48
  valid
• 4:48
  credentials
• 4:48
  were
• 4:49
  also
• 4:49
  needed.
• 4:50
  Google
• 4:50
  declined
• 4:51
  to
• 4:51
  name
• 4:51
  the
• 4:51
  specific
• 4:52
  tool,
• 4:52
  the
• 4:52
  hackers,
• 4:53
  or
• 4:53
  which
• 4:53
  AI
• 4:54
  model
• 4:54
  was
• 4:54
  used
• 4:54
  —
• 4:55
  only
• 4:55
  noting
• 4:56
  it
• 4:56
  wasn't
• 4:56
  Gemini.
• 4:57
  The
• 4:57
  defensive
• 4:58
  side
• 4:58
  of
• 4:58
  the
• 4:58
  equation
• 4:58
  continued
• 4:59
  to
• 4:59
  build
• 4:59
  its
• 4:59
  case.
• 5:00
  Mozilla
• 5:01
  published
• 5:01
  a
• 5:01
  detailed
• 5:01
  behind-the-scenes
• 5:02
  account
• 5:02
  of
• 5:02
  hardening
• 5:03
  Firefox
• 5:03
  with
• 5:03
  Claude,
• 5:04
  extending
• 5:05
  the
• 5:05
  Anthropic
• 5:05
  collaboration
• 5:06
  that
• 5:06
  previously
• 5:07
  found
• 5:07
  22
• 5:07
  zero-day
• 5:08
  vulnerabilities
• 5:08
  across
• 5:09
  Firefox
• 5:09
  in
• 5:09
  two
• 5:10
  weeks.
• 5:11
  The
• 5:11
  Reddit
• 5:11
  discussion
• 5:11
  was
• 5:12
  predictably
• 5:12
  polarized
• 5:12
  —
• 5:13
  some
• 5:14
  dismissing
• 5:14
  it
• 5:14
  as
• 5:14
  "security
• 5:15
  theater,"
• 5:16
  others
• 5:16
  noting
• 5:16
  that
• 5:16
  at
• 5:17
  $4
• 5:17
  in
• 5:17
  API
• 5:18
  credits
• 5:18
  for
• 5:18
  the
• 5:18
  exploit-generation
• 5:19
  side
• 5:19
  and
• 5:20
  skilled-researcher-equivalent
• 5:21
  output,
• 5:22
  the
• 5:22
  ROI
• 5:22
  is
• 5:22
  hard
• 5:23
  to
• 5:23
  argue
• 5:23
  with.
• 5:24
  The
• 5:24
  more
• 5:24
  interesting
• 5:25
  comments
• 5:25
  came
• 5:25
  from
• 5:25
  practitioners
• 5:26
  in
• 5:26
  finance
• 5:26
  who
• 5:27
  acknowledged
• 5:27
  being
• 5:27
  aware
• 5:28
  of
• 5:28
  many
• 5:28
  such
• 5:28
  vulnerabilities
• 5:29
  but
• 5:29
  not
• 5:30
  fixing
• 5:30
  them
• 5:30
  because
• 5:30
  "to
• 5:30
  exploit
• 5:31
  it
• 5:31
  literally
• 5:31
  means
• 5:32
  all
• 5:32
  other
• 5:32
  systems
• 5:32
  are
• 5:33
  already
• 5:33
  breached."
• 5:34
  That's
• 5:34
  exactly
• 5:35
  the
• 5:35
  calculus
• 5:35
  AI
• 5:35
  changes:
• 5:36
  when
• 5:37
  discovery
• 5:37
  is
• 5:37
  cheap
• 5:37
  and
• 5:38
  parallelizable,
• 5:38
  the
• 5:39
  old
• 5:39
  "not
• 5:39
  worth
• 5:40
  fixing"
• 5:40
  math
• 5:40
  breaks.
• 5:41
  The
• 5:42
  policy
• 5:42
  response
• 5:42
  is
• 5:43
  taking
• 5:43
  shape.
• 5:44
  US
• 5:45
  tech
• 5:45
  firms
• 5:45
  struck
• 5:45
  a
• 5:45
  deal
• 5:46
  with
• 5:46
  the
• 5:46
  government
• 5:46
  to
• 5:46
  review
• 5:47
  AI
• 5:47
  models
• 5:47
  for
• 5:48
  national
• 5:48
  security
• 5:48
  implications
• 5:49
  before
• 5:49
  public
• 5:50
  release.
• 5:51
  The
• 5:51
  LocalLLaMA
• 5:52
  community's
• 5:52
  reaction
• 5:53
  was
• 5:53
  almost
• 5:53
  uniformly
• 5:54
  hostile
• 5:54
  —
• 5:55
  "regulatory
• 5:55
  capture,"
• 5:57
  "RIP
• 5:57
  HuggingFace,"
• 5:58
  "more
• 5:58
  red
• 5:58
  tape
• 5:58
  before
• 5:59
  we
• 5:59
  get
• 5:59
  new
• 5:59
  models"
• 5:59
  —
• 6:00
  but
• 6:00
  the
• 6:01
  framing
• 6:01
  misses
• 6:01
  the
• 6:01
  actual
• 6:02
  mechanism.
• 6:03
  This
• 6:03
  isn't
• 6:03
  a
• 6:03
  ban
• 6:04
  on
• 6:04
  open
• 6:04
  weights.
• 6:05
  It's
• 6:05
  a
• 6:05
  pre-release
• 6:06
  review
• 6:06
  process
• 6:07
  for
• 6:07
  frontier
• 6:07
  models,
• 6:08
  driven
• 6:08
  by
• 6:09
  exactly
• 6:09
  the
• 6:09
  kind
• 6:09
  of
• 6:10
  AI-discovered
• 6:10
  zero-day
• 6:11
  Google
• 6:11
  just
• 6:11
  documented.
• 6:13
  Whether
• 6:13
  you
• 6:13
  think
• 6:13
  the
• 6:13
  cure
• 6:14
  is
• 6:14
  worse
• 6:14
  than
• 6:14
  the
• 6:14
  disease
• 6:15
  depends
• 6:15
  on
• 6:15
  whether
• 6:15
  you
• 6:16
  believe
• 6:16
  the
• 6:16
  government
• 6:16
  can
• 6:17
  review
• 6:17
  models
• 6:17
  faster
• 6:18
  than
• 6:18
  criminals
• 6:18
  can
• 6:18
  exploit
• 6:19
  them
• 6:19
  —
• 6:20
  and
• 6:20
  on
• 6:20
  that
• 6:21
  question,
• 6:22
  the
• 6:22
  track
• 6:22
  record
• 6:22
  is
• 6:22
  not
• 6:23
  encouraging.
• 6:27
  A
• 6:27
  provocative
• 6:28
  essay
• 6:28
  making
• 6:28
  the
• 6:28
  rounds
• 6:29
  argues
• 6:29
  that
• 6:29
  AI
• 6:30
  has
• 6:30
  inverted
• 6:30
  the
• 6:30
  old
• 6:30
  language-choice
• 6:31
  calculus:
• 6:32
  the
• 6:32
  languages
• 6:32
  that
• 6:33
  were
• 6:33
  hardest
• 6:33
  for
• 6:33
  humans
• 6:33
  —
• 6:34
  Rust,
• 6:35
  Go,
• 6:35
  Swift
• 6:35
  —
• 6:36
  turn
• 6:36
  out
• 6:36
  to
• 6:36
  be
• 6:36
  easiest
• 6:37
  for
• 6:37
  agents.
• 6:38
  The
• 6:38
  reason
• 6:39
  is
• 6:39
  tight
• 6:39
  compiler
• 6:39
  feedback
• 6:40
  loops.
• 6:41
  Every
• 6:41
  error
• 6:41
  message
• 6:42
  is
• 6:42
  a
• 6:42
  free
• 6:42
  training
• 6:42
  signal;
• 6:43
  every
• 6:43
  type
• 6:43
  constraint
• 6:44
  narrows
• 6:44
  the
• 6:44
  search
• 6:45
  space.
• 6:45
  The
• 6:45
  evidence
• 6:46
  is
• 6:46
  hard
• 6:46
  to
• 6:46
  dismiss.
• 6:47
  Microsoft
• 6:48
  rewrote
• 6:49
  the
• 6:49
  TypeScript
• 6:49
  compiler
• 6:49
  in
• 6:50
  Go
• 6:50
  (10x
• 6:50
  faster).
• 6:51
  Nicholas
• 6:52
  Carlini
• 6:52
  orchestrated
• 6:53
  16
• 6:53
  parallel
• 6:53
  Claude
• 6:54
  agents
• 6:54
  to
• 6:54
  write
• 6:54
  a
• 6:54
  production
• 6:55
  C
• 6:55
  compiler
• 6:55
  in
• 6:55
  Rust
• 6:56
  —
• 6:57
  100,000
• 6:57
  lines,
• 6:58
  boots
• 6:58
  Linux,
• 6:59
  compiles
• 6:59
  PostgreSQL,
• 7:00
  total
• 7:01
  cost
• 7:01
  under
• 7:01
  $20,000.
• 7:03
  Andreas
• 7:03
  Kling
• 7:03
  ported
• 7:04
  Ladybird's
• 7:04
  JavaScript
• 7:05
  engine
• 7:05
  from
• 7:05
  C++
• 7:06
  to
• 7:06
  Rust
• 7:07
  in
• 7:07
  two
• 7:07
  weeks
• 7:07
  with
• 7:07
  Claude
• 7:07
  Code
• 7:08
  —
• 7:09
  25,000
• 7:09
  lines,
• 7:10
  zero
• 7:10
  regressions
• 7:11
  across
• 7:11
  65,000+
• 7:13
  tests.
• 7:14
  Steve
• 7:14
  Klabnik
• 7:15
  built
• 7:15
  a
• 7:15
  new
• 7:15
  systems
• 7:15
  language
• 7:16
  in
• 7:16
  Rust
• 7:16
  in
• 7:16
  two
• 7:16
  weeks,
• 7:17
  getting
• 7:17
  further
• 7:17
  than
• 7:18
  he
• 7:18
  had
• 7:18
  in
• 7:18
  two
• 7:18
  months
• 7:18
  working
• 7:18
  manually.
• 7:19
  The
• 7:20
  irony
• 7:20
  runs
• 7:20
  deeper:
• 7:21
  the
• 7:21
  Python
• 7:21
  ecosystem
• 7:22
  is
• 7:22
  increasingly
• 7:22
  a
• 7:22
  Rust
• 7:23
  ecosystem
• 7:23
  wearing
• 7:23
  a
• 7:23
  Python
• 7:24
  hat.
• 7:24
  Pydantic's
• 7:25
  validation
• 7:25
  core
• 7:26
  is
• 7:26
  Rust.
• 7:27
  Polars
• 7:27
  is
• 7:27
  Rust.
• 7:28
  Hugging
• 7:28
  Face
• 7:28
  tokenizers,
• 7:29
  orjson,
• 7:30
  ruff,
• 7:30
  uv
• 7:31
  —
• 7:31
  all
• 7:31
  Rust.
• 7:33
  OpenAI
• 7:33
  acquired
• 7:34
  Astral
• 7:34
  (makers
• 7:35
  of
• 7:35
  ruff/uv)
• 7:36
  because
• 7:36
  uv
• 7:36
  saves
• 7:37
  Codex
• 7:37
  roughly
• 7:38
  a
• 7:38
  million
• 7:38
  minutes
• 7:38
  of
• 7:38
  compute
• 7:39
  per
• 7:39
  week.
• 7:40
  Anthropic
• 7:40
  acquired
• 7:40
  Bun.
• 7:42
  The
• 7:42
  wrappers
• 7:42
  remain
• 7:42
  Python,
• 7:43
  but
• 7:43
  the
• 7:43
  load-bearing
• 7:44
  code
• 7:44
  underneath
• 7:45
  has
• 7:45
  already
• 7:45
  shifted.
• 7:46
  As
• 7:46
  Armin
• 7:47
  Ronacher
• 7:47
  (creator
• 7:47
  of
• 7:47
  Flask)
• 7:48
  observed
• 7:48
  after
• 7:48
  porting
• 7:49
  MiniJinja
• 7:49
  from
• 7:49
  Rust
• 7:50
  to
• 7:50
  Go
• 7:50
  in
• 7:50
  10
• 7:50
  hours
• 7:51
  with
• 7:51
  an
• 7:51
  agent:
• 7:52
  "The
• 7:52
  value
• 7:52
  is
• 7:52
  shifting
• 7:53
  from
• 7:53
  the
• 7:53
  code
• 7:53
  to
• 7:53
  the
• 7:53
  tests
• 7:54
  and
• 7:54
  documentation."
• 7:55
  The
• 7:55
  deeper
• 7:56
  story
• 7:56
  behind
• 7:56
  these
• 7:56
  efficiency
• 7:57
  gains
• 7:57
  got
• 7:57
  a
• 7:57
  thorough
• 7:58
  airing
• 7:58
  in
• 7:58
  the
• 7:58
  Lex
• 7:58
  Fridman
• 7:59
  podcast
• 7:59
  with
• 7:59
  Dylan
• 8:00
  Patel
• 8:00
  (SemiAnalysis)
• 8:01
  and
• 8:01
  Nathan
• 8:01
  Lambert,
• 8:02
  diving
• 8:02
  into
• 8:02
  DeepSeek's
• 8:03
  training
• 8:03
  innovations.
• 8:04
  The
• 8:04
  headline-grabbing
• 8:05
  $5-6
• 8:06
  million
• 8:06
  cost
• 8:07
  for
• 8:07
  DeepSeek
• 8:07
  V3
• 8:08
  pre-training
• 8:08
  covers
• 8:09
  only
• 8:09
  one
• 8:09
  phase
• 8:09
  —
• 8:10
  SemiAnalysis
• 8:11
  estimates
• 8:12
  the
• 8:12
  actual
• 8:12
  GPU
• 8:12
  fleet
• 8:13
  at
• 8:13
  roughly
• 8:13
  50,000,
• 8:14
  shared
• 8:15
  with
• 8:15
  parent
• 8:15
  hedge
• 8:15
  fund
• 8:15
  High-Flyer's
• 8:16
  quantitative
• 8:17
  trading
• 8:17
  operations.
• 8:18
  The
• 8:18
  technical
• 8:19
  innovations
• 8:19
  matter
• 8:19
  more
• 8:19
  than
• 8:20
  the
• 8:20
  cost
• 8:20
  number:
• 8:21
  a
• 8:21
  Mixture
• 8:21
  of
• 8:21
  Experts
• 8:22
  architecture
• 8:22
  activating
• 8:23
  only
• 8:23
  37
• 8:24
  billion
• 8:24
  of
• 8:24
  671
• 8:25
  billion
• 8:26
  parameters
• 8:26
  (8
• 8:26
  of
• 8:27
  256
• 8:27
  experts,
• 8:28
  versus
• 8:29
  the
• 8:29
  typical
• 8:29
  2
• 8:29
  of
• 8:30
  8),
• 8:30
  Multi-head
• 8:31
  Latent
• 8:31
  Attention
• 8:31
  reducing
• 8:32
  memory
• 8:32
  by
• 8:32
  80-90%,
• 8:35
  and
• 8:35
  custom
• 8:36
  PTX-level
• 8:36
  communication
• 8:37
  scheduling
• 8:38
  that
• 8:38
  bypasses
• 8:38
  NVIDIA's
• 8:39
  standard
• 8:39
  NCCL
• 8:40
  library.
• 8:41
  Patel's
• 8:41
  sharpest
• 8:42
  insight:
• 8:43
  export
• 8:43
  controls
• 8:44
  don't
• 8:44
  prevent
• 8:44
  China
• 8:44
  from
• 8:45
  training
• 8:45
  models
• 8:45
  (small
• 8:46
  clusters
• 8:46
  suffice)
• 8:46
  but
• 8:47
  constrain
• 8:47
  deployment
• 8:47
  scale.
• 8:49
  "Training
• 8:49
  a
• 8:49
  model
• 8:49
  does
• 8:49
  effectively
• 8:50
  nothing.
• 8:51
  The
• 8:51
  thing
• 8:51
  that
• 8:51
  matters
• 8:51
  is
• 8:52
  implementation."
• 8:53
  Reuven
• 8:54
  Cohen
• 8:54
  frames
• 8:54
  the
• 8:54
  acceleration
• 8:55
  from
• 8:55
  a
• 8:55
  different
• 8:55
  angle,
• 8:56
  observing
• 8:57
  that
• 8:57
  successful
• 8:57
  open-source
• 8:58
  projects
• 8:58
  now
• 8:58
  behave
• 8:59
  like
• 8:59
  living
• 8:59
  systems:
• 9:00
  every
• 9:01
  issue,
• 9:01
  complaint,
• 9:02
  failed
• 9:03
  install,
• 9:03
  and
• 9:03
  angry
• 9:04
  rant
• 9:04
  becomes
• 9:04
  signal,
• 9:05
  not
• 9:05
  noise.
• 9:06
  Claude
• 9:06
  Code
• 9:06
  has
• 9:07
  collapsed
• 9:07
  the
• 9:07
  bug-to-fix
• 9:08
  cycle
• 9:08
  to
• 9:08
  hours.
• 9:09
  "The
• 9:09
  project
• 9:09
  starts
• 9:10
  evolving
• 9:10
  almost
• 9:10
  like
• 9:10
  an
• 9:10
  immune
• 9:11
  system
• 9:11
  responding
• 9:12
  to
• 9:12
  stress
• 9:12
  in
• 9:12
  real
• 9:12
  time."
• 9:13
  The
• 9:14
  old
• 9:14
  model
• 9:14
  was
• 9:14
  static
• 9:14
  releases
• 9:15
  and
• 9:15
  quarterly
• 9:15
  planning.
• 9:16
  This
• 9:17
  is
• 9:17
  recursive
• 9:17
  development
• 9:17
  —
• 9:18
  and
• 9:18
  the
• 9:18
  irony
• 9:19
  is
• 9:19
  that
• 9:19
  the
• 9:19
  more
• 9:19
  successful
• 9:20
  the
• 9:20
  project,
• 9:21
  the
• 9:21
  harsher
• 9:21
  the
• 9:21
  feedback,
• 9:22
  which
• 9:22
  is
• 9:22
  exactly
• 9:22
  what
• 9:22
  hardens
• 9:23
  it.
• 9:25
  We
• 9:26
  gave
• 9:26
  AI
• 9:26
  agents
• 9:27
  write
• 9:27
  access
• 9:27
  to
• 9:27
  our
• 9:27
  codebases.
• 9:28
  We
• 9:28
  did
• 9:29
  not
• 9:29
  give
• 9:29
  ourselves
• 9:29
  git
• 9:29
  for
• 9:30
  it.
• 9:30
  That's
• 9:30
  the
• 9:30
  pitch
• 9:30
  behind
• 9:31
  re
• 9:31
  gent,
• 9:31
  a
• 9:31
  Go-based
• 9:32
  version
• 9:32
  control
• 9:32
  system
• 9:33
  purpose-built
• 9:33
  for
• 9:33
  AI
• 9:34
  coding
• 9:34
  agent
• 9:34
  activity.
• 9:35
  It
• 9:35
  stores
• 9:35
  every
• 9:36
  tool
• 9:36
  call
• 9:36
  as
• 9:36
  a
• 9:36
  content-addressed
• 9:37
  Step
• 9:37
  in
• 9:38
  a
• 9:38
  .regent/
• 9:38
  directory
• 9:38
  (think
• 9:39
  .git/),
• 9:39
  forming
• 9:40
  a
• 9:40
  DAG
• 9:40
  where
• 9:40
  each
• 9:40
  session
• 9:41
  gets
• 9:41
  its
• 9:41
  own
• 9:41
  branch.
• 9:42
  Three
• 9:42
  primitives:
• 9:43
  rgt
• 9:44
  log
• 9:44
  (what
• 9:44
  did
• 9:44
  this
• 9:44
  session
• 9:44
  do),
• 9:45
  rgt
• 9:46
  blame
• 9:46
  (which
• 9:46
  prompt
• 9:46
  wrote
• 9:47
  this
• 9:47
  line),
• 9:47
  and
• 9:47
  eventually
• 9:48
  rgt
• 9:49
  rewind
• 9:49
  (restore
• 9:49
  any
• 9:50
  previous
• 9:50
  step).
• 9:51
  A
• 9:51
  VSCode
• 9:52
  extension
• 9:52
  adds
• 9:52
  inline
• 9:53
  blame
• 9:53
  annotations
• 9:53
  with
• 9:53
  hover
• 9:54
  tooltips
• 9:54
  showing
• 9:54
  full
• 9:54
  step
• 9:55
  context.
• 9:55
  The
• 9:55
  core
• 9:56
  is
• 9:56
  roughly
• 9:56
  7.8K
• 9:57
  lines
• 9:57
  of
• 9:57
  Go
• 9:57
  with
• 9:58
  BLAKE3
• 10:00
  hashing,
• 10:00
  SQLite
• 10:01
  indexing,
• 10:01
  and
• 10:01
  sub-10ms
• 10:02
  lookups.
• 10:03
  It's
• 10:04
  not
• 10:04
  v1.0
• 10:05
  yet,
• 10:05
  but
• 10:05
  the
• 10:05
  concept
• 10:06
  fills
• 10:06
  a
• 10:06
  genuine
• 10:06
  gap
• 10:07
  —
• 10:07
  when
• 10:07
  your
• 10:08
  agent
• 10:08
  makes
• 10:08
  50
• 10:08
  tool
• 10:09
  calls
• 10:09
  in
• 10:09
  a
• 10:09
  session
• 10:09
  and
• 10:10
  something
• 10:10
  breaks,
• 10:10
  you
• 10:11
  currently
• 10:11
  have
• 10:11
  no
• 10:11
  structured
• 10:12
  way
• 10:12
  to
• 10:12
  audit
• 10:12
  what
• 10:12
  happened.
• 10:14
  On
• 10:14
  the
• 10:14
  review
• 10:14
  side,
• 10:14
  adamsreview
• 10:15
  ships
• 10:15
  a
• 10:15
  six-command
• 10:16
  pipeline
• 10:16
  for
• 10:16
  Claude
• 10:17
  Code
• 10:17
  that
• 10:17
  runs
• 10:17
  multi-lens
• 10:18
  parallel
• 10:18
  code
• 10:19
  review
• 10:19
  —
• 10:19
  up
• 10:20
  to
• 10:20
  seven
• 10:20
  sub-agents
• 10:21
  covering
• 10:21
  correctness,
• 10:22
  security,
• 10:23
  UX,
• 10:23
  and
• 10:23
  more
• 10:23
  —
• 10:24
  followed
• 10:24
  by
• 10:24
  deduplication,
• 10:25
  a
• 10:26
  cheap-then-deep
• 10:26
  validation
• 10:27
  gate,
• 10:27
  and
• 10:27
  an
• 10:27
  optional
• 10:28
  Opus
• 10:28
  cross-cutting
• 10:29
  pass.
• 10:29
  The
• 10:30
  fix
• 10:30
  command
• 10:30
  dispatches
• 10:31
  per-group
• 10:31
  sub-agents
• 10:31
  in
• 10:32
  parallel,
• 10:32
  re-reviews
• 10:33
  with
• 10:33
  Opus,
• 10:34
  and
• 10:34
  reverts
• 10:34
  any
• 10:34
  regressions
• 10:35
  before
• 10:35
  committing
• 10:35
  survivors.
• 10:36
  On
• 10:37
  the
• 10:37
  author's
• 10:37
  own
• 10:37
  PRs,
• 10:38
  it
• 10:38
  catches
• 10:38
  "dramatically
• 10:39
  more
• 10:39
  real
• 10:39
  bugs"
• 10:40
  than
• 10:40
  Claude
• 10:40
  Code's
• 10:40
  built-in
• 10:41
  /review,
• 10:42
  CodeRabbit,
• 10:42
  or
• 10:42
  Greptile,
• 10:43
  with
• 10:44
  fewer
• 10:44
  false
• 10:44
  positives.
• 10:45
  The
• 10:46
  --ensemble
• 10:46
  flag
• 10:46
  adds
• 10:46
  a
• 10:46
  Codex
• 10:47
  CLI
• 10:47
  pass
• 10:47
  and
• 10:47
  PR
• 10:48
  bot-comment
• 10:48
  scrape
• 10:48
  on
• 10:48
  top.
• 10:49
  Anecdotal,
• 10:50
  n=1,
• 10:51
  but
• 10:51
  the
• 10:51
  architecture
• 10:52
  —
• 10:52
  parallel
• 10:53
  detection,
• 10:54
  validation
• 10:54
  gates,
• 10:55
  automated
• 10:55
  fix-and-revert
• 10:55
  —
• 10:56
  represents
• 10:57
  a
• 10:57
  mature
• 10:57
  approach
• 10:57
  to
• 10:58
  the
• 10:58
  "who
• 10:58
  reviews
• 10:58
  the
• 10:59
  AI's
• 10:59
  code?"
• 10:59
  problem.
• 11:01
  The
• 11:01
  cost
• 11:01
  visibility
• 11:01
  gap
• 11:02
  got
• 11:02
  its
• 11:02
  own
• 11:02
  tool:
• 11:03
  token-dashboard
• 11:03
  reads
• 11:04
  Claude
• 11:04
  Code's
• 11:04
  JSONL
• 11:05
  session
• 11:05
  transcripts
• 11:05
  and
• 11:06
  produces
• 11:06
  per-prompt
• 11:06
  cost
• 11:07
  analytics,
• 11:07
  tool/file
• 11:08
  heatmaps,
• 11:09
  subagent
• 11:09
  attribution,
• 11:10
  and
• 11:10
  cache
• 11:10
  analytics.
• 11:12
  Everything
• 11:12
  local,
• 11:13
  zero
• 11:13
  telemetry,
• 11:14
  stdlib-only
• 11:15
  Python.
• 11:15
  The
• 11:16
  most
• 11:16
  useful
• 11:16
  insight
• 11:16
  it
• 11:17
  surfaces:
• 11:17
  which
• 11:18
  prompts
• 11:18
  are
• 11:18
  expensive
• 11:18
  (usually
• 11:19
  the
• 11:19
  ones
• 11:19
  involving
• 11:19
  large
• 11:20
  tool
• 11:20
  results)
• 11:21
  and
• 11:21
  whether
• 11:21
  your
• 11:21
  cache
• 11:21
  hits
• 11:21
  are
• 11:22
  actually
• 11:22
  saving
• 11:22
  money.
• 11:23
  For
• 11:23
  the
• 11:24
  self-hosted
• 11:24
  crowd,
• 11:25
  Open
• 11:25
  WebUI
• 11:25
  v0.9.3/v0.9.4
• 11:30
  landed
• 11:30
  with
• 11:30
  performance
• 11:31
  improvements
• 11:31
  that
• 11:31
  matter
• 11:32
  at
• 11:32
  scale:
• 11:33
  chat
• 11:33
  history
• 11:33
  now
• 11:34
  loads
• 11:34
  from
• 11:34
  normalized
• 11:35
  message
• 11:35
  records,
• 11:36
  prompt
• 11:36
  lists
• 11:36
  filter
• 11:37
  in
• 11:37
  a
• 11:37
  single
• 11:37
  DB
• 11:38
  query
• 11:38
  instead
• 11:38
  of
• 11:38
  per-prompt
• 11:39
  permission
• 11:39
  checks,
• 11:40
  and
• 11:40
  per-user
• 11:41
  memory
• 11:41
  lookups
• 11:41
  are
• 11:41
  indexed.
• 11:42
  The
• 11:42
  headline
• 11:43
  feature
• 11:43
  is
• 11:43
  finally
• 11:44
  being
• 11:44
  able
• 11:44
  to
• 11:44
  edit
• 11:44
  assistant
• 11:45
  responses
• 11:45
  —
• 11:46
  including
• 11:46
  reasoning
• 11:47
  blocks
• 11:47
  and
• 11:47
  tool
• 11:47
  calls
• 11:47
  —
• 11:48
  and
• 11:48
  continue
• 11:49
  generating
• 11:49
  from
• 11:49
  the
• 11:49
  edited
• 11:50
  state
• 11:50
  with
• 11:50
  full
• 11:50
  context
• 11:51
  preserved.
• 11:52
  The
• 11:52
  upgrade
• 11:52
  path
• 11:52
  has
• 11:53
  a
• 11:53
  sharp
• 11:53
  edge,
• 11:53
  though:
• 11:55
  database
• 11:55
  schema
• 11:55
  changes
• 11:56
  mean
• 11:56
  all
• 11:56
  instances
• 11:57
  in
• 11:57
  a
• 11:57
  multi-worker
• 11:58
  deployment
• 11:58
  must
• 11:58
  update
• 11:59
  simultaneously,
• 12:00
  and
• 12:00
  community
• 12:01
  reports
• 12:01
  of
• 12:01
  broken
• 12:01
  Notes
• 12:02
  and
• 12:02
  chat
• 12:02
  history
• 12:03
  loading
• 12:03
  issues
• 12:03
  suggest
• 12:04
  it
• 12:04
  shipped
• 12:04
  slightly
• 12:05
  undercooked.
• 12:06
  The
• 12:06
  infrastructure
• 12:07
  layer
• 12:07
  got
• 12:07
  a
• 12:07
  new
• 12:07
  entrant
• 12:08
  from
• 12:08
  MIT's
• 12:08
  database
• 12:09
  group:
• 12:09
  Caliby,
• 12:10
  an
• 12:10
  embedded
• 12:11
  vector
• 12:11
  database
• 12:11
  designed
• 12:12
  specifically
• 12:12
  for
• 12:12
  AI
• 12:13
  agent
• 12:13
  memory.
• 12:14
  C++
• 12:15
  core
• 12:15
  with
• 12:15
  Python
• 12:15
  bindings,
• 12:16
  supporting
• 12:17
  HNSW,
• 12:17
  DiskANN,
• 12:18
  and
• 12:18
  IVF+PQ
• 12:19
  indexes
• 12:20
  with
• 12:20
  unified
• 12:20
  text-plus-vector
• 12:21
  storage.
• 12:22
  The
• 12:22
  pitch
• 12:22
  is
• 12:23
  the
• 12:23
  "DuckDB
• 12:23
  of
• 12:23
  AI
• 12:24
  agent
• 12:24
  data"
• 12:24
  —
• 12:25
  one
• 12:25
  pip
• 12:25
  install,
• 12:26
  no
• 12:26
  services
• 12:26
  to
• 12:26
  deploy,
• 12:27
  no
• 12:27
  DevOps.
• 12:28
  Benchmarks
• 12:28
  show
• 12:28
  4-5x
• 12:29
  throughput
• 12:29
  versus
• 12:30
  pgvector
• 12:31
  on
• 12:31
  50K
• 12:31
  vectors
• 12:32
  at
• 12:32
  dim=128,
• 12:34
  though
• 12:34
  the
• 12:34
  community
• 12:34
  immediately
• 12:35
  flagged
• 12:35
  that
• 12:36
  128
• 12:37
  dimensions
• 12:37
  is
• 12:37
  cache-friendly
• 12:38
  territory
• 12:39
  and
• 12:39
  demanded
• 12:39
  benchmarks
• 12:40
  at
• 12:40
  768+
• 12:41
  dimensions
• 12:42
  with
• 12:42
  orders
• 12:42
  of
• 12:42
  magnitude
• 12:43
  more
• 12:43
  vectors
• 12:44
  before
• 12:44
  taking
• 12:44
  the
• 12:44
  enterprise
• 12:45
  claims
• 12:45
  seriously.
• 12:47
  An
• 12:48
  ICLR
• 12:48
  2026
• 12:49
  paper
• 12:49
  from
• 12:49
  Sakana
• 12:50
  AI
• 12:50
  introduces
• 12:50
  the
• 12:51
  RL
• 12:51
  Conductor,
• 12:52
  a
• 12:52
  7B-parameter
• 12:53
  model
• 12:53
  trained
• 12:53
  via
• 12:54
  reinforcement
• 12:54
  learning
• 12:54
  to
• 12:55
  coordinate
• 12:55
  pools
• 12:55
  of
• 12:55
  much
• 12:56
  larger
• 12:56
  worker
• 12:56
  LLMs.
• 12:57
  The
• 12:57
  Conductor
• 12:58
  doesn't
• 12:58
  solve
• 12:58
  tasks
• 12:59
  directly
• 12:59
  —
• 13:00
  it
• 13:00
  outputs
• 13:00
  structured
• 13:00
  agentic
• 13:01
  workflows:
• 13:01
  natural-language
• 13:02
  subtask
• 13:02
  instructions,
• 13:03
  worker
• 13:04
  assignments,
• 13:04
  and
• 13:04
  access
• 13:04
  lists
• 13:05
  defining
• 13:05
  inter-agent
• 13:06
  visibility.
• 13:07
  Training
• 13:07
  uses
• 13:07
  GRPO
• 13:08
  on
• 13:08
  960
• 13:09
  verifiable
• 13:09
  problems
• 13:10
  and
• 13:10
  converges
• 13:11
  in
• 13:11
  just
• 13:11
  200
• 13:11
  iterations.
• 13:12
  Over
• 13:12
  training,
• 13:13
  the
• 13:13
  model
• 13:13
  learns
• 13:14
  emergent
• 13:14
  behaviors
• 13:14
  including
• 13:15
  targeted
• 13:15
  prompt
• 13:15
  engineering
• 13:16
  matched
• 13:16
  to
• 13:16
  worker
• 13:17
  strengths,
• 13:17
  verification
• 13:18
  rounds,
• 13:18
  and
• 13:19
  difficulty-adaptive
• 13:19
  compute
• 13:20
  allocation.
• 13:21
  The
• 13:21
  results
• 13:21
  are
• 13:21
  remarkable:
• 13:23
  despite
• 13:23
  being
• 13:23
  far
• 13:23
  smaller
• 13:24
  than
• 13:24
  any
• 13:24
  worker
• 13:25
  (which
• 13:25
  include
• 13:25
  GPT-5,
• 13:26
  Claude
• 13:26
  Sonnet
• 13:27
  4,
• 13:27
  and
• 13:27
  Gemini
• 13:28
  2.5
• 13:28
  Pro),
• 13:29
  the
• 13:29
  Conductor
• 13:29
  achieves
• 13:30
  MATH500
• 13:32
  99.4%,
• 13:34
  LiveCodeBench
• 13:34
  83.93%,
• 13:36
  and
• 13:36
  GPQA
• 13:37
  Diamond
• 13:37
  87.5%
• 13:38
  —
• 13:39
  exceeding
• 13:39
  GPT-5
• 13:40
  by
• 13:40
  2-5
• 13:41
  points
• 13:41
  on
• 13:41
  most
• 13:41
  tasks
• 13:41
  while
• 13:42
  averaging
• 13:42
  only
• 13:42
  three
• 13:42
  workflow
• 13:43
  steps.
• 13:44
  A
• 13:44
  recursive
• 13:44
  variant
• 13:45
  where
• 13:45
  the
• 13:45
  Conductor
• 13:45
  can
• 13:45
  select
• 13:46
  itself
• 13:46
  as
• 13:46
  a
• 13:46
  worker
• 13:46
  unlocks
• 13:47
  an
• 13:47
  additional
• 13:47
  test-time
• 13:48
  scaling
• 13:48
  axis
• 13:49
  with
• 13:49
  less
• 13:49
  than
• 13:49
  2x
• 13:50
  inference
• 13:50
  cost.
• 13:51
  The
• 13:51
  plumbing
• 13:52
  for
• 13:52
  multi-agent
• 13:52
  systems
• 13:53
  on
• 13:53
  edge
• 13:53
  devices
• 13:53
  got
• 13:53
  its
• 13:54
  own
• 13:54
  contribution:
• 13:55
  QKVShare,
• 13:55
  a
• 13:56
  framework
• 13:56
  for
• 13:56
  quantized
• 13:57
  KV-cache
• 13:57
  handoff
• 13:57
  between
• 13:58
  agents.
• 13:59
  The
• 13:59
  core
• 13:59
  problem
• 14:00
  is
• 14:00
  straightforward
• 14:00
  —
• 14:01
  when
• 14:01
  one
• 14:01
  agent
• 14:02
  passes
• 14:02
  context
• 14:03
  to
• 14:03
  another
• 14:03
  on
• 14:03
  a
• 14:03
  shared
• 14:03
  device,
• 14:04
  the
• 14:04
  receiving
• 14:05
  agent
• 14:05
  currently
• 14:05
  either
• 14:06
  re-processes
• 14:06
  everything
• 14:07
  from
• 14:07
  scratch
• 14:07
  (expensive)
• 14:08
  or
• 14:08
  transfers
• 14:08
  full-precision
• 14:09
  KV
• 14:09
  state
• 14:09
  (memory-hungry).
• 14:10
  QKVShare
• 14:11
  packages
• 14:11
  the
• 14:12
  sender's
• 14:12
  KV
• 14:12
  state
• 14:12
  into
• 14:13
  a
• 14:13
  quantized
• 14:13
  "CacheCard"
• 14:14
  with
• 14:14
  per-token
• 14:15
  mixed-precision
• 14:15
  allocation
• 14:16
  guided
• 14:16
  by
• 14:16
  a
• 14:16
  topology-aware
• 14:17
  controller.
• 14:18
  On
• 14:18
  150
• 14:20
  GSM8K
• 14:21
  problems
• 14:22
  with
• 14:22
  Llama
• 14:22
  3.1
• 14:23
  8B,
• 14:24
  the
• 14:24
  QKVShare
• 14:24
  handoff
• 14:25
  path
• 14:25
  reduced
• 14:25
  time-to-first-token
• 14:26
  from
• 14:26
  1,030ms
• 14:28
  to
• 14:28
  397ms
• 14:29
  at
• 14:29
  8K
• 14:30
  context
• 14:30
  versus
• 14:31
  full
• 14:31
  re-prefill.
• 14:32
  The
• 14:32
  paper
• 14:32
  is
• 14:32
  refreshingly
• 14:33
  honest
• 14:33
  about
• 14:33
  what
• 14:34
  it
• 14:34
  hasn't
• 14:34
  proven
• 14:34
  yet
• 14:34
  —
• 14:35
  the
• 14:35
  topology-aware
• 14:36
  controller
• 14:36
  hasn't
• 14:37
  consistently
• 14:37
  beaten
• 14:38
  a
• 14:38
  simpler
• 14:38
  local-only
• 14:39
  adaptive
• 14:39
  approach,
• 14:40
  and
• 14:40
  the
• 14:40
  prototype
• 14:41
  mixes
• 14:41
  runtimes
• 14:41
  in
• 14:41
  ways
• 14:42
  that
• 14:42
  complicate
• 14:42
  absolute
• 14:43
  latency
• 14:43
  comparisons.
• 14:45
  For
• 14:45
  a
• 14:45
  concrete
• 14:45
  example
• 14:46
  of
• 14:46
  multi-agent
• 14:46
  AI
• 14:47
  meeting
• 14:47
  the
• 14:47
  physical
• 14:47
  world,
• 14:48
  MachinaCheck
• 14:49
  deploys
• 14:49
  a
• 14:49
  four-agent
• 14:50
  pipeline
• 14:50
  for
• 14:50
  CNC
• 14:51
  manufacturability
• 14:51
  assessment
• 14:52
  on
• 14:52
  AMD's
• 14:52
  MI300X.
• 14:56
  A
• 14:56
  user
• 14:56
  uploads
• 14:57
  a
• 14:57
  STEP
• 14:57
  file
• 14:57
  (standard
• 14:58
  CAD
• 14:58
  format)
• 14:58
  with
• 14:58
  material,
• 14:59
  tolerance,
• 14:59
  and
• 15:00
  thread
• 15:00
  specs;
• 15:01
  30
• 15:01
  seconds
• 15:01
  later
• 15:01
  they
• 15:02
  get
• 15:02
  a
• 15:02
  complete
• 15:02
  feasibility
• 15:03
  report.
• 15:04
  The
• 15:04
  architecture
• 15:04
  makes
• 15:05
  the
• 15:05
  right
• 15:05
  call
• 15:05
  on
• 15:05
  where
• 15:05
  to
• 15:05
  use
• 15:05
  LLMs
• 15:06
  and
• 15:06
  where
• 15:06
  not
• 15:07
  to:
• 15:07
  the
• 15:07
  STEP
• 15:08
  parser
• 15:08
  is
• 15:08
  pure
• 15:08
  Python
• 15:09
  (mathematically
• 15:09
  exact
• 15:10
  geometry
• 15:10
  extraction),
• 15:12
  the
• 15:12
  tool-matching
• 15:12
  agent
• 15:12
  is
• 15:13
  a
• 15:13
  deterministic
• 15:13
  database
• 15:14
  lookup,
• 15:15
  and
• 15:15
  only
• 15:15
  the
• 15:15
  operations
• 15:16
  classifier
• 15:16
  and
• 15:16
  feasibility
• 15:17
  decision
• 15:17
  agent
• 15:18
  use
• 15:18
  Qwen
• 15:18
  2.5
• 15:19
  7B.
• 15:20
  The
• 15:20
  MI300X's
• 15:21
  192GB
• 15:23
  HBM3
• 15:24
  matters
• 15:24
  here
• 15:25
  not
• 15:25
  for
• 15:25
  raw
• 15:25
  speed
• 15:26
  but
• 15:26
  for
• 15:26
  data
• 15:26
  sovereignty
• 15:27
  —
• 15:27
  manufacturing
• 15:28
  customers
• 15:29
  sign
• 15:29
  NDAs,
• 15:30
  and
• 15:30
  sending
• 15:30
  proprietary
• 15:31
  STEP
• 15:31
  geometry
• 15:32
  to
• 15:32
  a
• 15:32
  cloud
• 15:32
  API
• 15:33
  endpoint
• 15:33
  is
• 15:33
  a
• 15:33
  confidentiality
• 15:34
  violation.
• 15:39
  A
• 15:40
  software
• 15:40
  engineer
• 15:40
  living
• 15:41
  in
• 15:41
  a
• 15:41
  noisy
• 15:41
  city
• 15:42
  built
• 15:42
  a
• 15:42
  sleep-disruption
• 15:43
  diagnostic
• 15:43
  system
• 15:44
  in
• 15:44
  roughly
• 15:44
  eight
• 15:45
  hours
• 15:45
  using
• 15:45
  AI
• 15:46
  tooling
• 15:46
  —
• 15:46
  a
• 15:46
  project
• 15:47
  he
• 15:47
  would
• 15:47
  not
• 15:47
  have
• 15:47
  started
• 15:48
  without
• 15:48
  it.
• 15:49
  The
• 15:49
  setup:
• 15:49
  two
• 15:50
  USB
• 15:50
  microphones
• 15:51
  (inside
• 15:51
  and
• 15:51
  outside),
• 15:52
  a
• 15:52
  Raspberry
• 15:53
  Pi
• 15:53
  gated
• 15:53
  by
• 15:54
  Home
• 15:54
  Assistant
• 15:54
  automations
• 15:55
  to
• 15:55
  only
• 15:55
  record
• 15:56
  when
• 15:56
  the
• 15:56
  user
• 15:56
  is
• 15:56
  in
• 15:56
  bed,
• 15:57
  Garmin
• 15:57
  sleep
• 15:57
  data
• 15:58
  pulled
• 15:58
  via
• 15:58
  API,
• 15:59
  and
• 15:59
  a
• 15:59
  custom
• 16:00
  web
• 16:00
  app
• 16:00
  that
• 16:00
  lays
• 16:00
  everything
• 16:01
  out
• 16:01
  as
• 16:01
  synced
• 16:01
  tracks
• 16:01
  like
• 16:02
  a
• 16:02
  music
• 16:02
  DAW.
• 16:03
  The
• 16:03
  AI
• 16:03
  wrote
• 16:04
  the
• 16:04
  code,
• 16:04
  including
• 16:05
  a
• 16:05
  custom
• 16:05
  Home
• 16:05
  Assistant
• 16:06
  integration
• 16:07
  and
• 16:07
  the
• 16:07
  Raspberry
• 16:07
  Pi's
• 16:08
  audio
• 16:08
  detection
• 16:08
  pipeline.
• 16:09
  The
• 16:09
  engineer
• 16:10
  tested
• 16:10
  results
• 16:10
  and
• 16:11
  gave
• 16:11
  feedback;
• 16:11
  he
• 16:12
  did
• 16:12
  not
• 16:12
  read
• 16:12
  the
• 16:12
  code.
• 16:13
  For
• 16:13
  the
• 16:13
  Pi
• 16:13
  specifically,
• 16:14
  he
• 16:14
  gave
• 16:14
  the
• 16:15
  coding
• 16:15
  agent
• 16:15
  SSH
• 16:16
  access
• 16:16
  and
• 16:16
  let
• 16:17
  it
• 16:17
  iterate
• 16:17
  directly
• 16:17
  on
• 16:18
  the
• 16:18
  device
• 16:18
  —
• 16:18
  setting
• 16:19
  up
• 16:19
  experiments,
• 16:20
  asking
• 16:20
  him
• 16:20
  to
• 16:20
  shout
• 16:21
  or
• 16:21
  drop
• 16:21
  something,
• 16:21
  recording
• 16:22
  the
• 16:22
  sample,
• 16:22
  and
• 16:23
  analyzing
• 16:23
  it.
• 16:24
  The
• 16:24
  results
• 16:25
  were
• 16:25
  immediate
• 16:25
  and
• 16:25
  actionable:
• 16:26
  neighbor
• 16:26
  doors,
• 16:27
  dish
• 16:27
  clinks
• 16:28
  traveling
• 16:28
  through
• 16:28
  walls,
• 16:29
  motorbikes,
• 16:29
  the
• 16:29
  trash
• 16:30
  collection
• 16:30
  truck.
• 16:31
  With
• 16:31
  actual
• 16:32
  data
• 16:32
  instead
• 16:32
  of
• 16:32
  guesses,
• 16:33
  targeted
• 16:33
  fixes
• 16:34
  (acoustic
• 16:34
  panels,
• 16:35
  door
• 16:35
  insulation,
• 16:36
  a
• 16:36
  conversation)
• 16:36
  showed
• 16:37
  up
• 16:37
  in
• 16:37
  both
• 16:37
  subjective
• 16:37
  morning
• 16:38
  feel
• 16:38
  and
• 16:38
  Garmin
• 16:38
  data
• 16:39
  over
• 16:39
  time.
• 16:40
  The
• 16:40
  broader
• 16:41
  pattern
• 16:41
  matters
• 16:41
  more
• 16:42
  than
• 16:42
  the
• 16:42
  specific
• 16:42
  project:
• 16:43
  a
• 16:43
  whole
• 16:43
  category
• 16:44
  of
• 16:44
  small
• 16:44
  personal
• 16:45
  problems
• 16:45
  has
• 16:45
  crossed
• 16:46
  from
• 16:46
  "too
• 16:46
  much
• 16:46
  effort
• 16:46
  for
• 16:47
  the
• 16:47
  payoff"
• 16:47
  into
• 16:48
  "sure,
• 16:48
  why
• 16:48
  not,
• 16:49
  let's
• 16:49
  give
• 16:49
  it
• 16:49
  a
• 16:49
  weekend."
• 16:51
  In
• 16:51
  the
• 16:51
  adjacent
• 16:51
  world
• 16:52
  of
• 16:52
  dedicated
• 16:52
  silicon
• 16:53
  doing
• 16:53
  extraordinary
• 16:53
  things,
• 16:54
  a
• 16:54
  Hackaday
• 16:55
  project
• 16:55
  crammed
• 16:55
  10,240
• 16:57
  individually
• 16:58
  controllable
• 16:58
  oscillators
• 16:59
  onto
• 16:59
  a
• 16:59
  Terasic
• 16:59
  DE10-nano
• 17:00
  FPGA.
• 17:02
  The
• 17:02
  creator
• 17:03
  calls
• 17:03
  it
• 17:03
  a
• 17:03
  spectrum
• 17:03
  engine:
• 17:04
  rather
• 17:04
  than
• 17:04
  generating
• 17:05
  waveforms
• 17:06
  through
• 17:06
  a
• 17:06
  DAC
• 17:06
  fed
• 17:06
  with
• 17:06
  samples,
• 17:08
  it
• 17:08
  directly
• 17:08
  implements
• 17:09
  the
• 17:09
  additive
• 17:09
  synthesis
• 17:09
  side
• 17:10
  of
• 17:10
  a
• 17:10
  Fourier
• 17:10
  transform
• 17:11
  in
• 17:11
  parallel
• 17:11
  hardware
• 17:12
  —
• 17:13
  every
• 17:13
  oscillator
• 17:14
  with
• 17:14
  independently
• 17:14
  controllable
• 17:15
  frequency,
• 17:16
  phase,
• 17:16
  and
• 17:16
  amplitude,
• 17:17
  all
• 17:17
  running
• 17:18
  concurrently
• 17:18
  in
• 17:18
  real
• 17:19
  time
• 17:19
  with
• 17:19
  no
• 17:19
  processor
• 17:20
  bottleneck.
• 17:21
  It
• 17:21
  can
• 17:21
  emulate
• 17:22
  virtually
• 17:22
  any
• 17:22
  form
• 17:23
  of
• 17:23
  audio
• 17:23
  synthesis
• 17:24
  driven
• 17:24
  by
• 17:24
  software,
• 17:25
  but
• 17:25
  without
• 17:26
  the
• 17:26
  software
• 17:26
  overhead.
• 17:27
  The
• 17:27
  demo
• 17:28
  shows
• 17:28
  it
• 17:28
  running
• 17:28
  as
• 17:29
  an
• 17:29
  80-voice
• 17:29
  polyphonic
• 17:30
  synthesizer,
• 17:31
  and
• 17:31
  while
• 17:31
  commenters
• 17:32
  noted
• 17:32
  the
• 17:32
  sounds
• 17:33
  aren't
• 17:33
  exactly
• 17:33
  groundbreaking,
• 17:34
  the
• 17:34
  architecture
• 17:35
  opens
• 17:35
  interesting
• 17:36
  doors
• 17:36
  for
• 17:36
  complex-harmonic
• 17:37
  generation
• 17:38
  at
• 17:38
  bandwidths
• 17:38
  that
• 17:38
  would
• 17:39
  choke
• 17:39
  a
• 17:39
  CPU.