Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – July 28, 2026

Transcript

AGI Dreams Podcast – July 28, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Sysdig's
• 0:00
  threat
• 0:00
  research
• 0:01
  team
• 0:01
  has
• 0:01
  documented
• 0:02
  what
• 0:02
  appears
• 0:02
  to
• 0:02
  be
• 0:02
  the
• 0:02
  first
• 0:03
  end-to-end
• 0:04
  ransomware
• 0:04
  operation
• 0:05
  executed
• 0:05
  autonomously
• 0:06
  by
• 0:06
  an
• 0:06
  LLM,
• 0:07
  and
• 0:07
  the
• 0:07
  implications
• 0:08
  land
• 0:08
  exactly
• 0:08
  where
• 0:09
  security
• 0:09
  professionals
• 0:09
  expected
• 0:10
  them
• 0:10
  to,
• 0:11
  just
• 0:11
  sooner
• 0:11
  than
• 0:11
  most
• 0:11
  predicted.
• 0:12
  The
• 0:12
  campaign,
• 0:13
  attributed
• 0:13
  to
• 0:13
  an
• 0:14
  "agentic
• 0:14
  threat
• 0:14
  actor"
• 0:15
  dubbed
• 0:15
  JadePuffer,
• 0:16
  exploited
• 0:16
  CVE-2025-3248
• 0:18
  --
• 0:20
  an
• 0:20
  unauthenticated
• 0:21
  remote
• 0:21
  code
• 0:21
  execution
• 0:22
  flaw
• 0:22
  in
• 0:22
  Langflow,
• 0:23
  the
• 0:23
  open-source
• 0:23
  AI-application
• 0:24
  builder
• 0:24
  --
• 0:25
  then
• 0:25
  pivoted
• 0:25
  to
• 0:25
  a
• 0:26
  separate
• 0:26
  production
• 0:26
  server
• 0:27
  running
• 0:27
  MySQL
• 0:27
  and
• 0:28
  Alibaba
• 0:28
  Nacos.
• 0:29
  The
• 0:29
  LLM
• 0:30
  agent
• 0:30
  enumerated
• 0:30
  the
• 0:30
  database,
• 0:31
  exfiltrated
• 0:32
  selected
• 0:32
  data,
• 0:33
  deleted
• 0:33
  the
• 0:33
  originals,
• 0:34
  and
• 0:34
  dropped
• 0:34
  an
• 0:34
  extortion
• 0:35
  note,
• 0:35
  all
• 0:36
  without
• 0:36
  a
• 0:36
  human
• 0:36
  operator
• 0:36
  touching
• 0:37
  the
• 0:37
  keyboard.
• 0:38
  None
• 0:38
  of
• 0:38
  the
• 0:38
  individual
• 0:39
  techniques
• 0:39
  were
• 0:39
  novel.
• 0:40
  What
• 0:41
  made
• 0:41
  JadePuffer
• 0:41
  remarkable
• 0:42
  was
• 0:42
  the
• 0:42
  chaining:
• 0:43
  the
• 0:43
  payloads
• 0:44
  were
• 0:44
  "self-narrating,"
• 0:45
  containing
• 0:45
  natural-language
• 0:46
  reasoning
• 0:47
  and
• 0:47
  target
• 0:47
  prioritization
• 0:48
  annotations
• 0:49
  that
• 0:49
  human
• 0:49
  operators
• 0:49
  rarely
• 0:50
  write
• 0:50
  but
• 0:51
  LLM-generated
• 0:51
  code
• 0:52
  produces
• 0:52
  reflexively.
• 0:53
  When
• 0:54
  a
• 0:54
  login
• 0:54
  attempt
• 0:54
  failed,
• 0:55
  the
• 0:55
  agent
• 0:56
  refined
• 0:56
  its
• 0:56
  parameters
• 0:57
  and
• 0:57
  had
• 0:57
  a
• 0:57
  working
• 0:57
  fix
• 0:57
  in
• 0:57
  31
• 0:58
  seconds.
• 0:59
  As
• 0:59
  Sysdig's
• 0:59
  Michael
• 1:00
  Clark
• 1:00
  put
• 1:00
  it,
• 1:01
  "tradecraft
• 1:01
  that
• 1:01
  once
• 1:01
  implied
• 1:02
  a
• 1:02
  capable
• 1:02
  human
• 1:02
  now
• 1:03
  implies
• 1:03
  a
• 1:03
  capable
• 1:04
  model."
• 1:05
  The
• 1:05
  defensive
• 1:05
  side
• 1:06
  of
• 1:06
  agentic
• 1:06
  security
• 1:06
  is
• 1:07
  evolving
• 1:07
  just
• 1:07
  as
• 1:08
  fast.
• 1:08
  Lovable,
• 1:09
  the
• 1:09
  AI-powered
• 1:10
  app
• 1:10
  builder,
• 1:11
  published
• 1:11
  a
• 1:11
  detailed
• 1:12
  account
• 1:12
  of
• 1:12
  running
• 1:12
  swarms
• 1:13
  of
• 1:13
  AI
• 1:13
  hacking
• 1:14
  agents
• 1:14
  against
• 1:14
  its
• 1:14
  own
• 1:15
  infrastructure
• 1:15
  in
• 1:15
  a
• 1:15
  continuous
• 1:16
  capture-the-flag
• 1:17
  program.
• 1:17
  The
• 1:18
  key
• 1:18
  design
• 1:18
  insight:
• 1:19
  never
• 1:19
  ask
• 1:19
  an
• 1:20
  agent
• 1:20
  to
• 1:20
  check
• 1:20
  whether
• 1:20
  a
• 1:20
  vulnerability
• 1:21
  exists.
• 1:22
  That
• 1:22
  framing
• 1:23
  lets
• 1:23
  the
• 1:23
  agent
• 1:23
  treat
• 1:24
  a
• 1:24
  clean
• 1:24
  pass
• 1:24
  as
• 1:24
  success
• 1:25
  and
• 1:25
  quit
• 1:25
  early,
• 1:26
  producing
• 1:26
  the
• 1:27
  "low-severity
• 1:27
  slop"
• 1:28
  that
• 1:28
  plagues
• 1:28
  conventional
• 1:29
  scanners.
• 1:30
  Instead,
• 1:31
  Lovable
• 1:31
  tells
• 1:31
  each
• 1:32
  agent
• 1:32
  that
• 1:32
  the
• 1:32
  vulnerability
• 1:33
  is
• 1:33
  real
• 1:33
  and
• 1:33
  its
• 1:33
  only
• 1:34
  job
• 1:34
  is
• 1:34
  to
• 1:34
  find
• 1:34
  it.
• 1:35
  The
• 1:35
  flag
• 1:36
  --
• 1:36
  a
• 1:36
  secret
• 1:37
  string
• 1:37
  planted
• 1:38
  deep
• 1:38
  in
• 1:38
  privileged
• 1:39
  surfaces
• 1:39
  --
• 1:40
  serves
• 1:40
  as
• 1:40
  deterministic
• 1:41
  ground
• 1:41
  truth.
• 1:42
  If
• 1:42
  an
• 1:42
  agent
• 1:43
  captures
• 1:43
  it,
• 1:44
  it
• 1:44
  found
• 1:44
  a
• 1:44
  real
• 1:44
  way
• 1:45
  in,
• 1:45
  not
• 1:45
  a
• 1:45
  model's
• 1:46
  hunch.
• 1:46
  Cost
• 1:47
  optimization
• 1:47
  matters
• 1:48
  here
• 1:48
  too:
• 1:49
  for
• 1:49
  certain
• 1:49
  bug
• 1:49
  classes,
• 1:50
  hundreds
• 1:50
  of
• 1:51
  cheap-model
• 1:51
  subagents
• 1:51
  scanning
• 1:52
  for
• 1:52
  one
• 1:52
  specific
• 1:53
  behavior
• 1:53
  outperform
• 1:54
  a
• 1:54
  single
• 1:54
  frontier
• 1:54
  model
• 1:55
  doing
• 1:55
  open-ended
• 1:56
  exploration.
• 1:57
  This
• 1:58
  offense-defense
• 1:58
  duality
• 1:59
  makes
• 1:59
  the
• 1:59
  ongoing
• 2:00
  debate
• 2:00
  about
• 2:00
  Anthropic's
• 2:01
  cybersecurity
• 2:01
  guardrails
• 2:02
  feel
• 2:02
  increasingly
• 2:03
  urgent.
• 2:04
  A
• 2:04
  widely
• 2:04
  upvoted
• 2:05
  thread
• 2:05
  on
• 2:05
  r/Anthropic
• 2:06
  argues
• 2:07
  that
• 2:07
  restricting
• 2:07
  frontier
• 2:08
  models
• 2:08
  from
• 2:08
  security
• 2:09
  work
• 2:09
  is
• 2:09
  "completely
• 2:10
  backwards"
• 2:10
  --
• 2:11
  it
• 2:11
  creates
• 2:11
  a
• 2:11
  target-rich
• 2:12
  environment
• 2:12
  of
• 2:13
  insecure
• 2:13
  vibe-coded
• 2:14
  apps
• 2:14
  while
• 2:14
  leaving
• 2:14
  defenders
• 2:15
  unable
• 2:15
  to
• 2:16
  audit
• 2:16
  at
• 2:16
  frontier-model
• 2:17
  capability
• 2:17
  levels.
• 2:18
  The
• 2:19
  counterargument
• 2:19
  is
• 2:19
  real:
• 2:20
  distinguishing
• 2:21
  "analyze
• 2:21
  this
• 2:21
  code
• 2:22
  for
• 2:22
  vulnerabilities
• 2:22
  so
• 2:23
  I
• 2:23
  can
• 2:23
  fix
• 2:23
  them"
• 2:23
  from
• 2:24
  "so
• 2:24
  I
• 2:24
  can
• 2:24
  exploit
• 2:24
  them"
• 2:25
  is
• 2:25
  a
• 2:25
  genuinely
• 2:26
  hard
• 2:26
  problem.
• 2:27
  But
• 2:27
  as
• 2:27
  one
• 2:27
  commenter
• 2:28
  noted,
• 2:29
  the
• 2:29
  irony
• 2:29
  would
• 2:29
  be
• 2:29
  devastating
• 2:30
  if
• 2:30
  "made
• 2:30
  with
• 2:30
  Claude
• 2:31
  Code"
• 2:31
  became
• 2:32
  synonymous
• 2:32
  with
• 2:32
  "insecure
• 2:33
  software"
• 2:34
  because
• 2:34
  developers
• 2:35
  had
• 2:35
  to
• 2:35
  turn
• 2:35
  to
• 2:35
  unrestricted
• 2:36
  Chinese
• 2:36
  models
• 2:37
  for
• 2:37
  security
• 2:37
  auditing.
• 2:39
  On
• 2:39
  the
• 2:39
  tooling
• 2:39
  side,
• 2:40
  Offensive-COM
• 2:41
  is
• 2:41
  a
• 2:41
  new
• 2:41
  research-grade
• 2:42
  knowledge
• 2:42
  base
• 2:43
  covering
• 2:43
  Windows
• 2:43
  COM
• 2:44
  (Component
• 2:44
  Object
• 2:44
  Model)
• 2:45
  offensive
• 2:45
  security
• 2:46
  from
• 2:46
  zero
• 2:46
  to
• 2:46
  zero-day,
• 2:47
  spanning
• 2:48
  eight
• 2:48
  chapters
• 2:48
  with
• 2:49
  28
• 2:49
  technical
• 2:50
  diagrams,
• 2:50
  lab
• 2:51
  snippets,
• 2:51
  and
• 2:51
  detection
• 2:52
  guidance
• 2:52
  for
• 2:52
  every
• 2:53
  technique.
• 2:54
  It
• 2:54
  was
• 2:54
  generated
• 2:55
  by
• 2:55
  Kimi
• 2:55
  K3
• 2:56
  Swarms
• 2:56
  and
• 2:56
  carries
• 2:57
  an
• 2:57
  honest
• 2:57
  warning
• 2:57
  label
• 2:58
  about
• 2:58
  potential
• 2:59
  inaccuracies
• 2:59
  --
• 3:00
  but
• 3:00
  the
• 3:01
  structure
• 3:01
  is
• 3:01
  serious:
• 3:02
  DCOM
• 3:03
  lateral
• 3:03
  movement,
• 3:04
  the
• 3:04
  full
• 3:04
  Potato
• 3:05
  privilege-escalation
• 3:06
  family
• 3:06
  tree,
• 3:07
  UAC
• 3:07
  bypasses,
• 3:08
  TypeLib
• 3:08
  hijacking
• 3:09
  including
• 3:09
  the
• 3:09
  2025
• 3:10
  ReliaQuest/Black
• 3:11
  Basta
• 3:12
  in-the-wild
• 3:12
  case,
• 3:13
  and
• 3:13
  a
• 3:13
  capstone
• 3:14
  chapter
• 3:14
  assembling
• 3:14
  the
• 3:14
  full
• 3:15
  hunting
• 3:15
  pipeline
• 3:15
  from
• 3:15
  enumeration
• 3:16
  through
• 3:16
  fuzzing
• 3:16
  to
• 3:17
  MSRC
• 3:17
  reporting.
• 3:18
  Meanwhile,
• 3:19
  ShadowBroker
• 3:20
  ships
• 3:20
  a
• 3:20
  decentralized
• 3:21
  OSINT
• 3:21
  platform
• 3:22
  aggregating
• 3:22
  60+
• 3:23
  live
• 3:23
  intelligence
• 3:24
  feeds
• 3:24
  --
• 3:25
  aircraft
• 3:25
  ADS-B,
• 3:26
  maritime
• 3:27
  AIS,
• 3:27
  satellites,
• 3:28
  CCTV
• 3:29
  networks,
• 3:29
  GPS
• 3:30
  jamming,
• 3:30
  Shodan
• 3:31
  device
• 3:31
  search,
• 3:32
  malware
• 3:32
  C2
• 3:32
  hotspots,
• 3:33
  and
• 3:33
  Telegram
• 3:34
  war
• 3:34
  channels
• 3:34
  --
• 3:35
  onto
• 3:35
  a
• 3:35
  single
• 3:36
  dark-ops
• 3:36
  map
• 3:36
  interface,
• 3:37
  complete
• 3:37
  with
• 3:37
  an
• 3:38
  HMAC-signed
• 3:38
  agentic
• 3:39
  command
• 3:39
  channel
• 3:39
  for
• 3:39
  AI
• 3:40
  co-analysts.
• 3:45
  If
• 3:45
  agentic
• 3:45
  AI
• 3:46
  systems
• 3:46
  are
• 3:46
  going
• 3:46
  to
• 3:47
  operate
• 3:47
  autonomously
• 3:48
  in
• 3:48
  regulated
• 3:49
  industries
• 3:49
  --
• 3:49
  finance,
• 3:50
  healthcare,
• 3:51
  aviation
• 3:52
  --
• 3:52
  someone
• 3:53
  needs
• 3:53
  to
• 3:53
  verify
• 3:53
  that
• 3:53
  they
• 3:54
  actually
• 3:54
  follow
• 3:54
  the
• 3:54
  rules,
• 3:55
  not
• 3:55
  just
• 3:55
  at
• 3:55
  deployment
• 3:56
  time
• 3:56
  but
• 3:56
  continuously.
• 3:57
  A
• 3:58
  research
• 3:58
  team
• 3:58
  at
• 3:58
  the
• 3:58
  University
• 3:59
  of
• 3:59
  Toronto
• 4:00
  and
• 4:00
  the
• 4:00
  Vector
• 4:00
  Institute
• 4:00
  has
• 4:01
  proposed
• 4:01
  exactly
• 4:01
  this:
• 4:02
  a
• 4:02
  family
• 4:02
  of
• 4:02
  algorithms
• 4:03
  called
• 4:03
  TRAC
• 4:03
  (Temporal
• 4:03
  Rule
• 4:04
  Assessment
• 4:04
  and
• 4:04
  Compliance)
• 4:05
  that
• 4:05
  uses
• 4:05
  Linear
• 4:06
  Temporal
• 4:06
  Logic
• 4:06
  (LTL)
• 4:07
  to
• 4:07
  formally
• 4:08
  specify
• 4:08
  behavioral
• 4:09
  constraints
• 4:09
  and
• 4:09
  then
• 4:09
  monitors
• 4:10
  LLM-based
• 4:10
  systems
• 4:11
  for
• 4:11
  violations
• 4:11
  in
• 4:11
  real
• 4:12
  time.
• 4:12
  The
• 4:12
  approach
• 4:13
  is
• 4:13
  elegant
• 4:13
  in
• 4:13
  its
• 4:13
  decomposition:
• 4:15
  LLMs
• 4:15
  handle
• 4:15
  the
• 4:15
  labeling
• 4:16
  (identifying
• 4:16
  which
• 4:17
  propositions
• 4:17
  are
• 4:17
  true
• 4:17
  at
• 4:18
  each
• 4:18
  timestep),
• 4:19
  while
• 4:19
  formal
• 4:19
  methods
• 4:19
  handle
• 4:20
  the
• 4:20
  temporal
• 4:20
  reasoning
• 4:20
  (tracking
• 4:21
  whether
• 4:21
  patterns
• 4:21
  like
• 4:21
  "if
• 4:22
  invoiced,
• 4:22
  then
• 4:22
  eventually
• 4:23
  pay"
• 4:23
  are
• 4:23
  satisfied
• 4:23
  across
• 4:24
  arbitrarily
• 4:24
  long
• 4:24
  sequences).
• 4:25
  The
• 4:25
  results
• 4:26
  are
• 4:26
  striking
• 4:26
  --
• 4:27
  even
• 4:27
  small
• 4:27
  labeling
• 4:28
  models
• 4:28
  combined
• 4:28
  with
• 4:28
  TRAC
• 4:29
  match
• 4:29
  or
• 4:29
  exceed
• 4:30
  frontier
• 4:30
  LLMs
• 4:31
  used
• 4:31
  as
• 4:31
  standalone
• 4:32
  judges
• 4:32
  for
• 4:32
  auditing,
• 4:33
  at
• 4:33
  a
• 4:33
  fraction
• 4:34
  of
• 4:34
  the
• 4:34
  cost.
• 4:34
  The
• 4:35
  paper's
• 4:35
  controlled
• 4:35
  experiments
• 4:36
  reveal
• 4:36
  a
• 4:36
  fundamental
• 4:37
  limitation:
• 4:38
  LLM
• 4:38
  temporal
• 4:38
  reasoning
• 4:39
  degrades
• 4:39
  significantly
• 4:40
  with
• 4:40
  increasing
• 4:40
  event
• 4:40
  distance,
• 4:41
  constraint
• 4:41
  count,
• 4:42
  and
• 4:42
  proposition
• 4:42
  count.
• 4:43
  When
• 4:43
  the
• 4:44
  gap
• 4:44
  between
• 4:44
  causally
• 4:44
  related
• 4:45
  events
• 4:45
  exceeds
• 4:45
  about
• 4:46
  ten
• 4:46
  steps,
• 4:46
  smaller
• 4:47
  models
• 4:47
  drop
• 4:47
  to
• 4:47
  near-random
• 4:48
  performance.
• 4:49
  Complex
• 4:50
  temporal
• 4:50
  formulas
• 4:50
  break
• 4:51
  even
• 4:51
  frontier
• 4:51
  models.
• 4:52
  This
• 4:53
  is
• 4:53
  not
• 4:53
  a
• 4:53
  calibration
• 4:53
  problem
• 4:54
  --
• 4:54
  it
• 4:55
  is
• 4:55
  an
• 4:55
  architectural
• 4:55
  one.
• 4:56
  LLMs
• 4:56
  reason
• 4:57
  well
• 4:57
  about
• 4:57
  local
• 4:57
  patterns
• 4:58
  but
• 4:58
  struggle
• 4:59
  to
• 4:59
  track
• 4:59
  obligations
• 5:00
  across
• 5:00
  long
• 5:00
  behavioral
• 5:01
  traces,
• 5:01
  which
• 5:01
  is
• 5:02
  precisely
• 5:02
  the
• 5:02
  kind
• 5:02
  of
• 5:02
  reasoning
• 5:03
  that
• 5:03
  compliance
• 5:03
  monitoring
• 5:04
  requires.
• 5:05
  TRAC's
• 5:05
  extension,
• 5:06
  TRAC-PI,
• 5:09
  adds
• 5:09
  predictive
• 5:09
  monitoring
• 5:10
  and
• 5:10
  black-box
• 5:10
  intervention:
• 5:11
  when
• 5:12
  a
• 5:12
  violation
• 5:12
  is
• 5:12
  forecast
• 5:13
  within
• 5:13
  the
• 5:13
  next
• 5:13
  few
• 5:13
  steps,
• 5:14
  the
• 5:14
  system
• 5:15
  can
• 5:15
  reject
• 5:15
  the
• 5:15
  output,
• 5:16
  augment
• 5:16
  the
• 5:16
  prompt
• 5:17
  with
• 5:17
  the
• 5:17
  residual
• 5:17
  LTL
• 5:18
  formula,
• 5:19
  or
• 5:19
  substitute
• 5:19
  a
• 5:19
  safer
• 5:20
  model.
• 5:21
  Experiments
• 5:21
  show
• 5:22
  this
• 5:22
  reduces
• 5:22
  violation
• 5:23
  rates
• 5:23
  without
• 5:23
  significant
• 5:24
  task-performance
• 5:24
  degradation.
• 5:26
  A
• 5:26
  complementary
• 5:27
  essay
• 5:27
  by
• 5:27
  Justin
• 5:27
  Flick
• 5:28
  makes
• 5:28
  the
• 5:28
  practical
• 5:28
  case
• 5:29
  against
• 5:29
  a
• 5:29
  specific
• 5:29
  form
• 5:30
  of
• 5:30
  LLM
• 5:30
  self-assessment:
• 5:32
  asking
• 5:32
  models
• 5:32
  for
• 5:32
  confidence
• 5:33
  scores.
• 5:34
  The
• 5:35
  argument
• 5:35
  is
• 5:35
  architecturally
• 5:36
  grounded.
• 5:37
  Token-level
• 5:38
  likelihoods
• 5:38
  are
• 5:38
  not
• 5:39
  uniform
• 5:39
  across
• 5:39
  a
• 5:39
  response
• 5:40
  --
• 5:41
  structural
• 5:41
  glue
• 5:42
  tokens
• 5:42
  have
• 5:43
  near-certain
• 5:43
  probabilities
• 5:44
  while
• 5:44
  the
• 5:44
  load-bearing
• 5:45
  factual
• 5:45
  claim
• 5:45
  might
• 5:46
  be
• 5:46
  highly
• 5:46
  uncertain,
• 5:47
  and
• 5:47
  collapsing
• 5:48
  that
• 5:48
  distribution
• 5:48
  into
• 5:49
  a
• 5:49
  single
• 5:49
  number
• 5:49
  is,
• 5:50
  as
• 5:50
  Flick
• 5:50
  puts
• 5:51
  it,
• 5:51
  "not
• 5:51
  a
• 5:51
  measurement,
• 5:52
  it's
• 5:52
  a
• 5:52
  vibe."
• 5:53
  Research
• 5:53
  from
• 5:53
  Xiong
• 5:54
  et
• 5:54
  al.
• 5:55
  shows
• 5:55
  models
• 5:56
  cluster
• 5:56
  on
• 5:56
  round-number
• 5:57
  anchors,
• 5:58
  with
• 5:58
  one
• 5:58
  model
• 5:58
  reporting
• 5:59
  exactly
• 5:59
  100
• 6:00
  on
• 6:00
  68%
• 6:01
  of
• 6:01
  instances.
• 6:02
  Coarser
• 6:03
  categorical
• 6:03
  scales
• 6:04
  actually
• 6:04
  outperform
• 6:05
  fine-grained
• 6:06
  0-100
• 6:06
  scores
• 6:07
  on
• 6:07
  metacognitive
• 6:08
  sensitivity.
• 6:09
  Flick's
• 6:09
  most
• 6:10
  compelling
• 6:10
  point:
• 6:11
  if
• 6:11
  a
• 6:11
  model
• 6:11
  is
• 6:11
  aware
• 6:12
  enough
• 6:12
  to
• 6:12
  know
• 6:12
  something
• 6:13
  in
• 6:13
  its
• 6:13
  response
• 6:13
  is
• 6:13
  wrong,
• 6:14
  it
• 6:14
  should
• 6:14
  fix
• 6:15
  it,
• 6:15
  not
• 6:15
  ship
• 6:15
  it
• 6:16
  with
• 6:16
  a
• 6:16
  sticker.
• 6:17
  And
• 6:17
  if
• 6:17
  it
• 6:17
  is
• 6:17
  not
• 6:18
  aware
• 6:18
  enough,
• 6:19
  the
• 6:19
  confidence
• 6:19
  score
• 6:19
  is
• 6:20
  not
• 6:20
  measuring
• 6:20
  anything.
• 6:21
  The
• 6:21
  real
• 6:22
  problem
• 6:22
  is
• 6:22
  search
• 6:23
  quality,
• 6:23
  not
• 6:24
  self-assessment
• 6:24
  theater.
• 6:27
  Moonshot
• 6:28
  AI
• 6:28
  has
• 6:29
  released
• 6:29
  the
• 6:29
  full
• 6:29
  weights
• 6:29
  of
• 6:29
  Kimi
• 6:30
  K3
• 6:30
  on
• 6:30
  HuggingFace,
• 6:31
  making
• 6:32
  it
• 6:32
  the
• 6:32
  world's
• 6:32
  first
• 6:32
  open
• 6:33
  3T-class
• 6:33
  model.
• 6:34
  K3
• 6:35
  is
• 6:35
  a
• 6:35
  2.8-trillion-parameter
• 6:36
  mixture-of-experts
• 6:37
  model
• 6:37
  built
• 6:37
  on
• 6:37
  Kimi
• 6:38
  Delta
• 6:38
  Attention
• 6:38
  (KDA)
• 6:39
  and
• 6:39
  Attention
• 6:39
  Residuals
• 6:40
  (AttnRes),
• 6:40
  activating
• 6:41
  16
• 6:41
  out
• 6:41
  of
• 6:42
  896
• 6:42
  experts
• 6:43
  per
• 6:43
  token
• 6:43
  via
• 6:44
  a
• 6:44
  Stable
• 6:44
  LatentMoE
• 6:44
  framework.
• 6:45
  The
• 6:45
  benchmarks
• 6:46
  are
• 6:46
  frontier-competitive:
• 6:47
  K3
• 6:48
  trades
• 6:48
  blows
• 6:48
  with
• 6:48
  Claude
• 6:49
  Fable
• 6:49
  5
• 6:49
  and
• 6:49
  GPT-5.6
• 6:50
  Sol
• 6:51
  across
• 6:51
  coding
• 6:51
  (DeepSWE,
• 6:52
  Kimi
• 6:52
  Code
• 6:53
  Bench
• 6:53
  2.0),
• 6:54
  knowledge
• 6:54
  work
• 6:55
  (OfficeQA
• 6:55
  Pro,
• 6:55
  SpreadsheetBench
• 6:56
  2),
• 6:56
  and
• 6:57
  agentic
• 6:57
  tasks
• 6:57
  (GDPval-AA
• 6:58
  v2,
• 6:59
  APEX-Agents).
• 7:00
  It
• 7:01
  supports
• 7:01
  a
• 7:01
  million-token
• 7:02
  context
• 7:02
  window,
• 7:03
  native
• 7:03
  multimodal
• 7:04
  input
• 7:04
  (text,
• 7:05
  images,
• 7:05
  video),
• 7:06
  and
• 7:06
  quantization-aware
• 7:07
  training
• 7:07
  with
• 7:07
  MXFP4
• 7:09
  weights
• 7:09
  and
• 7:09
  MXFP8
• 7:12
  activations
• 7:12
  for
• 7:12
  broad
• 7:13
  hardware
• 7:13
  compatibility.
• 7:14
  The
• 7:15
  release
• 7:15
  includes
• 7:15
  an
• 7:15
  OpenAI/Anthropic-compatible
• 7:17
  API
• 7:18
  and
• 7:18
  works
• 7:18
  with
• 7:18
  Kimi
• 7:18
  Code
• 7:19
  as
• 7:19
  its
• 7:19
  recommended
• 7:20
  agent
• 7:20
  framework.
• 7:21
  The
• 7:22
  inference
• 7:22
  infrastructure
• 7:22
  story
• 7:23
  is
• 7:23
  less
• 7:23
  settled.
• 7:24
  A
• 7:24
  detailed
• 7:25
  community
• 7:25
  investigation
• 7:26
  into
• 7:26
  Ling-3.0-flash
• 7:27
  --
• 7:28
  Ant
• 7:29
  Group's
• 7:29
  latest
• 7:29
  frontier
• 7:30
  model
• 7:30
  --
• 7:30
  found
• 7:31
  that
• 7:31
  SGLang
• 7:31
  committed
• 7:32
  to
• 7:32
  day-zero
• 7:32
  support
• 7:33
  and
• 7:33
  vLLM
• 7:33
  is
• 7:34
  "coming
• 7:34
  soon,"
• 7:35
  but
• 7:35
  the
• 7:35
  llama.cpp
• 7:37
  situation
• 7:38
  is
• 7:38
  more
• 7:38
  complex.
• 7:39
  The
• 7:39
  good
• 7:39
  news:
• 7:40
  llama.cpp
• 7:42
  already
• 7:42
  ships
• 7:42
  the
• 7:42
  delta-net/KDA
• 7:45
  kernels
• 7:45
  from
• 7:45
  Kimi-Linear
• 7:46
  and
• 7:46
  Qwen3.5
• 7:49
  support.
• 7:50
  The
• 7:50
  blocker
• 7:51
  is
• 7:51
  the
• 7:51
  Bailing
• 7:51
  MoE
• 7:52
  conversion
• 7:52
  path,
• 7:53
  which
• 7:53
  is
• 7:53
  a
• 7:53
  "somebody-has-to-write-the-PR
• 7:55
  problem"
• 7:56
  rather
• 7:56
  than
• 7:56
  a
• 7:56
  fundamentally
• 7:57
  hard
• 7:57
  one.
• 7:58
  Community
• 7:58
  commenters
• 7:59
  confirmed
• 7:59
  BailingMoeV2
• 8:00
  actually
• 8:00
  did
• 8:01
  get
• 8:01
  merged
• 8:01
  via
• 8:01
  a
• 8:01
  different
• 8:02
  PR
• 8:02
  than
• 8:02
  the
• 8:02
  one
• 8:02
  that
• 8:03
  was
• 8:03
  closed
• 8:03
  as
• 8:03
  not
• 8:03
  planned.
• 8:04
  The
• 8:04
  weights
• 8:05
  themselves
• 8:05
  are
• 8:05
  expected
• 8:06
  shortly
• 8:06
  after
• 8:06
  a
• 8:06
  free
• 8:07
  API
• 8:07
  window
• 8:08
  ending
• 8:08
  August
• 8:08
  3
• 8:08
  --
• 8:09
  following
• 8:10
  the
• 8:10
  same
• 8:10
  pattern
• 8:10
  as
• 8:10
  Ling-2.6-flash,
• 8:12
  which
• 8:12
  went
• 8:12
  from
• 8:13
  free
• 8:13
  API
• 8:13
  to
• 8:14
  HuggingFace
• 8:14
  weights
• 8:14
  in
• 8:14
  about
• 8:15
  a
• 8:15
  week.
• 8:16
  All
• 8:16
  of
• 8:16
  this
• 8:16
  unfolds
• 8:17
  against
• 8:17
  a
• 8:17
  sharpening
• 8:17
  policy
• 8:18
  backdrop.
• 8:19
  Reports
• 8:20
  of
• 8:20
  the
• 8:20
  US
• 8:20
  government
• 8:20
  considering
• 8:21
  sanctions
• 8:21
  on
• 8:21
  open-source
• 8:22
  AI
• 8:22
  models
• 8:23
  have
• 8:23
  drawn
• 8:23
  predictable
• 8:24
  pushback
• 8:24
  from
• 8:24
  the
• 8:24
  local-inference
• 8:25
  community,
• 8:26
  with
• 8:26
  commenters
• 8:27
  noting
• 8:27
  the
• 8:27
  structural
• 8:27
  irony:
• 8:28
  the
• 8:28
  same
• 8:29
  frontier
• 8:29
  labs
• 8:29
  whose
• 8:30
  training
• 8:30
  data
• 8:30
  practices
• 8:31
  arguably
• 8:31
  constitute
• 8:32
  the
• 8:32
  largest-scale
• 8:33
  IP
• 8:33
  appropriation
• 8:34
  in
• 8:34
  history
• 8:34
  are
• 8:34
  now
• 8:35
  lobbying
• 8:35
  to
• 8:35
  restrict
• 8:36
  others
• 8:36
  from
• 8:36
  building
• 8:36
  on
• 8:37
  open
• 8:37
  weights.
• 8:38
  As
• 8:38
  one
• 8:38
  thread
• 8:38
  participant
• 8:39
  observed,
• 8:40
  calling
• 8:40
  it
• 8:40
  "IP
• 8:41
  theft"
• 8:42
  when
• 8:42
  there
• 8:42
  are
• 8:42
  no
• 8:42
  IP
• 8:42
  laws
• 8:43
  protecting
• 8:43
  AI
• 8:44
  outputs
• 8:44
  or
• 8:44
  behavior
• 8:45
  is
• 8:45
  "disingenuous
• 8:46
  at
• 8:46
  best
• 8:46
  --
• 8:47
  it's
• 8:47
  only
• 8:48
  a
• 8:48
  trade
• 8:48
  secret
• 8:48
  because
• 8:49
  they
• 8:49
  say
• 8:49
  it
• 8:49
  is."
• 8:52
  A
• 8:52
  research
• 8:52
  team
• 8:53
  from
• 8:53
  Shanghai
• 8:53
  Jiao
• 8:53
  Tong
• 8:54
  University,
• 8:55
  the
• 8:55
  University
• 8:55
  of
• 8:55
  Sydney,
• 8:56
  and
• 8:56
  three
• 8:56
  other
• 8:57
  institutions
• 8:57
  has
• 8:57
  published
• 8:58
  BabelTele,
• 8:59
  an
• 8:59
  empirical
• 8:59
  investigation
• 9:00
  into
• 9:00
  what
• 9:00
  happens
• 9:01
  when
• 9:01
  you
• 9:01
  stop
• 9:01
  optimizing
• 9:02
  LLM
• 9:02
  communication
• 9:03
  for
• 9:03
  human
• 9:03
  readability.
• 9:04
  The
• 9:05
  core
• 9:05
  finding:
• 9:06
  by
• 9:06
  prompting
• 9:06
  an
• 9:06
  LLM
• 9:07
  to
• 9:07
  rewrite
• 9:07
  documents
• 9:08
  into
• 9:08
  dense
• 9:08
  symbolic
• 9:09
  strings
• 9:09
  --
• 9:10
  mixing
• 9:10
  abbreviations,
• 9:11
  emojis,
• 9:12
  math
• 9:12
  operators,
• 9:13
  and
• 9:13
  cross-lingual
• 9:14
  fragments
• 9:14
  --
• 9:15
  you
• 9:15
  can
• 9:16
  compress
• 9:16
  text
• 9:16
  to
• 9:16
  27.9%
• 9:18
  of
• 9:18
  its
• 9:18
  original
• 9:18
  length
• 9:19
  while
• 9:19
  maintaining
• 9:20
  99.5%
• 9:21
  semantic
• 9:22
  fidelity
• 9:22
  for
• 9:22
  instruction-tuned
• 9:23
  models.
• 9:25
  The
• 9:25
  compression
• 9:25
  transfers
• 9:26
  across
• 9:26
  model
• 9:26
  families
• 9:27
  with
• 9:27
  zero
• 9:27
  coordination:
• 9:28
  text
• 9:28
  compressed
• 9:29
  by
• 9:29
  GPT-5.4
• 9:30
  or
• 9:30
  Claude
• 9:31
  is
• 9:31
  read
• 9:31
  by
• 9:31
  Qwen,
• 9:32
  DeepSeek,
• 9:32
  and
• 9:33
  Kimi
• 9:33
  with
• 9:33
  most
• 9:33
  accuracy
• 9:34
  intact.
• 9:35
  The
• 9:35
  asymmetry
• 9:36
  is
• 9:36
  revealing
• 9:36
  --
• 9:37
  compressions
• 9:37
  from
• 9:38
  Qwen
• 9:38
  and
• 9:38
  Kimi
• 9:38
  travel
• 9:39
  much
• 9:39
  worse,
• 9:39
  suggesting
• 9:40
  the
• 9:40
  encoding
• 9:40
  reflects
• 9:41
  distributional
• 9:41
  biases
• 9:42
  of
• 9:42
  whichever
• 9:42
  model
• 9:42
  did
• 9:42
  the
• 9:43
  compressing
• 9:43
  rather
• 9:43
  than
• 9:43
  a
• 9:43
  truly
• 9:44
  shared
• 9:44
  symbolic
• 9:44
  space.
• 9:45
  Practically,
• 9:46
  the
• 9:46
  agent-system
• 9:46
  results
• 9:47
  matter
• 9:47
  most:
• 9:48
  half
• 9:48
  the
• 9:48
  tokens
• 9:49
  on
• 9:49
  the
• 9:49
  LoCoMo
• 9:49
  memory
• 9:50
  benchmark
• 9:50
  for
• 9:50
  a
• 9:50
  two-point
• 9:51
  accuracy
• 9:51
  cost,
• 9:52
  and
• 9:52
  40%
• 9:53
  fewer
• 9:53
  tokens
• 9:53
  in
• 9:53
  multi-agent
• 9:54
  message
• 9:54
  passing
• 9:54
  with
• 9:55
  almost
• 9:55
  no
• 9:55
  loss.
• 9:56
  The
• 9:56
  catch,
• 9:56
  as
• 9:56
  Maxime
• 9:57
  Labonne
• 9:57
  noted
• 9:57
  in
• 9:58
  his
• 9:58
  analysis,
• 9:59
  is
• 9:59
  token
• 9:59
  accounting:
• 10:00
  producing
• 10:01
  the
• 10:01
  compressed
• 10:01
  version
• 10:01
  costs
• 10:02
  a
• 10:02
  full-context
• 10:03
  pass
• 10:03
  through
• 10:03
  a
• 10:03
  strong
• 10:03
  model,
• 10:04
  so
• 10:04
  this
• 10:04
  only
• 10:05
  pays
• 10:05
  off
• 10:05
  when
• 10:05
  the
• 10:05
  same
• 10:05
  text
• 10:06
  gets
• 10:06
  read
• 10:06
  many
• 10:06
  times.
• 10:08
  The
• 10:08
  open
• 10:08
  question
• 10:08
  --
• 10:09
  whether
• 10:10
  agent-to-agent
• 10:10
  messages
• 10:11
  should
• 10:11
  be
• 10:11
  human-auditable
• 10:12
  --
• 10:12
  is
• 10:12
  not
• 10:13
  just
• 10:13
  academic.
• 10:14
  In
• 10:14
  regulated
• 10:15
  environments,
• 10:16
  opaque
• 10:16
  inter-agent
• 10:16
  representations
• 10:17
  create
• 10:18
  an
• 10:18
  observability
• 10:18
  gap
• 10:19
  that
• 10:19
  compounds
• 10:19
  when
• 10:19
  debugging
• 10:20
  failures
• 10:20
  across
• 10:21
  a
• 10:21
  pipeline.
• 10:22
  A
• 10:22
  related
• 10:23
  experiment
• 10:23
  in
• 10:23
  extreme
• 10:24
  model
• 10:24
  compression
• 10:25
  comes
• 10:25
  from
• 10:25
  a
• 10:25
  practitioner
• 10:26
  working
• 10:26
  with
• 10:26
  financial
• 10:27
  documents
• 10:27
  who
• 10:27
  distilled
• 10:28
  an
• 10:28
  8B
• 10:28
  reasoning
• 10:28
  teacher
• 10:29
  into
• 10:29
  a
• 10:29
  0.6B
• 10:30
  Qwen3
• 10:30
  student
• 10:31
  using
• 10:31
  QLoRA
• 10:32
  on
• 10:32
  an
• 10:32
  M-series
• 10:32
  Mac.
• 10:34
  The
• 10:34
  student
• 10:34
  hit
• 10:34
  100%
• 10:35
  section
• 10:35
  accuracy
• 10:36
  on
• 10:36
  held-out
• 10:36
  10-K
• 10:37
  filings
• 10:37
  (up
• 10:37
  from
• 10:37
  36%
• 10:38
  base),
• 10:39
  but
• 10:39
  three
• 10:40
  findings
• 10:40
  stand
• 10:40
  out.
• 10:41
  First,
• 10:42
  few-shot
• 10:42
  prompting
• 10:43
  actively
• 10:43
  made
• 10:44
  the
• 10:44
  small
• 10:44
  model
• 10:44
  worse:
• 10:45
  at
• 10:45
  0.6B,
• 10:47
  the
• 10:47
  exemplars
• 10:47
  leaked,
• 10:48
  with
• 10:48
  14
• 10:48
  of
• 10:48
  21
• 10:49
  summaries
• 10:49
  describing
• 10:50
  the
• 10:50
  example
• 10:50
  company
• 10:51
  instead
• 10:51
  of
• 10:51
  the
• 10:51
  target
• 10:51
  document.
• 10:52
  Second,
• 10:53
  the
• 10:53
  student
• 10:54
  traded
• 10:54
  faithfulness
• 10:55
  for
• 10:55
  coverage
• 10:55
  --
• 10:56
  richer
• 10:56
  summaries
• 10:57
  but
• 10:57
  more
• 10:57
  factual
• 10:57
  slips
• 10:58
  (0.73
• 10:58
  vs
• 10:59
  0.83
• 11:00
  faithful).
• 11:01
  Third,
• 11:02
  and
• 11:02
  most
• 11:02
  instructive:
• 11:03
  a
• 11:03
  different
• 11:04
  8B
• 11:04
  teacher
• 11:05
  produced
• 11:05
  a
• 11:05
  lazier
• 11:05
  student,
• 11:06
  because
• 11:06
  the
• 11:06
  student
• 11:07
  copies
• 11:07
  the
• 11:07
  teacher's
• 11:08
  habits,
• 11:08
  not
• 11:08
  its
• 11:09
  intent.
• 11:10
  The
• 11:10
  lesson
• 11:10
  is
• 11:10
  practical
• 11:11
  --
• 11:11
  audit
• 11:12
  the
• 11:12
  teacher's
• 11:12
  actual
• 11:13
  output
• 11:13
  before
• 11:13
  committing
• 11:14
  to
• 11:14
  a
• 11:14
  training
• 11:14
  run.
• 11:17
  Dependently-typed
• 11:17
  languages
• 11:18
  like
• 11:18
  Lean
• 11:18
  have
• 11:18
  always
• 11:19
  promised
• 11:19
  a
• 11:19
  type
• 11:19
  system
• 11:20
  capable
• 11:20
  of
• 11:20
  encoding
• 11:21
  and
• 11:21
  enforcing
• 11:22
  arbitrarily
• 11:22
  subtle
• 11:23
  invariants
• 11:23
  --
• 11:24
  the
• 11:24
  kind
• 11:24
  of
• 11:24
  thing
• 11:24
  that
• 11:24
  ends
• 11:24
  up
• 11:25
  as
• 11:25
  a
• 11:25
  comment
• 11:25
  in
• 11:25
  normal
• 11:26
  code
• 11:26
  and
• 11:26
  gets
• 11:26
  lost
• 11:27
  as
• 11:27
  teams
• 11:27
  grow.
• 11:28
  The
• 11:28
  problem
• 11:28
  has
• 11:29
  been
• 11:29
  proof
• 11:29
  effort.
• 11:30
  The
• 11:30
  seL4
• 11:30
  retrospective
• 11:31
  found
• 11:31
  engineers
• 11:32
  spent
• 11:32
  roughly
• 11:32
  10x
• 11:33
  as
• 11:33
  much
• 11:33
  time
• 11:34
  proving
• 11:34
  as
• 11:34
  they
• 11:34
  did
• 11:34
  designing
• 11:35
  and
• 11:35
  implementing,
• 11:36
  producing
• 11:36
  20x
• 11:37
  as
• 11:37
  many
• 11:37
  lines
• 11:37
  of
• 11:37
  proof
• 11:38
  code
• 11:38
  as
• 11:38
  C
• 11:38
  code.
• 11:39
  That
• 11:39
  overhead
• 11:39
  has
• 11:40
  kept
• 11:40
  dependent
• 11:40
  types
• 11:40
  extremely
• 11:41
  niche.
• 11:42
  A
• 11:42
  new
• 11:43
  post
• 11:43
  from
• 11:43
  a
• 11:43
  Google
• 11:43
  engineer
• 11:44
  argues
• 11:44
  that
• 11:44
  LLMs
• 11:45
  have
• 11:45
  fundamentally
• 11:45
  changed
• 11:46
  this
• 11:46
  calculus,
• 11:47
  and
• 11:47
  backs
• 11:47
  the
• 11:47
  claim
• 11:47
  with
• 11:48
  a
• 11:48
  concrete
• 11:48
  artifact:
• 11:49
  a
• 11:49
  Zstandard
• 11:49
  decompressor
• 11:50
  written
• 11:50
  in
• 11:50
  Lean
• 11:50
  with
• 11:51
  LLM-assisted
• 11:51
  proofs
• 11:52
  of
• 11:52
  its
• 11:52
  core
• 11:52
  properties.
• 11:53
  The
• 11:53
  proven
• 11:53
  properties
• 11:54
  are
• 11:54
  not
• 11:54
  trivial.
• 11:55
  For
• 11:55
  the
• 11:55
  FSE
• 11:56
  (Finite
• 11:56
  State
• 11:57
  Entropy)
• 11:57
  table
• 11:57
  construction
• 11:58
  algorithm
• 11:58
  --
• 11:59
  the
• 11:59
  heart
• 11:59
  of
• 11:59
  Zstandard's
• 11:59
  compression
• 12:00
  --
• 12:00
  the
• 12:00
  proofs
• 12:01
  establish
• 12:01
  that
• 12:01
  the
• 12:01
  table
• 12:02
  has
• 12:02
  the
• 12:02
  correct
• 12:02
  size
• 12:02
  for
• 12:02
  a
• 12:02
  given
• 12:03
  accuracy,
• 12:04
  the
• 12:04
  number
• 12:04
  of
• 12:04
  states
• 12:04
  per
• 12:04
  symbol
• 12:05
  matches
• 12:05
  its
• 12:05
  probability,
• 12:06
  all
• 12:06
  state
• 12:06
  transitions
• 12:07
  produce
• 12:07
  valid
• 12:08
  state
• 12:08
  numbers,
• 12:08
  and
• 12:08
  for
• 12:09
  every
• 12:09
  symbol
• 12:09
  with
• 12:09
  non-zero
• 12:10
  probability
• 12:10
  and
• 12:10
  every
• 12:11
  target
• 12:11
  state,
• 12:11
  there
• 12:12
  is
• 12:12
  exactly
• 12:12
  one
• 12:12
  state
• 12:13
  for
• 12:13
  that
• 12:13
  symbol
• 12:13
  that
• 12:13
  can
• 12:13
  reach
• 12:14
  it.
• 12:15
  These
• 12:15
  are
• 12:15
  the
• 12:15
  subtle
• 12:15
  invariants
• 12:16
  that
• 12:16
  optimized
• 12:17
  decompression
• 12:17
  inner
• 12:17
  loops
• 12:18
  silently
• 12:18
  rely
• 12:19
  on.
• 12:19
  Several
• 12:20
  LLMs
• 12:20
  completed
• 12:20
  these
• 12:21
  proofs
• 12:21
  automatically
• 12:21
  in
• 12:21
  about
• 12:22
  20
• 12:22
  minutes,
• 12:22
  using
• 12:23
  only
• 12:23
  a
• 12:23
  fraction
• 12:23
  of
• 12:24
  a
• 12:24
  $20/month
• 12:25
  subscription
• 12:25
  quota.
• 12:26
  The
• 12:26
  proofs
• 12:26
  required
• 12:27
  restructuring
• 12:27
  the
• 12:27
  code
• 12:28
  away
• 12:28
  from
• 12:28
  heavy
• 12:28
  use
• 12:28
  of
• 12:29
  Lean's
• 12:29
  imperative
• 12:30
  do
• 12:30
  notation,
• 12:31
  which
• 12:31
  is
• 12:31
  harder
• 12:31
  for
• 12:31
  proof
• 12:32
  machinery
• 12:32
  to
• 12:32
  work
• 12:32
  with,
• 12:33
  but
• 12:33
  this
• 12:33
  is
• 12:33
  a
• 12:33
  practical
• 12:33
  constraint
• 12:34
  rather
• 12:34
  than
• 12:34
  a
• 12:34
  fundamental
• 12:35
  barrier.
• 12:36
  The
• 12:36
  author
• 12:36
  cautions
• 12:36
  that
• 12:37
  scaling
• 12:37
  questions
• 12:37
  remain
• 12:38
  open
• 12:38
  --
• 12:38
  very
• 12:39
  strong
• 12:39
  types
• 12:39
  can
• 12:39
  amplify
• 12:40
  the
• 12:40
  scope
• 12:40
  of
• 12:40
  changes,
• 12:41
  and
• 12:41
  proof
• 12:41
  effort
• 12:42
  might
• 12:42
  scale
• 12:42
  poorly
• 12:42
  in
• 12:43
  larger
• 12:43
  systems.
• 12:44
  But
• 12:44
  the
• 12:44
  delta
• 12:44
  is
• 12:45
  enormous:
• 12:45
  from
• 12:45
  10x
• 12:46
  human
• 12:46
  effort
• 12:47
  to
• 12:47
  20
• 12:47
  minutes
• 12:47
  of
• 12:47
  LLM
• 12:48
  time.
• 12:48
  We
• 12:49
  have,
• 12:49
  practically
• 12:49
  speaking,
• 12:50
  a
• 12:50
  new
• 12:50
  kind
• 12:50
  of
• 12:50
  programming
• 12:51
  language
• 12:51
  available
• 12:52
  to
• 12:52
  us.
• 12:54
  The
• 12:54
  question
• 12:55
  of
• 12:55
  where
• 12:55
  inference
• 12:55
  should
• 12:55
  live
• 12:56
  --
• 12:56
  cloud
• 12:57
  GPU
• 12:57
  fleets
• 12:58
  or
• 12:58
  local
• 12:58
  hardware
• 12:58
  --
• 12:59
  keeps
• 12:59
  getting
• 12:59
  more
• 12:59
  nuanced.
• 13:01
  A
• 13:01
  deep
• 13:01
  technical
• 13:02
  analysis
• 13:02
  of
• 13:02
  Proven
• 13:02
  LLM,
• 13:03
  a
• 13:03
  custom
• 13:04
  Rust-and-Metal
• 13:04
  inference
• 13:05
  engine
• 13:05
  specialized
• 13:06
  for
• 13:06
  Qwen
• 13:06
  3.6
• 13:07
  on
• 13:07
  Apple
• 13:07
  Silicon,
• 13:08
  demonstrates
• 13:08
  what
• 13:09
  is
• 13:09
  possible
• 13:09
  when
• 13:09
  you
• 13:09
  abandon
• 13:10
  portable
• 13:10
  frameworks
• 13:10
  and
• 13:11
  go
• 13:11
  model-specific.
• 13:12
  The
• 13:12
  engine
• 13:12
  replaces
• 13:13
  the
• 13:13
  entire
• 13:13
  execution
• 13:14
  boundary:
• 13:15
  155
• 13:16
  compiled
• 13:16
  Metal
• 13:17
  kernels
• 13:17
  covering
• 13:17
  MoE
• 13:18
  routing,
• 13:18
  DeltaNet
• 13:19
  recurrence,
• 13:19
  gated
• 13:20
  attention,
• 13:21
  and
• 13:21
  speculative
• 13:22
  decoding
• 13:22
  with
• 13:22
  rollback-safe
• 13:23
  repair.
• 13:24
  One
• 13:24
  measured
• 13:24
  prompt
• 13:24
  path
• 13:25
  collapsed
• 13:25
  92
• 13:25
  command
• 13:26
  buffers
• 13:26
  into
• 13:26
  one.
• 13:27
  A
• 13:27
  strict
• 13:27
  repair-row
• 13:28
  candidate
• 13:28
  reached
• 13:28
  71
• 13:29
  tok/s
• 13:30
  decode
• 13:30
  and
• 13:30
  55
• 13:31
  tok/s
• 13:31
  end-to-end
• 13:32
  on
• 13:32
  code
• 13:32
  generation.
• 13:33
  The
• 13:33
  project's
• 13:33
  most
• 13:33
  interesting
• 13:34
  feature
• 13:34
  is
• 13:34
  its
• 13:34
  proof
• 13:34
  discipline:
• 13:35
  every
• 13:36
  performance
• 13:36
  claim
• 13:36
  is
• 13:36
  tied
• 13:36
  to
• 13:37
  runtime
• 13:37
  identity,
• 13:37
  host
• 13:38
  load,
• 13:38
  acceptance
• 13:38
  rate,
• 13:39
  and
• 13:39
  promotion
• 13:39
  state.
• 13:40
  Dead
• 13:41
  ends
• 13:41
  are
• 13:41
  recorded
• 13:41
  and
• 13:41
  can
• 13:42
  veto
• 13:42
  a
• 13:42
  shiny
• 13:42
  number
• 13:42
  when
• 13:42
  the
• 13:42
  comparison
• 13:43
  is
• 13:43
  invalid.
• 13:44
  CUDA
• 13:44
  remains
• 13:44
  the
• 13:45
  factory;
• 13:45
  Apple
• 13:46
  becomes
• 13:46
  the
• 13:46
  laboratory.
• 13:47
  For
• 13:48
  those
• 13:48
  on
• 13:48
  the
• 13:48
  NVIDIA
• 13:48
  side
• 13:48
  of
• 13:49
  the
• 13:49
  divide,
• 13:49
  the
• 13:49
  RTX
• 13:49
  2080
• 13:50
  Ti
• 13:50
  VRAM
• 13:50
  upgrade
• 13:51
  to
• 13:51
  22GB
• 13:51
  continues
• 13:52
  to
• 13:52
  find
• 13:52
  its
• 13:52
  audience.
• 13:53
  A
• 13:53
  service
• 13:53
  now
• 13:53
  offers
• 13:54
  BGA
• 13:54
  rework
• 13:55
  replacing
• 13:55
  all
• 13:55
  stock
• 13:55
  1GB
• 13:56
  GDDR6
• 13:57
  modules
• 13:57
  with
• 13:57
  2GB
• 13:58
  parts,
• 13:59
  complete
• 13:59
  with
• 13:59
  VBIOS
• 14:00
  configuration,
• 14:01
  thermal
• 14:01
  pad
• 14:01
  replacement,
• 14:02
  and
• 14:02
  stability
• 14:02
  testing,
• 14:03
  with
• 14:03
  a
• 14:03
  12-day
• 14:04
  turnaround.
• 14:05
  The
• 14:05
  mod
• 14:05
  turns
• 14:05
  a
• 14:05
  card
• 14:06
  that
• 14:06
  costs
• 14:06
  a
• 14:06
  fraction
• 14:06
  of
• 14:06
  a
• 14:06
  modern
• 14:07
  GPU
• 14:07
  into
• 14:07
  something
• 14:07
  that
• 14:08
  can
• 14:08
  handle
• 14:08
  memory-intensive
• 14:09
  AI
• 14:09
  workloads
• 14:09
  that
• 14:09
  its
• 14:09
  original
• 14:10
  11GB
• 14:10
  could
• 14:10
  not
• 14:11
  touch.
• 14:11
  On
• 14:11
  the
• 14:11
  voice
• 14:12
  front,
• 14:12
  Microsoft
• 14:12
  has
• 14:12
  released
• 14:13
  VibeVoice-ASR-BitNet,
• 14:14
  a
• 14:14
  heterogeneously
• 14:15
  quantized
• 14:15
  variant
• 14:15
  of
• 14:15
  its
• 14:16
  VibeVoice-ASR
• 14:16
  speech
• 14:17
  recognition
• 14:17
  model
• 14:17
  compressed
• 14:17
  from
• 14:18
  4.62GB
• 14:19
  to
• 14:19
  1.58GB.
• 14:21
  It
• 14:21
  achieves
• 14:22
  1.6-2.3x
• 14:23
  faster
• 14:23
  inference
• 14:24
  than
• 14:24
  Whisper.cpp
• 14:25
  with
• 14:25
  real-time
• 14:26
  capability
• 14:26
  (RTF
• 14:26
  1)
• 14:27
  on
• 14:27
  as
• 14:27
  few
• 14:27
  as
• 14:27
  three
• 14:27
  CPU
• 14:28
  threads
• 14:28
  --
• 14:28
  no
• 14:28
  GPU
• 14:29
  required.
• 14:29
  Community
• 14:30
  reaction
• 14:30
  was
• 14:30
  mixed:
• 14:31
  the
• 14:31
  original
• 14:31
  VibeVoice
• 14:32
  was
• 14:32
  heavy
• 14:32
  to
• 14:33
  begin
• 14:33
  with,
• 14:33
  and
• 14:33
  even
• 14:34
  in
• 14:34
  BitNet
• 14:34
  form
• 14:34
  it
• 14:34
  is
• 14:34
  outclassed
• 14:35
  by
• 14:35
  Cohere
• 14:35
  and
• 14:35
  Parakeet
• 14:36
  on
• 14:36
  raw
• 14:36
  speed.
• 14:36
  Complementing
• 14:37
  the
• 14:37
  recognition
• 14:37
  side,
• 14:38
  Voice
• 14:38
  Clone
• 14:38
  Lab
• 14:38
  packages
• 14:39
  Qwen3-TTS
• 14:40
  fine-tuning
• 14:40
  into
• 14:40
  a
• 14:40
  guided
• 14:41
  pipeline:
• 14:41
  give
• 14:41
  it
• 14:41
  5-15
• 14:42
  minutes
• 14:42
  of
• 14:42
  clean
• 14:43
  speech,
• 14:43
  and
• 14:43
  it
• 14:43
  trains
• 14:43
  a
• 14:43
  personal
• 14:44
  voice
• 14:44
  model
• 14:44
  you
• 14:44
  can
• 14:44
  drive
• 14:45
  from
• 14:45
  a
• 14:45
  CLI
• 14:45
  or
• 14:45
  web
• 14:46
  UI.
• 14:46
  Zero-shot
• 14:47
  mode
• 14:47
  lets
• 14:47
  you
• 14:47
  try
• 14:47
  a
• 14:47
  voice
• 14:48
  instantly
• 14:48
  from
• 14:48
  a
• 14:48
  single
• 14:49
  clip.
• 14:49
  Everything
• 14:49
  stays
• 14:49
  local
• 14:50
  --
• 14:50
  audio,
• 14:50
  transcripts,
• 14:51
  and
• 14:51
  voice
• 14:51
  models
• 14:51
  never
• 14:51
  leave
• 14:52
  the
• 14:52
  machine.
• 14:55
  Albert
• 14:55
  is
• 14:55
  a
• 14:55
  new
• 14:55
  autonomous
• 14:56
  harness
• 14:56
  for
• 14:56
  Claude
• 14:57
  Code
• 14:57
  that
• 14:57
  takes
• 14:58
  a
• 14:58
  different
• 14:58
  approach
• 14:58
  to
• 14:58
  the
• 14:58
  agentic
• 14:59
  coding
• 14:59
  problem:
• 15:00
  give
• 15:00
  it
• 15:00
  a
• 15:00
  goal
• 15:00
  in
• 15:01
  plain
• 15:01
  English
• 15:01
  and
• 15:01
  walk
• 15:02
  away.
• 15:03
  An
• 15:03
  orchestrator
• 15:03
  (A.L.B.E.R.T.
• 15:04
  --
• 15:04
  Agentic
• 15:04
  Loop
• 15:04
  Broker
• 15:05
  for
• 15:05
  Execution,
• 15:06
  Reasoning
• 15:06
  &
• 15:06
  Tasking)
• 15:07
  decomposes
• 15:07
  the
• 15:07
  goal
• 15:08
  into
• 15:08
  tasks,
• 15:09
  assigns
• 15:09
  each
• 15:09
  to
• 15:09
  the
• 15:09
  cheapest
• 15:10
  model
• 15:10
  tier
• 15:10
  that
• 15:10
  can
• 15:11
  handle
• 15:11
  it
• 15:11
  (Haiku,
• 15:12
  Sonnet,
• 15:12
  or
• 15:12
  Opus),
• 15:13
  fans
• 15:13
  them
• 15:13
  out
• 15:14
  concurrently
• 15:14
  in
• 15:14
  isolated
• 15:15
  git
• 15:15
  worktrees,
• 15:16
  and
• 15:16
  runs
• 15:16
  independent
• 15:17
  verify/code-review/QA
• 15:18
  critics
• 15:19
  on
• 15:19
  every
• 15:19
  result.
• 15:20
  A
• 15:20
  task
• 15:20
  is
• 15:20
  done
• 15:21
  only
• 15:21
  with
• 15:21
  captured
• 15:21
  evidence
• 15:21
  --
• 15:22
  producers
• 15:23
  never
• 15:23
  grade
• 15:23
  themselves.
• 15:24
  Merging
• 15:25
  is
• 15:25
  automatic
• 15:25
  once
• 15:25
  code-review
• 15:26
  and
• 15:26
  QA
• 15:26
  pass,
• 15:27
  but
• 15:27
  deploys
• 15:28
  and
• 15:28
  irreversible
• 15:28
  actions
• 15:29
  stay
• 15:29
  gated
• 15:29
  behind
• 15:29
  explicit
• 15:30
  policy
• 15:30
  flags.
• 15:31
  The
• 15:32
  real-time
• 15:32
  console
• 15:32
  provides
• 15:33
  observability
• 15:33
  without
• 15:34
  hooks:
• 15:34
  it
• 15:34
  tails
• 15:35
  Claude
• 15:35
  Code's
• 15:35
  session
• 15:35
  transcripts
• 15:36
  and
• 15:36
  emits
• 15:37
  only
• 15:37
  structured
• 15:37
  metadata,
• 15:38
  never
• 15:38
  prompt
• 15:39
  or
• 15:39
  response
• 15:39
  bodies.
• 15:40
  Privacy
• 15:41
  is
• 15:41
  structural,
• 15:41
  not
• 15:41
  a
• 15:41
  setting.
• 15:42
  BuildLLM
• 15:43
  takes
• 15:43
  the
• 15:43
  educational
• 15:43
  route,
• 15:44
  providing
• 15:44
  a
• 15:44
  complete
• 15:45
  from-scratch
• 15:45
  learning
• 15:45
  lab
• 15:46
  for
• 15:46
  decoder-only
• 15:46
  language
• 15:47
  models.
• 15:47
  Three
• 15:48
  model
• 15:48
  iterations
• 15:48
  --
• 15:49
  8M
• 15:49
  parameters
• 15:49
  on
• 15:49
  CPU,
• 15:50
  42M
• 15:51
  on
• 15:51
  CUDA,
• 15:51
  98M
• 15:52
  on
• 15:52
  CUDA
• 15:52
  --
• 15:52
  use
• 15:53
  identical
• 15:53
  source
• 15:53
  code
• 15:53
  with
• 15:53
  different
• 15:54
  architecture
• 15:54
  configs.
• 15:55
  The
• 15:55
  curriculum
• 15:55
  runs
• 15:56
  from
• 15:56
  corpus
• 15:56
  construction
• 15:57
  (Simple
• 15:57
  Wikipedia,
• 15:58
  RFCs,
• 15:59
  FineWeb
• 15:59
  Edu)
• 15:59
  through
• 15:59
  tokenizer
• 16:00
  training,
• 16:00
  encoding,
• 16:01
  and
• 16:01
  three
• 16:01
  iterations
• 16:02
  of
• 16:02
  increasingly
• 16:02
  ambitious
• 16:03
  training.
• 16:03
  It
• 16:04
  is
• 16:04
  refreshingly
• 16:04
  opinionated:
• 16:05
  do
• 16:05
  not
• 16:05
  combine
• 16:06
  validation
• 16:06
  loss
• 16:06
  from
• 16:06
  different
• 16:07
  tokenizers,
• 16:07
  do
• 16:07
  not
• 16:08
  download
• 16:08
  someone
• 16:08
  else's
• 16:08
  checkpoint
• 16:09
  and
• 16:09
  rename
• 16:09
  it,
• 16:09
  corpus-tokenizer-model
• 16:10
  identity
• 16:11
  must
• 16:11
  remain
• 16:11
  together.
• 16:12
  NVIDIA
• 16:12
  researchers
• 16:13
  have
• 16:13
  published
• 16:13
  GPC
• 16:14
  (Generative
• 16:14
  Pretrained
• 16:14
  Controllers)
• 16:15
  at
• 16:15
  SIGGRAPH
• 16:16
  2026,
• 16:18
  applying
• 16:19
  the
• 16:19
  next-token
• 16:19
  prediction
• 16:19
  paradigm
• 16:20
  to
• 16:20
  physics-based
• 16:20
  character
• 16:21
  animation.
• 16:22
  The
• 16:22
  system
• 16:22
  learns
• 16:22
  a
• 16:22
  discrete
• 16:23
  "motion
• 16:23
  vocabulary"
• 16:24
  via
• 16:24
  Finite
• 16:24
  Scalar
• 16:25
  Quantization
• 16:25
  from
• 16:25
  600+
• 16:26
  hours
• 16:26
  of
• 16:26
  diverse
• 16:27
  human
• 16:27
  motion
• 16:27
  data,
• 16:28
  then
• 16:28
  trains
• 16:28
  a
• 16:28
  GPT-style
• 16:29
  transformer
• 16:29
  over
• 16:29
  those
• 16:29
  tokens.
• 16:30
  The
• 16:31
  result:
• 16:31
  a
• 16:31
  99.98%
• 16:33
  tracking
• 16:33
  success
• 16:34
  rate,
• 16:34
  natural
• 16:35
  emergent
• 16:35
  behaviors
• 16:35
  like
• 16:36
  perturbation
• 16:36
  responses
• 16:37
  and
• 16:37
  fall
• 16:37
  recovery,
• 16:38
  and
• 16:38
  parameter-efficient
• 16:38
  fine-tuning
• 16:39
  for
• 16:39
  new
• 16:39
  downstream
• 16:40
  tasks.
• 16:40
  And
• 16:41
  in
• 16:41
  a
• 16:41
  category
• 16:41
  entirely
• 16:42
  its
• 16:42
  own,
• 16:42
  Pentaton
• 16:43
  LP
• 16:43
  is
• 16:43
  a
• 16:44
  music
• 16:44
  streamer
• 16:44
  built
• 16:44
  from
• 16:45
  scratch
• 16:45
  by
• 16:45
  someone
• 16:45
  who
• 16:45
  learned
• 16:46
  PCB
• 16:46
  design,
• 16:47
  3D
• 16:47
  printing,
• 16:48
  and
• 16:48
  C
• 16:48
  along
• 16:48
  the
• 16:48
  way.
• 16:49
  The
• 16:49
  device
• 16:50
  is
• 16:50
  a
• 16:50
  12-by-12-inch
• 16:50
  display
• 16:51
  --
• 16:52
  the
• 16:52
  size
• 16:52
  of
• 16:52
  a
• 16:52
  vinyl
• 16:52
  sleeve
• 16:53
  --
• 16:53
  driven
• 16:54
  by
• 16:54
  a
• 16:54
  Radxa
• 16:54
  CM3
• 16:55
  compute
• 16:55
  module,
• 16:56
  showing
• 16:56
  full-resolution
• 16:57
  album
• 16:57
  artwork
• 16:57
  via
• 16:57
  a
• 16:57
  custom
• 16:58
  AirPlay
• 16:58
  extension
• 16:59
  that
• 16:59
  works
• 16:59
  around
• 17:00
  Apple's
• 17:00
  500x500
• 17:01
  pixel
• 17:01
  limitation.
• 17:02
  Four
• 17:03
  PCB
• 17:03
  revisions,
• 17:04
  a
• 17:04
  custom
• 17:04
  FreeCAD
• 17:05
  macro
• 17:05
  for
• 17:05
  the
• 17:05
  enclosure,
• 17:06
  GPU-accelerated
• 17:07
  crossfades
• 17:07
  of
• 17:08
  4-megapixel
• 17:08
  images
• 17:09
  at
• 17:09
  60fps,
• 17:10
  and
• 17:10
  a
• 17:10
  2-watt
• 17:11
  idle
• 17:11
  draw.
• 17:12
  Sometimes
• 17:12
  the
• 17:12
  most
• 17:13
  impressive
• 17:13
  engineering
• 17:14
  has
• 17:14
  nothing
• 17:14
  to
• 17:14
  do
• 17:14
  with
• 17:15
  AI.