Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – May 29, 2026

Transcript

AGI Dreams Podcast – May 29, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Not
• 0:00
  all
• 0:00
  threat
• 0:00
  actors
• 0:01
  chase
• 0:01
  money
• 0:01
  or
• 0:01
  further
• 0:02
  national
• 0:02
  objectives.
• 0:03
  Some
• 0:03
  just
• 0:04
  want
• 0:04
  to
• 0:04
  burn
• 0:04
  the
• 0:04
  house
• 0:04
  down.
• 0:05
  Nightmare-Eclipse
• 0:05
  —
• 0:06
  a
• 0:06
  solo
• 0:07
  security
• 0:07
  researcher
• 0:07
  operating
• 0:08
  under
• 0:08
  anime-decorated
• 0:09
  aliases
• 0:09
  like
• 0:09
  "Chaotic
• 0:10
  Eclipse"
• 0:10
  and
• 0:10
  "Dead
• 0:10
  Eclipse"
• 0:11
  —
• 0:12
  has
• 0:12
  released
• 0:12
  six
• 0:12
  Windows
• 0:13
  zero-day
• 0:13
  exploits
• 0:13
  since
• 0:14
  April
• 0:14
  2026
• 0:15
  in
• 0:15
  what
• 0:15
  Barracuda's
• 0:15
  threat
• 0:16
  intelligence
• 0:16
  team
• 0:16
  describes
• 0:17
  as
• 0:17
  an
• 0:17
  escalating
• 0:17
  retaliatory
• 0:18
  campaign
• 0:18
  against
• 0:18
  Microsoft.
• 0:19
  The
• 0:20
  motivation,
• 0:20
  per
• 0:20
  Eclipse's
• 0:21
  own
• 0:21
  blog:
• 0:22
  Microsoft
• 0:22
  violated
• 0:23
  an
• 0:23
  agreement
• 0:23
  and
• 0:24
  "left
• 0:24
  me
• 0:24
  homeless
• 0:24
  with
• 0:24
  nothing."
• 0:25
  Whether
• 0:25
  that's
• 0:26
  a
• 0:26
  former
• 0:26
  employee,
• 0:27
  contractor,
• 0:27
  or
• 0:27
  external
• 0:28
  researcher
• 0:28
  remains
• 0:29
  unverified.
• 0:30
  What
• 0:30
  isn't
• 0:30
  in
• 0:30
  question
• 0:31
  is
• 0:31
  the
• 0:31
  damage
• 0:31
  —
• 0:32
  Huntress
• 0:32
  Labs
• 0:32
  has
• 0:33
  confirmed
• 0:33
  exploitation
• 0:33
  activity
• 0:34
  linked
• 0:34
  to
• 0:34
  Russian-geolocated
• 0:35
  infrastructure,
• 0:36
  and
• 0:36
  CISA
• 0:37
  has
• 0:37
  added
• 0:37
  BlueHammer
• 0:39
  (CVE-2026-33825)
• 0:42
  to
• 0:42
  its
• 0:42
  Known
• 0:42
  Exploited
• 0:43
  Vulnerabilities
• 0:43
  catalog.
• 0:44
  The
• 0:44
  exploit
• 0:45
  chain
• 0:45
  reads
• 0:45
  like
• 0:46
  a
• 0:46
  product
• 0:46
  roadmap
• 0:46
  for
• 0:47
  endpoint
• 0:47
  compromise.
• 0:48
  BlueHammer
• 0:49
  and
• 0:49
  RedSun
• 0:49
  are
• 0:49
  two
• 0:50
  separate
• 0:50
  privilege-escalation
• 0:51
  paths
• 0:51
  through
• 0:52
  Windows
• 0:52
  Defender
• 0:52
  —
• 0:53
  the
• 0:53
  tool
• 0:53
  that's
• 0:54
  supposed
• 0:54
  to
• 0:54
  stop
• 0:54
  attacks,
• 0:55
  not
• 0:55
  enable
• 0:55
  them.
• 0:56
  UnDefend
• 0:57
  then
• 0:57
  blinds
• 0:58
  Defender
• 0:58
  while
• 0:58
  making
• 0:58
  the
• 0:58
  system
• 0:59
  appear
• 0:59
  healthy.
• 1:00
  GreenPlasma
• 1:01
  offers
• 1:01
  an
• 1:01
  alternate
• 1:02
  SYSTEM
• 1:03
  escalation
• 1:03
  path
• 1:03
  through
• 1:04
  broader
• 1:04
  Windows
• 1:04
  internals,
• 1:05
  and
• 1:06
  MiniPlasma
• 1:06
  targets
• 1:07
  the
• 1:07
  Cloud
• 1:07
  Files
• 1:07
  Mini
• 1:08
  Filter
• 1:08
  Driver.
• 1:09
  Then
• 1:09
  there's
• 1:10
  YellowKey,
• 1:10
  which
• 1:11
  has
• 1:11
  drawn
• 1:11
  the
• 1:11
  most
• 1:11
  attention
• 1:12
  because
• 1:12
  it
• 1:12
  targets
• 1:13
  BitLocker.
• 1:14
  A
• 1:14
  detailed
• 1:15
  video
• 1:15
  breakdown
• 1:16
  explains
• 1:16
  the
• 1:16
  mechanism:
• 1:17
  Windows
• 1:18
  11's
• 1:18
  recovery
• 1:19
  environment
• 1:19
  automatically
• 1:20
  replays
• 1:20
  NTFS
• 1:21
  file-system
• 1:21
  transactions
• 1:22
  from
• 1:22
  external
• 1:22
  volumes.
• 1:23
  A
• 1:23
  malicious
• 1:24
  USB
• 1:24
  containing
• 1:25
  crafted
• 1:25
  FSTX
• 1:26
  transactions
• 1:27
  deletes
• 1:27
  winpeshl.ini
• 1:28
  —
• 1:30
  the
• 1:30
  file
• 1:31
  telling
• 1:31
  recovery
• 1:31
  which
• 1:32
  application
• 1:32
  to
• 1:32
  load
• 1:32
  —
• 1:33
  causing
• 1:33
  a
• 1:33
  drop
• 1:34
  to
• 1:34
  a
• 1:34
  command
• 1:34
  shell
• 1:34
  that
• 1:34
  already
• 1:35
  has
• 1:35
  the
• 1:35
  TPM-unsealed
• 1:37
  BitLocker
• 1:37
  key
• 1:37
  in
• 1:37
  memory.
• 1:38
  The
• 1:39
  mitigation
• 1:39
  is
• 1:39
  relatively
• 1:40
  straightforward
• 1:40
  for
• 1:41
  informed
• 1:41
  administrators
• 1:42
  (enable
• 1:43
  TPM
• 1:43
  PIN,
• 1:44
  or
• 1:44
  remove
• 1:44
  the
• 1:44
  autofstx
• 1:45
  registry
• 1:45
  key),
• 1:46
  but
• 1:46
  Eclipse
• 1:47
  has
• 1:47
  claimed
• 1:47
  the
• 1:47
  bypass
• 1:48
  works
• 1:48
  even
• 1:48
  with
• 1:49
  TPM+PIN,
• 1:50
  just
• 1:50
  hasn't
• 1:51
  published
• 1:51
  that
• 1:51
  proof-of-concept.
• 1:53
  Eclipse
• 1:53
  has
• 1:53
  promised
• 1:53
  RCE
• 1:54
  drops
• 1:54
  and
• 1:54
  "a
• 1:55
  big
• 1:55
  surprise"
• 1:55
  for
• 1:55
  June
• 1:56
  Patch
• 1:56
  Tuesday,
• 1:57
  plus
• 1:57
  a
• 1:57
  dead-man's
• 1:58
  switch
• 1:58
  for
• 1:58
  automatic
• 1:59
  disclosure.
• 2:00
  The
• 2:00
  researcher
• 2:00
  has
• 2:01
  been
• 2:01
  banned
• 2:01
  from
• 2:01
  both
• 2:01
  GitHub
• 2:02
  and
• 2:02
  GitLab.
• 2:06
  The
• 2:06
  DeepSWE
• 2:07
  benchmark
• 2:07
  made
• 2:08
  waves
• 2:08
  this
• 2:08
  week
• 2:08
  by
• 2:08
  claiming
• 2:09
  Claude
• 2:09
  Opus
• 2:09
  "cheats"
• 2:10
  —
• 2:10
  but
• 2:11
  the
• 2:11
  details
• 2:11
  are
• 2:11
  more
• 2:11
  nuanced.
• 2:12
  When
• 2:13
  the
• 2:13
  prompt
• 2:13
  and
• 2:13
  repository
• 2:14
  state
• 2:14
  don't
• 2:14
  match,
• 2:15
  Opus
• 2:15
  4.7
• 2:16
  explores
• 2:17
  recent
• 2:17
  changes
• 2:17
  with
• 2:17
  git
• 2:18
  log
• 2:18
  and
• 2:18
  recovers
• 2:18
  the
• 2:18
  gold
• 2:19
  solution
• 2:19
  from
• 2:19
  .git
• 2:20
  history.
• 2:21
  Is
• 2:21
  that
• 2:21
  cheating,
• 2:22
  or
• 2:22
  exactly
• 2:23
  what
• 2:23
  a
• 2:23
  senior
• 2:23
  engineer
• 2:23
  would
• 2:24
  do
• 2:24
  when
• 2:24
  the
• 2:24
  codebase
• 2:24
  doesn't
• 2:25
  match
• 2:25
  the
• 2:25
  spec?
• 2:26
  Several
• 2:26
  commenters
• 2:27
  pointed
• 2:27
  out
• 2:27
  that
• 2:27
  if
• 2:28
  .git
• 2:28
  is
• 2:28
  present
• 2:28
  and
• 2:29
  no
• 2:29
  constraint
• 2:29
  prohibits
• 2:29
  its
• 2:30
  use,
• 2:30
  git
• 2:30
  log
• 2:31
  is
• 2:31
  environment
• 2:31
  use,
• 2:32
  not
• 2:32
  rule
• 2:32
  violation.
• 2:33
  The
• 2:33
  deeper
• 2:34
  concern:
• 2:34
  Sonnet
• 2:35
  4.6
• 2:35
  on
• 2:36
  "high"
• 2:36
  effort
• 2:36
  beats
• 2:36
  Opus
• 2:37
  4.6
• 2:37
  on
• 2:38
  "max"
• 2:38
  effort
• 2:38
  in
• 2:38
  some
• 2:38
  configurations,
• 2:39
  and
• 2:39
  GPT-5.4
• 2:41
  Mini
• 2:41
  outranks
• 2:42
  Kimi
• 2:42
  K2.6,
• 2:44
  which
• 2:45
  doesn't
• 2:45
  match
• 2:45
  practitioner
• 2:45
  experience.
• 2:47
  The
• 2:47
  real
• 2:47
  lesson
• 2:47
  is
• 2:47
  that
• 2:47
  evaluation
• 2:48
  harnesses
• 2:48
  need
• 2:49
  to
• 2:49
  declare
• 2:49
  their
• 2:49
  environment
• 2:50
  contract
• 2:50
  alongside
• 2:50
  the
• 2:50
  score.
• 2:52
  ITBench-AA,
• 2:54
  a
• 2:54
  collaboration
• 2:54
  between
• 2:55
  Artificial
• 2:55
  Analysis
• 2:55
  and
• 2:56
  IBM,
• 2:56
  offers
• 2:56
  a
• 2:57
  more
• 2:57
  controlled
• 2:57
  view.
• 2:58
  Across
• 2:58
  59
• 2:59
  Kubernetes
• 2:59
  incident-response
• 3:00
  tasks,
• 3:00
  the
• 3:00
  best
• 3:01
  model
• 3:01
  —
• 3:01
  Claude
• 3:02
  Opus
• 3:02
  4.7
• 3:03
  at
• 3:03
  max
• 3:03
  effort
• 3:03
  —
• 3:04
  scores
• 3:04
  just
• 3:04
  47%.
• 3:05
  GPT-5.5
• 3:07
  follows
• 3:07
  at
• 3:07
  46%,
• 3:09
  Qwen3.7
• 3:10
  Max
• 3:11
  at
• 3:11
  42%.
• 3:12
  These
• 3:13
  are
• 3:13
  real
• 3:13
  SRE
• 3:13
  scenarios
• 3:14
  requiring
• 3:14
  log
• 3:15
  reading,
• 3:15
  dependency
• 3:16
  tracing,
• 3:16
  and
• 3:16
  root-cause
• 3:17
  identification.
• 3:18
  More
• 3:18
  turns
• 3:19
  don't
• 3:19
  help:
• 3:20
  Gemini
• 3:20
  3.1
• 3:21
  Pro
• 3:21
  Preview
• 3:22
  averages
• 3:22
  83
• 3:22
  turns
• 3:23
  per
• 3:23
  task
• 3:24
  but
• 3:24
  scores
• 3:24
  only
• 3:24
  30%,
• 3:25
  while
• 3:25
  Gemma
• 3:26
  4
• 3:26
  31B
• 3:26
  averages
• 3:27
  58
• 3:27
  turns
• 3:28
  and
• 3:28
  scores
• 3:28
  37%
• 3:29
  at
• 3:29
  $0.14/task
• 3:31
  versus
• 3:32
  $2.23.
• 3:33
  Models
• 3:34
  that
• 3:34
  over-investigate
• 3:35
  surface
• 3:35
  upstream
• 3:35
  fault-injection
• 3:36
  mechanisms
• 3:37
  as
• 3:37
  false
• 3:37
  positives,
• 3:38
  tanking
• 3:38
  their
• 3:39
  precision
• 3:39
  scores.
• 3:40
  Open-weight
• 3:41
  models
• 3:41
  sit
• 3:41
  on
• 3:41
  the
• 3:41
  cost
• 3:41
  frontier
• 3:43
  —
• 3:44
  GLM-5.1
• 3:45
  Reasoning
• 3:45
  scores
• 3:46
  40%
• 3:46
  at
• 3:46
  $1.23/task,
• 3:48
  matching
• 3:49
  Gemini
• 3:49
  3.5
• 3:50
  Flash
• 3:50
  at
• 3:50
  $1.70.
• 3:52
  A
• 3:52
  rigorous
• 3:52
  ACM
• 3:53
  paper
• 3:53
  deepens
• 3:53
  this
• 3:54
  picture
• 3:54
  through
• 3:54
  controlled
• 3:55
  ablation
• 3:55
  of
• 3:55
  compound
• 3:55
  LLM
• 3:56
  agent
• 3:56
  design
• 3:57
  across
• 3:57
  3,475
• 3:58
  episodes
• 3:59
  in
• 3:59
  a
• 3:59
  cyber-defense
• 3:59
  POMDP.
• 4:01
  The
• 4:01
  headline:
• 4:02
  programmatic
• 4:02
  state
• 4:03
  abstraction
• 4:03
  —
• 4:04
  giving
• 4:04
  the
• 4:04
  agent
• 4:04
  a
• 4:04
  deterministic,
• 4:05
  structured
• 4:06
  summary
• 4:06
  instead
• 4:07
  of
• 4:07
  raw
• 4:07
  observations
• 4:07
  —
• 4:08
  delivers
• 4:09
  the
• 4:09
  largest
• 4:09
  performance
• 4:10
  improvement
• 4:10
  per
• 4:10
  token,
• 4:11
  up
• 4:11
  to
• 4:11
  76%
• 4:12
  better
• 4:12
  outcomes
• 4:13
  at
• 4:13
  near-zero
• 4:13
  marginal
• 4:14
  cost.
• 4:15
  Hierarchy
• 4:16
  helps
• 4:16
  when
• 4:16
  applied
• 4:16
  sparingly
• 4:17
  (bounded
• 4:18
  specialists
• 4:18
  with
• 4:18
  strict
• 4:19
  I/O
• 4:19
  contracts),
• 4:20
  but
• 4:21
  distributing
• 4:21
  deliberation
• 4:22
  tools
• 4:22
  across
• 4:22
  a
• 4:22
  hierarchy
• 4:23
  produces
• 4:23
  what
• 4:24
  the
• 4:24
  authors
• 4:24
  term
• 4:24
  a
• 4:24
  "deliberation
• 4:25
  cascade."
• 4:26
  Independent
• 4:27
  self-critique
• 4:28
  loops
• 4:28
  in
• 4:28
  each
• 4:28
  sub-agent
• 4:29
  amplify
• 4:29
  uncertainty
• 4:30
  rather
• 4:30
  than
• 4:30
  resolving
• 4:31
  it,
• 4:32
  degrading
• 4:32
  performance
• 4:33
  for
• 4:33
  all
• 4:33
  six
• 4:33
  tested
• 4:34
  models
• 4:34
  while
• 4:34
  doubling
• 4:35
  token
• 4:35
  costs.
• 4:36
  The
• 4:36
  design
• 4:37
  principle:
• 4:38
  invest
• 4:38
  in
• 4:38
  context
• 4:39
  engineering
• 4:39
  and
• 4:40
  bounded
• 4:40
  task
• 4:40
  decomposition,
• 4:42
  not
• 4:42
  deeper
• 4:42
  per-agent
• 4:43
  reasoning.
• 4:44
  This
• 4:44
  aligns
• 4:44
  with
• 4:44
  the
• 4:44
  ITBench-AA
• 4:47
  finding
• 4:47
  that
• 4:47
  more
• 4:48
  turns
• 4:48
  actively
• 4:48
  hurt
• 4:49
  —
• 4:50
  the
• 4:50
  failure
• 4:50
  mode
• 4:50
  is
• 4:51
  the
• 4:51
  same
• 4:51
  whether
• 4:51
  the
• 4:51
  over-reasoning
• 4:52
  happens
• 4:52
  within
• 4:52
  one
• 4:53
  agent
• 4:53
  or
• 4:53
  across
• 4:53
  a
• 4:53
  hierarchy.
• 4:55
  On
• 4:55
  the
• 4:55
  theoretical
• 4:56
  side,
• 4:56
  a
• 4:56
  new
• 4:57
  paper
• 4:57
  claims
• 4:57
  the
• 4:57
  mathematical
• 4:58
  thread
• 4:58
  connecting
• 4:59
  a
• 4:59
  decade
• 4:59
  of
• 4:59
  robustness
• 5:00
  techniques
• 5:00
  —
• 5:01
  PGD
• 5:02
  adversarial
• 5:02
  training,
• 5:03
  RLHF,
• 5:04
  data
• 5:04
  augmentation
• 5:05
  —
• 5:06
  showing
• 5:06
  they
• 5:06
  all
• 5:07
  implicitly
• 5:07
  estimate
• 5:08
  the
• 5:08
  same
• 5:08
  "deployment
• 5:09
  nuisance
• 5:09
  covariance
• 5:10
  matrix."
• 5:11
  When
• 5:11
  estimated
• 5:12
  correctly
• 5:12
  and
• 5:12
  applied
• 5:13
  as
• 5:13
  a
• 5:13
  geometric
• 5:13
  penalty,
• 5:14
  sycophancy
• 5:15
  on
• 5:15
  Qwen2.5-7B
• 5:20
  drops
• 5:20
  from
• 5:20
  38.5%
• 5:22
  to
• 5:22
  13.5%,
• 5:24
  beating
• 5:24
  standard
• 5:24
  PGD
• 5:25
  adversarial
• 5:25
  training
• 5:26
  by
• 5:26
  14.8
• 5:27
  points
• 5:27
  on
• 5:27
  clean
• 5:27
  accuracy.
• 5:29
  The
• 5:29
  kicker
• 5:29
  from
• 5:29
  Theorem
• 5:29
  G:
• 5:30
  if
• 5:30
  the
• 5:30
  matrix
• 5:31
  misses
• 5:31
  even
• 5:31
  one
• 5:32
  direction
• 5:32
  where
• 5:32
  real-world
• 5:33
  data
• 5:33
  varies,
• 5:33
  the
• 5:34
  model
• 5:34
  will
• 5:34
  actively
• 5:35
  exploit
• 5:35
  that
• 5:35
  blind
• 5:35
  spot.
• 5:36
  More
• 5:36
  data
• 5:37
  and
• 5:37
  bigger
• 5:37
  models
• 5:38
  won't
• 5:38
  fix
• 5:38
  a
• 5:38
  geometry
• 5:39
  problem.
• 5:43
  Anthropic
• 5:44
  launched
• 5:44
  dynamic
• 5:45
  workflows
• 5:45
  in
• 5:45
  Claude
• 5:45
  Code,
• 5:46
  a
• 5:46
  feature
• 5:46
  that
• 5:47
  lets
• 5:47
  the
• 5:47
  agent
• 5:47
  write
• 5:47
  orchestration
• 5:48
  scripts
• 5:48
  running
• 5:49
  tens
• 5:49
  to
• 5:49
  hundreds
• 5:50
  of
• 5:50
  parallel
• 5:50
  subagents
• 5:50
  in
• 5:51
  a
• 5:51
  single
• 5:51
  session.
• 5:52
  The
• 5:52
  showcase
• 5:53
  example:
• 5:54
  Jarred
• 5:54
  Sumner
• 5:54
  used
• 5:54
  dynamic
• 5:55
  workflows
• 5:55
  to
• 5:55
  port
• 5:55
  Bun
• 5:56
  from
• 5:56
  Zig
• 5:56
  to
• 5:56
  Rust
• 5:56
  —
• 5:57
  roughly
• 5:57
  750,000
• 5:59
  lines
• 5:59
  of
• 5:59
  code
• 5:59
  —
• 6:00
  in
• 6:00
  eleven
• 6:00
  days
• 6:01
  with
• 6:01
  99.8%
• 6:02
  of
• 6:02
  existing
• 6:02
  tests
• 6:03
  passing.
• 6:04
  One
• 6:04
  workflow
• 6:04
  mapped
• 6:05
  Rust
• 6:05
  lifetimes
• 6:05
  across
• 6:06
  the
• 6:06
  Zig
• 6:06
  codebase;
• 6:06
  another
• 6:07
  wrote
• 6:07
  every
• 6:07
  .rs
• 6:07
  file
• 6:08
  with
• 6:08
  paired
• 6:08
  reviewers
• 6:08
  per
• 6:09
  file;
• 6:09
  a
• 6:09
  fix
• 6:10
  loop
• 6:10
  drove
• 6:10
  the
• 6:10
  build
• 6:10
  until
• 6:11
  clean.
• 6:12
  Anthropic
• 6:12
  is
• 6:12
  transparent
• 6:13
  about
• 6:13
  the
• 6:13
  tradeoff:
• 6:14
  "dynamic
• 6:14
  workflows
• 6:14
  consume
• 6:15
  meaningfully
• 6:15
  more
• 6:15
  usage
• 6:16
  than
• 6:16
  a
• 6:16
  typical
• 6:16
  Claude
• 6:17
  Code
• 6:17
  session."
• 6:18
  Enterprise
• 6:18
  plans
• 6:19
  have
• 6:19
  them
• 6:19
  off
• 6:19
  by
• 6:19
  default,
• 6:20
  and
• 6:20
  the
• 6:20
  first
• 6:20
  trigger
• 6:21
  shows
• 6:21
  what's
• 6:21
  about
• 6:22
  to
• 6:22
  run
• 6:22
  and
• 6:22
  asks
• 6:22
  for
• 6:22
  confirmation.
• 6:24
  Nolan
• 6:24
  Lawson
• 6:24
  published
• 6:25
  a
• 6:25
  thoughtful
• 6:25
  counterpoint:
• 6:26
  using
• 6:26
  AI
• 6:26
  to
• 6:27
  write
• 6:27
  better
• 6:27
  code
• 6:27
  more
• 6:27
  slowly.
• 6:28
  His
• 6:28
  technique
• 6:29
  runs
• 6:29
  Claude,
• 6:29
  Codex,
• 6:30
  and
• 6:30
  Cursor
• 6:30
  Bugbot
• 6:31
  in
• 6:31
  parallel
• 6:31
  against
• 6:31
  every
• 6:32
  PR,
• 6:32
  then
• 6:33
  has
• 6:33
  a
• 6:33
  synthesizer
• 6:33
  deduplicate
• 6:34
  and
• 6:34
  rank
• 6:34
  findings.
• 6:35
  The
• 6:35
  false-positive
• 6:36
  rate
• 6:36
  is
• 6:36
  "near
• 6:37
  zero,"
• 6:37
  and
• 6:37
  it
• 6:38
  consistently
• 6:38
  surfaces
• 6:38
  criticals
• 6:39
  and
• 6:39
  highs
• 6:39
  that
• 6:39
  predate
• 6:40
  the
• 6:40
  PR.
• 6:41
  Velocity
• 6:41
  doesn't
• 6:42
  increase
• 6:42
  —
• 6:43
  the
• 6:43
  review
• 6:43
  sends
• 6:43
  him
• 6:44
  down
• 6:44
  side-quest
• 6:44
  rabbit
• 6:45
  holes
• 6:45
  fixing
• 6:45
  pre-existing
• 6:46
  bugs
• 6:46
  —
• 6:47
  but
• 6:47
  codebase
• 6:47
  health
• 6:48
  improves
• 6:48
  steadily.
• 6:49
  A
• 6:49
  commenter's
• 6:50
  caveat
• 6:50
  is
• 6:51
  worth
• 6:51
  repeating:
• 6:52
  "The
• 6:52
  agents
• 6:52
  find
• 6:53
  the
• 6:53
  bugs;
• 6:54
  you
• 6:54
  still
• 6:54
  need
• 6:54
  to
• 6:54
  understand
• 6:55
  them."
• 6:56
  On
• 6:56
  r/ClaudeAI,
• 6:58
  practitioners
• 6:58
  debating
• 6:59
  overnight
• 6:59
  autonomous
• 7:00
  coding
• 7:00
  have
• 7:01
  reached
• 7:01
  pragmatic
• 7:01
  consensus:
• 7:03
  it
• 7:03
  works
• 7:04
  for
• 7:04
  tightly
• 7:04
  scoped
• 7:04
  tasks
• 7:05
  with
• 7:05
  machine-checkable
• 7:05
  stop
• 7:06
  conditions
• 7:06
  —
• 7:07
  failing
• 7:08
  tests
• 7:08
  that
• 7:08
  should
• 7:08
  pass,
• 7:09
  dependency
• 7:10
  bumps,
• 7:10
  mechanical
• 7:11
  refactors.
• 7:12
  The
• 7:13
  pro
• 7:13
  move
• 7:13
  is
• 7:13
  an
• 7:13
  orchestration
• 7:14
  script
• 7:14
  that
• 7:14
  commits
• 7:14
  after
• 7:15
  each
• 7:15
  step,
• 7:16
  writes
• 7:16
  a
• 7:16
  handoff
• 7:16
  summary,
• 7:17
  and
• 7:17
  rehydrates
• 7:18
  a
• 7:18
  fresh
• 7:18
  session
• 7:18
  to
• 7:18
  prevent
• 7:19
  context
• 7:19
  drift.
• 7:20
  Anything
• 7:20
  architectural?
• 7:21
  "It'll
• 7:22
  drift
• 7:22
  and
• 7:22
  commit
• 7:22
  very
• 7:23
  confidently
• 7:23
  to
• 7:23
  the
• 7:23
  wrong
• 7:24
  abstraction."
• 7:25
  The
• 7:25
  adversarial
• 7:26
  multi-agent
• 7:26
  setup
• 7:27
  —
• 7:27
  separate
• 7:28
  agents
• 7:28
  for
• 7:28
  requirements,
• 7:29
  architecture,
• 7:30
  implementation,
• 7:31
  and
• 7:31
  review
• 7:31
  —
• 7:32
  is
• 7:32
  what
• 7:32
  makes
• 7:32
  overnight
• 7:33
  runs
• 7:33
  trustworthy
• 7:34
  for
• 7:34
  some
• 7:34
  practitioners,
• 7:35
  but
• 7:35
  even
• 7:35
  veterans
• 7:36
  acknowledge
• 7:36
  the
• 7:36
  morning
• 7:37
  triage
• 7:37
  cost.
• 7:41
  DeepSeek
• 7:42
  V4
• 7:42
  Pro's
• 7:42
  pricing
• 7:43
  tells
• 7:43
  the
• 7:43
  story:
• 7:44
  $0.435
• 7:45
  per
• 7:46
  million
• 7:46
  input
• 7:46
  tokens,
• 7:47
  $0.87
• 7:47
  output.
• 7:48
  That's
• 7:48
  28.7×
• 7:49
  cheaper
• 7:50
  than
• 7:50
  Claude
• 7:50
  Opus
• 7:50
  on
• 7:50
  output
• 7:51
  and
• 7:51
  11.5×
• 7:52
  cheaper
• 7:52
  than
• 7:52
  GPT-5.5
• 7:54
  on
• 7:54
  input.
• 7:55
  The
• 7:55
  Reddit
• 7:55
  post
• 7:55
  framing
• 7:56
  this
• 7:56
  as
• 7:56
  "popping
• 7:56
  the
• 7:57
  American
• 7:57
  AI
• 7:57
  bubble"
• 7:57
  is
• 7:57
  provocative,
• 7:58
  but
• 7:58
  the
• 7:59
  thesis
• 7:59
  —
• 7:59
  that
• 8:00
  AI
• 8:00
  pricing
• 8:00
  power
• 8:00
  is
• 8:01
  eroding
• 8:01
  faster
• 8:01
  than
• 8:01
  Wall
• 8:01
  Street
• 8:02
  expects
• 8:02
  —
• 8:02
  has
• 8:03
  teeth.
• 8:04
  When
• 8:04
  a
• 8:04
  model
• 8:04
  is
• 8:05
  competitive
• 8:05
  at
• 8:05
  1/20th
• 8:06
  the
• 8:06
  cost,
• 8:06
  margin
• 8:07
  compression
• 8:07
  becomes
• 8:07
  a
• 8:07
  question
• 8:08
  of
• 8:08
  when,
• 8:08
  not
• 8:08
  if.
• 8:09
  The
• 8:09
  argument
• 8:10
  gains
• 8:10
  force
• 8:10
  when
• 8:11
  you
• 8:11
  realize
• 8:11
  V4
• 8:11
  Flash
• 8:12
  already
• 8:12
  runs
• 8:12
  locally
• 8:12
  on
• 8:13
  consumer
• 8:13
  hardware.
• 8:14
  A
• 8:14
  self-described
• 8:15
  "vibe
• 8:15
  coder"
• 8:15
  got
• 8:16
  the
• 8:16
  284B-total
• 8:17
  /
• 8:18
  13B-active
• 8:19
  MoE
• 8:19
  running
• 8:19
  at
• 8:20
  8.4
• 8:20
  tok/s
• 8:21
  on
• 8:21
  three
• 8:21
  RTX
• 8:22
  3090s
• 8:22
  with
• 8:23
  128GB
• 8:24
  system
• 8:24
  RAM.
• 8:26
  The
• 8:26
  catch:
• 8:27
  mainline
• 8:27
  llama.cpp
• 8:29
  doesn't
• 8:29
  support
• 8:29
  V4's
• 8:30
  architecture
• 8:30
  yet
• 8:30
  —
• 8:31
  Compressed
• 8:31
  Sparse
• 8:32
  Attention,
• 8:32
  Sinkhorn-normalized
• 8:34
  hyperconnections,
• 8:35
  256-expert
• 8:35
  routing
• 8:36
  —
• 8:37
  so
• 8:37
  it
• 8:37
  lives
• 8:37
  on
• 8:38
  forks.
• 8:39
  Most
• 8:39
  HuggingFace
• 8:40
  GGUFs
• 8:40
  were
• 8:40
  quantized
• 8:41
  against
• 8:41
  an
• 8:41
  older
• 8:41
  fork
• 8:42
  with
• 8:42
  incompatible
• 8:42
  metadata,
• 8:43
  requiring
• 8:43
  12
• 8:44
  missing
• 8:44
  metadata
• 8:44
  keys
• 8:45
  and
• 8:45
  ~393
• 8:46
  tensor
• 8:46
  renames.
• 8:47
  The
• 8:48
  poster
• 8:48
  published
• 8:48
  a
• 8:48
  one-pass
• 8:49
  Python
• 8:49
  patcher
• 8:49
  that
• 8:50
  stream-copies
• 8:50
  the
• 8:50
  150GB
• 8:52
  weight
• 8:52
  blob
• 8:53
  with
• 8:53
  a
• 8:53
  rewritten
• 8:53
  header
• 8:53
  in
• 8:53
  four
• 8:54
  minutes
• 8:54
  on
• 8:54
  NVMe.
• 8:55
  The
• 8:55
  key
• 8:55
  flag:
• 8:56
  --cpu-moe
• 8:56
  keeps
• 8:57
  all
• 8:57
  256
• 8:58
  expert
• 8:58
  FFNs
• 8:59
  in
• 8:59
  system
• 8:59
  RAM
• 8:59
  while
• 8:59
  16GB
• 9:00
  of
• 9:00
  non-expert
• 9:01
  weights
• 9:01
  fit
• 9:01
  across
• 9:01
  the
• 9:02
  GPUs.
• 9:03
  The
• 9:03
  third
• 9:03
  thread
• 9:03
  connects
• 9:04
  the
• 9:04
  dots:
• 9:05
  an
• 9:05
  r/LocalLLaMA
• 9:06
  discussion
• 9:06
  on
• 9:06
  why
• 9:06
  AI
• 9:07
  companies
• 9:07
  spread
• 9:07
  FUD
• 9:07
  about
• 9:08
  their
• 9:08
  own
• 9:08
  products.
• 9:09
  The
• 9:09
  "critihype"
• 9:09
  thesis:
• 9:10
  if
• 9:11
  the
• 9:11
  "critique"
• 9:12
  is
• 9:12
  that
• 9:12
  AI
• 9:12
  is
• 9:12
  too
• 9:12
  powerful,
• 9:13
  too
• 9:13
  dangerous,
• 9:15
  too
• 9:15
  close
• 9:15
  to
• 9:15
  AGI
• 9:15
  —
• 9:16
  that's
• 9:16
  marketing,
• 9:17
  not
• 9:17
  critique.
• 9:18
  The
• 9:18
  fear
• 9:18
  serves
• 9:19
  a
• 9:19
  specific
• 9:19
  purpose:
• 9:20
  encouraging
• 9:21
  regulation
• 9:21
  that
• 9:21
  creates
• 9:22
  barriers
• 9:22
  to
• 9:22
  entry
• 9:23
  before
• 9:23
  open
• 9:23
  models
• 9:24
  render
• 9:24
  centralized
• 9:24
  gatekeeping
• 9:25
  irrelevant.
• 9:26
  "Without
• 9:27
  regulation,
• 9:27
  they
• 9:28
  have
• 9:28
  no
• 9:28
  moat.
• 9:29
  With
• 9:29
  regulation,
• 9:30
  they
• 9:30
  have
• 9:30
  a
• 9:30
  regulatory
• 9:31
  apparatus
• 9:31
  they
• 9:31
  can
• 9:32
  capture."
• 9:33
  Whether
• 9:33
  that's
• 9:33
  tinfoil-hat
• 9:34
  territory
• 9:34
  or
• 9:35
  pattern
• 9:35
  recognition,
• 9:36
  the
• 9:36
  economic
• 9:37
  logic
• 9:37
  is
• 9:37
  hard
• 9:37
  to
• 9:38
  dismiss
• 9:38
  when
• 9:38
  a
• 9:38
  284B
• 9:39
  model
• 9:40
  runs
• 9:40
  on
• 9:40
  three
• 9:40
  consumer
• 9:41
  GPUs
• 9:41
  at
• 9:41
  pennies
• 9:42
  per
• 9:42
  million
• 9:42
  tokens.
• 9:43
  The
• 9:43
  three
• 9:44
  threads
• 9:44
  form
• 9:44
  a
• 9:44
  causal
• 9:45
  chain
• 9:45
  that
• 9:45
  this
• 9:45
  publication
• 9:46
  has
• 9:46
  covered
• 9:46
  in
• 9:46
  pieces
• 9:47
  but
• 9:47
  never
• 9:47
  unified:
• 9:48
  pricing
• 9:49
  pressure
• 9:49
  makes
• 9:49
  local
• 9:49
  inference
• 9:50
  viable,
• 9:51
  local
• 9:51
  inference
• 9:52
  viability
• 9:52
  erodes
• 9:53
  the
• 9:53
  API
• 9:54
  moat,
• 9:54
  and
• 9:54
  the
• 9:55
  erosion
• 9:55
  of
• 9:55
  the
• 9:55
  moat
• 9:55
  makes
• 9:56
  regulatory
• 9:56
  capture
• 9:57
  the
• 9:57
  only
• 9:57
  durable
• 9:57
  defense.
• 10:01
  Running
• 10:02
  long-context
• 10:02
  models
• 10:03
  locally
• 10:03
  means
• 10:03
  confronting
• 10:04
  a
• 10:04
  brutal
• 10:04
  memory
• 10:05
  constraint:
• 10:06
  at
• 10:06
  128K
• 10:07
  context,
• 10:08
  the
• 10:08
  KV
• 10:08
  cache
• 10:09
  can
• 10:09
  dwarf
• 10:09
  the
• 10:09
  model
• 10:09
  weights.
• 10:11
  This
• 10:11
  publication
• 10:12
  has
• 10:12
  tracked
• 10:12
  KV
• 10:12
  cache
• 10:13
  quantization
• 10:13
  methods
• 10:14
  across
• 10:14
  six
• 10:14
  editions,
• 10:15
  and
• 10:15
  the
• 10:15
  community
• 10:16
  consensus
• 10:16
  has
• 10:16
  been
• 10:16
  bleak:
• 10:17
  sub-4-bit
• 10:17
  approaches
• 10:18
  consistently
• 10:18
  degraded
• 10:19
  quality
• 10:19
  to
• 10:19
  the
• 10:19
  point
• 10:20
  where
• 10:20
  FP8
• 10:20
  emerged
• 10:21
  as
• 10:21
  the
• 10:21
  practical
• 10:21
  default.
• 10:22
  OSCAR
• 10:23
  may
• 10:23
  be
• 10:23
  the
• 10:23
  first
• 10:23
  method
• 10:24
  to
• 10:24
  crack
• 10:24
  the
• 10:24
  accuracy
• 10:25
  wall
• 10:25
  below
• 10:25
  3
• 10:25
  bits.
• 10:26
  It
• 10:26
  proposes
• 10:27
  a
• 10:27
  clean
• 10:27
  solution:
• 10:28
  capture
• 10:28
  Q/K/V
• 10:30
  activations
• 10:30
  on
• 10:30
  a
• 10:30
  calibration
• 10:31
  set,
• 10:31
  compute
• 10:32
  attention-aware
• 10:32
  covariance
• 10:33
  matrices
• 10:33
  per
• 10:33
  layer,
• 10:34
  then
• 10:34
  derive
• 10:34
  rotations
• 10:35
  that
• 10:35
  align
• 10:35
  quantization
• 10:36
  with
• 10:36
  the
• 10:36
  directions
• 10:36
  attention
• 10:37
  actually
• 10:37
  uses.
• 10:38
  The
• 10:38
  result
• 10:38
  is
• 10:39
  INT2
• 10:39
  KV
• 10:40
  cache
• 10:40
  storage
• 10:40
  —
• 10:41
  roughly
• 10:41
  7×
• 10:41
  compression
• 10:42
  versus
• 10:42
  BF16
• 10:42
  —
• 10:43
  with
• 10:43
  single-digit
• 10:44
  percentage-point
• 10:45
  accuracy
• 10:45
  drops.
• 10:46
  On
• 10:46
  a
• 10:46
  5-benchmark
• 10:47
  mean
• 10:47
  across
• 10:47
  reasoning
• 10:47
  and
• 10:48
  coding
• 10:48
  tasks,
• 10:49
  Qwen3-8B
• 10:50
  under
• 10:51
  OSCAR
• 10:51
  scores
• 10:51
  69.42%
• 10:53
  versus
• 10:53
  70.84%
• 10:54
  for
• 10:54
  BF16,
• 10:55
  while
• 10:56
  QuaRot-INT2
• 10:56
  collapses
• 10:57
  to
• 10:57
  10.14%
• 10:58
  and
• 10:58
  naive
• 10:59
  INT2
• 10:59
  hits
• 10:59
  zero.
• 11:00
  OSCAR
• 11:01
  is
• 11:01
  the
• 11:01
  only
• 11:01
  INT2
• 11:02
  method
• 11:02
  that
• 11:02
  doesn't
• 11:03
  collapse
• 11:03
  on
• 11:03
  reasoning,
• 11:04
  and
• 11:04
  it's
• 11:04
  integrated
• 11:05
  into
• 11:05
  SGLang
• 11:06
  with
• 11:06
  a
• 11:06
  pre-computed
• 11:07
  "RotationZoo"
• 11:08
  on
• 11:08
  HuggingFace
• 11:09
  so
• 11:09
  users
• 11:09
  can
• 11:09
  skip
• 11:10
  calibration
• 11:10
  entirely.
• 11:11
  Shard
• 11:12
  takes
• 11:12
  a
• 11:12
  different
• 11:12
  approach:
• 11:13
  PCA
• 11:14
  plus
• 11:14
  INT4
• 11:15
  on
• 11:15
  K
• 11:15
  heads
• 11:15
  (effectively
• 11:16
  low-rank
• 11:16
  once
• 11:16
  you
• 11:17
  undo
• 11:17
  RoPE),
• 11:17
  and
• 11:17
  Hadamard
• 11:18
  rotation
• 11:18
  plus
• 11:18
  vector
• 11:19
  quantization
• 11:19
  on
• 11:19
  V
• 11:20
  heads.
• 11:20
  The
• 11:21
  result
• 11:21
  is
• 11:21
  ~10×
• 11:22
  KV
• 11:22
  compression
• 11:22
  on
• 11:23
  Llama-3.1-8B
• 11:25
  without
• 11:26
  measurable
• 11:26
  NIAH
• 11:27
  or
• 11:27
  LongBench
• 11:27
  degradation.
• 11:28
  Community
• 11:29
  reception
• 11:29
  was
• 11:29
  characteristically
• 11:30
  blunt
• 11:30
  —
• 11:31
  "stop
• 11:31
  vibe
• 11:32
  coding
• 11:32
  for
• 11:32
  llama
• 11:32
  3.1,
• 11:33
  make
• 11:33
  it
• 11:34
  for
• 11:34
  Qwen
• 11:34
  3.6
• 11:34
  27B"
• 11:35
  —
• 11:36
  but
• 11:36
  the
• 11:36
  split
• 11:36
  K/V
• 11:37
  treatment
• 11:37
  is
• 11:38
  a
• 11:38
  genuinely
• 11:38
  novel
• 11:38
  design
• 11:39
  choice
• 11:39
  .
• 11:40
  LightVLM
• 11:40
  bundles
• 11:41
  KV
• 11:41
  compression
• 11:41
  with
• 11:42
  INT4
• 11:42
  weights
• 11:43
  and
• 11:43
  visual
• 11:43
  token
• 11:44
  pruning
• 11:44
  for
• 11:44
  vision-language
• 11:45
  models,
• 11:45
  squeezing
• 11:46
  LLaVA-1.5-7B
• 11:50
  to
• 11:50
  6.2GB
• 11:51
  peak
• 11:51
  memory
• 11:51
  at
• 11:51
  71.9
• 11:52
  tok/s
• 11:53
  on
• 11:53
  an
• 11:53
  RTX
• 11:53
  4090
• 11:54
  —
• 11:55
  down
• 11:55
  from
• 11:55
  15.1GB
• 11:57
  at
• 11:58
  FP16
• 11:58
  .
• 11:59
  And
• 11:59
  Speech
• 11:59
  Tokenizer
• 12:00
  Arena
• 12:00
  applies
• 12:01
  the
• 12:01
  same
• 12:01
  side-by-side
• 12:02
  comparison
• 12:02
  philosophy
• 12:03
  to
• 12:03
  discrete
• 12:04
  speech
• 12:04
  tokenizers,
• 12:05
  benchmarking
• 12:05
  EnCodec,
• 12:06
  DAC,
• 12:07
  SpeechTokenizer,
• 12:09
  and
• 12:09
  HuBERT
• 12:09
  units
• 12:09
  on
• 12:10
  reconstruction
• 12:10
  quality,
• 12:11
  bitrate,
• 12:12
  and
• 12:12
  downstream
• 12:12
  WER
• 12:12
  —
• 12:13
  the
• 12:13
  kind
• 12:14
  of
• 12:14
  standardized
• 12:14
  comparison
• 12:15
  the
• 12:15
  speech
• 12:15
  community
• 12:15
  has
• 12:16
  lacked
• 12:16
  .
• 12:19
  hipEngine
• 12:19
  is
• 12:20
  a
• 12:20
  new
• 12:20
  ROCm-native
• 12:22
  inference
• 12:23
  engine
• 12:23
  built
• 12:23
  from
• 12:23
  scratch
• 12:24
  with
• 12:24
  custom
• 12:24
  HIP/C++
• 12:25
  kernels
• 12:25
  —
• 12:26
  no
• 12:26
  PyTorch
• 12:27
  dependency
• 12:27
  —
• 12:28
  that
• 12:28
  runs
• 12:29
  Qwen
• 12:29
  3.6
• 12:29
  MoE
• 12:30
  competitively
• 12:30
  with
• 12:30
  llama.cpp
• 12:31
  on
• 12:32
  RDNA3.
• 12:33
  On
• 12:33
  a
• 12:33
  Radeon
• 12:34
  7900
• 12:35
  XTX,
• 12:36
  prefill
• 12:36
  throughput
• 12:36
  with
• 12:36
  ParoQuant
• 12:37
  hits
• 12:37
  2,839
• 12:38
  tok/s
• 12:39
  at
• 12:39
  4K
• 12:40
  context
• 12:40
  versus
• 12:40
  2,177
• 12:42
  for
• 12:42
  llama.cpp
• 12:43
  HIP.
• 12:44
  With
• 12:44
  near-lossless
• 12:44
  INT8
• 12:45
  KV
• 12:45
  cache,
• 12:46
  the
• 12:46
  full
• 12:46
  256K
• 12:47
  context
• 12:48
  window
• 12:48
  fits
• 12:48
  in
• 12:48
  under
• 12:48
  24GB.
• 12:50
  On
• 12:50
  Strix
• 12:50
  Halo
• 12:51
  (Ryzen
• 12:51
  AI
• 12:51
  MAX+
• 12:52
  395),
• 12:53
  it
• 12:53
  already
• 12:54
  beats
• 12:54
  llama.cpp
• 12:55
  HIP
• 12:55
  on
• 12:55
  decode
• 12:56
  at
• 12:56
  most
• 12:56
  context
• 12:56
  lengths
• 12:57
  with
• 12:57
  "minimal
• 12:57
  targeted
• 12:58
  optimization."
• 12:59
  The
• 12:59
  engine
• 12:59
  ships
• 13:00
  with
• 13:00
  100+
• 13:00
  custom
• 13:01
  kernels,
• 13:02
  initial
• 13:02
  GGUF
• 13:03
  support,
• 13:03
  and
• 13:03
  an
• 13:03
  AGPLv3
• 13:04
  license.
• 13:05
  The
• 13:05
  GGUF
• 13:06
  path
• 13:06
  is
• 13:06
  strategically
• 13:07
  important
• 13:07
  —
• 13:08
  it
• 13:08
  means
• 13:08
  existing
• 13:09
  quantized
• 13:09
  models
• 13:09
  work
• 13:10
  without
• 13:10
  custom
• 13:10
  training,
• 13:11
  unlike
• 13:11
  ParoQuant
• 13:12
  which
• 13:12
  can
• 13:12
  take
• 13:12
  days
• 13:13
  to
• 13:13
  quantize.
• 13:14
  The
• 13:14
  developer
• 13:14
  notes
• 13:15
  the
• 13:15
  kernel
• 13:15
  optimization
• 13:16
  was
• 13:16
  "the
• 13:16
  result
• 13:16
  of
• 13:17
  hundreds
• 13:17
  (thousands?)
• 13:18
  of
• 13:18
  rounds
• 13:19
  of
• 13:19
  AI-assisted
• 13:20
  generation,"
• 13:21
  making
• 13:21
  hipEngine
• 13:22
  itself
• 13:22
  an
• 13:22
  artifact
• 13:23
  of
• 13:23
  the
• 13:23
  agentic
• 13:23
  coding
• 13:24
  workflows
• 13:24
  discussed
• 13:25
  above.
• 13:25
  Community
• 13:26
  interest
• 13:26
  centers
• 13:27
  on
• 13:27
  multi-GPU
• 13:27
  support
• 13:28
  and
• 13:28
  expanding
• 13:28
  beyond
• 13:29
  Qwen
• 13:29
  to
• 13:29
  Gemma
• 13:29
  4
• 13:30
  and
• 13:30
  other
• 13:30
  architectures.
• 13:31
  At
• 13:31
  the
• 13:31
  extreme
• 13:32
  edge,
• 13:32
  a
• 13:32
  developer
• 13:33
  built
• 13:33
  a
• 13:33
  from-scratch
• 13:34
  C++
• 13:35
  engine
• 13:35
  to
• 13:35
  run
• 13:35
  MiniCPM-V
• 13:37
  4.6
• 13:38
  entirely
• 13:39
  on
• 13:39
  the
• 13:39
  Orange
• 13:39
  Pi
• 13:40
  AIPro
• 13:40
  —
• 13:40
  a
• 13:41
  $149
• 13:42
  board
• 13:42
  with
• 13:42
  Huawei's
• 13:43
  Ascend
• 13:43
  310B
• 13:44
  NPU.
• 13:45
  Stock
• 13:46
  aclnnMm
• 13:46
  gave
• 13:46
  2.88
• 13:47
  tok/s;
• 13:48
  custom
• 13:49
  AscendC
• 13:49
  cube
• 13:49
  kernels
• 13:50
  for
• 13:50
  M=1
• 13:51
  matmul,
• 13:52
  16-chunk
• 13:52
  lm
• 13:52
  head
• 13:53
  tiling,
• 13:53
  and
• 13:53
  vectorized
• 13:54
  causal-conv1d
• 13:55
  brought
• 13:55
  it
• 13:55
  to
• 13:55
  5.90
• 13:56
  tok/s
• 13:56
  —
• 13:57
  a
• 13:57
  2×
• 13:58
  speedup.
• 13:58
  Both
• 13:59
  text
• 13:59
  generation
• 14:00
  and
• 14:00
  SigLIP
• 14:00
  vision
• 14:00
  tower
• 14:01
  run
• 14:01
  natively
• 14:01
  on
• 14:01
  the
• 14:01
  NPU
• 14:02
  with
• 14:02
  zero
• 14:02
  PyTorch
• 14:03
  dependency.
• 14:04
  The
• 14:04
  theoretical
• 14:05
  floor
• 14:05
  at
• 14:05
  44
• 14:06
  GB/s
• 14:06
  bandwidth
• 14:07
  is
• 14:07
  32ms
• 14:08
  per
• 14:08
  step;
• 14:09
  current
• 14:09
  latency
• 14:09
  sits
• 14:10
  at
• 14:10
  170ms,
• 14:11
  with
• 14:11
  fused
• 14:12
  INT4/INT8
• 14:13
  dequantization
• 14:14
  as
• 14:14
  the
• 14:14
  next
• 14:15
  optimization
• 14:15
  target.
• 14:19
  Volkswagen
• 14:20
  has
• 14:20
  permanently
• 14:20
  disabled
• 14:21
  the
• 14:21
  unofficial
• 14:21
  API
• 14:22
  that
• 14:22
  Home
• 14:22
  Assistant's
• 14:22
  volkswagencarnet
• 14:23
  integration
• 14:24
  relied
• 14:24
  on,
• 14:25
  requiring
• 14:25
  a
• 14:25
  "client
• 14:26
  assertion"
• 14:26
  only
• 14:27
  approved
• 14:27
  commercial
• 14:28
  partners
• 14:28
  can
• 14:28
  provide.
• 14:30
  Existing
• 14:30
  tokens
• 14:30
  work
• 14:31
  until
• 14:31
  expiry;
• 14:32
  new
• 14:32
  authorizations
• 14:33
  are
• 14:33
  blocked.
• 14:34
  The
• 14:34
  Android
• 14:34
  app
• 14:35
  and
• 14:35
  browser
• 14:35
  login
• 14:35
  remain
• 14:36
  functional
• 14:36
  —
• 14:37
  this
• 14:37
  isn't
• 14:37
  a
• 14:37
  service
• 14:37
  outage,
• 14:38
  it's
• 14:38
  a
• 14:38
  deliberate
• 14:39
  lockout
• 14:39
  of
• 14:39
  third-party
• 14:40
  automation.
• 14:41
  A
• 14:41
  commercial
• 14:41
  API
• 14:42
  exists
• 14:42
  (used
• 14:43
  by
• 14:43
  Tronity)
• 14:44
  but
• 14:44
  is
• 14:44
  paid
• 14:44
  and
• 14:44
  gated.
• 14:45
  For
• 14:45
  the
• 14:45
  Home
• 14:45
  Assistant
• 14:46
  community,
• 14:47
  this
• 14:47
  is
• 14:47
  the
• 14:47
  automaker
• 14:48
  equivalent
• 14:48
  of
• 14:48
  the
• 14:48
  robot
• 14:48
  vacuum
• 14:49
  that
• 14:49
  bricked
• 14:49
  when
• 14:49
  its
• 14:49
  owner
• 14:50
  blocked
• 14:50
  telemetry:
• 14:51
  your
• 14:51
  car,
• 14:51
  their
• 14:52
  data.
• 14:53
  YouTube
• 14:53
  is
• 14:53
  moving
• 14:53
  in
• 14:54
  a
• 14:54
  more
• 14:54
  transparent
• 14:54
  direction,
• 14:55
  rolling
• 14:55
  out
• 14:56
  automatic
• 14:56
  detection
• 14:57
  and
• 14:57
  labeling
• 14:57
  of
• 14:57
  AI-generated
• 14:58
  video
• 14:58
  content.
• 14:59
  Starting
• 15:00
  May
• 15:00
  2026,
• 15:01
  if
• 15:01
  a
• 15:01
  creator
• 15:01
  doesn't
• 15:01
  disclose
• 15:02
  photorealistic
• 15:02
  AI
• 15:03
  use
• 15:03
  and
• 15:03
  YouTube's
• 15:03
  systems
• 15:04
  detect
• 15:04
  it,
• 15:04
  a
• 15:05
  label
• 15:05
  is
• 15:05
  applied
• 15:05
  automatically
• 15:05
  —
• 15:06
  displayed
• 15:06
  as
• 15:07
  an
• 15:07
  overlay
• 15:07
  and
• 15:07
  below
• 15:07
  the
• 15:07
  player.
• 15:08
  Creators
• 15:09
  can
• 15:09
  contest
• 15:09
  incorrect
• 15:10
  detections,
• 15:10
  but
• 15:11
  disclosures
• 15:11
  are
• 15:11
  permanent
• 15:11
  for
• 15:12
  content
• 15:12
  made
• 15:12
  with
• 15:12
  YouTube's
• 15:13
  own
• 15:13
  tools
• 15:13
  (Veo,
• 15:14
  Dream
• 15:14
  Screen)
• 15:14
  or
• 15:15
  carrying
• 15:15
  synthetic-media
• 15:16
  provenance
• 15:16
  metadata.
• 15:17
  The
• 15:17
  policy
• 15:17
  explicitly
• 15:18
  notes
• 15:18
  "a
• 15:18
  disclosure
• 15:19
  label
• 15:19
  alone
• 15:19
  does
• 15:19
  not
• 15:20
  change
• 15:20
  how
• 15:20
  a
• 15:20
  video
• 15:20
  is
• 15:20
  recommended
• 15:21
  or
• 15:21
  whether
• 15:21
  it's
• 15:21
  eligible
• 15:22
  to
• 15:22
  earn
• 15:22
  money"
• 15:22
  —
• 15:23
  a
• 15:23
  line
• 15:23
  that
• 15:23
  will
• 15:23
  be
• 15:23
  tested
• 15:23
  as
• 15:24
  AI-generated
• 15:24
  content
• 15:25
  scales.
• 15:25
  A
• 15:25
  103-billion-token
• 15:27
  Usenet
• 15:27
  corpus
• 15:27
  spanning
• 15:28
  1980–2013
• 15:29
  is
• 15:29
  being
• 15:29
  pitched
• 15:29
  as
• 15:30
  "pre-web,
• 15:30
  human-only,
• 15:31
  zero
• 15:31
  AI
• 15:31
  contamination."
• 15:32
  It
• 15:32
  sounds
• 15:32
  valuable
• 15:33
  until
• 15:33
  the
• 15:33
  community
• 15:34
  starts
• 15:34
  poking
• 15:34
  holes:
• 15:35
  multiple
• 15:35
  commenters
• 15:36
  questioned
• 15:36
  the
• 15:36
  ethics
• 15:37
  of
• 15:37
  licensing
• 15:37
  other
• 15:37
  people's
• 15:38
  public
• 15:38
  posts
• 15:38
  for
• 15:39
  commercial
• 15:39
  training
• 15:39
  without
• 15:39
  consent,
• 15:40
  others
• 15:41
  noted
• 15:41
  AI
• 15:41
  labs
• 15:42
  likely
• 15:42
  already
• 15:42
  scraped
• 15:43
  Usenet,
• 15:43
  and
• 15:43
  the
• 15:43
  "free
• 15:43
  preview,
• 15:44
  paid
• 15:44
  full
• 15:44
  access"
• 15:45
  model
• 15:45
  "goes
• 15:46
  against
• 15:46
  the
• 15:46
  spirit
• 15:46
  of
• 15:46
  Usenet
• 15:47
  and
• 15:47
  the
• 15:47
  pre-algorithm
• 15:48
  internet"
• 15:48
  .
• 15:48
  Meanwhile,
• 15:49
  Clark
• 15:49
  Browser
• 15:49
  takes
• 15:50
  the
• 15:50
  automation-versus-detection
• 15:51
  arms
• 15:51
  race
• 15:51
  to
• 15:52
  the
• 15:52
  source
• 15:52
  level.
• 15:53
  Rather
• 15:53
  than
• 15:53
  papering
• 15:54
  over
• 15:54
  headless-browser
• 15:54
  tells
• 15:55
  with
• 15:55
  JavaScript
• 15:55
  injections,
• 15:56
  it
• 15:56
  patches
• 15:57
  Chromium
• 15:57
  where
• 15:57
  the
• 15:58
  values
• 15:58
  originate
• 15:59
  —
• 15:59
  navigator.webdriver
• 16:00
  returns
• 16:00
  false,
• 16:01
  plugins
• 16:01
  show
• 16:02
  five
• 16:02
  PDF-viewer
• 16:03
  entries,
• 16:03
  WebGL
• 16:04
  strings
• 16:04
  match
• 16:04
  real
• 16:05
  GPUs,
• 16:06
  UA
• 16:06
  Client
• 16:06
  Hints
• 16:07
  are
• 16:07
  coherent.
• 16:08
  It
• 16:08
  passes
• 16:08
  Cloudflare
• 16:09
  challenges,
• 16:10
  SannySoft,
• 16:10
  and
• 16:11
  BrowserLeaks
• 16:11
  in
• 16:11
  testing,
• 16:12
  ships
• 16:12
  prebuilt
• 16:13
  binaries
• 16:13
  under
• 16:13
  MIT,
• 16:14
  and
• 16:14
  offers
• 16:15
  30+
• 16:15
  --fingerprint-
• 16:16
  CLI
• 16:16
  switches
• 16:17
  for
• 16:17
  deterministic
• 16:18
  identity
• 16:18
  generation
• 16:18
  .