Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – October 05, 2026

Transcript

AGI Dreams Podcast – October 05, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Cantina
• 0:00
  Security's
• 0:00
  first
• 0:01
  open-weights
• 0:01
  security
• 0:02
  model
• 0:02
  arrives
• 0:03
  with
• 0:03
  an
• 0:03
  argument
• 0:03
  attached,
• 0:04
  and
• 0:04
  the
• 0:04
  argument
• 0:05
  is
• 0:05
  the
• 0:05
  durable
• 0:06
  half.
• 0:07
  Cybersecurity
• 0:07
  is
• 0:07
  adversarial:
• 0:08
  attackers
• 0:09
  do
• 0:09
  not
• 0:09
  respect
• 0:10
  acceptable-use
• 0:10
  policies
• 0:11
  or
• 0:11
  procurement
• 0:11
  rules,
• 0:12
  and
• 0:13
  they
• 0:13
  can
• 0:13
  run
• 0:13
  open
• 0:13
  models
• 0:14
  locally,
• 0:14
  strip
• 0:15
  safeguards,
• 0:15
  and
• 0:15
  build
• 0:16
  around
• 0:16
  capabilities
• 0:17
  that
• 0:17
  already
• 0:17
  exist
• 0:17
  —
• 0:19
  an
• 0:19
  asymmetric
• 0:19
  safety
• 0:19
  in
• 0:20
  which
• 0:20
  defenders
• 0:20
  are
• 0:20
  restricted
• 0:21
  from
• 0:21
  what
• 0:21
  attackers
• 0:21
  can
• 0:21
  obtain
• 0:22
  anyway.
• 0:23
  Cantina
• 0:23
  traces
• 0:23
  the
• 0:24
  precedent
• 0:24
  to
• 0:24
  the
• 0:24
  late-1990s
• 0:25
  disclosure
• 0:25
  fights,
• 0:26
  when
• 0:26
  Nmap
• 0:27
  and
• 0:27
  Metasploit
• 0:27
  were
• 0:27
  controversial
• 0:28
  until
• 0:29
  reproducible
• 0:29
  exploits
• 0:30
  became
• 0:30
  basic
• 0:30
  defender
• 0:31
  infrastructure
• 0:31
  —
• 0:32
  the
• 0:32
  takeaway
• 0:33
  never
• 0:33
  being
• 0:33
  that
• 0:33
  dual-use
• 0:34
  is
• 0:34
  harmless,
• 0:35
  but
• 0:35
  that
• 0:35
  restricting
• 0:35
  defenders
• 0:36
  does
• 0:36
  not
• 0:36
  make
• 0:36
  the
• 0:36
  offense
• 0:36
  disappear.
• 0:38
  Machine-speed
• 0:38
  attacks,
• 0:39
  the
• 0:39
  argument
• 0:39
  concludes,
• 0:40
  require
• 0:40
  machine-speed
• 0:41
  defense
• 0:41
  .
• 0:42
  The
• 0:43
  engineering
• 0:43
  deserves
• 0:44
  more
• 0:44
  attention
• 0:44
  than
• 0:44
  the
• 0:44
  philosophy.
• 0:46
  apex-flash-1
• 0:47
  is
• 0:47
  a
• 0:47
  reinforcement
• 0:48
  learning
• 0:48
  post-train
• 0:49
  of
• 0:49
  GLM-5.3-Flash,
• 0:50
  tuned
• 0:51
  with
• 0:51
  GRPO
• 0:51
  —
• 0:52
  Group
• 0:53
  Relative
• 0:53
  Policy
• 0:53
  Optimization,
• 0:54
  scoring
• 0:55
  attempts
• 0:55
  against
• 0:55
  each
• 0:55
  other
• 0:56
  rather
• 0:56
  than
• 0:56
  a
• 0:56
  fixed
• 0:56
  baseline.
• 0:58
  Training
• 0:58
  environments
• 0:58
  came
• 0:59
  from
• 0:59
  Cantina's
• 0:59
  own
• 0:59
  findings:
• 1:00
  150
• 1:01
  tasks
• 1:02
  from
• 1:02
  50
• 1:02
  vulnerability
• 1:03
  cases
• 1:03
  in
• 1:03
  three
• 1:03
  views
• 1:04
  —
• 1:05
  full
• 1:05
  source
• 1:05
  with
• 1:05
  guidance,
• 1:06
  full
• 1:06
  source
• 1:07
  without,
• 1:07
  and
• 1:07
  blackbox
• 1:08
  access
• 1:08
  to
• 1:08
  a
• 1:08
  running
• 1:09
  target.
• 1:10
  The
• 1:10
  vulnerability
• 1:11
  mix
• 1:11
  mirrors
• 1:11
  production
• 1:12
  work:
• 1:12
  72
• 1:13
  percent
• 1:13
  authorization,
• 1:14
  identity,
• 1:15
  and
• 1:15
  scope
• 1:15
  binding.
• 1:17
  Training
• 1:17
  used
• 1:17
  rank-256
• 1:19
  LoRA
• 1:19
  across
• 1:19
  all
• 1:20
  experts
• 1:20
  and
• 1:20
  routers
• 1:21
  plus
• 1:21
  full-parameter
• 1:22
  updates
• 1:22
  on
• 1:22
  16
• 1:23
  activation-selected
• 1:24
  experts;
• 1:25
  updating
• 1:25
  everything
• 1:26
  collapsed
• 1:26
  the
• 1:26
  model
• 1:26
  —
• 1:27
  misattributed
• 1:28
  gradients
• 1:28
  from
• 1:28
  a
• 1:28
  small
• 1:29
  RL
• 1:29
  dataset,
• 1:29
  the
• 1:29
  team
• 1:30
  suspects.
• 1:31
  The
• 1:31
  economics
• 1:32
  are
• 1:32
  the
• 1:32
  actual
• 1:32
  headline.
• 1:33
  Across
• 1:34
  a
• 1:34
  60-task
• 1:34
  held-out
• 1:35
  run
• 1:35
  from
• 1:35
  20
• 1:36
  unseen
• 1:36
  cases,
• 1:37
  apex-flash-1
• 1:38
  scored
• 1:38
  66.7
• 1:39
  percent
• 1:40
  adjudicated
• 1:40
  first-draw
• 1:41
  pass@1
• 1:42
  at
• 1:42
  an
• 1:42
  estimated
• 1:42
  $2.38,
• 1:44
  versus
• 1:45
  60.0
• 1:45
  percent
• 1:46
  at
• 1:46
  $4.56
• 1:47
  for
• 1:47
  the
• 1:47
  GLM-5.3-Flash
• 1:49
  base
• 1:49
  and
• 1:49
  71.7
• 1:50
  percent
• 1:51
  at
• 1:51
  $74.68
• 1:52
  for
• 1:52
  Claude
• 1:53
  Opus
• 1:53
  5
• 1:53
  High
• 1:53
  —
• 1:54
  within
• 1:55
  five
• 1:55
  points
• 1:55
  of
• 1:55
  the
• 1:55
  frontier
• 1:56
  at
• 1:56
  roughly
• 1:56
  three
• 1:57
  percent
• 1:57
  of
• 1:57
  the
• 1:57
  price.
• 1:58
  The
• 1:58
  model
• 1:59
  card
• 1:59
  is
• 1:59
  careful:
• 2:00
  text-based
• 2:01
  security
• 2:01
  tasks
• 2:01
  only,
• 2:02
  image
• 2:03
  and
• 2:03
  video
• 2:03
  untested,
• 2:04
  the
• 2:04
  checkpoint
• 2:05
  a
• 2:05
  focused
• 2:05
  worker
• 2:05
  under
• 2:06
  a
• 2:06
  larger
• 2:06
  orchestrator,
• 2:07
  recommended
• 2:08
  with
• 2:08
  the
• 2:08
  Codex
• 2:08
  harness.
• 2:10
  An
• 2:10
  abliterated
• 2:10
  variant
• 2:11
  —
• 2:12
  a
• 2:12
  derivative
• 2:12
  with
• 2:12
  refusal
• 2:13
  behavior
• 2:13
  modified
• 2:13
  —
• 2:14
  ships
• 2:15
  alongside,
• 2:15
  with
• 2:15
  the
• 2:15
  evaluation
• 2:16
  applying
• 2:17
  to
• 2:17
  the
• 2:17
  standard
• 2:17
  checkpoint
• 2:17
  .
• 2:18
  Anthropic
• 2:18
  used
• 2:19
  CyScenarioBench
• 2:19
  —
• 2:20
  Irregular's
• 2:21
  private
• 2:21
  benchmark
• 2:22
  for
• 2:22
  multi-stage
• 2:23
  offensive
• 2:23
  cyber
• 2:23
  operations,
• 2:24
  built
• 2:25
  from
• 2:25
  real
• 2:25
  incidents
• 2:26
  as
• 2:26
  attack
• 2:26
  trees
• 2:27
  in
• 2:27
  containerized
• 2:28
  network
• 2:28
  topologies
• 2:28
  —
• 2:29
  for
• 2:29
  Claude
• 2:29
  Opus
• 2:30
  5.5.
• 2:31
  With
• 2:31
  cyber
• 2:32
  mitigations
• 2:32
  disabled,
• 2:33
  Opus
• 2:34
  5.5
• 2:35
  averaged
• 2:35
  67.6
• 2:36
  percent
• 2:37
  across
• 2:37
  a
• 2:37
  ten-challenge
• 2:38
  subset,
• 2:39
  ahead
• 2:39
  of
• 2:39
  Claude
• 2:39
  Mythos
• 2:40
  5.1
• 2:40
  at
• 2:41
  61.7,
• 2:42
  Claude
• 2:43
  Opus
• 2:43
  5
• 2:43
  at
• 2:43
  53.0,
• 2:45
  and
• 2:45
  Claude
• 2:45
  Sonnet
• 2:46
  5
• 2:46
  at
• 2:46
  under
• 2:46
  one
• 2:46
  percent.
• 2:47
  Irregular
• 2:48
  states
• 2:48
  plainly
• 2:49
  what
• 2:49
  this
• 2:49
  measures:
• 2:50
  capability
• 2:50
  elicitation,
• 2:51
  not
• 2:52
  real-world
• 2:52
  attack
• 2:52
  efficacy
• 2:53
  .
• 2:53
  The
• 2:54
  resale
• 2:54
  market
• 2:54
  is
• 2:54
  not
• 2:55
  waiting:
• 2:56
  Audn.ai
• 2:58
  sells
• 2:58
  one
• 2:58
  OpenAI-compatible
• 2:59
  API
• 3:00
  for
• 3:00
  four
• 3:00
  uncensored
• 3:01
  models,
• 3:02
  including
• 3:02
  unrestricted
• 3:03
  GLM
• 3:03
  5.3
• 3:04
  for
• 3:04
  $999
• 3:06
  a
• 3:06
  month
• 3:06
  aimed
• 3:07
  at
• 3:07
  100
• 3:07
  cybersecurity
• 3:08
  researchers,
• 3:09
  a
• 3:09
  resold
• 3:10
  offensive-cyber
• 3:10
  model
• 3:11
  with
• 3:11
  1M
• 3:11
  context,
• 3:12
  and
• 3:12
  a
• 3:12
  Qwen3.8
• 3:15
  fine-tune
• 3:16
  with
• 3:16
  zero
• 3:16
  refusals
• 3:17
  on
• 3:17
  the
• 3:17
  519-prompt
• 3:18
  benchmark
• 3:18
  —
• 3:20
  rates
• 3:20
  published
• 3:20
  "as
• 3:21
  bounds,
• 3:21
  not
• 3:21
  ground
• 3:22
  truth"
• 3:22
  .
• 3:25
  While
• 3:25
  the
• 3:25
  industry
• 3:25
  argues
• 3:26
  over
• 3:26
  who
• 3:26
  should
• 3:26
  hold
• 3:26
  offensive
• 3:27
  capability,
• 3:28
  somebody
• 3:28
  is
• 3:28
  using
• 3:29
  theirs.
• 3:30
  A
• 3:30
  wave
• 3:30
  of
• 3:30
  cyberattacks
• 3:31
  believed
• 3:31
  to
• 3:31
  have
• 3:31
  used
• 3:32
  AI
• 3:32
  agents
• 3:32
  hit
• 3:33
  Korean
• 3:34
  financial
• 3:34
  institutions:
• 3:35
  Shinhan
• 3:35
  Bank,
• 3:36
  KB
• 3:36
  Kookmin
• 3:36
  Bank,
• 3:37
  Hana
• 3:37
  Bank,
• 3:38
  BNK
• 3:38
  Busan
• 3:38
  Bank,
• 3:39
  Yegaram
• 3:39
  Savings
• 3:39
  Bank,
• 3:40
  Welcome
• 3:40
  Savings
• 3:40
  Bank,
• 3:41
  and
• 3:41
  Hyundai
• 3:42
  Capital
• 3:42
  leaked
• 3:42
  customer
• 3:43
  information,
• 3:44
  while
• 3:44
  the
• 3:44
  Korean
• 3:44
  Federation
• 3:45
  of
• 3:45
  Community
• 3:45
  Credit
• 3:45
  Cooperatives
• 3:46
  was
• 3:46
  attacked
• 3:46
  without
• 3:46
  a
• 3:47
  leak.
• 3:47
  The
• 3:48
  core
• 3:48
  networks
• 3:48
  handling
• 3:48
  deposits,
• 3:49
  loans,
• 3:49
  and
• 3:50
  transfers
• 3:50
  are
• 3:50
  separated
• 3:51
  from
• 3:51
  the
• 3:51
  external
• 3:51
  internet,
• 3:52
  and
• 3:52
  the
• 3:52
  attackers
• 3:53
  did
• 3:53
  not
• 3:53
  try
• 3:53
  them
• 3:53
  —
• 3:54
  they
• 3:54
  targeted
• 3:54
  the
• 3:54
  weaker
• 3:55
  links
• 3:55
  connected
• 3:55
  to
• 3:55
  the
• 3:55
  outside.
• 3:56
  President
• 3:57
  Lee
• 3:57
  Jae
• 3:57
  Myung
• 3:57
  ordered
• 3:58
  a
• 3:58
  thorough
• 3:58
  investigation;
• 3:59
  regulators
• 3:59
  demanded
• 4:00
  the
• 4:00
  highest
• 4:00
  vigilance.
• 4:01
  The
• 4:01
  warning
• 4:01
  is
• 4:02
  the
• 4:02
  right
• 4:02
  one:
• 4:02
  network
• 4:03
  separation
• 4:03
  alone
• 4:03
  is
• 4:04
  no
• 4:04
  longer
• 4:04
  enough,
• 4:05
  every
• 4:05
  external
• 4:05
  connection
• 4:06
  is
• 4:06
  a
• 4:06
  candidate
• 4:06
  entry
• 4:06
  point,
• 4:07
  and
• 4:07
  secondary
• 4:08
  damage
• 4:08
  —
• 4:08
  voice
• 4:09
  phishing
• 4:09
  with
• 4:09
  leaked
• 4:09
  personal
• 4:10
  data
• 4:10
  —
• 4:11
  cannot
• 4:11
  be
• 4:11
  ruled
• 4:11
  out.
• 4:12
  Established
• 4:12
  versus
• 4:12
  asserted:
• 4:13
  the
• 4:14
  leaks
• 4:14
  are
• 4:14
  documented,
• 4:14
  the
• 4:15
  AI
• 4:15
  attribution
• 4:15
  is
• 4:15
  so
• 4:15
  far
• 4:16
  a
• 4:16
  belief,
• 4:16
  and
• 4:17
  whether
• 4:17
  securities
• 4:17
  firms,
• 4:17
  insurers,
• 4:18
  and
• 4:18
  card
• 4:18
  companies
• 4:19
  were
• 4:19
  also
• 4:19
  hit
• 4:20
  remains
• 4:20
  unconfirmed
• 4:20
  .
• 4:21
  The
• 4:21
  physical
• 4:22
  version
• 4:22
  came
• 4:22
  through
• 4:22
  anonymous
• 4:23
  officials.
• 4:24
  FBI
• 4:24
  and
• 4:25
  Coast
• 4:25
  Guard
• 4:25
  investigators
• 4:26
  have
• 4:26
  found
• 4:26
  evidence
• 4:27
  that
• 4:27
  hackers
• 4:27
  accessed
• 4:28
  the
• 4:28
  propulsion
• 4:28
  system
• 4:29
  of
• 4:29
  an
• 4:29
  oil
• 4:29
  supertanker
• 4:30
  approaching
• 4:30
  the
• 4:30
  Texas
• 4:31
  coast
• 4:31
  this
• 4:31
  summer
• 4:31
  —
• 4:32
  outsiders
• 4:33
  holding
• 4:33
  temporary
• 4:33
  access
• 4:34
  to
• 4:34
  the
• 4:34
  ship's
• 4:34
  digital
• 4:34
  systems,
• 4:35
  duration
• 4:36
  and
• 4:36
  scope
• 4:36
  of
• 4:36
  control
• 4:36
  still
• 4:37
  unclear.
• 4:38
  The
• 4:38
  breach
• 4:38
  underscores
• 4:39
  the
• 4:39
  urgency
• 4:39
  that
• 4:40
  led
• 4:40
  US
• 4:40
  authorities
• 4:40
  to
• 4:41
  board
• 4:41
  the
• 4:41
  VL
• 4:41
  Prosperity
• 4:42
  in
• 4:42
  August
• 4:42
  —
• 4:43
  fully
• 4:43
  laden,
• 4:43
  longer
• 4:44
  than
• 4:44
  the
• 4:44
  Chrysler
• 4:44
  Building
• 4:44
  is
• 4:45
  tall,
• 4:45
  bound
• 4:45
  for
• 4:46
  Galveston.
• 4:47
  Attribution
• 4:47
  and
• 4:48
  mechanism
• 4:48
  remain
• 4:48
  under
• 4:48
  examination;
• 4:50
  the
• 4:50
  officials
• 4:50
  asked
• 4:50
  not
• 4:51
  to
• 4:51
  be
• 4:51
  identified,
• 4:52
  and
• 4:52
  the
• 4:52
  boarding
• 4:52
  is
• 4:53
  the
• 4:53
  corroborated
• 4:53
  part
• 4:53
  .
• 4:55
  Defenders
• 4:56
  chasing
• 4:56
  cheap,
• 4:57
  fast
• 4:57
  classification
• 4:58
  have
• 4:58
  spent
• 4:58
  weeks
• 4:58
  hearing
• 4:59
  about
• 4:59
  Jev,
• 4:59
  TypeSafe
• 5:00
  AI's
• 5:00
  non-generative
• 5:01
  decision
• 5:01
  model
• 5:01
  —
• 5:02
  no
• 5:02
  text
• 5:02
  output,
• 5:03
  just
• 5:03
  typed
• 5:03
  answers
• 5:04
  with
• 5:04
  calibrated
• 5:04
  probabilities
• 5:04
  —
• 5:05
  and
• 5:05
  the
• 5:05
  independent
• 5:06
  numbers
• 5:06
  cut
• 5:06
  in
• 5:06
  both
• 5:07
  directions.
• 5:08
  Red
• 5:08
  Hat's
• 5:08
  AI
• 5:08
  Safety
• 5:09
  team
• 5:09
  benchmarked
• 5:10
  nine
• 5:10
  guardrail
• 5:10
  candidates
• 5:11
  on
• 5:11
  prompt-injection
• 5:11
  detection
• 5:12
  and
• 5:12
  content
• 5:12
  safety,
• 5:13
  using
• 5:13
  class-balanced
• 5:14
  datasets
• 5:14
  in
• 5:14
  NeMo
• 5:15
  Guardrails.
• 5:16
  The
• 5:16
  conclusion
• 5:16
  is
• 5:17
  deflationary:
• 5:18
  the
• 5:18
  team
• 5:18
  "did
• 5:18
  not
• 5:18
  find
• 5:19
  that
• 5:19
  decision
• 5:19
  models
• 5:19
  produced
• 5:20
  faster,
• 5:20
  cheaper,
• 5:21
  or
• 5:21
  higher-quality
• 5:21
  answers
• 5:22
  compared
• 5:22
  with
• 5:22
  LLM-as-a-judge."
• 5:23
  Pre-trained
• 5:24
  CPU-scale
• 5:24
  classifiers
• 5:25
  under
• 5:25
  200
• 5:26
  million
• 5:26
  parameters
• 5:26
  —
• 5:27
  OpenShift
• 5:27
  AI's
• 5:28
  default
• 5:28
  guardrails
• 5:28
  —
• 5:29
  came
• 5:29
  within
• 5:29
  0.20
• 5:31
  points
• 5:31
  of
• 5:31
  the
• 5:31
  injection
• 5:31
  lead
• 5:31
  while
• 5:32
  topping
• 5:32
  the
• 5:32
  latency
• 5:32
  table.
• 5:33
  Jev
• 5:34
  did
• 5:34
  outperform
• 5:34
  the
• 5:34
  pre-trained
• 5:35
  content-safety
• 5:36
  model
• 5:36
  on
• 5:36
  accuracy,
• 5:37
  but
• 5:37
  Nemotron-3.5-Content-Safety
• 5:39
  trailed
• 5:39
  it
• 5:39
  by
• 5:39
  1.13
• 5:40
  points
• 5:40
  at
• 5:40
  significantly
• 5:41
  lower
• 5:41
  median
• 5:42
  latency,
• 5:42
  and
• 5:42
  a
• 5:42
  Qwen3.6-35B
• 5:45
  judge
• 5:46
  topped
• 5:46
  the
• 5:46
  injection
• 5:46
  leaderboard
• 5:47
  while
• 5:47
  beating
• 5:47
  Jev
• 5:47
  on
• 5:47
  latency
• 5:48
  universally.
• 5:49
  Shieldstral,
• 5:50
  a
• 5:50
  safety
• 5:50
  fine-tune,
• 5:51
  performed
• 5:51
  surprisingly
• 5:52
  poorly
• 5:52
  against
• 5:53
  its
• 5:53
  own
• 5:53
  benchmarks,
• 5:54
  and
• 5:54
  prompts
• 5:54
  tuned
• 5:54
  for
• 5:55
  Jev
• 5:55
  did
• 5:55
  not
• 5:55
  transfer
• 5:56
  to
• 5:56
  Laya
• 5:56
  .
• 5:57
  arXiv
• 5:57
  2609.37647,
• 6:00
  from
• 6:00
  the
• 6:00
  University
• 6:01
  of
• 6:01
  Bonn,
• 6:01
  the
• 6:01
  Lamarr
• 6:02
  Institute,
• 6:02
  and
• 6:03
  Fraunhofer
• 6:03
  IAIS,
• 6:04
  ran
• 6:04
  Jev
• 6:05
  zero-shot
• 6:05
  across
• 6:06
  37
• 6:06
  public
• 6:06
  datasets
• 6:07
  and
• 6:07
  seven
• 6:07
  task
• 6:08
  families
• 6:08
  —
• 6:09
  346,009
• 6:10
  requests,
• 6:11
  $9.15
• 6:12
  total,
• 6:13
  0.36-second
• 6:14
  mean
• 6:14
  latency
• 6:14
  —
• 6:15
  with
• 6:15
  Qwen3.8-27B
• 6:19
  and
• 6:19
  Gemma-4-E4B
• 6:19
  as
• 6:20
  controls.
• 6:21
  Jev
• 6:21
  beat
• 6:21
  Qwen
• 6:22
  on
• 6:22
  27
• 6:22
  of
• 6:22
  37
• 6:23
  datasets
• 6:23
  and
• 6:23
  Gemma
• 6:24
  on
• 6:24
  all
• 6:24
  37.
• 6:25
  It
• 6:25
  excels
• 6:26
  at
• 6:26
  gist-level
• 6:26
  short-text
• 6:27
  decisions:
• 6:28
  IMDB
• 6:28
  96.5,
• 6:29
  SST-2
• 6:30
  96.4,
• 6:32
  ARC
• 6:32
  98.8,
• 6:33
  language
• 6:34
  identification
• 6:34
  99.6,
• 6:37
  CLINC150
• 6:39
  routing
• 6:39
  89.5.
• 6:41
  Its
• 6:41
  probabilities
• 6:42
  are
• 6:42
  genuinely
• 6:42
  calibrated
• 6:43
  —
• 6:44
  pooled
• 6:44
  expected
• 6:44
  calibration
• 6:45
  error
• 6:45
  of
• 6:45
  0.028
• 6:46
  against
• 6:47
  Gemma's
• 6:47
  0.208
• 6:48
  —
• 6:49
  and
• 6:49
  confidence
• 6:49
  supports
• 6:50
  selective
• 6:50
  prediction,
• 6:51
  lifting
• 6:51
  Banking77
• 6:52
  from
• 6:53
  79.7
• 6:54
  to
• 6:54
  96.3
• 6:55
  at
• 6:55
  50
• 6:55
  percent
• 6:55
  coverage.
• 6:56
  The
• 6:56
  weak
• 6:57
  spots
• 6:57
  mirror
• 6:57
  the
• 6:57
  vendor's
• 6:58
  own
• 6:58
  list:
• 6:59
  fine-grained
• 6:59
  labels,
• 7:00
  low-resource
• 7:01
  languages
• 7:01
  (Nigerian
• 7:02
  Fulfulde
• 7:02
  37.4),
• 7:04
  legal
• 7:04
  judgment
• 7:05
  (AGB-DE
• 7:05
  F1
• 7:06
  0.204
• 7:07
  —
• 7:09
  "a
• 7:09
  legal
• 7:09
  judgment
• 7:10
  that
• 7:10
  requires
• 7:11
  domain
• 7:11
  knowledge
• 7:11
  rather
• 7:12
  than
• 7:12
  a
• 7:12
  snap
• 7:12
  decision").
• 7:13
  Then
• 7:13
  the
• 7:13
  anomaly:
• 7:14
  Jev
• 7:15
  scores
• 7:15
  better
• 7:15
  on
• 7:15
  MMLU's
• 7:16
  calculation-heavy
• 7:17
  subjects
• 7:17
  (94.3)
• 7:18
  than
• 7:18
  its
• 7:19
  others
• 7:19
  (91.3)
• 7:19
  —
• 7:21
  the
• 7:21
  opposite
• 7:21
  of
• 7:21
  both
• 7:22
  reference
• 7:22
  models.
• 7:23
  Rotating
• 7:24
  answer
• 7:24
  options
• 7:24
  changes
• 7:25
  nothing;
• 7:26
  withholding
• 7:26
  the
• 7:26
  question
• 7:27
  drops
• 7:27
  accuracy
• 7:28
  to
• 7:28
  near
• 7:28
  chance
• 7:28
  (31.5),
• 7:30
  ruling
• 7:30
  out
• 7:30
  shallow
• 7:31
  memorization
• 7:32
  but
• 7:32
  not
• 7:32
  memorized
• 7:32
  question-answer
• 7:33
  pairs.
• 7:34
  The
• 7:34
  authors
• 7:35
  treat
• 7:35
  long-established
• 7:36
  English
• 7:36
  benchmarks
• 7:37
  "with
• 7:37
  caution,"
• 7:38
  with
• 7:38
  training
• 7:38
  exposure
• 7:39
  the
• 7:39
  most
• 7:39
  plausible
• 7:39
  explanation
• 7:40
  .
• 7:41
  The
• 7:41
  reproduction
• 7:42
  layer
• 7:42
  is
• 7:42
  arriving:
• 7:43
  apolinario/decision-index
• 7:45
  rebuilds
• 7:46
  the
• 7:46
  live
• 7:46
  leaderboard
• 7:46
  from
• 7:47
  pinned,
• 7:47
  sha256-verified
• 7:49
  sources,
• 7:50
  runnable
• 7:50
  with
• 7:50
  checkpoint
• 7:51
  and
• 7:51
  resume.
• 7:52
  Decision
• 7:53
  Index
• 7:53
  0.2.1
• 7:55
  spans
• 7:55
  38
• 7:56
  benchmarks
• 7:56
  and
• 7:56
  roughly
• 7:57
  120,340
• 7:58
  requests,
• 7:59
  with
• 7:59
  67
• 8:00
  entrants
• 8:00
  —
• 8:01
  Jev
• 8:01
  at
• 8:01
  57.89,
• 8:03
  Rune
• 8:03
  26B-A4B
• 8:04
  v3
• 8:05
  at
• 8:05
  57.44
• 8:06
  —
• 8:07
  engines
• 8:08
  over
• 8:08
  1,000
• 8:08
  ms
• 8:09
  median
• 8:09
  latency
• 8:09
  excluded
• 8:10
  as
• 8:10
  no
• 8:10
  longer
• 8:10
  "Jev-like,"
• 8:11
  no
• 8:12
  truncation,
• 8:12
  no
• 8:13
  option
• 8:13
  filtering,
• 8:14
  unanswered
• 8:14
  counts
• 8:14
  as
• 8:14
  wrong
• 8:15
  .
• 8:15
  multimodalart's
• 8:16
  Hugging
• 8:16
  Face
• 8:17
  Space
• 8:17
  hosts
• 8:17
  the
• 8:17
  board
• 8:18
  .
• 8:20
  Cirrius
• 8:20
  Tech's
• 8:21
  analysis
• 8:21
  of
• 8:21
  what
• 8:22
  happens
• 8:22
  when
• 8:22
  a
• 8:22
  decision
• 8:22
  model
• 8:23
  sits
• 8:23
  inside
• 8:23
  a
• 8:23
  security
• 8:24
  pipeline
• 8:24
  is
• 8:25
  the
• 8:25
  sharpest
• 8:25
  security
• 8:25
  writing
• 8:26
  of
• 8:26
  the
• 8:26
  batch.
• 8:27
  JEV
• 8:27
  looks
• 8:28
  ideal
• 8:28
  for
• 8:28
  security
• 8:29
  automation:
• 8:30
  give
• 8:30
  it
• 8:30
  evidence,
• 8:30
  ask
• 8:31
  a
• 8:31
  question,
• 8:31
  get
• 8:32
  a
• 8:32
  typed
• 8:32
  answer,
• 8:32
  cheaply
• 8:33
  and
• 8:33
  quickly.
• 8:34
  Christophe
• 8:34
  Parisel's
• 8:35
  "Covert
• 8:35
  Order"
• 8:35
  experiment
• 8:36
  shows
• 8:36
  the
• 8:36
  problem.
• 8:37
  The
• 8:37
  same
• 8:37
  nine
• 8:38
  sentences,
• 8:38
  reordered
• 8:39
  with
• 8:39
  meaning
• 8:39
  deliberately
• 8:40
  balanced
• 8:40
  between
• 8:40
  two
• 8:40
  choices,
• 8:41
  moved
• 8:42
  one
• 8:42
  class's
• 8:42
  probability
• 8:43
  from
• 8:43
  0.21
• 8:44
  to
• 8:44
  0.46
• 8:44
  —
• 8:45
  a
• 8:46
  25-point
• 8:46
  swing
• 8:46
  —
• 8:47
  while
• 8:47
  confidence
• 8:48
  did
• 8:48
  not
• 8:48
  necessarily
• 8:49
  fall.
• 8:50
  Label
• 8:50
  assignment
• 8:51
  is
• 8:51
  worse:
• 8:51
  swapping
• 8:52
  which
• 8:52
  class
• 8:52
  maps
• 8:53
  to
• 8:53
  the
• 8:53
  API's
• 8:53
  arbitrary
• 8:54
  "A"
• 8:54
  label
• 8:54
  changed
• 8:55
  outcomes
• 8:55
  to
• 8:55
  the
• 8:55
  point
• 8:55
  that
• 8:55
  one
• 8:56
  class
• 8:56
  was
• 8:56
  never
• 8:56
  selected
• 8:57
  in
• 8:57
  200
• 8:57
  calls.
• 8:58
  Not
• 8:58
  noise
• 8:59
  —
• 9:00
  exploitable
• 9:00
  decision
• 9:01
  structure.
• 9:02
  Threat
• 9:02
  intelligence
• 9:03
  is
• 9:03
  hostile
• 9:03
  input
• 9:03
  by
• 9:04
  construction
• 9:04
  —
• 9:05
  headers,
• 9:05
  URLs,
• 9:06
  DNS
• 9:06
  names,
• 9:06
  file
• 9:07
  names,
• 9:07
  package
• 9:07
  metadata
• 9:08
  —
• 9:08
  so
• 9:09
  an
• 9:09
  attacker
• 9:09
  needs
• 9:09
  control
• 9:10
  of
• 9:10
  only
• 9:10
  enough
• 9:10
  of
• 9:10
  it
• 9:10
  to
• 9:11
  influence
• 9:11
  the
• 9:11
  decision
• 9:11
  .
• 9:12
  The
• 9:12
  concrete
• 9:13
  case
• 9:13
  is
• 9:13
  alert
• 9:13
  triage:
• 9:15
  Vega's
• 9:15
  proof
• 9:15
  of
• 9:15
  concept
• 9:16
  put
• 9:16
  Jev
• 9:16
  as
• 9:16
  a
• 9:16
  cheap
• 9:16
  gate
• 9:17
  in
• 9:17
  front
• 9:17
  of
• 9:17
  a
• 9:17
  full
• 9:17
  triage
• 9:17
  agent,
• 9:18
  closing
• 9:18
  any
• 9:19
  alert
• 9:19
  it
• 9:19
  marked
• 9:19
  "not
• 9:19
  escalated"
• 9:20
  above
• 9:20
  a
• 9:20
  confidence
• 9:21
  threshold.
• 9:22
  Across
• 9:22
  two
• 9:22
  tenants
• 9:22
  it
• 9:22
  closed
• 9:23
  15
• 9:23
  percent
• 9:23
  of
• 9:23
  alerts
• 9:24
  on
• 9:24
  the
• 9:24
  busier
• 9:24
  one
• 9:24
  and
• 9:24
  33
• 9:25
  percent
• 9:25
  on
• 9:25
  the
• 9:25
  quieter
• 9:25
  one
• 9:25
  at
• 9:26
  a
• 9:26
  0.8
• 9:26
  threshold,
• 9:27
  with
• 9:27
  judged
• 9:28
  correctness
• 9:28
  around
• 9:28
  98-99
• 9:29
  percent
• 9:29
  —
• 9:30
  and
• 9:30
  confirmed
• 9:30
  escalations
• 9:31
  inside
• 9:31
  the
• 9:31
  closed
• 9:32
  set:
• 9:32
  one
• 9:33
  on
• 9:33
  the
• 9:33
  busy
• 9:33
  tenant,
• 9:34
  two
• 9:34
  on
• 9:34
  the
• 9:34
  quiet
• 9:34
  one.
• 9:35
  At
• 9:35
  0.9
• 9:36
  nothing
• 9:36
  slipped
• 9:37
  through,
• 9:37
  but
• 9:37
  coverage
• 9:38
  shrank;
• 9:39
  Vega
• 9:39
  is
• 9:39
  explicit
• 9:40
  that
• 9:40
  Jev
• 9:40
  is
• 9:40
  a
• 9:40
  one-sided
• 9:41
  gate,
• 9:41
  not
• 9:42
  a
• 9:42
  replacement
• 9:42
  for
• 9:42
  the
• 9:42
  agent's
• 9:43
  verdict.
• 9:44
  Cirrius's
• 9:44
  response
• 9:45
  is
• 9:45
  architectural:
• 9:46
  high
• 9:46
  confidence
• 9:46
  is
• 9:47
  not
• 9:47
  authorization,
• 9:48
  structured
• 9:48
  output
• 9:49
  is
• 9:49
  not
• 9:49
  a
• 9:49
  security
• 9:49
  boundary,
• 9:50
  and
• 9:50
  the
• 9:50
  metric
• 9:51
  that
• 9:51
  matters
• 9:51
  is
• 9:51
  P(correct
• 9:52
  |
• 9:52
  adversarially
• 9:53
  constructed
• 9:53
  input)
• 9:54
  —
• 9:55
  mutate
• 9:55
  only
• 9:55
  attacker-controlled
• 9:56
  parts
• 9:56
  of
• 9:56
  the
• 9:56
  evidence,
• 9:57
  preserve
• 9:57
  the
• 9:57
  malicious
• 9:58
  behavior,
• 9:59
  and
• 9:59
  measure
• 9:59
  how
• 9:59
  far
• 9:59
  the
• 9:59
  decision
• 10:00
  and
• 10:00
  its
• 10:00
  confidence
• 10:01
  move.
• 10:02
  The
• 10:02
  moment
• 10:02
  a
• 10:02
  probabilistic
• 10:03
  judgment
• 10:03
  determines
• 10:04
  whether
• 10:04
  investigation
• 10:04
  continues,
• 10:05
  the
• 10:05
  model
• 10:06
  has
• 10:06
  joined
• 10:06
  the
• 10:06
  control
• 10:07
  plane
• 10:07
  and
• 10:07
  needs
• 10:07
  a
• 10:07
  control
• 10:08
  plane's
• 10:08
  threat
• 10:08
  model.
• 10:09
  Cotool
• 10:10
  is
• 10:10
  the
• 10:10
  same
• 10:10
  direction
• 10:11
  as
• 10:11
  a
• 10:11
  product:
• 10:12
  detection
• 10:12
  agents
• 10:13
  hunting
• 10:13
  against
• 10:13
  a
• 10:13
  natural-language
• 10:14
  threat
• 10:14
  model,
• 10:15
  automated
• 10:15
  response
• 10:16
  from
• 10:16
  any
• 10:16
  alert
• 10:16
  source,
• 10:17
  humans
• 10:17
  in
• 10:17
  the
• 10:17
  loop
• 10:18
  "at
• 10:18
  any
• 10:18
  step"
• 10:19
  as
• 10:19
  a
• 10:19
  vendor
• 10:19
  promise,
• 10:20
  threat-intel
• 10:21
  filtered
• 10:21
  to
• 10:21
  environment
• 10:22
  relevance,
• 10:22
  an
• 10:23
  evaluation
• 10:23
  harness
• 10:23
  measuring
• 10:24
  every
• 10:24
  agent
• 10:24
  run.
• 10:25
  Every
• 10:26
  feature
• 10:26
  assumes
• 10:27
  the
• 10:27
  boundary
• 10:27
  Cirrius
• 10:28
  is
• 10:28
  drawing
• 10:28
  —
• 10:29
  AI
• 10:29
  systems
• 10:29
  produce
• 10:30
  evidence,
• 10:30
  security
• 10:31
  controls
• 10:31
  enforce
• 10:32
  policy,
• 10:33
  and
• 10:33
  those
• 10:33
  are
• 10:33
  not
• 10:33
  the
• 10:33
  same
• 10:34
  thing
• 10:34
  .
• 10:36
  Debian's
• 10:37
  DSA-6528-1
• 10:40
  fixed
• 10:40
  1,313
• 10:41
  CVEs
• 10:42
  in
• 10:43
  one
• 10:43
  update
• 10:43
  of
• 10:43
  the
• 10:43
  linux
• 10:44
  package
• 10:44
  (kernel
• 10:45
  6.12.111-1
• 10:47
  for
• 10:47
  stable):
• 10:48
  three
• 10:48
  from
• 10:48
  2024,
• 10:49
  fifteen
• 10:49
  from
• 10:50
  2025,
• 10:51
  roughly
• 10:51
  1,295
• 10:52
  from
• 10:53
  2026,
• 10:54
  the
• 10:54
  bulk
• 10:54
  in
• 10:54
  near-contiguous
• 10:55
  blocks
• 10:55
  —
• 10:56
  the
• 10:56
  kernel's
• 10:56
  CVE
• 10:57
  Numbering
• 10:57
  Authority
• 10:57
  assigning
• 10:58
  batches
• 10:58
  wholesale.
• 10:59
  No
• 10:59
  per-CVSS
• 11:00
  severities,
• 11:01
  no
• 11:01
  subsystem
• 11:02
  breakdown,
• 11:03
  no
• 11:03
  exploitation
• 11:03
  statement
• 11:04
  —
• 11:05
  just
• 11:05
  the
• 11:05
  aggregate
• 11:05
  warning
• 11:06
  of
• 11:06
  privilege
• 11:06
  escalation,
• 11:07
  denial
• 11:07
  of
• 11:07
  service,
• 11:08
  or
• 11:08
  information
• 11:09
  leaks
• 11:09
  on
• 11:09
  an
• 11:09
  OpenPGP-signed
• 11:10
  advisory,
• 11:11
  the
• 11:11
  strongest
• 11:11
  verification
• 11:12
  anywhere
• 11:12
  in
• 11:12
  it
• 11:12
  .
• 11:13
  At
• 11:13
  the
• 11:13
  micro
• 11:13
  end
• 11:14
  sits
• 11:14
  a
• 11:14
  ten-line
• 11:14
  torvalds/linux
• 11:15
  commit
• 11:16
  masking
• 11:16
  bits
• 11:16
  in
• 11:16
  ASID,
• 11:17
  the
• 11:17
  address-space
• 11:18
  identifier
• 11:18
  AMD
• 11:19
  virtualization
• 11:19
  uses
• 11:20
  —
• 11:20
  the
• 11:20
  quiet
• 11:21
  unit
• 11:21
  at
• 11:21
  which
• 11:21
  a
• 11:21
  1,300-CVE
• 11:25
  flood
• 11:25
  actually
• 11:26
  gets
• 11:26
  fixed
• 11:26
  .
• 11:27
  PatchBench
• 11:27
  (arXiv
• 11:29
  2609.04075)
• 11:30
  asks
• 11:30
  whether
• 11:31
  AI
• 11:31
  agents
• 11:31
  can
• 11:31
  absorb
• 11:32
  that
• 11:32
  workload;
• 11:33
  the
• 11:33
  answer
• 11:33
  is
• 11:34
  not
• 11:34
  yet,
• 11:35
  and
• 11:35
  the
• 11:35
  measurements
• 11:35
  flattering
• 11:36
  until
• 11:36
  now
• 11:36
  because
• 11:36
  they
• 11:36
  reward
• 11:37
  two
• 11:37
  failure
• 11:37
  modes
• 11:38
  —
• 11:38
  patch
• 11:39
  memorization
• 11:39
  (reproducing
• 11:40
  historical
• 11:40
  developer
• 11:40
  fixes)
• 11:41
  and
• 11:41
  symptom-guarding
• 11:42
  (suppressing
• 11:42
  the
• 11:42
  reported
• 11:43
  crash
• 11:43
  without
• 11:43
  fixing
• 11:43
  the
• 11:44
  root
• 11:44
  cause).
• 11:44
  Its
• 11:45
  DiffBLEU
• 11:45
  metric
• 11:45
  (a
• 11:45
  diff-aware
• 11:46
  similarity
• 11:46
  score)
• 11:47
  finds
• 11:47
  that
• 11:47
  at
• 11:47
  a
• 11:47
  0.75
• 11:48
  memorization
• 11:49
  threshold,
• 11:50
  25
• 11:50
  percent
• 11:51
  of
• 11:51
  agent
• 11:51
  patches
• 11:51
  on
• 11:52
  an
• 11:52
  existing
• 11:52
  300-task
• 11:53
  benchmark
• 11:53
  are
• 11:54
  highly
• 11:54
  similar
• 11:54
  to
• 11:54
  historical
• 11:55
  developer
• 11:55
  fixes
• 11:55
  —
• 11:56
  roughly
• 11:57
  double
• 11:57
  the
• 11:57
  11
• 11:57
  percent
• 11:58
  rate
• 11:58
  for
• 11:58
  standalone
• 11:59
  LLMs
• 11:59
  —
• 12:00
  and
• 12:00
  agent
• 12:00
  harnesses
• 12:01
  amplify
• 12:01
  it,
• 12:01
  with
• 12:01
  GPT-5.6
• 12:03
  Sol
• 12:03
  rising
• 12:03
  from
• 12:03
  8.3
• 12:04
  to
• 12:04
  22.0
• 12:05
  percent
• 12:05
  memorization
• 12:06
  under
• 12:06
  Codex.
• 12:07
  Worse,
• 12:07
  81
• 12:08
  percent
• 12:08
  of
• 12:08
  Codex
• 12:09
  patches
• 12:09
  modified
• 12:10
  crash-stack
• 12:10
  functions
• 12:11
  even
• 12:11
  when
• 12:11
  the
• 12:11
  real
• 12:11
  fix
• 12:12
  lies
• 12:12
  elsewhere;
• 12:13
  in
• 12:13
  CVE-2022-1276
• 12:17
  the
• 12:17
  agent
• 12:17
  guarded
• 12:18
  the
• 12:18
  VM
• 12:18
  crash
• 12:18
  site
• 12:19
  instead
• 12:19
  of
• 12:19
  fixing
• 12:19
  the
• 12:19
  compiler-side
• 12:20
  root
• 12:20
  cause,
• 12:21
  so
• 12:21
  "the
• 12:21
  patched
• 12:21
  program
• 12:22
  can
• 12:22
  still
• 12:22
  silently
• 12:23
  generate
• 12:23
  malformed
• 12:23
  outputs."
• 12:24
  PatchBench
• 12:25
  itself
• 12:25
  is
• 12:25
  213
• 12:27
  tasks
• 12:27
  across
• 12:27
  16
• 12:28
  CWEs
• 12:29
  and
• 12:29
  32
• 12:29
  real
• 12:29
  projects,
• 12:31
  built
• 12:31
  so
• 12:31
  ground-truth
• 12:32
  fixes
• 12:32
  lie
• 12:32
  outside
• 12:33
  the
• 12:33
  crash
• 12:33
  stack,
• 12:34
  with
• 12:34
  vulnerabilities
• 12:35
  transplanted
• 12:35
  into
• 12:36
  newer
• 12:36
  repository
• 12:37
  versions
• 12:37
  and
• 12:37
  patch
• 12:38
  sites
• 12:38
  mutated
• 12:38
  so
• 12:39
  memorized
• 12:39
  fixes
• 12:40
  cannot
• 12:40
  be
• 12:40
  reused
• 12:40
  verbatim
• 12:41
  .
• 12:42
  The
• 12:42
  results
• 12:42
  sting:
• 12:43
  PoC-only
• 12:44
  validation
• 12:45
  inflates
• 12:45
  solve
• 12:45
  rates
• 12:46
  1.83x
• 12:47
  on
• 12:47
  average
• 12:48
  —
• 12:48
  83.1
• 12:49
  percent
• 12:49
  of
• 12:49
  PoCs
• 12:50
  pass
• 12:50
  while
• 12:51
  45.3
• 12:52
  percent
• 12:52
  of
• 12:52
  tasks
• 12:53
  are
• 12:53
  actually
• 12:53
  solved.
• 12:55
  The
• 12:55
  top
• 12:55
  three
• 12:55
  agents
• 12:56
  pass
• 12:56
  over
• 12:56
  97
• 12:57
  percent
• 12:57
  of
• 12:57
  PoCs
• 12:58
  but
• 12:58
  solve
• 12:58
  59.2,
• 13:00
  58.2,
• 13:01
  and
• 13:01
  56.8
• 13:02
  percent;
• 13:03
  the
• 13:03
  top
• 13:03
  AIxCC
• 13:04
  systems
• 13:05
  —
• 13:05
  Atlantis,
• 13:06
  Buttercup,
• 13:07
  RoboDuck
• 13:07
  —
• 13:08
  underperform
• 13:09
  general-purpose
• 13:09
  agents
• 13:10
  on
• 13:10
  identical
• 13:10
  models,
• 13:11
  hindered
• 13:11
  by
• 13:12
  rigid
• 13:12
  frameworks.
• 13:13
  Semantic
• 13:13
  validation
• 13:14
  is
• 13:14
  the
• 13:14
  bottleneck
• 13:15
  at
• 13:15
  63.4
• 13:16
  percent
• 13:17
  average,
• 13:18
  larger
• 13:18
  budgets
• 13:18
  plateau
• 13:19
  ($25
• 13:20
  caps
• 13:20
  add
• 13:21
  at
• 13:21
  most
• 13:21
  2.3
• 13:22
  points),
• 13:23
  67
• 13:24
  tasks
• 13:24
  were
• 13:24
  solved
• 13:25
  by
• 13:25
  no
• 13:25
  agent,
• 13:26
  and
• 13:26
  6.8
• 13:27
  to
• 13:27
  7.1
• 13:28
  percent
• 13:28
  of
• 13:28
  passing
• 13:28
  patches
• 13:29
  still
• 13:30
  leave
• 13:30
  root
• 13:30
  causes
• 13:31
  partially
• 13:31
  unfixed.
• 13:32
  The
• 13:32
  human
• 13:32
  alternative
• 13:33
  is
• 13:33
  visible
• 13:34
  where
• 13:34
  stakes
• 13:34
  are
• 13:34
  highest:
• 13:35
  Yukon's
• 13:36
  HashSmash
• 13:37
  tracks
• 13:37
  the
• 13:37
  Keccak[1600]/SHA3-256
• 13:41
  collision
• 13:42
  frontier,
• 13:43
  where
• 13:43
  only
• 13:43
  human-promoted
• 13:44
  results
• 13:45
  form
• 13:45
  the
• 13:45
  published
• 13:45
  frontier
• 13:46
  —
• 13:46
  "the
• 13:47
  nominal
• 13:47
  reference
• 13:47
  is
• 13:48
  not
• 13:48
  a
• 13:48
  qualified
• 13:48
  attack
• 13:49
  or
• 13:49
  a
• 13:49
  proved
• 13:50
  security
• 13:50
  bound"
• 13:50
  .
• 13:54
  Local
• 13:54
  inference
• 13:54
  keeps
• 13:55
  absorbing
• 13:55
  work
• 13:56
  that
• 13:56
  once
• 13:56
  required
• 13:56
  cloud
• 13:57
  budgets.
• 13:57
  backburner
• 13:58
  turns
• 13:58
  an
• 13:58
  iPhone
• 13:59
  into
• 13:59
  a
• 13:59
  co-processor
• 14:00
  for
• 14:00
  a
• 14:00
  Mac
• 14:00
  running
• 14:00
  local
• 14:01
  LLMs:
• 14:02
  a
• 14:02
  llama.cpp
• 14:04
  fork
• 14:04
  with
• 14:04
  custom
• 14:04
  kernels
• 14:05
  splits
• 14:05
  the
• 14:05
  job
• 14:06
  over
• 14:06
  a
• 14:06
  10
• 14:06
  Gb/s
• 14:07
  USB-C
• 14:08
  cable.
• 14:08
  Below
• 14:09
  64k
• 14:09
  context
• 14:10
  the
• 14:10
  Mac
• 14:10
  runs
• 14:10
  the
• 14:11
  first
• 14:11
  40
• 14:11
  layers
• 14:11
  of
• 14:11
  each
• 14:12
  microbatch
• 14:12
  and
• 14:12
  streams
• 14:13
  the
• 14:13
  residual
• 14:14
  to
• 14:14
  the
• 14:14
  phone
• 14:14
  for
• 14:14
  layers
• 14:14
  41-64;
• 14:16
  past
• 14:16
  64k,
• 14:17
  KV
• 14:17
  pages
• 14:17
  —
• 14:18
  the
• 14:18
  attention
• 14:19
  cache
• 14:19
  of
• 14:19
  previous
• 14:19
  tokens'
• 14:20
  keys
• 14:20
  and
• 14:20
  values
• 14:20
  —
• 14:21
  migrate
• 14:22
  to
• 14:22
  the
• 14:22
  phone,
• 14:22
  buying
• 14:22
  196k-229k
• 14:25
  tokens
• 14:25
  of
• 14:25
  context
• 14:26
  on
• 14:26
  an
• 14:26
  iPhone
• 14:26
  17
• 14:27
  Pro
• 14:27
  Max
• 14:27
  against
• 14:28
  64k
• 14:28
  on
• 14:29
  a
• 14:29
  24
• 14:29
  GB
• 14:29
  Mac
• 14:30
  alone.
• 14:30
  Prefill
• 14:31
  runs
• 14:31
  29
• 14:32
  to
• 14:32
  44
• 14:32
  percent
• 14:32
  faster
• 14:33
  at
• 14:33
  16k-48k
• 14:34
  context,
• 14:35
  per-token
• 14:35
  time
• 14:36
  at
• 14:36
  140k
• 14:36
  drops
• 14:37
  from
• 14:37
  279
• 14:38
  to
• 14:38
  176
• 14:39
  ms,
• 14:40
  greedy
• 14:40
  output
• 14:40
  token-identical
• 14:41
  with
• 14:41
  or
• 14:41
  without
• 14:42
  the
• 14:42
  phone.
• 14:43
  The
• 14:43
  phone
• 14:43
  answers
• 14:44
  only
• 14:44
  the
• 14:44
  Mac
• 14:44
  over
• 14:44
  USB,
• 14:46
  with
• 14:46
  an
• 14:46
  OpenAI-compatible
• 14:47
  server
• 14:47
  at
• 14:47
  localhost
• 14:48
  .
• 14:48
  The
• 14:49
  browser
• 14:49
  is
• 14:49
  becoming
• 14:49
  the
• 14:49
  other
• 14:50
  local
• 14:50
  runtime:
• 14:51
  kernels
• 14:51
  for
• 14:51
  more
• 14:52
  than
• 14:52
  200
• 14:52
  common
• 14:53
  ML
• 14:53
  operations,
• 14:54
  open-sourced
• 14:54
  to
• 14:55
  run
• 14:55
  entirely
• 14:55
  in-browser
• 14:56
  on
• 14:56
  WebGPU
• 14:56
  —
• 14:57
  the
• 14:57
  browser
• 14:58
  API
• 14:58
  exposing
• 14:59
  the
• 14:59
  local
• 14:59
  GPU
• 14:59
  —
• 15:01
  with
• 15:01
  the
• 15:01
  optimizations
• 15:01
  being
• 15:02
  upstreamed
• 15:02
  into
• 15:02
  Transformers.js,
• 15:04
  ONNX
• 15:05
  Runtime
• 15:05
  Web,
• 15:06
  and
• 15:06
  LiteRT.js
• 15:07
  .
• 15:08
  Training
• 15:09
  cost
• 15:09
  is
• 15:09
  collapsing
• 15:10
  the
• 15:10
  same
• 15:10
  way.
• 15:11
  A
• 15:11
  hobbyist
• 15:11
  trained
• 15:12
  a
• 15:12
  3.87B-parameter
• 15:12
  MoE
• 15:13
  —
• 15:14
  1.45B
• 15:15
  active
• 15:16
  per
• 15:16
  token,
• 15:16
  every
• 15:16
  layer
• 15:17
  mixture-of-experts,
• 15:18
  16
• 15:18
  experts
• 15:18
  with
• 15:19
  top-4
• 15:19
  routing,
• 15:20
  a
• 15:20
  Qwen3
• 15:20
  tokenizer,
• 15:21
  4,096-token
• 15:22
  context
• 15:22
  —
• 15:23
  from
• 15:23
  scratch
• 15:24
  on
• 15:24
  86.5B
• 15:25
  tokens
• 15:25
  across
• 15:26
  one-to-two
• 15:26
  GH200s
• 15:29
  using
• 15:29
  DiLoCo,
• 15:30
  a
• 15:30
  distributed
• 15:30
  training
• 15:31
  method
• 15:31
  that
• 15:31
  synchronizes
• 15:32
  infrequently.
• 15:33
  HumanEval+
• 15:33
  of
• 15:33
  41.5
• 15:35
  at
• 15:35
  roughly
• 15:35
  0.087T
• 15:37
  tokens
• 15:37
  matches
• 15:38
  Qwen2.5-1.5B,
• 15:41
  which
• 15:41
  used
• 15:41
  18T
• 15:42
  —
• 15:42
  a
• 15:42
  startling
• 15:42
  data-efficiency
• 15:43
  claim
• 15:43
  on
• 15:43
  code
• 15:43
  —
• 15:44
  while
• 15:44
  MMLU
• 15:45
  at
• 15:45
  28.6
• 15:46
  is
• 15:46
  near
• 15:46
  chance
• 15:46
  and
• 15:46
  LiveCodeBench
• 15:47
  medium/hard
• 15:48
  is
• 15:48
  near
• 15:48
  zero,
• 15:49
  limitations
• 15:49
  the
• 15:49
  author
• 15:50
  lists
• 15:50
  honestly.
• 15:51
  DPO
• 15:51
  with
• 15:51
  220k
• 15:52
  pairs
• 15:53
  made
• 15:53
  answers
• 15:53
  longer
• 15:53
  and
• 15:54
  hurt
• 15:54
  code
• 15:54
  and
• 15:54
  math,
• 15:54
  so
• 15:55
  the
• 15:55
  checkpoint
• 15:55
  was
• 15:55
  dropped
• 15:55
  .
• 15:56
  At
• 15:57
  the
• 15:57
  recreational
• 15:57
  end
• 15:57
  of
• 15:58
  the
• 15:58
  same
• 15:58
  hardware,
• 15:59
  a
• 15:59
  local
• 15:59
  LLM
• 16:00
  radio
• 16:00
  on
• 16:00
  a
• 16:00
  couple
• 16:00
  of
• 16:01
  DGX
• 16:01
  Sparks,
• 16:02
  a
• 16:02
  5090,
• 16:03
  and
• 16:03
  a
• 16:03
  4070
• 16:04
  Ti
• 16:05
  runs
• 16:05
  three
• 16:05
  local
• 16:05
  models
• 16:06
  generating
• 16:06
  music,
• 16:07
  voices,
• 16:08
  and
• 16:08
  sound
• 16:08
  effects
• 16:08
  while
• 16:09
  a
• 16:09
  radio
• 16:09
  host
• 16:09
  comments
• 16:10
  on
• 16:10
  the
• 16:10
  songs
• 16:10
  —
• 16:11
  "a
• 16:11
  lot
• 16:11
  more
• 16:12
  farm
• 16:12
  than
• 16:12
  pilgrim"
• 16:12
  .
• 16:15
  Okta
• 16:16
  and
• 16:16
  Microsoft
• 16:16
  are
• 16:16
  building
• 16:17
  agent
• 16:17
  identity
• 16:17
  for
• 16:17
  corporate
• 16:18
  fleets;
• 16:18
  nobody
• 16:19
  was
• 16:19
  building
• 16:19
  it
• 16:19
  for
• 16:19
  one
• 16:20
  person
• 16:20
  with
• 16:20
  one
• 16:20
  agent
• 16:21
  and
• 16:21
  one
• 16:21
  phone,
• 16:22
  so
• 16:22
  a
• 16:22
  hobbyist
• 16:22
  built
• 16:23
  Auth
• 16:23
  Your
• 16:23
  Agent.
• 16:24
  One
• 16:24
  rule:
• 16:25
  the
• 16:25
  agent
• 16:25
  never
• 16:25
  sees
• 16:26
  a
• 16:26
  password,
• 16:26
  and
• 16:27
  anything
• 16:27
  that
• 16:27
  changes
• 16:27
  something
• 16:28
  waits
• 16:28
  for
• 16:28
  a
• 16:28
  thumb.
• 16:29
  Sites
• 16:29
  that
• 16:30
  integrate
• 16:30
  it
• 16:30
  get
• 16:30
  a
• 16:30
  "Sign
• 16:31
  in
• 16:31
  with
• 16:31
  your
• 16:31
  agent"
• 16:31
  flow:
• 16:32
  the
• 16:32
  agent
• 16:33
  signs
• 16:33
  with
• 16:33
  its
• 16:33
  own
• 16:33
  key,
• 16:34
  the
• 16:34
  human
• 16:35
  approves
• 16:35
  with
• 16:35
  a
• 16:35
  phone
• 16:35
  passkey,
• 16:36
  and
• 16:36
  the
• 16:37
  site
• 16:37
  issues
• 16:37
  short-lived
• 16:38
  agent-scoped
• 16:38
  tokens.
• 16:39
  Every
• 16:39
  other
• 16:40
  site
• 16:40
  gets
• 16:40
  the
• 16:40
  vault:
• 16:41
  a
• 16:41
  sandboxed
• 16:41
  Chromium
• 16:42
  in
• 16:42
  Docker
• 16:42
  on
• 16:42
  the
• 16:42
  user's
• 16:43
  own
• 16:43
  machine,
• 16:43
  where
• 16:44
  a
• 16:44
  login,
• 16:44
  CAPTCHA,
• 16:45
  or
• 16:45
  2FA
• 16:46
  prompt
• 16:46
  hands
• 16:46
  a
• 16:46
  live
• 16:46
  view
• 16:47
  to
• 16:47
  the
• 16:47
  phone,
• 16:47
  and
• 16:48
  every
• 16:48
  click
• 16:48
  that
• 16:48
  would
• 16:48
  write
• 16:49
  something
• 16:49
  is
• 16:49
  held
• 16:49
  until
• 16:49
  Approve
• 16:50
  or
• 16:50
  Deny.
• 16:51
  It
• 16:51
  ships
• 16:51
  as
• 16:52
  an
• 16:52
  MCP
• 16:52
  (Model
• 16:53
  Context
• 16:53
  Protocol)
• 16:53
  server,
• 16:54
  so
• 16:54
  the
• 16:54
  model
• 16:55
  behind
• 16:55
  it
• 16:55
  is
• 16:55
  irrelevant;
• 16:56
  the
• 16:56
  Reddit
• 16:56
  post
• 16:57
  describing
• 16:57
  it
• 16:57
  was
• 16:57
  written
• 16:57
  by
• 16:57
  the
• 16:58
  agent
• 16:58
  itself,
• 16:59
  typed
• 16:59
  through
• 16:59
  the
• 16:59
  vault
• 16:59
  with
• 16:59
  the
• 16:59
  Post
• 17:00
  button
• 17:00
  waiting
• 17:00
  for
• 17:00
  a
• 17:00
  thumb,
• 17:01
  and
• 17:01
  disclosed
• 17:01
  as
• 17:01
  such
• 17:02
  .
• 17:03
  VoxLux
• 17:03
  gives
• 17:03
  people
• 17:04
  and
• 17:04
  AI
• 17:04
  agents
• 17:05
  private
• 17:05
  rooms
• 17:05
  that
• 17:05
  no
• 17:05
  external
• 17:06
  entity
• 17:06
  operates.
• 17:07
  There's
• 17:07
  no
• 17:07
  account,
• 17:08
  no
• 17:08
  central
• 17:08
  directory,
• 17:09
  and
• 17:09
  no
• 17:09
  messaging
• 17:10
  server.
• 17:11
  Each
• 17:11
  person,
• 17:12
  and
• 17:12
  each
• 17:12
  agent
• 17:12
  session
• 17:13
  in
• 17:13
  Claude
• 17:13
  Code,
• 17:13
  Codex
• 17:14
  or
• 17:14
  OpenCode,
• 17:15
  becomes
• 17:15
  a
• 17:15
  node
• 17:15
  with
• 17:15
  its
• 17:15
  own
• 17:16
  keys.
• 17:17
  Nodes
• 17:17
  join
• 17:17
  end-to-end-encrypted
• 17:18
  rooms
• 17:18
  as
• 17:19
  peers.
• 17:20
  Being
• 17:20
  in
• 17:20
  a
• 17:20
  room
• 17:20
  lets
• 17:20
  you
• 17:20
  see
• 17:21
  that
• 17:21
  messages
• 17:21
  exist,
• 17:22
  but
• 17:22
  you
• 17:22
  can
• 17:22
  read
• 17:22
  someone
• 17:23
  only
• 17:23
  once
• 17:23
  you
• 17:23
  each
• 17:23
  choose
• 17:24
  to
• 17:24
  trust
• 17:24
  the
• 17:24
  other.
• 17:25
  The
• 17:25
  same
• 17:25
  rooms
• 17:25
  carry
• 17:26
  more
• 17:26
  than
• 17:26
  chat.
• 17:27
  A
• 17:27
  node
• 17:28
  can
• 17:28
  offer
• 17:28
  a
• 17:28
  service
• 17:28
  such
• 17:29
  as
• 17:29
  SSH,
• 17:30
  a
• 17:30
  file
• 17:30
  share
• 17:30
  or
• 17:31
  a
• 17:31
  NAS,
• 17:31
  and
• 17:31
  the
• 17:31
  nodes
• 17:32
  it
• 17:32
  trusts
• 17:32
  can
• 17:32
  reach
• 17:33
  it,
• 17:33
  even
• 17:33
  when
• 17:34
  it
• 17:34
  has
• 17:34
  no
• 17:34
  public
• 17:34
  address.
• 17:35
  The
• 17:36
  only
• 17:36
  infrastructure
• 17:36
  is
• 17:37
  an
• 17:37
  anchor
• 17:37
  you
• 17:37
  run
• 17:37
  yourself,
• 17:38
  and
• 17:38
  it's
• 17:38
  needed
• 17:39
  only
• 17:39
  when
• 17:39
  two
• 17:39
  machines
• 17:40
  are
• 17:40
  both
• 17:40
  behind
• 17:40
  NAT
• 17:41
  and
• 17:41
  can't
• 17:41
  find
• 17:42
  each
• 17:42
  other
• 17:42
  directly.
• 17:43
  The
• 17:43
  anchor
• 17:44
  holds
• 17:44
  no
• 17:44
  keys
• 17:45
  and
• 17:45
  can
• 17:45
  read
• 17:45
  nothing.
• 17:46
  Vox
• 17:47
  doesn't
• 17:47
  start,
• 17:47
  contain
• 17:48
  or
• 17:48
  supervise
• 17:49
  agents.
• 17:50
  It
• 17:50
  carries
• 17:50
  their
• 17:50
  messages
• 17:51
  and
• 17:51
  tunnels,
• 17:52
  so
• 17:52
  agents
• 17:52
  and
• 17:52
  the
• 17:52
  people
• 17:53
  they
• 17:53
  work
• 17:53
  with
• 17:53
  can
• 17:53
  split
• 17:54
  up
• 17:54
  work,
• 17:54
  hand
• 17:55
  it
• 17:55
  off,
• 17:55
  and
• 17:55
  stay
• 17:55
  in
• 17:55
  one
• 17:56
  private
• 17:56
  room
• 17:56
  wherever
• 17:56
  each
• 17:57
  of
• 17:57
  them
• 17:57
  runs.
• 17:58
  Vox
• 17:58
  is
• 17:58
  MIT-licensed
• 17:59
  and
• 17:59
  runs
• 17:59
  on
• 18:00
  macOS
• 18:00
  and
• 18:00
  Linux.
• 18:01
  (mode:
• 18:03
  https://voxlux.us).
• 18:06
  REAmon
• 18:06
  brings
• 18:06
  the
• 18:06
  same
• 18:07
  instinct
• 18:07
  to
• 18:07
  reverse
• 18:08
  engineering:
• 18:09
  a
• 18:09
  Docker-orchestrated
• 18:10
  workspace
• 18:10
  with
• 18:10
  a
• 18:10
  Next.js/Prisma
• 18:12
  front,
• 18:13
  PostgreSQL
• 18:14
  for
• 18:14
  targets
• 18:15
  and
• 18:15
  task
• 18:15
  state,
• 18:16
  and
• 18:16
  Neo4j
• 18:17
  for
• 18:17
  a
• 18:17
  knowledge
• 18:17
  graph
• 18:18
  connecting
• 18:18
  evidence,
• 18:18
  findings,
• 18:19
  and
• 18:19
  hypotheses.
• 18:20
  Workspaces
• 18:21
  hold
• 18:21
  files,
• 18:22
  repositories,
• 18:23
  live
• 18:23
  processes,
• 18:24
  devices,
• 18:25
  and
• 18:25
  debug
• 18:25
  sessions
• 18:26
  under
• 18:26
  bounded
• 18:27
  defaults
• 18:27
  —
• 18:28
  a
• 18:28
  512
• 18:29
  MiB
• 18:29
  per-file
• 18:29
  limit,
• 18:30
  60-second
• 18:30
  windows
• 18:31
  —
• 18:32
  and
• 18:32
  the
• 18:32
  release
• 18:32
  gate
• 18:33
  runs
• 18:33
  Trivy
• 18:33
  image
• 18:34
  scans,
• 18:34
  browser
• 18:35
  end-to-end
• 18:35
  tests,
• 18:36
  database
• 18:37
  restore
• 18:37
  drills,
• 18:37
  and
• 18:38
  two-replica
• 18:38
  crash
• 18:38
  recovery
• 18:39
  .
• 18:40
  Wallet-Risk-Scanner
• 18:41
  applies
• 18:41
  it
• 18:41
  to
• 18:41
  AML
• 18:42
  screening:
• 18:42
  a
• 18:43
  0-100
• 18:43
  score
• 18:44
  from
• 18:44
  sanctions
• 18:44
  exposure
• 18:45
  (capped
• 18:45
  at
• 18:45
  40),
• 18:46
  high-risk
• 18:46
  contract
• 18:47
  interaction
• 18:47
  (30),
• 18:48
  and
• 18:49
  fund-source
• 18:49
  tracing
• 18:49
  (30),
• 18:50
  aggregated
• 18:51
  from
• 18:51
  six
• 18:51
  providers
• 18:52
  (GoPlus,
• 18:53
  Etherscan
• 18:53
  V2,
• 18:54
  ChainAbuse,
• 18:55
  MistTrack,
• 18:56
  BlockSec)
• 18:56
  across
• 18:57
  15-plus
• 18:57
  chains,
• 18:58
  with
• 18:58
  multi-hop
• 18:59
  tracing,
• 19:00
  mixer
• 19:00
  and
• 19:00
  honeypot
• 19:01
  detection,
• 19:01
  batch
• 19:02
  screening,
• 19:02
  and
• 19:02
  24-hour
• 19:03
  local
• 19:03
  blacklist
• 19:04
  caching.
• 19:05
  Scoring
• 19:05
  runs
• 19:06
  entirely
• 19:06
  locally,
• 19:07
  and
• 19:07
  the
• 19:07
  disclaimer
• 19:08
  is
• 19:08
  the
• 19:08
  correct
• 19:08
  one:
• 19:09
  risk
• 19:09
  scores
• 19:10
  are
• 19:10
  heuristic
• 19:10
  signals,
• 19:11
  not
• 19:11
  legal
• 19:11
  determinations
• 19:12
  .
• 19:13
  The
• 19:13
  provenance
• 19:13
  version
• 19:14
  of
• 19:14
  the
• 19:14
  same
• 19:14
  concern
• 19:15
  is
• 19:15
  Reuven
• 19:15
  Cohen's
• 19:16
  warning
• 19:16
  about
• 19:16
  feeding
• 19:17
  unpublished
• 19:17
  research
• 19:18
  to
• 19:18
  ChatGPT
• 19:19
  and
• 19:19
  Claude.
• 19:20
  OpenAI
• 19:21
  says
• 19:21
  eligible
• 19:21
  consumer
• 19:22
  ChatGPT
• 19:23
  and
• 19:23
  Codex
• 19:23
  content
• 19:24
  may
• 19:24
  improve
• 19:24
  its
• 19:24
  models;
• 19:26
  Anthropic
• 19:26
  says
• 19:26
  consumer
• 19:27
  Claude
• 19:27
  chats
• 19:28
  may
• 19:28
  train
• 19:28
  where
• 19:28
  users
• 19:29
  permit
• 19:29
  it.
• 19:30
  The
• 19:30
  2025
• 19:31
  Navier-Stokes
• 19:31
  Millennium
• 19:32
  Prize
• 19:32
  controversy
• 19:33
  made
• 19:33
  the
• 19:33
  question
• 19:34
  concrete
• 19:34
  —
• 19:35
  OpenAI
• 19:36
  investigated
• 19:36
  and
• 19:37
  says
• 19:37
  it
• 19:37
  found
• 19:37
  no
• 19:37
  evidence
• 19:38
  that
• 19:38
  mathematicians'
• 19:38
  Codex
• 19:39
  interactions
• 19:39
  influenced
• 19:40
  the
• 19:40
  result,
• 19:41
  which,
• 19:41
  as
• 19:42
  Cohen
• 19:42
  puts
• 19:42
  it,
• 19:43
  "is
• 19:43
  not
• 19:43
  proof
• 19:43
  of
• 19:43
  misuse.
• 19:44
  It
• 19:45
  is
• 19:45
  proof
• 19:45
  that
• 19:45
  provenance
• 19:46
  questions
• 19:46
  can
• 19:46
  arise
• 19:46
  after
• 19:47
  disclosure,
• 19:48
  and
• 19:48
  may
• 19:48
  be
• 19:48
  difficult
• 19:48
  to
• 19:48
  resolve."
• 19:50
  His
• 19:50
  timeline
• 19:50
  makes
• 19:50
  the
• 19:51
  point
• 19:51
  without
• 19:51
  proving
• 19:51
  copying:
• 19:52
  his
• 19:52
  Q
• 19:52
  Star
• 19:53
  work
• 19:53
  on
• 19:53
  multi-agent
• 19:54
  reinforcement
• 19:54
  learning
• 19:55
  was
• 19:55
  public
• 19:55
  in
• 19:55
  November
• 19:56
  2023,
• 19:57
  and
• 19:57
  OpenAI
• 19:58
  filed
• 19:58
  2024
• 19:59
  patent
• 19:59
  families
• 20:00
  covering
• 20:00
  multi-agent
• 20:01
  interaction,
• 20:01
  shared
• 20:02
  workspaces,
• 20:03
  and
• 20:03
  agent
• 20:03
  coordination.
• 20:04
  "The
• 20:04
  timing
• 20:05
  does
• 20:05
  not
• 20:05
  prove
• 20:05
  copying"
• 20:05
  —
• 20:06
  it
• 20:06
  shows
• 20:07
  why
• 20:07
  timestamps,
• 20:07
  logs,
• 20:08
  and
• 20:08
  prior-art
• 20:09
  records
• 20:09
  matter.
• 20:10
  The
• 20:10
  advice
• 20:10
  is
• 20:11
  unglamorous:
• 20:12
  run
• 20:12
  private
• 20:12
  models
• 20:13
  on
• 20:13
  infrastructure
• 20:13
  you
• 20:13
  control,
• 20:14
  encrypt,
• 20:15
  preserve
• 20:15
  logs,
• 20:16
  timestamp
• 20:17
  discoveries,
• 20:17
  and
• 20:18
  file
• 20:18
  before
• 20:18
  disclosure