Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – July 03, 2026

Transcript

AGI Dreams Podcast – July 03, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Anthropic
• 0:00
  dropped
• 0:00
  Claude
• 0:01
  Sonnet
• 0:01
  5
• 0:01
  this
• 0:02
  week,
• 0:02
  positioning
• 0:02
  it
• 0:03
  as
• 0:03
  the
• 0:03
  most
• 0:03
  agentic
• 0:03
  Sonnet-class
• 0:04
  model
• 0:04
  to
• 0:05
  date
• 0:05
  —
• 0:05
  and,
• 0:06
  at
• 0:06
  introductory
• 0:06
  pricing
• 0:07
  of
• 0:07
  $2/$10
• 0:09
  per
• 0:09
  million
• 0:09
  input/output
• 0:10
  tokens
• 0:11
  through
• 0:11
  August
• 0:11
  31,
• 0:12
  possibly
• 0:13
  the
• 0:13
  most
• 0:13
  cost-efficient
• 0:14
  frontier
• 0:14
  model
• 0:15
  for
• 0:15
  sustained
• 0:15
  agentic
• 0:15
  work.
• 0:16
  The
• 0:16
  pitch
• 0:17
  is
• 0:17
  straightforward:
• 0:18
  Sonnet
• 0:18
  5
• 0:19
  narrows
• 0:19
  the
• 0:19
  gap
• 0:19
  with
• 0:19
  Opus
• 0:20
  4.8
• 0:20
  on
• 0:21
  reasoning,
• 0:21
  coding,
• 0:22
  and
• 0:22
  tool
• 0:22
  use,
• 0:23
  while
• 0:23
  costing
• 0:23
  roughly
• 0:24
  60%
• 0:24
  less
• 0:24
  per
• 0:25
  token.
• 0:25
  Early
• 0:26
  access
• 0:26
  partners
• 0:27
  report
• 0:28
  the
• 0:28
  model
• 0:28
  finishes
• 0:29
  complex
• 0:29
  multi-step
• 0:30
  tasks
• 0:30
  where
• 0:31
  previous
• 0:31
  Sonnets
• 0:31
  would
• 0:31
  stall,
• 0:32
  self-checks
• 0:33
  its
• 0:33
  own
• 0:33
  output
• 0:34
  unprompted,
• 0:34
  and
• 0:34
  handles
• 0:35
  brownfield
• 0:35
  code
• 0:36
  —
• 0:36
  race
• 0:37
  conditions,
• 0:38
  hidden
• 0:38
  test
• 0:38
  dependencies
• 0:38
  —
• 0:39
  with
• 0:39
  notably
• 0:40
  better
• 0:40
  root-cause
• 0:40
  analysis
• 0:41
  than
• 0:41
  its
• 0:41
  predecessor.
• 0:42
  Anthropic's
• 0:43
  own
• 0:43
  safety
• 0:43
  evaluations
• 0:44
  show
• 0:44
  lower
• 0:45
  hallucination
• 0:45
  and
• 0:45
  sycophancy
• 0:46
  rates
• 0:46
  than
• 0:46
  Sonnet
• 0:46
  4.6,
• 0:47
  better
• 0:48
  resistance
• 0:48
  to
• 0:48
  prompt
• 0:48
  injection
• 0:49
  in
• 0:49
  agentic
• 0:49
  contexts,
• 0:50
  and
• 0:50
  substantially
• 0:51
  weaker
• 0:51
  cyber
• 0:51
  capabilities
• 0:52
  than
• 0:52
  Opus-class
• 0:52
  models
• 0:53
  —
• 0:53
  it
• 0:53
  never
• 0:54
  developed
• 0:54
  a
• 0:54
  working
• 0:54
  exploit
• 0:55
  in
• 0:55
  Firefox
• 0:55
  vulnerability
• 0:56
  tests.
• 0:56
  One
• 0:57
  trade-off:
• 0:57
  an
• 0:58
  updated
• 0:58
  tokenizer
• 0:58
  inflates
• 0:59
  input
• 0:59
  token
• 0:59
  counts
• 0:59
  by
• 1:00
  1.0–1.35x
• 1:02
  depending
• 1:02
  on
• 1:03
  content,
• 1:03
  which
• 1:04
  the
• 1:04
  introductory
• 1:04
  pricing
• 1:04
  is
• 1:05
  designed
• 1:05
  to
• 1:05
  absorb.
• 1:06
  That
• 1:06
  safety
• 1:07
  posture
• 1:07
  arrives
• 1:07
  just
• 1:08
  as
• 1:08
  an
• 1:08
  independent
• 1:08
  red-team
• 1:08
  study
• 1:09
  from
• 1:09
  Italy's
• 1:09
  AI4I
• 1:10
  institute
• 1:11
  quantifies
• 1:11
  what
• 1:11
  "frontier
• 1:12
  model
• 1:12
  safety"
• 1:12
  actually
• 1:13
  means
• 1:13
  under
• 1:13
  adversarial
• 1:14
  pressure.
• 1:15
  The
• 1:15
  researchers
• 1:15
  subjected
• 1:16
  Fable
• 1:16
  5
• 1:16
  and
• 1:16
  Opus
• 1:17
  4.8
• 1:17
  to
• 1:17
  hundreds
• 1:18
  of
• 1:18
  thousands
• 1:18
  of
• 1:18
  automated
• 1:19
  jailbreak
• 1:19
  attempts
• 1:20
  across
• 1:20
  a
• 1:20
  ten-category
• 1:21
  harm
• 1:21
  taxonomy,
• 1:22
  using
• 1:22
  four
• 1:22
  attack
• 1:22
  families
• 1:23
  —
• 1:23
  from
• 1:24
  static
• 1:24
  obfuscation
• 1:24
  to
• 1:24
  adaptive
• 1:25
  tree-of-attacks
• 1:25
  search.
• 1:26
  Every
• 1:27
  apparent
• 1:27
  success
• 1:27
  was
• 1:27
  re-adjudicated
• 1:28
  by
• 1:28
  a
• 1:28
  three-judge
• 1:29
  panel
• 1:29
  requiring
• 1:29
  majority
• 1:30
  confirmation.
• 1:31
  The
• 1:31
  headline
• 1:31
  finding:
• 1:32
  static
• 1:33
  obfuscation
• 1:33
  (base64
• 1:34
  encoding,
• 1:34
  ciphers,
• 1:35
  role-play
• 1:35
  wrappers)
• 1:36
  is
• 1:36
  "near-fully
• 1:36
  neutralised,"
• 1:37
  with
• 1:37
  confirmed
• 1:38
  rates
• 1:38
  at
• 1:38
  or
• 1:38
  below
• 1:39
  0.1%
• 1:39
  despite
• 1:40
  roughly
• 1:40
  100,000
• 1:41
  attempts
• 1:41
  per
• 1:41
  model.
• 1:42
  But
• 1:43
  adaptive
• 1:43
  attacks,
• 1:43
  where
• 1:44
  an
• 1:44
  attacker
• 1:44
  model
• 1:44
  iteratively
• 1:45
  rewrites
• 1:45
  prompts
• 1:45
  based
• 1:46
  on
• 1:46
  refusals,
• 1:47
  remain
• 1:47
  devastatingly
• 1:47
  effective.
• 1:48
  Tree-of-attacks
• 1:49
  search
• 1:49
  broke
• 1:50
  Opus
• 1:50
  4.8
• 1:50
  on
• 1:51
  over
• 1:51
  13%
• 1:51
  of
• 1:52
  intents,
• 1:52
  with
• 1:52
  child-safety
• 1:53
  framings
• 1:53
  hitting
• 1:54
  19%
• 1:54
  and
• 1:54
  cybersecurity
• 1:55
  peaking
• 1:55
  at
• 1:55
  double
• 1:55
  digits.
• 1:56
  Fable
• 1:57
  5
• 1:57
  held
• 1:57
  every
• 1:57
  attack
• 1:58
  family
• 1:58
  to
• 1:58
  single
• 1:58
  digits
• 1:59
  but
• 1:59
  still
• 1:59
  produced
• 1:59
  67
• 2:00
  panel-confirmed
• 2:01
  harmful
• 2:01
  completions
• 2:01
  spanning
• 2:02
  every
• 2:02
  harm
• 2:02
  category.
• 2:03
  The
• 2:03
  vulnerability
• 2:04
  is
• 2:04
  contextual
• 2:05
  rather
• 2:05
  than
• 2:05
  lexical
• 2:05
  —
• 2:06
  the
• 2:06
  same
• 2:07
  intent
• 2:07
  succeeds
• 2:07
  when
• 2:08
  reframed,
• 2:08
  not
• 2:08
  when
• 2:09
  encoded
• 2:09
  —
• 2:10
  which
• 2:10
  makes
• 2:10
  it
• 2:10
  harder
• 2:10
  to
• 2:10
  defend
• 2:11
  with
• 2:11
  surface-level
• 2:11
  filters.
• 2:12
  Most
• 2:13
  concerning:
• 2:13
  these
• 2:14
  failures
• 2:14
  were
• 2:14
  found
• 2:15
  "automatically,
• 2:15
  cheaply,
• 2:16
  and
• 2:16
  within
• 2:16
  the
• 2:16
  first
• 2:17
  one
• 2:17
  or
• 2:17
  two
• 2:17
  refinement
• 2:18
  steps"
• 2:18
  by
• 2:18
  an
• 2:18
  attacker
• 2:19
  model
• 2:19
  with
• 2:19
  no
• 2:19
  human
• 2:19
  expert
• 2:20
  in
• 2:20
  the
• 2:20
  loop.
• 2:21
  At
• 2:21
  deployment
• 2:21
  scale,
• 2:22
  a
• 2:22
  success
• 2:22
  rate
• 2:22
  of
• 2:23
  this
• 2:23
  magnitude
• 2:23
  is
• 2:23
  a
• 2:23
  steady,
• 2:24
  reproducible
• 2:25
  stream.
• 2:26
  A
• 2:26
  companion
• 2:26
  cost-performance
• 2:27
  analysis
• 2:27
  of
• 2:27
  Fable
• 2:28
  5
• 2:28
  on
• 2:28
  SWE-bench
• 2:29
  Lite
• 2:29
  reinforces
• 2:29
  a
• 2:29
  practical
• 2:30
  point:
• 2:31
  Fable
• 2:31
  5
• 2:32
  resolved
• 2:32
  23
• 2:33
  of
• 2:33
  25
• 2:33
  "hard-tail"
• 2:34
  tasks
• 2:34
  that
• 2:34
  defeated
• 2:35
  every
• 2:35
  cheaper
• 2:35
  model,
• 2:36
  but
• 2:36
  a
• 2:36
  Sonnet-first,
• 2:38
  Fable-on-failure
• 2:38
  routing
• 2:39
  strategy
• 2:39
  improved
• 2:40
  resolution
• 2:40
  from
• 2:40
  84%
• 2:41
  to
• 2:41
  88%
• 2:42
  while
• 2:42
  cutting
• 2:42
  costs
• 2:43
  22%.
• 2:44
  The
• 2:44
  optimal
• 2:45
  deployment
• 2:45
  is
• 2:45
  a
• 2:45
  tiered
• 2:46
  ladder
• 2:46
  where
• 2:46
  Fable
• 2:46
  sits
• 2:47
  at
• 2:47
  the
• 2:47
  top
• 2:47
  rung,
• 2:48
  engaged
• 2:48
  only
• 2:48
  for
• 2:49
  the
• 2:49
  5–25%
• 2:50
  of
• 2:51
  instances
• 2:51
  that
• 2:51
  actually
• 2:52
  need
• 2:52
  frontier-grade
• 2:52
  reasoning.
• 2:57
  OpenAI
• 2:57
  has
• 2:58
  proposed
• 2:58
  giving
• 2:58
  the
• 2:58
  U.S.
• 2:59
  government
• 2:59
  a
• 3:00
  5%
• 3:00
  equity
• 3:01
  stake
• 3:01
  —
• 3:02
  worth
• 3:02
  roughly
• 3:02
  $42.6
• 3:04
  billion
• 3:04
  at
• 3:05
  its
• 3:05
  $852
• 3:06
  billion
• 3:06
  valuation
• 3:07
  —
• 3:08
  as
• 3:08
  part
• 3:09
  of
• 3:09
  a
• 3:09
  broader
• 3:09
  arrangement
• 3:10
  where
• 3:10
  each
• 3:10
  major
• 3:11
  U.S.
• 3:11
  AI
• 3:11
  developer
• 3:12
  would
• 3:12
  cede
• 3:12
  similar
• 3:13
  shares
• 3:13
  through
• 3:13
  a
• 3:13
  sovereign
• 3:14
  wealth
• 3:14
  fund
• 3:14
  vehicle.
• 3:15
  CEO
• 3:15
  Sam
• 3:15
  Altman
• 3:16
  reportedly
• 3:16
  pitched
• 3:16
  the
• 3:17
  concept
• 3:17
  directly
• 3:17
  to
• 3:18
  the
• 3:18
  Trump
• 3:18
  administration,
• 3:19
  framing
• 3:19
  it
• 3:19
  as
• 3:19
  the
• 3:20
  best
• 3:20
  way
• 3:20
  to
• 3:20
  share
• 3:20
  AI's
• 3:21
  economic
• 3:21
  upside
• 3:21
  with
• 3:22
  the
• 3:22
  public.
• 3:22
  The
• 3:23
  talks
• 3:23
  are
• 3:23
  "conceptual"
• 3:24
  and
• 3:24
  in
• 3:24
  early
• 3:25
  stages;
• 3:25
  implementation
• 3:26
  could
• 3:26
  require
• 3:26
  an
• 3:27
  act
• 3:27
  of
• 3:27
  Congress.
• 3:28
  The
• 3:28
  proposal
• 3:28
  envisions
• 3:29
  Anthropic,
• 3:29
  Google,
• 3:30
  and
• 3:30
  Meta
• 3:30
  ceding
• 3:30
  similar
• 3:31
  stakes,
• 3:31
  though
• 3:32
  none
• 3:32
  have
• 3:32
  agreed.
• 3:33
  Anthropic
• 3:33
  says
• 3:33
  it
• 3:34
  has
• 3:34
  not
• 3:34
  discussed
• 3:34
  a
• 3:34
  government
• 3:35
  equity
• 3:35
  arrangement.
• 3:36
  Both
• 3:36
  OpenAI
• 3:37
  and
• 3:37
  Anthropic
• 3:38
  have
• 3:38
  previously
• 3:38
  floated
• 3:39
  public
• 3:39
  wealth
• 3:39
  fund
• 3:39
  concepts
• 3:40
  in
• 3:40
  policy
• 3:40
  papers,
• 3:41
  and
• 3:41
  both
• 3:41
  are
• 3:41
  preparing
• 3:42
  for
• 3:42
  IPOs
• 3:42
  that
• 3:43
  could
• 3:43
  value
• 3:43
  each
• 3:43
  above
• 3:44
  $1
• 3:44
  trillion.
• 3:45
  Altman
• 3:46
  has
• 3:46
  spoken
• 3:46
  with
• 3:46
  Commerce
• 3:47
  Secretary
• 3:47
  Howard
• 3:47
  Lutnick,
• 3:48
  Treasury
• 3:48
  Secretary
• 3:49
  Scott
• 3:49
  Bessent,
• 3:50
  and
• 3:50
  Senator
• 3:50
  Bernie
• 3:50
  Sanders
• 3:51
  —
• 3:52
  the
• 3:52
  latter
• 3:52
  pushing
• 3:53
  a
• 3:53
  50%
• 3:53
  one-time
• 3:54
  tax
• 3:54
  on
• 3:54
  major
• 3:55
  AI
• 3:55
  companies'
• 3:55
  stock
• 3:56
  to
• 3:56
  fund
• 3:56
  an
• 3:57
  independent
• 3:57
  commission.
• 3:59
  The
• 3:59
  Trump
• 3:59
  administration
• 4:00
  has
• 4:00
  already
• 4:00
  taken
• 4:00
  stakes
• 4:01
  in
• 4:01
  Intel,
• 4:02
  quantum
• 4:02
  computing
• 4:02
  firms,
• 4:03
  and
• 4:03
  critical
• 4:04
  mineral
• 4:04
  companies
• 4:04
  during
• 4:05
  the
• 4:05
  president's
• 4:05
  second
• 4:05
  term.
• 4:06
  Trump
• 4:06
  has
• 4:07
  described
• 4:07
  such
• 4:07
  ownership
• 4:08
  as
• 4:08
  making
• 4:08
  Americans
• 4:09
  "partners
• 4:09
  in
• 4:09
  this
• 4:09
  revolution."
• 4:11
  The
• 4:11
  proposal
• 4:11
  lands
• 4:12
  amid
• 4:12
  a
• 4:12
  broader
• 4:12
  battle
• 4:13
  over
• 4:13
  who
• 4:13
  controls
• 4:13
  AI
• 4:14
  access.
• 4:15
  Anthropic
• 4:15
  CEO
• 4:16
  Dario
• 4:16
  Amodei
• 4:17
  drew
• 4:17
  fresh
• 4:17
  community
• 4:18
  fire
• 4:18
  this
• 4:18
  week
• 4:18
  for
• 4:18
  arguing
• 4:19
  that
• 4:19
  open-source
• 4:19
  models
• 4:20
  cannot
• 4:20
  provide
• 4:20
  the
• 4:20
  same
• 4:21
  benefits
• 4:21
  as
• 4:21
  proprietary
• 4:22
  ones
• 4:22
  —
• 4:23
  claiming
• 4:23
  you
• 4:23
  "cannot
• 4:24
  see
• 4:24
  inside
• 4:24
  the
• 4:24
  model,"
• 4:25
  that
• 4:25
  collaborative
• 4:25
  fine-tuning
• 4:26
  "doesn't
• 4:26
  work
• 4:27
  in
• 4:27
  the
• 4:27
  same
• 4:27
  way,"
• 4:28
  and
• 4:28
  that
• 4:28
  running
• 4:28
  models
• 4:28
  locally
• 4:29
  is
• 4:29
  impractical.
• 4:30
  The
• 4:31
  r/LocalLLaMA
• 4:32
  community
• 4:32
  dismantled
• 4:33
  each
• 4:33
  claim:
• 4:34
  open
• 4:34
  weights
• 4:34
  are
• 4:35
  literally
• 4:35
  the
• 4:35
  inspectable
• 4:36
  part,
• 4:36
  fine-tuning
• 4:37
  has
• 4:37
  produced
• 4:37
  "endless
• 4:38
  real
• 4:38
  improvements,"
• 4:39
  and
• 4:39
  models
• 4:40
  like
• 4:40
  Qwen
• 4:40
  27B
• 4:41
  run
• 4:41
  comfortably
• 4:42
  on
• 4:42
  consumer
• 4:42
  hardware
• 4:43
  without
• 4:43
  any
• 4:43
  cloud
• 4:43
  dependency.
• 4:44
  The
• 4:45
  broader
• 4:45
  sentiment
• 4:45
  crystallized
• 4:46
  around
• 4:46
  a
• 4:46
  familiar
• 4:46
  observation:
• 4:47
  the
• 4:48
  CEO
• 4:48
  of
• 4:48
  a
• 4:48
  company
• 4:49
  selling
• 4:49
  proprietary
• 4:50
  AI
• 4:50
  access
• 4:51
  has
• 4:51
  a
• 4:51
  structural
• 4:51
  incentive
• 4:52
  to
• 4:52
  argue
• 4:52
  against
• 4:52
  free
• 4:53
  alternatives.
• 4:54
  Meanwhile,
• 4:54
  the
• 4:55
  open-source
• 4:55
  community
• 4:56
  is
• 4:56
  building
• 4:56
  infrastructure
• 4:57
  for
• 4:57
  a
• 4:57
  future
• 4:57
  where
• 4:58
  model
• 4:58
  distribution
• 4:58
  does
• 4:59
  not
• 4:59
  depend
• 4:59
  on
• 4:59
  any
• 4:59
  single
• 5:00
  platform.
• 5:01
  Model
• 5:01
  Registry
• 5:02
  publishes
• 5:02
  BitTorrent
• 5:02
  files
• 5:03
  for
• 5:03
  popular
• 5:03
  open
• 5:04
  models
• 5:04
  with
• 5:04
  Hugging
• 5:05
  Face
• 5:05
  as
• 5:05
  a
• 5:05
  fallback
• 5:06
  web
• 5:06
  seed
• 5:06
  —
• 5:07
  downloads
• 5:07
  work
• 5:07
  peer-to-peer
• 5:08
  first
• 5:08
  and
• 5:08
  fall
• 5:09
  back
• 5:09
  to
• 5:09
  HF's
• 5:09
  CDN
• 5:10
  when
• 5:10
  no
• 5:10
  peers
• 5:10
  are
• 5:11
  available.
• 5:12
  The
• 5:12
  project
• 5:12
  is
• 5:12
  still
• 5:13
  experimental,
• 5:14
  but
• 5:14
  community
• 5:14
  interest
• 5:15
  is
• 5:15
  immediate:
• 5:16
  multiple
• 5:17
  users
• 5:17
  volunteered
• 5:18
  seeding
• 5:18
  capacity,
• 5:19
  and
• 5:19
  several
• 5:19
  framed
• 5:20
  it
• 5:20
  as
• 5:20
  essential
• 5:20
  contingency
• 5:21
  planning
• 5:21
  for
• 5:21
  a
• 5:22
  future
• 5:22
  where
• 5:22
  centralized
• 5:23
  model
• 5:23
  hosting
• 5:24
  becomes
• 5:24
  politically
• 5:25
  or
• 5:25
  commercially
• 5:25
  restricted.
• 5:29
  As
• 5:29
  AI
• 5:29
  agents
• 5:30
  move
• 5:30
  from
• 5:30
  demos
• 5:31
  to
• 5:31
  production,
• 5:32
  three
• 5:32
  distinct
• 5:33
  problems
• 5:33
  are
• 5:33
  crystallizing:
• 5:34
  how
• 5:35
  agents
• 5:35
  learn
• 5:35
  from
• 5:36
  their
• 5:36
  own
• 5:36
  work,
• 5:36
  how
• 5:37
  infrastructure
• 5:37
  handles
• 5:38
  real-world
• 5:38
  compound
• 5:39
  load,
• 5:39
  and
• 5:39
  how
• 5:40
  to
• 5:40
  keep
• 5:40
  self-improving
• 5:41
  agents
• 5:41
  honest.
• 5:42
  A
• 5:42
  LinkedIn
• 5:43
  editorial
• 5:43
  this
• 5:43
  week
• 5:43
  names
• 5:44
  the
• 5:44
  third
• 5:44
  problem
• 5:44
  directly:
• 5:45
  Goodhart
• 5:45
  Resistance.
• 5:47
  The
• 5:47
  moment
• 5:47
  an
• 5:47
  agent
• 5:47
  can
• 5:48
  optimize
• 5:48
  its
• 5:48
  own
• 5:48
  behavior,
• 5:49
  the
• 5:49
  acceptance
• 5:50
  gate
• 5:50
  —
• 5:51
  the
• 5:51
  metric
• 5:51
  it
• 5:51
  optimizes
• 5:52
  against
• 5:52
  —
• 5:53
  becomes
• 5:53
  part
• 5:53
  of
• 5:53
  the
• 5:53
  risk
• 5:54
  surface.
• 5:55
  The
• 5:55
  agent
• 5:55
  will
• 5:55
  learn
• 5:56
  to
• 5:56
  satisfy
• 5:56
  the
• 5:56
  verifier,
• 5:57
  which
• 5:57
  may
• 5:57
  or
• 5:57
  may
• 5:58
  not
• 5:58
  mean
• 5:58
  doing
• 5:58
  better
• 5:58
  work.
• 5:59
  The
• 5:59
  prescription
• 6:00
  is
• 6:00
  blunt:
• 6:01
  shadow
• 6:01
  first,
• 6:02
  promote
• 6:02
  on
• 6:02
  holdout
• 6:02
  data,
• 6:03
  watch
• 6:03
  for
• 6:04
  lagged
• 6:04
  failures
• 6:04
  (reverted
• 6:05
  code,
• 6:05
  reopened
• 6:05
  tickets,
• 6:06
  manually
• 6:06
  repaired
• 6:07
  invoices),
• 6:07
  and
• 6:08
  roll
• 6:08
  back
• 6:08
  fast.
• 6:09
  A
• 6:09
  verifier
• 6:10
  is
• 6:10
  an
• 6:10
  instrument,
• 6:10
  not
• 6:11
  truth.
• 6:11
  Agent
• 6:12
  Apprenticeship
• 6:12
  from
• 6:12
  Forsy
• 6:13
  AI
• 6:13
  operationalizes
• 6:13
  part
• 6:14
  of
• 6:14
  that
• 6:14
  vision.
• 6:15
  The
• 6:15
  framework
• 6:15
  creates
• 6:16
  a
• 6:16
  loop
• 6:16
  where
• 6:16
  agents
• 6:16
  complete
• 6:17
  real-world
• 6:17
  tasks,
• 6:18
  are
• 6:18
  evaluated
• 6:18
  by
• 6:18
  mentors,
• 6:19
  and
• 6:19
  generate
• 6:20
  reusable
• 6:20
  learning
• 6:20
  signals
• 6:20
  —
• 6:21
  execution
• 6:22
  traces,
• 6:22
  work
• 6:22
  episodes,
• 6:23
  and
• 6:23
  structured
• 6:23
  experience
• 6:24
  compilations
• 6:24
  —
• 6:25
  that
• 6:25
  feed
• 6:25
  back
• 6:25
  into
• 6:25
  future
• 6:26
  improvement.
• 6:27
  The
• 6:27
  seed
• 6:27
  dataset
• 6:27
  includes
• 6:28
  500+
• 6:28
  curated
• 6:29
  tasks,
• 6:29
  1,000+
• 6:30
  execution
• 6:30
  traces,
• 6:31
  and
• 6:31
  39,000+
• 6:33
  structured
• 6:33
  experience
• 6:34
  records
• 6:34
  spanning
• 6:34
  multiple
• 6:35
  domains.
• 6:36
  It
• 6:36
  supports
• 6:36
  Codex,
• 6:37
  Cursor,
• 6:37
  Claude
• 6:38
  Code,
• 6:38
  and
• 6:38
  custom
• 6:38
  agents.
• 6:40
  The
• 6:40
  key
• 6:40
  design
• 6:40
  choice:
• 6:41
  learning
• 6:41
  is
• 6:41
  earned
• 6:42
  from
• 6:42
  completed
• 6:42
  work,
• 6:43
  not
• 6:43
  synthesized
• 6:43
  from
• 6:44
  hypothetical
• 6:44
  examples.
• 6:45
  Scaling
• 6:46
  those
• 6:46
  agents
• 6:46
  in
• 6:46
  production
• 6:47
  brings
• 6:47
  its
• 6:47
  own
• 6:47
  challenges,
• 6:48
  as
• 6:48
  documented
• 6:49
  in
• 6:49
  a
• 6:49
  Salesforce
• 6:49
  deployment
• 6:50
  study.
• 6:51
  Their
• 6:51
  Agentforce
• 6:51
  platform
• 6:52
  —
• 6:52
  where
• 6:52
  a
• 6:52
  single
• 6:53
  user
• 6:53
  request
• 6:53
  fans
• 6:54
  out
• 6:54
  to
• 6:54
  3–5
• 6:55
  concurrent
• 6:55
  model
• 6:56
  invocations
• 6:56
  —
• 6:57
  revealed
• 6:57
  that
• 6:57
  cold
• 6:57
  starts
• 6:58
  compound
• 6:58
  multiplicatively
• 6:59
  through
• 6:59
  dependency
• 6:59
  graphs,
• 7:00
  not
• 7:00
  additively.
• 7:01
  A
• 7:01
  three-model
• 7:02
  pipeline
• 7:02
  with
• 7:02
  individual
• 7:03
  cold
• 7:03
  starts
• 7:03
  of
• 7:03
  150s,
• 7:03
  30s,
• 7:04
  and
• 7:04
  20s
• 7:05
  experienced
• 7:06
  180s
• 7:07
  effective
• 7:07
  cold
• 7:07
  start
• 7:08
  because
• 7:08
  upstream
• 7:08
  models
• 7:08
  must
• 7:09
  produce
• 7:09
  results
• 7:10
  before
• 7:10
  downstream
• 7:10
  models
• 7:11
  begin.
• 7:12
  Coordinated
• 7:12
  pre-warming
• 7:13
  reduced
• 7:13
  this
• 7:13
  by
• 7:13
  65%.
• 7:15
  The
• 7:15
  system
• 7:15
  handles
• 7:16
  722,000
• 7:17
  daily
• 7:17
  LLM
• 7:18
  inferences
• 7:18
  across
• 7:19
  21
• 7:19
  global
• 7:19
  regions,
• 7:20
  processing
• 7:20
  4.4
• 7:21
  billion
• 7:22
  tokens
• 7:22
  per
• 7:22
  day.
• 7:23
  Per-model
• 7:23
  independent
• 7:24
  scaling
• 7:24
  correctly
• 7:25
  handles
• 7:25
  asymmetric
• 7:26
  traffic
• 7:26
  patterns:
• 7:27
  embedding
• 7:27
  models
• 7:28
  scale
• 7:28
  proportionally
• 7:28
  with
• 7:29
  every
• 7:29
  request
• 7:29
  while
• 7:29
  SQL
• 7:30
  executors
• 7:30
  scale
• 7:31
  only
• 7:31
  2–3x
• 7:32
  during
• 7:33
  spikes.
• 7:34
  The
• 7:34
  architecture
• 7:35
  achieved
• 7:35
  50%
• 7:36
  P95
• 7:37
  tail
• 7:37
  latency
• 7:37
  reduction
• 7:38
  and
• 7:38
  30–40%
• 7:40
  cost
• 7:40
  savings
• 7:41
  over
• 7:41
  static
• 7:41
  deployments.
• 7:43
  Embodied
• 7:43
  agents
• 7:43
  face
• 7:44
  an
• 7:44
  even
• 7:44
  harder
• 7:44
  version
• 7:45
  of
• 7:45
  these
• 7:45
  problems.
• 7:46
  OmniAct,
• 7:47
  from
• 7:47
  Fudan
• 7:47
  University,
• 7:48
  tackles
• 7:49
  persistent
• 7:49
  physical
• 7:50
  autonomy
• 7:50
  by
• 7:51
  decomposing
• 7:51
  planning,
• 7:52
  memory,
• 7:53
  and
• 7:53
  execution
• 7:53
  verification
• 7:54
  into
• 7:54
  three
• 7:55
  cooperating
• 7:55
  modules.
• 7:56
  Its
• 7:56
  hierarchical
• 7:57
  memory
• 7:57
  compresses
• 7:58
  interaction
• 7:58
  history
• 7:59
  at
• 7:59
  semantic
• 7:59
  event
• 8:00
  boundaries
• 8:00
  rather
• 8:01
  than
• 8:01
  fixed
• 8:01
  intervals,
• 8:02
  yielding
• 8:03
  near-flat
• 8:03
  token
• 8:03
  consumption
• 8:04
  over
• 8:04
  100,000+
• 8:07
  accumulated
• 8:07
  tokens
• 8:08
  —
• 8:09
  compared
• 8:09
  to
• 8:09
  linear
• 8:09
  growth
• 8:10
  that
• 8:10
  would
• 8:10
  exhaust
• 8:10
  most
• 8:11
  context
• 8:11
  windows.
• 8:12
  Across
• 8:13
  40
• 8:13
  real-world
• 8:13
  tasks
• 8:14
  on
• 8:14
  two
• 8:14
  robotic
• 8:15
  platforms,
• 8:16
  asynchronous
• 8:17
  visual
• 8:17
  preemption
• 8:18
  (periodic
• 8:18
  VLM-based
• 8:19
  verification
• 8:20
  of
• 8:20
  physical
• 8:20
  execution)
• 8:21
  caught
• 8:21
  grasp
• 8:22
  failures
• 8:22
  and
• 8:23
  navigation
• 8:23
  deviations
• 8:24
  that
• 8:24
  open-loop
• 8:24
  baselines
• 8:25
  propagated
• 8:26
  into
• 8:26
  cascading
• 8:26
  faults.
• 8:27
  Most
• 8:28
  strikingly,
• 8:28
  it
• 8:28
  elevated
• 8:29
  the
• 8:29
  open-weight
• 8:30
  Qwen3-VL-30B
• 8:32
  to
• 8:32
  proprietary
• 8:33
  Gemini-3.1-Pro
• 8:34
  performance
• 8:35
  levels
• 8:35
  (+30
• 8:36
  points)
• 8:36
  without
• 8:37
  additional
• 8:37
  training,
• 8:38
  demonstrating
• 8:38
  that
• 8:39
  architectural
• 8:39
  clarity
• 8:40
  complements
• 8:40
  model
• 8:40
  capacity
• 8:41
  rather
• 8:41
  than
• 8:42
  competing
• 8:42
  with
• 8:42
  it.
• 8:46
  Cellebrite
• 8:46
  Labs
• 8:47
  released
• 8:47
  ghidra-rpc,
• 8:48
  turning
• 8:48
  Ghidra
• 8:49
  —
• 8:49
  the
• 8:49
  NSA's
• 8:50
  open-source
• 8:50
  reverse
• 8:51
  engineering
• 8:51
  suite
• 8:51
  —
• 8:52
  into
• 8:52
  a
• 8:52
  persistent
• 8:53
  background
• 8:53
  daemon
• 8:53
  controllable
• 8:54
  by
• 8:54
  any
• 8:54
  AI
• 8:54
  coding
• 8:55
  assistant
• 8:55
  via
• 8:56
  structured
• 8:56
  JSON
• 8:56
  over
• 8:57
  a
• 8:57
  Unix
• 8:57
  socket.
• 8:58
  The
• 8:58
  agent
• 8:58
  can
• 8:58
  decompile
• 8:59
  functions
• 8:59
  to
• 8:59
  pseudo-C,
• 9:00
  trace
• 9:00
  call
• 9:01
  graphs,
• 9:01
  rename
• 9:02
  symbols,
• 9:02
  define
• 9:03
  structs,
• 9:03
  patch
• 9:04
  instructions,
• 9:04
  and
• 9:04
  diff
• 9:05
  binary
• 9:05
  versions,
• 9:06
  all
• 9:06
  without
• 9:06
  human
• 9:06
  intervention.
• 9:07
  Ghidra
• 9:07
  stays
• 9:08
  warm
• 9:08
  between
• 9:08
  commands
• 9:09
  (no
• 9:09
  re-analysis
• 9:09
  per
• 9:09
  invocation),
• 9:10
  and
• 9:11
  all
• 9:11
  changes
• 9:11
  persist
• 9:12
  in
• 9:12
  the
• 9:12
  project
• 9:12
  file.
• 9:12
  This
• 9:13
  is
• 9:13
  not
• 9:14
  "AI-assisted
• 9:14
  RE"
• 9:14
  in
• 9:15
  the
• 9:15
  vague
• 9:15
  sense
• 9:15
  —
• 9:15
  it
• 9:16
  is
• 9:16
  a
• 9:16
  fully
• 9:16
  autonomous
• 9:17
  reverse
• 9:17
  engineering
• 9:18
  skill
• 9:18
  set
• 9:18
  where
• 9:18
  the
• 9:18
  agent
• 9:19
  navigates
• 9:19
  binary
• 9:20
  analysis
• 9:20
  the
• 9:20
  way
• 9:20
  a
• 9:20
  human
• 9:20
  analyst
• 9:21
  would,
• 9:21
  issuing
• 9:22
  commands
• 9:22
  and
• 9:22
  reasoning
• 9:23
  over
• 9:23
  structured
• 9:23
  results.
• 9:24
  On
• 9:25
  the
• 9:25
  memory
• 9:25
  side,
• 9:25
  Recall
• 9:26
  addresses
• 9:26
  Claude
• 9:26
  Code's
• 9:27
  cold-start
• 9:27
  problem
• 9:28
  with
• 9:28
  a
• 9:28
  fully
• 9:28
  local,
• 9:29
  zero-API-key
• 9:30
  approach.
• 9:31
  Every
• 9:31
  session
• 9:31
  is
• 9:31
  captured
• 9:32
  as
• 9:32
  an
• 9:32
  append-only
• 9:33
  log,
• 9:33
  and
• 9:33
  a
• 9:33
  local
• 9:34
  TF-IDF
• 9:35
  +
• 9:36
  TextRank
• 9:37
  summarizer
• 9:37
  —
• 9:38
  no
• 9:38
  LLM
• 9:38
  call
• 9:38
  anywhere
• 9:39
  —
• 9:39
  condenses
• 9:40
  it
• 9:40
  into
• 9:40
  a
• 9:40
  compact
• 9:40
  resume
• 9:41
  point
• 9:41
  (~1–2K
• 9:42
  tokens)
• 9:43
  that
• 9:43
  loads
• 9:43
  on
• 9:43
  the
• 9:43
  next
• 9:43
  session.
• 9:44
  The
• 9:44
  privacy
• 9:45
  guarantee
• 9:45
  is
• 9:45
  absolute:
• 9:46
  no
• 9:46
  network
• 9:47
  calls,
• 9:47
  no
• 9:48
  model
• 9:48
  endpoint,
• 9:49
  no
• 9:49
  credentials.
• 9:51
  It
• 9:51
  fills
• 9:51
  a
• 9:51
  specific
• 9:51
  gap
• 9:52
  between
• 9:52
  CLAUDE.md
• 9:53
  (hand-curated
• 9:53
  instructions)
• 9:54
  and
• 9:54
  --continue
• 9:55
  (token-heavy
• 9:56
  full
• 9:56
  transcript
• 9:56
  replay)
• 9:57
  —
• 9:57
  an
• 9:58
  automatic,
• 9:59
  deterministic
• 9:59
  record
• 9:59
  of
• 10:00
  what
• 10:00
  each
• 10:00
  session
• 10:00
  did,
• 10:01
  condensed
• 10:01
  offline
• 10:02
  at
• 10:02
  zero
• 10:02
  token
• 10:02
  cost.
• 10:03
  For
• 10:04
  Rust
• 10:04
  developers
• 10:04
  fighting
• 10:05
  slow
• 10:05
  CI,
• 10:06
  the
• 10:06
  rust-optimizer
• 10:07
  plugin
• 10:07
  audits
• 10:07
  a
• 10:07
  repo's
• 10:08
  GitHub
• 10:08
  Actions,
• 10:09
  release
• 10:09
  workflows,
• 10:10
  Docker
• 10:11
  images,
• 10:11
  caching,
• 10:12
  and
• 10:12
  dependency
• 10:12
  graphs,
• 10:13
  then
• 10:13
  produces
• 10:14
  a
• 10:14
  prioritized
• 10:14
  optimization
• 10:15
  report
• 10:15
  with
• 10:16
  a
• 10:16
  machine-checkable
• 10:16
  OPTIMIZATION
• 10:17
  SPEC.md.
• 10:18
  It
• 10:18
  never
• 10:19
  edits
• 10:19
  code
• 10:19
  —
• 10:20
  it
• 10:20
  diagnoses
• 10:21
  root
• 10:21
  causes
• 10:21
  (a
• 10:21
  workspace
• 10:22
  compiling
• 10:22
  four
• 10:22
  times
• 10:23
  per
• 10:23
  PR,
• 10:23
  fat
• 10:24
  debug
• 10:24
  artifacts
• 10:24
  eating
• 10:25
  disk),
• 10:25
  reports
• 10:26
  with
• 10:26
  honest
• 10:26
  metrics,
• 10:26
  and
• 10:27
  hands
• 10:27
  off
• 10:27
  to
• 10:27
  Claude's
• 10:27
  autopilot
• 10:28
  pipeline.
• 10:29
  Three
• 10:29
  principles:
• 10:30
  root
• 10:30
  cause
• 10:31
  over
• 10:31
  symptom,
• 10:31
  the
• 10:32
  compiler
• 10:32
  is
• 10:32
  the
• 10:32
  arbiter,
• 10:33
  enforce
• 10:33
  or
• 10:33
  remove.
• 10:35
  Open
• 10:35
  Design
• 10:35
  positions
• 10:36
  itself
• 10:36
  as
• 10:36
  the
• 10:36
  open-source
• 10:37
  alternative
• 10:37
  to
• 10:37
  Claude
• 10:38
  Design
• 10:38
  —
• 10:39
  agent-native,
• 10:40
  model-agnostic,
• 10:41
  local-first.
• 10:43
  It
• 10:43
  runs
• 10:43
  on
• 10:43
  22
• 10:44
  coding-agent
• 10:44
  CLIs
• 10:45
  via
• 10:45
  MCP
• 10:45
  server
• 10:46
  integration,
• 10:47
  ships
• 10:47
  150
• 10:48
  brand-grade
• 10:48
  design
• 10:49
  systems
• 10:49
  as
• 10:49
  DESIGN.md
• 10:50
  files,
• 10:51
  and
• 10:51
  produces
• 10:52
  real
• 10:52
  HTML/CSS/MP4
• 10:55
  artifacts:
• 10:56
  prototypes,
• 10:57
  dashboards,
• 10:58
  pitch
• 10:58
  decks,
• 10:59
  and
• 10:59
  HyperFrames
• 10:59
  motion
• 11:00
  graphics.
• 11:01
  The
• 11:01
  0.10.0
• 11:03
  release
• 11:03
  adds
• 11:03
  parallel
• 11:04
  sessions,
• 11:05
  and
• 11:05
  the
• 11:05
  project
• 11:05
  frames
• 11:05
  itself
• 11:06
  as
• 11:06
  "a
• 11:06
  Figma
• 11:06
  alternative
• 11:07
  for
• 11:07
  the
• 11:07
  agent
• 11:07
  era"
• 11:08
  —
• 11:08
  delivering
• 11:09
  single-page
• 11:09
  artifacts
• 11:10
  in
• 11:10
  real
• 11:10
  CSS
• 11:11
  and
• 11:11
  real
• 11:11
  fonts,
• 11:12
  already
• 11:13
  shaped
• 11:13
  by
• 11:13
  a
• 11:13
  design
• 11:13
  system,
• 11:14
  already
• 11:14
  runnable
• 11:15
  inside
• 11:15
  whatever
• 11:16
  coding
• 11:16
  agent
• 11:16
  sits
• 11:16
  on
• 11:17
  the
• 11:17
  developer's
• 11:17
  PATH.
• 11:22
  Hierarchos
• 11:23
  is
• 11:23
  a
• 11:23
  232-million-parameter
• 11:25
  experiment
• 11:25
  asking
• 11:25
  whether
• 11:26
  a
• 11:26
  hybrid
• 11:26
  non-Transformer
• 11:27
  architecture
• 11:27
  —
• 11:28
  RWKV
• 11:28
  backbone,
• 11:29
  hierarchical
• 11:29
  manager/worker
• 11:30
  loops,
• 11:31
  differentiable
• 11:31
  slot-based
• 11:32
  long-term
• 11:32
  memory,
• 11:33
  and
• 11:33
  a
• 11:33
  deterministic
• 11:34
  suffix
• 11:34
  automaton
• 11:35
  —
• 11:35
  can
• 11:35
  survive
• 11:36
  training,
• 11:36
  avoid
• 11:37
  collapse,
• 11:37
  and
• 11:37
  maintain
• 11:38
  coherent
• 11:38
  instruction-following.
• 11:39
  After
• 11:39
  13
• 11:40
  epochs
• 11:40
  on
• 11:40
  an
• 11:40
  RTX
• 11:41
  6000
• 11:41
  Blackwell,
• 11:42
  the
• 11:42
  answer
• 11:42
  is
• 11:42
  a
• 11:42
  qualified
• 11:43
  yes:
• 11:44
  ARC
• 11:44
  Easy
• 11:44
  hits
• 11:45
  36%,
• 11:45
  HellaSwag
• 11:46
  37%
• 11:47
  normalized,
• 11:47
  TruthfulQA
• 11:48
  MC1
• 11:48
  22%
• 11:49
  —
• 11:50
  roughly
• 11:50
  GPT-2
• 11:51
  era,
• 11:51
  not
• 11:52
  GPT-3.5.
• 11:53
  The
• 11:53
  researchers
• 11:53
  are
• 11:53
  refreshingly
• 11:54
  honest
• 11:54
  about
• 11:54
  the
• 11:54
  limitations.
• 11:56
  The
• 11:56
  real
• 11:56
  contribution
• 11:57
  is
• 11:57
  engineering:
• 11:58
  they
• 11:58
  identified
• 11:58
  and
• 11:59
  fixed
• 11:59
  critical
• 11:59
  train/inference
• 12:00
  parity
• 12:00
  mismatches
• 12:01
  —
• 12:02
  drift
• 12:02
  state
• 12:02
  reseeding
• 12:03
  bugs,
• 12:03
  supervised
• 12:04
  memory
• 12:04
  updates
• 12:05
  creating
• 12:05
  training-only
• 12:06
  helper
• 12:06
  signals,
• 12:07
  unbounded
• 12:07
  channel
• 12:07
  mixing
• 12:08
  causing
• 12:08
  NaN
• 12:08
  gradients
• 12:08
  —
• 12:09
  that
• 12:09
  would
• 12:09
  have
• 12:10
  killed
• 12:10
  the
• 12:10
  architecture
• 12:10
  silently.
• 12:11
  The
• 12:11
  scaling
• 12:12
  plan
• 12:12
  targets
• 12:12
  1B–1.5B
• 12:14
  parameters
• 12:14
  next,
• 12:15
  with
• 12:15
  ablations
• 12:15
  to
• 12:16
  isolate
• 12:16
  how
• 12:16
  much
• 12:16
  each
• 12:17
  component
• 12:17
  contributes
• 12:17
  versus
• 12:18
  a
• 12:18
  pure
• 12:18
  Transformer
• 12:19
  baseline
• 12:19
  at
• 12:19
  equal
• 12:19
  parameter
• 12:20
  counts.
• 12:21
  Allen
• 12:21
  AI's
• 12:21
  DiScoFormer
• 12:22
  tackles
• 12:22
  a
• 12:22
  more
• 12:22
  fundamental
• 12:23
  problem:
• 12:24
  estimating
• 12:24
  both
• 12:24
  the
• 12:25
  density
• 12:25
  and
• 12:25
  score
• 12:25
  (gradient
• 12:26
  of
• 12:26
  the
• 12:26
  log-density)
• 12:27
  of
• 12:27
  an
• 12:27
  unknown
• 12:27
  distribution
• 12:28
  from
• 12:28
  a
• 12:28
  finite
• 12:28
  sample,
• 12:29
  in
• 12:29
  a
• 12:29
  single
• 12:30
  forward
• 12:30
  pass,
• 12:31
  without
• 12:31
  retraining
• 12:31
  per
• 12:31
  distribution.
• 12:33
  The
• 12:33
  architecture
• 12:33
  exploits
• 12:34
  a
• 12:34
  mathematical
• 12:35
  connection:
• 12:36
  cross-attention
• 12:36
  weights
• 12:37
  approximate
• 12:37
  a
• 12:37
  Gaussian
• 12:37
  kernel,
• 12:38
  making
• 12:39
  a
• 12:39
  single
• 12:39
  attention
• 12:39
  block
• 12:39
  equivalent
• 12:40
  to
• 12:40
  kernel
• 12:40
  density
• 12:40
  estimation
• 12:41
  but
• 12:41
  learnable
• 12:42
  and
• 12:42
  multi-scale.
• 12:43
  In
• 12:43
  100
• 12:43
  dimensions,
• 12:44
  DiScoFormer
• 12:45
  cuts
• 12:45
  score
• 12:45
  error
• 12:45
  by
• 12:46
  6.5x
• 12:47
  and
• 12:47
  density
• 12:47
  error
• 12:47
  by
• 12:47
  37x
• 12:48
  compared
• 12:49
  to
• 12:49
  best
• 12:49
  hand-tuned
• 12:49
  KDE.
• 12:50
  Since
• 12:51
  score
• 12:51
  estimation
• 12:51
  underlies
• 12:52
  diffusion
• 12:52
  models,
• 12:53
  Bayesian
• 12:53
  sampling,
• 12:54
  and
• 12:54
  particle
• 12:54
  simulations,
• 12:55
  a
• 12:55
  pretrained
• 12:56
  plug-in
• 12:56
  estimator
• 12:56
  that
• 12:56
  scales
• 12:57
  to
• 12:57
  high
• 12:57
  dimensions
• 12:57
  could
• 12:58
  reduce
• 12:58
  costs
• 12:59
  across
• 12:59
  all
• 12:59
  of
• 12:59
  them
• 12:59
  simultaneously.
• 13:00
  A
• 13:01
  community
• 13:01
  project
• 13:01
  on
• 13:01
  r/LocalLLaMA
• 13:03
  takes
• 13:03
  interpretability
• 13:04
  in
• 13:04
  a
• 13:04
  visual
• 13:04
  direction,
• 13:05
  mapping
• 13:05
  activation
• 13:06
  paths
• 13:06
  across
• 13:07
  model
• 13:07
  layers
• 13:07
  during
• 13:07
  inference
• 13:08
  on
• 13:08
  Gemma
• 13:08
  4
• 13:08
  and
• 13:08
  Qwen
• 13:09
  3.6
• 13:09
  models.
• 13:10
  Testing
• 13:11
  five
• 13:11
  simple
• 13:11
  prompts
• 13:12
  (capital
• 13:12
  of
• 13:12
  Mongolia,
• 13:13
  why
• 13:13
  leaves
• 13:13
  change
• 13:14
  color,
• 13:14
  Fahrenheit-to-Celsius),
• 13:16
  the
• 13:16
  visualizations
• 13:16
  reveal
• 13:17
  strikingly
• 13:17
  different
• 13:18
  activation
• 13:18
  variance
• 13:18
  across
• 13:19
  architectures
• 13:19
  —
• 13:20
  Gemma
• 13:21
  4
• 13:21
  31B
• 13:22
  shows
• 13:22
  minimal
• 13:22
  variance
• 13:23
  while
• 13:23
  the
• 13:23
  26B
• 13:24
  variant
• 13:24
  shows
• 13:24
  extreme
• 13:25
  variance
• 13:25
  for
• 13:25
  the
• 13:25
  same
• 13:25
  prompts.
• 13:26
  The
• 13:26
  author
• 13:27
  draws
• 13:27
  an
• 13:27
  analogy
• 13:28
  to
• 13:28
  neuroscience:
• 13:29
  "there
• 13:29
  is
• 13:29
  no
• 13:29
  'sarcastic
• 13:30
  node'
• 13:30
  that
• 13:30
  fires
• 13:31
  independently
• 13:31
  —
• 13:32
  it's
• 13:32
  a
• 13:32
  series
• 13:33
  of
• 13:33
  nodes
• 13:33
  firing
• 13:34
  together
• 13:34
  to
• 13:34
  create
• 13:34
  that
• 13:35
  sarcasm."
• 13:36
  The
• 13:36
  community
• 13:36
  requested
• 13:37
  code
• 13:37
  access
• 13:38
  and
• 13:38
  more
• 13:38
  detailed
• 13:39
  descriptions
• 13:39
  of
• 13:39
  the
• 13:40
  visualization
• 13:40
  methodology.
• 13:45
  Pine64
• 13:45
  launched
• 13:46
  PineVoice,
• 13:46
  a
• 13:46
  $50
• 13:47
  smart
• 13:47
  speaker
• 13:48
  built
• 13:48
  on
• 13:48
  a
• 13:48
  Bouffalo
• 13:49
  Lab
• 13:49
  BL606P
• 13:51
  RISC-V
• 13:53
  SoC
• 13:53
  with
• 13:54
  integrated
• 13:54
  Wi-Fi,
• 13:54
  Bluetooth
• 13:55
  5.0,
• 13:56
  and
• 13:56
  Zigbee
• 13:56
  radios.
• 13:57
  It
• 13:58
  ships
• 13:58
  with
• 13:58
  Alibaba's
• 13:58
  open-source
• 13:59
  YoC
• 13:59
  platform
• 14:00
  and
• 14:00
  the
• 14:00
  Wyoming
• 14:00
  Satellite
• 14:01
  protocol,
• 14:02
  turning
• 14:02
  it
• 14:02
  into
• 14:02
  a
• 14:02
  local
• 14:03
  microphone
• 14:03
  and
• 14:03
  speaker
• 14:04
  for
• 14:04
  self-hosted
• 14:04
  Home
• 14:04
  Assistant
• 14:05
  setups.
• 14:06
  The
• 14:06
  specs
• 14:06
  —
• 14:07
  32
• 14:07
  MiB
• 14:08
  pSRAM,
• 14:08
  16
• 14:09
  MiB
• 14:09
  flash,
• 14:09
  128
• 14:10
  KiB
• 14:11
  ROM
• 14:11
  —
• 14:12
  are
• 14:12
  deliberately
• 14:12
  minimal;
• 14:13
  this
• 14:14
  is
• 14:14
  an
• 14:14
  embedded
• 14:14
  device
• 14:14
  priced
• 14:15
  to
• 14:15
  match
• 14:15
  the
• 14:15
  Amazon
• 14:16
  Echo
• 14:16
  Dot,
• 14:17
  not
• 14:17
  compete
• 14:17
  with
• 14:17
  it
• 14:17
  on
• 14:17
  features.
• 14:19
  Pine64's
• 14:19
  model
• 14:20
  has
• 14:20
  always
• 14:20
  been
• 14:20
  cheap,
• 14:21
  open-friendly
• 14:22
  hardware
• 14:22
  that
• 14:22
  developers
• 14:23
  shape
• 14:23
  into
• 14:23
  viable
• 14:24
  products.
• 14:25
  Whether
• 14:25
  PineVoice
• 14:25
  achieves
• 14:26
  that
• 14:26
  depends
• 14:26
  entirely
• 14:27
  on
• 14:27
  community
• 14:27
  firmware
• 14:28
  development
• 14:28
  —
• 14:29
  Pine64
• 14:29
  warns
• 14:30
  it
• 14:30
  is
• 14:30
  early-stage
• 14:30
  and
• 14:31
  not
• 14:31
  consumer-grade.
• 14:32
  Complementing
• 14:33
  that
• 14:33
  hardware
• 14:33
  minimalism,
• 14:34
  a
• 14:34
  benchmarking
• 14:35
  study
• 14:35
  ran
• 14:35
  eight
• 14:36
  sub-1B
• 14:36
  LLMs
• 14:37
  on
• 14:37
  a
• 14:37
  $250
• 14:38
  Jetson
• 14:38
  Orin
• 14:39
  Nano
• 14:39
  Super
• 14:39
  across
• 14:40
  all
• 14:40
  four
• 14:40
  power
• 14:40
  modes.
• 14:41
  The
• 14:41
  headline:
• 14:42
  llama.cpp
• 14:44
  consistently
• 14:44
  beats
• 14:44
  Ollama
• 14:45
  on
• 14:45
  sub-1B
• 14:46
  models,
• 14:46
  with
• 14:46
  gaps
• 14:47
  from
• 14:47
  1.37x
• 14:49
  (SmolLM2-135M)
• 14:51
  to
• 14:51
  a
• 14:51
  striking
• 14:52
  4.2x
• 14:53
  (LFM2.5-350M)
• 14:55
  —
• 14:56
  the
• 14:57
  latter
• 14:57
  almost
• 14:57
  certainly
• 14:57
  caused
• 14:58
  by
• 14:58
  Ollama's
• 14:58
  bundled
• 14:59
  llama.cpp
• 15:00
  version
• 15:00
  lacking
• 15:01
  optimized
• 15:01
  kernels
• 15:01
  for
• 15:02
  LFM2's
• 15:02
  hybrid
• 15:03
  architecture.
• 15:04
  At
• 15:04
  25W,
• 15:06
  SmolLM2-135M
• 15:07
  hit
• 15:08
  165
• 15:08
  tok/s
• 15:09
  with
• 15:09
  29.6
• 15:10
  output
• 15:11
  tokens
• 15:11
  per
• 15:11
  joule,
• 15:12
  while
• 15:12
  LFM2.5-1.2B
• 15:15
  led
• 15:15
  the
• 15:15
  ~1B
• 15:16
  class
• 15:16
  at
• 15:16
  54.1
• 15:17
  tok/s
• 15:18
  in
• 15:18
  only
• 15:18
  698
• 15:19
  MB.
• 15:21
  A
• 15:21
  top
• 15:21
  comment
• 15:21
  notes
• 15:22
  Ollama
• 15:22
  v0.30.0
• 15:25
  switched
• 15:26
  to
• 15:26
  directly
• 15:26
  using
• 15:27
  llama.cpp
• 15:28
  as
• 15:28
  its
• 15:28
  backend,
• 15:29
  which
• 15:29
  "invalidates
• 15:30
  all
• 15:30
  conclusions"
• 15:31
  about
• 15:31
  the
• 15:31
  backend
• 15:31
  gap
• 15:31
  —
• 15:32
  though
• 15:32
  the
• 15:32
  raw
• 15:33
  per-model
• 15:33
  data
• 15:33
  remains
• 15:34
  valuable
• 15:34
  for
• 15:34
  edge
• 15:34
  deployment
• 15:35
  planning.
• 15:36
  NVIDIA's
• 15:36
  Cosmos3-Nano
• 15:37
  also
• 15:38
  appeared
• 15:38
  on
• 15:38
  the
• 15:38
  Hugging
• 15:39
  Face
• 15:39
  trending
• 15:39
  list,
• 15:40
  signaling
• 15:40
  continued
• 15:41
  interest
• 15:41
  in
• 15:41
  compact
• 15:42
  world
• 15:42
  models
• 15:42
  for
• 15:43
  edge
• 15:43
  deployment.
• 15:46
  The
• 15:46
  Underhanded
• 15:47
  C
• 15:47
  Contest,
• 15:48
  resurrected
• 15:48
  after
• 15:49
  years
• 15:49
  of
• 15:49
  dormancy
• 15:50
  and
• 15:50
  newly
• 15:50
  re-surfaced
• 15:51
  on
• 15:51
  Hacker
• 15:51
  News,
• 15:52
  remains
• 15:52
  one
• 15:52
  of
• 15:52
  the
• 15:52
  most
• 15:52
  instructive
• 15:53
  exercises
• 15:53
  in
• 15:53
  software
• 15:54
  security
• 15:54
  —
• 15:55
  and
• 15:55
  its
• 15:55
  lessons
• 15:56
  deserve
• 15:56
  fresh
• 15:56
  attention
• 15:57
  in
• 15:57
  an
• 15:57
  era
• 15:57
  where
• 15:57
  AI
• 15:58
  generates
• 15:58
  most
• 15:58
  of
• 15:58
  the
• 15:58
  code
• 15:59
  under
• 15:59
  review.
• 16:00
  The
• 16:00
  challenge:
• 16:01
  write
• 16:01
  a
• 16:01
  program
• 16:01
  that
• 16:01
  appears
• 16:02
  to
• 16:02
  perform
• 16:02
  a
• 16:02
  nuclear
• 16:03
  weapons
• 16:03
  inspection
• 16:04
  (comparing
• 16:04
  gamma-ray
• 16:05
  spectra)
• 16:06
  but
• 16:06
  contains
• 16:06
  a
• 16:06
  subtle
• 16:06
  bug
• 16:07
  allowing
• 16:07
  a
• 16:07
  host
• 16:07
  country
• 16:07
  to
• 16:08
  cheat.
• 16:09
  Over
• 16:09
  40
• 16:09
  submissions
• 16:10
  demonstrated
• 16:10
  how
• 16:10
  code
• 16:11
  that
• 16:11
  passes
• 16:11
  casual
• 16:11
  review
• 16:12
  —
• 16:12
  and
• 16:12
  careful
• 16:13
  static
• 16:13
  analysis
• 16:13
  —
• 16:14
  can
• 16:14
  harbor
• 16:15
  deliberately
• 16:15
  planted
• 16:15
  vulnerabilities.
• 16:16
  The
• 16:17
  dominant
• 16:17
  technique
• 16:17
  was
• 16:18
  NaN
• 16:18
  poisoning:
• 16:18
  engineering
• 16:19
  floating-point
• 16:19
  computations
• 16:20
  where
• 16:20
  edge
• 16:20
  inputs
• 16:21
  produce
• 16:21
  NaN
• 16:21
  (Not
• 16:21
  a
• 16:22
  Number)
• 16:22
  values
• 16:22
  that
• 16:22
  propagate
• 16:23
  silently
• 16:23
  to
• 16:24
  a
• 16:24
  final
• 16:24
  comparison
• 16:25
  returning
• 16:25
  the
• 16:25
  wrong
• 16:25
  result.
• 16:26
  About
• 16:27
  a
• 16:27
  third
• 16:27
  of
• 16:27
  submissions
• 16:27
  used
• 16:27
  this,
• 16:28
  but
• 16:28
  sophistication
• 16:29
  varied
• 16:29
  enormously.
• 16:30
  The
• 16:31
  winner
• 16:31
  triggered
• 16:31
  a
• 16:31
  NaN
• 16:31
  through
• 16:32
  a
• 16:32
  Poisson
• 16:32
  probability
• 16:32
  calculation
• 16:33
  that
• 16:34
  overflows
• 16:34
  at
• 16:34
  realistic
• 16:35
  bin
• 16:35
  counts
• 16:35
  (~1686)
• 16:36
  —
• 16:37
  achievable
• 16:37
  by
• 16:37
  packing
• 16:38
  a
• 16:38
  warhead
• 16:38
  with
• 16:38
  a
• 16:38
  short-lived
• 16:39
  nuclide
• 16:39
  producing
• 16:39
  a
• 16:39
  single
• 16:40
  strong
• 16:40
  peak.
• 16:41
  Another
• 16:42
  entry
• 16:42
  hid
• 16:42
  the
• 16:42
  bug
• 16:42
  in
• 16:42
  logging
• 16:43
  code:
• 16:43
  a
• 16:43
  carefully
• 16:44
  sized
• 16:44
  log
• 16:45
  message
• 16:45
  overwrites
• 16:46
  two
• 16:46
  bytes
• 16:46
  of
• 16:46
  a
• 16:46
  floating-point
• 16:47
  exponent,
• 16:48
  changing
• 16:48
  2.0
• 16:49
  to
• 16:49
  something
• 16:49
  that
• 16:49
  still
• 16:50
  displays
• 16:50
  as
• 16:50
  "2.0"
• 16:51
  but
• 16:51
  makes
• 16:52
  pow()
• 16:52
  return
• 16:52
  NaN
• 16:53
  on
• 16:53
  negative
• 16:53
  inputs.
• 16:54
  A
• 16:54
  third
• 16:55
  passed
• 16:55
  error
• 16:55
  message
• 16:56
  (a
• 16:56
  string
• 16:56
  whose
• 16:56
  initial
• 16:57
  bytes
• 16:57
  happen
• 16:57
  to
• 16:57
  be
• 16:57
  valid
• 16:58
  x86
• 16:58
  instructions
• 16:59
  that
• 16:59
  pop
• 17:00
  a
• 17:00
  stack
• 17:00
  frame
• 17:00
  and
• 17:00
  return
• 17:01
  true)
• 17:01
  instead
• 17:01
  of
• 17:01
  error
• 17:02
  messager
• 17:02
  (the
• 17:02
  actual
• 17:03
  handler
• 17:03
  function).
• 17:04
  These
• 17:04
  are
• 17:04
  exactly
• 17:05
  the
• 17:05
  class
• 17:05
  of
• 17:05
  bugs
• 17:05
  that
• 17:05
  survive
• 17:06
  automated
• 17:06
  review
• 17:07
  —
• 17:07
  semantically
• 17:08
  correct-looking
• 17:09
  code
• 17:09
  with
• 17:09
  mathematically
• 17:10
  or
• 17:10
  architecturally
• 17:11
  subtle
• 17:11
  failure
• 17:11
  modes
• 17:12
  that
• 17:12
  require
• 17:12
  domain
• 17:13
  expertise
• 17:13
  and
• 17:13
  adversarial
• 17:14
  thinking
• 17:14
  to
• 17:14
  catch.