Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – March 19, 2026

Transcript

AGI Dreams Podcast – March 19, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Chris
• 0:00
  Wysopal,
• 0:01
  co-founder
• 0:01
  of
• 0:02
  Veracode
• 0:02
  and
• 0:02
  one
• 0:02
  of
• 0:02
  the
• 0:02
  original
• 0:03
  L0pht
• 0:03
  Heavy
• 0:04
  Industries
• 0:04
  crew,
• 0:04
  published
• 0:05
  an
• 0:05
  unusually
• 0:06
  candid
• 0:06
  assessment
• 0:06
  of
• 0:06
  where
• 0:06
  AI-generated
• 0:07
  code
• 0:07
  is
• 0:07
  dragging
• 0:08
  application
• 0:08
  security.
• 0:09
  His
• 0:09
  core
• 0:10
  thesis:
• 0:11
  AI
• 0:11
  is
• 0:11
  not
• 0:11
  breaking
• 0:11
  application
• 0:12
  security
• 0:12
  —
• 0:13
  it
• 0:13
  is
• 0:13
  exposing
• 0:13
  the
• 0:13
  fact
• 0:13
  that
• 0:14
  the
• 0:14
  old
• 0:14
  model
• 0:14
  never
• 0:15
  scaled.
• 0:16
  When
• 0:16
  a
• 0:16
  team
• 0:17
  can
• 0:17
  produce
• 0:17
  ten
• 0:17
  times
• 0:18
  more
• 0:18
  code
• 0:18
  but
• 0:18
  its
• 0:18
  ability
• 0:19
  to
• 0:19
  review,
• 0:20
  test,
• 0:20
  and
• 0:20
  threat-model
• 0:21
  stays
• 0:21
  flat,
• 0:22
  they
• 0:22
  are
• 0:22
  not
• 0:22
  moving
• 0:22
  faster;
• 0:23
  they
• 0:23
  are
• 0:23
  manufacturing
• 0:24
  security
• 0:25
  debt.
• 0:26
  Wysopal
• 0:26
  introduces
• 0:27
  the
• 0:27
  concept
• 0:27
  of
• 0:27
  "risk
• 0:28
  velocity"
• 0:28
  —
• 0:29
  the
• 0:29
  rate
• 0:29
  at
• 0:30
  which
• 0:30
  new
• 0:30
  risk
• 0:30
  is
• 0:30
  created
• 0:31
  versus
• 0:31
  eliminated
• 0:31
  —
• 0:32
  and
• 0:32
  argues
• 0:33
  it
• 0:33
  is
• 0:33
  now
• 0:33
  the
• 0:33
  defining
• 0:34
  metric
• 0:34
  for
• 0:34
  CISOs,
• 0:35
  not
• 0:35
  vulnerability
• 0:36
  count.
• 0:37
  The
• 0:37
  failure
• 0:37
  modes
• 0:37
  he
• 0:37
  catalogs
• 0:38
  are
• 0:38
  familiar
• 0:38
  but
• 0:39
  sharpened:
• 0:40
  insecure
• 0:40
  reproduction
• 0:41
  of
• 0:41
  training-data
• 0:41
  patterns
• 0:42
  (SQL
• 0:42
  injection,
• 0:43
  XSS,
• 0:43
  SSRF),
• 0:45
  missing
• 0:45
  authorization
• 0:46
  context
• 0:46
  that
• 0:46
  LLMs
• 0:47
  cannot
• 0:47
  infer
• 0:47
  from
• 0:47
  prompts,
• 0:48
  a
• 0:48
  "comprehension
• 0:49
  gap"
• 0:50
  where
• 0:50
  developers
• 0:50
  accept
• 0:50
  working
• 0:51
  code
• 0:51
  they
• 0:51
  do
• 0:51
  not
• 0:51
  fully
• 0:52
  understand,
• 0:53
  and
• 0:53
  hallucinated
• 0:53
  dependencies
• 0:54
  that
• 0:54
  open
• 0:54
  typosquatting
• 0:55
  vectors.
• 0:56
  His
• 0:56
  most
• 0:56
  provocative
• 0:57
  claim:
• 0:58
  "secure
• 0:58
  by
• 0:58
  design"
• 0:59
  is
• 0:59
  not
• 0:59
  a
• 0:59
  principle
• 0:59
  —
• 1:00
  it
• 1:00
  is
• 1:00
  an
• 1:01
  engineering
• 1:01
  platform
• 1:01
  decision,
• 1:02
  and
• 1:02
  when
• 1:02
  enterprises
• 1:03
  treat
• 1:03
  it
• 1:03
  as
• 1:03
  a
• 1:03
  campaign,
• 1:04
  it
• 1:04
  fades.
• 1:06
  That
• 1:06
  comprehension
• 1:06
  gap
• 1:07
  is
• 1:07
  playing
• 1:07
  out
• 1:07
  in
• 1:07
  real
• 1:08
  time
• 1:08
  on
• 1:08
  developer
• 1:08
  forums.
• 1:10
  A
• 1:10
  thread
• 1:10
  on
• 1:10
  r/ChatGPTCoding
• 1:15
  crystallized
• 1:16
  the
• 1:16
  problem:
• 1:17
  generated
• 1:17
  code
• 1:18
  "appears
• 1:18
  professional
• 1:19
  and
• 1:19
  well-structured,
• 1:20
  which
• 1:20
  creates
• 1:20
  false
• 1:21
  confidence."
• 1:22
  The
• 1:22
  poster's
• 1:22
  framing
• 1:23
  is
• 1:23
  precise
• 1:23
  —
• 1:24
  people
• 1:24
  assume
• 1:25
  it
• 1:25
  is
• 1:25
  correct
• 1:25
  because
• 1:25
  it
• 1:25
  looks
• 1:26
  correct,
• 1:26
  without
• 1:27
  verifying
• 1:27
  logic
• 1:28
  or
• 1:28
  testing
• 1:28
  edge
• 1:28
  cases.
• 1:29
  The
• 1:29
  proposed
• 1:30
  solution
• 1:31
  (treat
• 1:31
  output
• 1:31
  as
• 1:31
  a
• 1:31
  starting
• 1:32
  point
• 1:32
  requiring
• 1:33
  thorough
• 1:33
  review)
• 1:33
  is
• 1:33
  correct
• 1:34
  in
• 1:34
  theory
• 1:34
  and
• 1:34
  ignored
• 1:35
  in
• 1:35
  practice
• 1:36
  because
• 1:36
  the
• 1:36
  whole
• 1:36
  point
• 1:37
  of
• 1:37
  AI
• 1:37
  coding
• 1:37
  is
• 1:38
  speed.
• 1:39
  One
• 1:39
  concrete
• 1:39
  response
• 1:40
  to
• 1:40
  the
• 1:40
  sandboxing
• 1:40
  side
• 1:41
  of
• 1:41
  this
• 1:41
  problem:
• 1:42
  Greywall,
• 1:43
  a
• 1:43
  deny-by-default
• 1:44
  command
• 1:44
  sandbox
• 1:45
  that
• 1:45
  wraps
• 1:46
  AI
• 1:46
  coding
• 1:46
  agents
• 1:47
  in
• 1:47
  filesystem
• 1:48
  and
• 1:48
  network
• 1:48
  isolation.
• 1:49
  It
• 1:50
  ships
• 1:50
  built-in
• 1:50
  profiles
• 1:51
  for
• 1:51
  Claude,
• 1:51
  Codex,
• 1:52
  Cursor,
• 1:53
  Aider,
• 1:53
  and
• 1:54
  a
• 1:54
  dozen
• 1:54
  other
• 1:54
  agents
• 1:54
  —
• 1:55
  on
• 1:55
  first
• 1:56
  run,
• 1:56
  it
• 1:57
  shows
• 1:57
  what
• 1:57
  the
• 1:57
  profile
• 1:57
  allows
• 1:58
  and
• 1:58
  lets
• 1:58
  you
• 1:58
  approve,
• 1:59
  edit,
• 1:59
  or
• 2:00
  skip.
• 2:00
  The
• 2:01
  interesting
• 2:01
  architectural
• 2:02
  choice:
• 2:03
  all
• 2:03
  network
• 2:03
  traffic
• 2:03
  routes
• 2:04
  through
• 2:04
  greyproxy,
• 2:05
  a
• 2:05
  companion
• 2:06
  transparent
• 2:06
  proxy
• 2:07
  with
• 2:07
  a
• 2:07
  live
• 2:07
  allow/deny
• 2:08
  dashboard,
• 2:09
  so
• 2:09
  you
• 2:09
  can
• 2:10
  see
• 2:10
  exactly
• 2:10
  what
• 2:10
  your
• 2:10
  agent
• 2:11
  is
• 2:11
  phoning
• 2:11
  home
• 2:11
  to.
• 2:12
  On
• 2:13
  Linux
• 2:13
  it
• 2:13
  uses
• 2:13
  bubblewrap
• 2:14
  plus
• 2:14
  network
• 2:14
  namespaces
• 2:15
  for
• 2:15
  full
• 2:15
  isolation;
• 2:16
  on
• 2:17
  macOS,
• 2:18
  Apple's
• 2:18
  Seatbelt
• 2:19
  sandbox-exec.
• 2:20
  Learning
• 2:20
  mode
• 2:21
  traces
• 2:21
  filesystem
• 2:22
  access
• 2:22
  via
• 2:22
  strace
• 2:23
  and
• 2:23
  auto-generates
• 2:23
  config
• 2:24
  profiles
• 2:24
  for
• 2:24
  future
• 2:25
  runs.
• 2:26
  It
• 2:26
  is
• 2:26
  a
• 2:26
  fork
• 2:26
  of
• 2:27
  Tusk
• 2:27
  AI's
• 2:27
  Fence
• 2:27
  project,
• 2:28
  inspired
• 2:29
  by
• 2:29
  Anthropic's
• 2:30
  sandbox-runtime.
• 2:35
  The
• 2:35
  question
• 2:35
  of
• 2:35
  how
• 2:35
  agents
• 2:36
  actually
• 2:36
  interact
• 2:37
  with
• 2:37
  the
• 2:37
  world's
• 2:37
  existing
• 2:37
  software
• 2:38
  keeps
• 2:38
  generating
• 2:39
  increasingly
• 2:39
  ambitious
• 2:40
  answers.
• 2:41
  CLI-Anything,
• 2:42
  from
• 2:42
  HKU's
• 2:43
  Data
• 2:43
  Science
• 2:43
  group,
• 2:43
  takes
• 2:44
  perhaps
• 2:44
  the
• 2:44
  most
• 2:44
  sweeping
• 2:44
  approach:
• 2:45
  a
• 2:45
  Claude
• 2:46
  Code
• 2:46
  plugin
• 2:47
  that
• 2:47
  auto-generates
• 2:47
  complete
• 2:48
  CLI
• 2:48
  harnesses
• 2:49
  for
• 2:49
  any
• 2:49
  software
• 2:50
  with
• 2:50
  a
• 2:50
  codebase,
• 2:51
  using
• 2:51
  a
• 2:51
  7-phase
• 2:52
  pipeline
• 2:52
  (analyze,
• 2:52
  design,
• 2:53
  implement,
• 2:53
  plan
• 2:54
  tests,
• 2:54
  write
• 2:55
  tests,
• 2:55
  document,
• 2:56
  publish).
• 2:57
  Point
• 2:57
  it
• 2:58
  at
• 2:58
  GIMP,
• 2:58
  Blender,
• 2:59
  LibreOffice,
• 3:00
  or
• 3:00
  Audacity
• 3:00
  and
• 3:00
  it
• 3:00
  produces
• 3:01
  a
• 3:01
  pip-installable
• 3:02
  CLI
• 3:02
  with
• 3:03
  JSON
• 3:03
  output
• 3:03
  mode,
• 3:04
  undo/redo,
• 3:05
  REPL
• 3:05
  interface,
• 3:06
  and
• 3:06
  a
• 3:06
  SKILL.md
• 3:07
  file
• 3:08
  that
• 3:08
  agents
• 3:08
  can
• 3:08
  auto-discover.
• 3:09
  The
• 3:09
  claim:
• 3:10
  1,720
• 3:12
  tests
• 3:12
  passing
• 3:13
  across
• 3:13
  14
• 3:13
  applications
• 3:14
  at
• 3:14
  100%
• 3:15
  pass
• 3:15
  rate.
• 3:15
  The
• 3:16
  vision
• 3:16
  is
• 3:16
  that
• 3:16
  CLI
• 3:17
  is
• 3:17
  the
• 3:17
  universal
• 3:18
  agent
• 3:18
  interface
• 3:18
  —
• 3:19
  structured,
• 3:20
  composable,
• 3:20
  self-describing
• 3:21
  via
• 3:22
  --help,
• 3:22
  and
• 3:23
  deterministic
• 3:23
  —
• 3:24
  in
• 3:24
  contrast
• 3:25
  to
• 3:25
  the
• 3:25
  fragility
• 3:25
  of
• 3:25
  GUI
• 3:26
  automation
• 3:27
  or
• 3:27
  the
• 3:27
  limitations
• 3:27
  of
• 3:27
  purpose-built
• 3:28
  APIs.
• 3:29
  A
• 3:29
  new
• 3:29
  CLI-Hub
• 3:30
  registry
• 3:30
  lets
• 3:30
  contributors
• 3:31
  share
• 3:31
  harnesses
• 3:32
  across
• 3:32
  the
• 3:32
  community.
• 3:33
  On
• 3:33
  the
• 3:34
  gateway
• 3:34
  side,
• 3:34
  GoClaw
• 3:35
  takes
• 3:35
  a
• 3:35
  different
• 3:35
  approach
• 3:36
  to
• 3:36
  agent
• 3:36
  infrastructure:
• 3:37
  a
• 3:37
  single
• 3:38
  ~25MB
• 3:39
  Go
• 3:39
  binary
• 3:40
  that
• 3:40
  orchestrates
• 3:40
  multi-agent
• 3:41
  teams
• 3:41
  across
• 3:41
  13+
• 3:42
  LLM
• 3:43
  providers
• 3:43
  with
• 3:43
  full
• 3:44
  multi-tenant
• 3:44
  PostgreSQL
• 3:45
  isolation.
• 3:46
  It
• 3:46
  is
• 3:46
  a
• 3:46
  Go
• 3:47
  port
• 3:47
  of
• 3:47
  OpenClaw
• 3:47
  with
• 3:48
  added
• 3:48
  agent
• 3:48
  teams
• 3:49
  (shared
• 3:49
  task
• 3:49
  boards,
• 3:50
  inter-agent
• 3:50
  delegation),
• 3:51
  a
• 3:51
  5-layer
• 3:52
  security
• 3:52
  stack
• 3:53
  (rate
• 3:53
  limiting,
• 3:53
  prompt
• 3:54
  injection
• 3:54
  detection,
• 3:55
  SSRF
• 3:55
  protection,
• 3:56
  shell
• 3:57
  deny
• 3:57
  patterns,
• 3:58
  AES-256-GCM
• 4:00
  encryption),
• 4:03
  and
• 4:03
  MCP
• 4:03
  protocol
• 4:04
  support
• 4:04
  via
• 4:05
  stdio/SSE/streamable-HTTP.
• 4:08
  The
• 4:08
  resource
• 4:09
  comparison
• 4:09
  is
• 4:09
  telling:
• 4:10
  OpenClaw
• 4:11
  needs
• 4:11
  a
• 4:11
  $599
• 4:13
  Mac
• 4:13
  Mini
• 4:13
  and
• 4:13
  >1GB
• 4:14
  RAM;
• 4:15
  GoClaw
• 4:15
  runs
• 4:16
  on
• 4:16
  a
• 4:16
  $5
• 4:16
  VPS
• 4:17
  with
• 4:17
  ~35MB
• 4:18
  idle.
• 4:19
  Seven
• 4:20
  messaging
• 4:20
  channels
• 4:20
  (Telegram,
• 4:21
  Discord,
• 4:22
  Slack,
• 4:22
  Zalo,
• 4:23
  Feishu,
• 4:24
  WhatsApp)
• 4:24
  make
• 4:24
  it
• 4:24
  a
• 4:24
  practical
• 4:25
  multi-channel
• 4:26
  deployment
• 4:26
  target.
• 4:27
  The
• 4:27
  browser
• 4:27
  automation
• 4:28
  angle
• 4:28
  keeps
• 4:28
  evolving
• 4:29
  too.
• 4:30
  A
• 4:30
  breakdown
• 4:30
  of
• 4:30
  using
• 4:31
  Playwright
• 4:31
  CLI
• 4:32
  with
• 4:32
  Claude
• 4:32
  Code
• 4:32
  for
• 4:33
  browser
• 4:33
  swarms
• 4:34
  makes
• 4:34
  the
• 4:34
  case
• 4:34
  that
• 4:34
  the
• 4:34
  CLI
• 4:35
  approach
• 4:35
  is
• 4:35
  "infinitely
• 4:36
  better"
• 4:36
  than
• 4:36
  the
• 4:37
  Playwright
• 4:37
  MCP
• 4:38
  or
• 4:38
  Claude-in-Chrome
• 4:38
  for
• 4:39
  parallel
• 4:39
  execution
• 4:39
  —
• 4:40
  you
• 4:40
  can
• 4:40
  spin
• 4:41
  up
• 4:41
  multiple
• 4:41
  sub-agents
• 4:42
  each
• 4:42
  running
• 4:42
  headless
• 4:43
  browser
• 4:43
  automations
• 4:44
  from
• 4:44
  the
• 4:44
  terminal,
• 4:45
  with
• 4:45
  dramatically
• 4:45
  lower
• 4:46
  token
• 4:46
  consumption
• 4:47
  than
• 4:47
  screenshot-based
• 4:48
  approaches.
• 4:52
  The
• 4:53
  convergence
• 4:53
  of
• 4:53
  cheaper
• 4:53
  small
• 4:54
  models
• 4:54
  and
• 4:54
  sub-agent
• 4:55
  architecture
• 4:56
  is
• 4:56
  producing
• 4:56
  a
• 4:56
  phase
• 4:57
  change
• 4:57
  in
• 4:57
  how
• 4:57
  coding
• 4:57
  workflows
• 4:58
  actually
• 4:58
  run.
• 5:00
  A
• 5:00
  detailed
• 5:00
  walkthrough
• 5:00
  of
• 5:01
  the
• 5:01
  emerging
• 5:01
  pattern
• 5:01
  makes
• 5:02
  the
• 5:02
  economics
• 5:02
  clear:
• 5:03
  Claude
• 5:04
  Haiku
• 5:04
  4.5
• 5:05
  at
• 5:05
  $1/$5
• 5:06
  per
• 5:06
  million
• 5:07
  tokens
• 5:08
  was
• 5:08
  already
• 5:08
  enabling
• 5:09
  sub-agent
• 5:09
  research
• 5:09
  at
• 5:09
  scale,
• 5:10
  but
• 5:10
  GPT
• 5:11
  5.4
• 5:11
  Nano
• 5:12
  —
• 5:13
  a
• 5:13
  fifth
• 5:13
  of
• 5:13
  the
• 5:13
  price,
• 5:14
  188
• 5:15
  tokens
• 5:15
  per
• 5:15
  second,
• 5:16
  and
• 5:16
  benchmarking
• 5:17
  above
• 5:17
  Haiku
• 5:17
  on
• 5:18
  LiveBench
• 5:18
  —
• 5:19
  makes
• 5:19
  the
• 5:19
  budget
• 5:20
  essentially
• 5:20
  unlimited
• 5:21
  for
• 5:21
  context-gathering
• 5:21
  sub-agents.
• 5:23
  The
• 5:23
  key
• 5:23
  insight
• 5:23
  is
• 5:23
  architectural,
• 5:25
  not
• 5:25
  just
• 5:25
  economic:
• 5:26
  sub-agents
• 5:26
  handle
• 5:26
  the
• 5:27
  token-heavy
• 5:27
  work
• 5:27
  (codebase
• 5:28
  analysis,
• 5:29
  web
• 5:29
  research,
• 5:30
  code
• 5:30
  review)
• 5:30
  that
• 5:30
  would
• 5:30
  pollute
• 5:31
  the
• 5:31
  main
• 5:31
  agent's
• 5:31
  context
• 5:32
  window,
• 5:33
  returning
• 5:33
  only
• 5:33
  concise
• 5:34
  summaries.
• 5:35
  One
• 5:35
  session
• 5:35
  spawned
• 5:35
  three
• 5:36
  parallel
• 5:36
  sub-agents
• 5:37
  consuming
• 5:37
  70K,
• 5:38
  2M,
• 5:39
  and
• 5:39
  1.5M
• 5:40
  tokens
• 5:40
  respectively
• 5:40
  —
• 5:41
  completely
• 5:41
  unreasonable
• 5:42
  with
• 5:42
  frontier
• 5:43
  models,
• 5:43
  perfectly
• 5:44
  viable
• 5:44
  with
• 5:44
  cheap
• 5:44
  ones.
• 5:45
  The
• 5:45
  critical
• 5:46
  warning:
• 5:47
  sub-agents
• 5:47
  work
• 5:47
  for
• 5:47
  research
• 5:48
  and
• 5:48
  planning,
• 5:49
  not
• 5:49
  implementation.
• 5:50
  Parallel
• 5:51
  implementation
• 5:51
  agents
• 5:52
  that
• 5:52
  cannot
• 5:52
  see
• 5:52
  each
• 5:52
  other's
• 5:53
  file
• 5:53
  changes
• 5:53
  produce
• 5:53
  hallucinations
• 5:54
  and
• 5:54
  conflicts.
• 5:55
  Every
• 5:56
  major
• 5:56
  coding
• 5:56
  agent
• 5:56
  —
• 5:57
  Claude
• 5:57
  Code,
• 5:58
  Codex,
• 5:58
  Gemini
• 5:59
  CLI,
• 5:59
  GitHub
• 5:59
  Copilot,
• 6:00
  Cursor,
• 6:00
  OpenCode
• 6:01
  —
• 6:01
  is
• 6:02
  now
• 6:02
  building
• 6:02
  native
• 6:02
  sub-agent
• 6:03
  support.
• 6:07
  An
• 6:07
  editorial
• 6:08
  from
• 6:08
  Unhyped
• 6:09
  AI
• 6:09
  delivers
• 6:09
  the
• 6:09
  sharpest
• 6:10
  organizational
• 6:11
  critique
• 6:11
  of
• 6:11
  agent
• 6:11
  deployment
• 6:12
  yet
• 6:12
  published.
• 6:13
  The
• 6:13
  core
• 6:13
  argument:
• 6:14
  "agent
• 6:14
  deployment"
• 6:15
  is
• 6:15
  a
• 6:15
  misleading
• 6:16
  phrase
• 6:16
  because
• 6:16
  it
• 6:16
  makes
• 6:17
  the
• 6:17
  work
• 6:17
  sound
• 6:17
  like
• 6:17
  an
• 6:18
  installation.
• 6:19
  In
• 6:19
  practice,
• 6:20
  delegating
• 6:21
  behavior
• 6:21
  to
• 6:21
  software
• 6:21
  changes
• 6:22
  how
• 6:22
  work
• 6:22
  moves,
• 6:23
  how
• 6:23
  decisions
• 6:24
  get
• 6:24
  made,
• 6:24
  where
• 6:24
  judgment
• 6:25
  lives,
• 6:25
  and
• 6:26
  who
• 6:26
  absorbs
• 6:26
  consequences
• 6:27
  when
• 6:27
  the
• 6:27
  workflow
• 6:27
  breaks.
• 6:29
  The
• 6:29
  author
• 6:29
  coins
• 6:30
  "AI
• 6:30
  Translation
• 6:31
  Debt"
• 6:31
  —
• 6:31
  the
• 6:31
  unpriced
• 6:32
  work
• 6:32
  required
• 6:33
  to
• 6:33
  make
• 6:33
  fragmented
• 6:33
  organizations
• 6:34
  function
• 6:34
  as
• 6:35
  one
• 6:35
  system.
• 6:36
  For
• 6:37
  years,
• 6:37
  humans
• 6:38
  absorbed
• 6:38
  this
• 6:38
  debt
• 6:38
  by
• 6:39
  carrying
• 6:39
  context,
• 6:40
  making
• 6:40
  judgment
• 6:40
  calls,
• 6:41
  and
• 6:41
  repairing
• 6:42
  meaning
• 6:42
  at
• 6:42
  handoff
• 6:42
  boundaries.
• 6:43
  Agents
• 6:44
  do
• 6:44
  not
• 6:44
  remove
• 6:44
  Translation
• 6:45
  Debt;
• 6:45
  they
• 6:46
  collect
• 6:46
  it,
• 6:46
  amplify
• 6:47
  it,
• 6:47
  and
• 6:47
  present
• 6:48
  it
• 6:48
  back
• 6:48
  as
• 6:48
  "review."
• 6:50
  The
• 6:50
  result:
• 6:50
  local
• 6:51
  throughput
• 6:51
  rises,
• 6:52
  downstream
• 6:53
  confidence
• 6:53
  does
• 6:53
  not.
• 6:54
  Senior
• 6:55
  staff
• 6:55
  become
• 6:55
  the
• 6:56
  checksum
• 6:56
  for
• 6:56
  a
• 6:56
  workflow
• 6:57
  moving
• 6:57
  too
• 6:57
  quickly
• 6:58
  to
• 6:58
  be
• 6:58
  socially
• 6:58
  held
• 6:59
  together.
• 7:00
  The
• 7:00
  prescription
• 7:00
  connects
• 7:01
  to
• 7:01
  Team
• 7:01
  Topologies:
• 7:02
  Conway's
• 7:02
  Law
• 7:03
  still
• 7:03
  holds,
• 7:04
  and
• 7:04
  whatever
• 7:04
  your
• 7:04
  organization
• 7:05
  cannot
• 7:05
  coordinate
• 7:06
  cleanly,
• 7:06
  your
• 7:06
  agents
• 7:07
  will
• 7:07
  not
• 7:07
  coordinate
• 7:08
  cleanly
• 7:08
  either.
• 7:09
  Designing
• 7:09
  for
• 7:09
  humans
• 7:10
  is
• 7:10
  now
• 7:10
  the
• 7:10
  fastest
• 7:11
  route
• 7:11
  to
• 7:11
  scalable
• 7:12
  autonomy
• 7:12
  in
• 7:13
  machines
• 7:13
  —
• 7:14
  not
• 7:14
  as
• 7:14
  a
• 7:14
  moral
• 7:14
  stance,
• 7:15
  but
• 7:15
  as
• 7:15
  an
• 7:15
  operating
• 7:16
  stance.
• 7:17
  The
• 7:17
  flip
• 7:17
  side
• 7:17
  —
• 7:18
  agents
• 7:18
  that
• 7:18
  actually
• 7:19
  work
• 7:19
  when
• 7:19
  the
• 7:19
  organizational
• 7:20
  scaffolding
• 7:20
  is
• 7:21
  right
• 7:21
  —
• 7:21
  shows
• 7:22
  up
• 7:22
  in
• 7:22
  NVIDIA's
• 7:23
  KGMON
• 7:23
  Data
• 7:24
  Explorer,
• 7:24
  which
• 7:25
  claimed
• 7:25
  first
• 7:25
  place
• 7:25
  on
• 7:25
  the
• 7:26
  DABStep
• 7:26
  benchmark
• 7:26
  (Data
• 7:27
  Agent
• 7:27
  Benchmark
• 7:27
  for
• 7:28
  Multi-step
• 7:28
  Reasoning)
• 7:29
  with
• 7:29
  a
• 7:29
  30x
• 7:30
  speedup
• 7:30
  over
• 7:30
  the
• 7:30
  Claude
• 7:31
  Code
• 7:31
  baseline.
• 7:32
  The
• 7:32
  architecture
• 7:33
  splits
• 7:33
  into
• 7:33
  three
• 7:34
  phases:
• 7:35
  a
• 7:35
  Learning
• 7:35
  Loop
• 7:35
  where
• 7:36
  a
• 7:36
  heavyweight
• 7:36
  model
• 7:36
  (Opus
• 7:37
  4.5/4.6)
• 7:38
  tackles
• 7:39
  representative
• 7:39
  tasks
• 7:40
  against
• 7:40
  ground
• 7:40
  truth
• 7:41
  and
• 7:41
  distills
• 7:41
  solutions
• 7:42
  into
• 7:42
  a
• 7:42
  reusable
• 7:43
  helper.py
• 7:44
  library;
• 7:45
  a
• 7:45
  Fast
• 7:46
  Inference
• 7:46
  phase
• 7:46
  where
• 7:46
  a
• 7:46
  lightweight
• 7:47
  model
• 7:47
  (Haiku
• 7:48
  4.5)
• 7:48
  solves
• 7:49
  unseen
• 7:49
  tasks
• 7:49
  using
• 7:50
  only
• 7:50
  those
• 7:50
  pre-built
• 7:51
  tools
• 7:51
  in
• 7:51
  a
• 7:51
  single
• 7:51
  pass;
• 7:52
  and
• 7:53
  an
• 7:53
  Offline
• 7:53
  Reflection
• 7:53
  phase
• 7:54
  where
• 7:54
  a
• 7:54
  heavyweight
• 7:54
  reviewer
• 7:55
  audits
• 7:55
  outputs
• 7:55
  for
• 7:56
  consistency.
• 7:57
  The
• 7:57
  results
• 7:57
  are
• 7:57
  striking:
• 7:58
  20
• 7:58
  seconds
• 7:59
  per
• 7:59
  task
• 7:59
  versus
• 7:59
  10
• 8:00
  minutes
• 8:00
  for
• 8:00
  the
• 8:00
  from-scratch
• 8:01
  baseline,
• 8:01
  and
• 8:02
  89.95
• 8:03
  on
• 8:03
  hard
• 8:03
  tasks
• 8:04
  versus
• 8:04
  66.93
• 8:06
  for
• 8:06
  Claude
• 8:06
  Code
• 8:06
  with
• 8:07
  Opus
• 8:07
  doing
• 8:07
  everything
• 8:07
  cold.
• 8:08
  The
• 8:08
  core
• 8:09
  insight
• 8:09
  —
• 8:10
  that
• 8:10
  investing
• 8:10
  upfront
• 8:11
  in
• 8:11
  code
• 8:11
  abstraction
• 8:12
  lets
• 8:12
  smaller
• 8:12
  models
• 8:13
  outperform
• 8:13
  larger
• 8:14
  ones
• 8:14
  on
• 8:14
  complex
• 8:15
  multi-step
• 8:15
  problems
• 8:15
  —
• 8:16
  is
• 8:16
  a
• 8:16
  practical
• 8:17
  validation
• 8:17
  of
• 8:17
  the
• 8:17
  sub-agent
• 8:18
  economics
• 8:19
  discussed
• 8:19
  above.
• 8:25
  NVIDIA's
• 8:26
  Code
• 8:26
  Concepts
• 8:26
  dataset
• 8:27
  offers
• 8:27
  a
• 8:28
  clean
• 8:28
  demonstration
• 8:29
  of
• 8:29
  concept-driven
• 8:30
  synthetic
• 8:30
  data
• 8:30
  generation
• 8:31
  at
• 8:31
  scale.
• 8:32
  The
• 8:32
  team
• 8:32
  built
• 8:32
  a
• 8:32
  taxonomy
• 8:33
  of
• 8:33
  thousands
• 8:34
  of
• 8:34
  programming
• 8:34
  concepts
• 8:35
  organized
• 8:35
  hierarchically,
• 8:36
  identified
• 8:37
  91
• 8:37
  core
• 8:38
  concepts
• 8:38
  relevant
• 8:39
  to
• 8:39
  HumanEval,
• 8:40
  then
• 8:40
  generated
• 8:40
  approximately
• 8:41
  15
• 8:42
  million
• 8:42
  synthetic
• 8:42
  Python
• 8:43
  problems
• 8:43
  guided
• 8:43
  by
• 8:44
  combinations
• 8:44
  of
• 8:44
  those
• 8:45
  concepts.
• 8:46
  Each
• 8:46
  problem
• 8:46
  was
• 8:46
  validated
• 8:47
  via
• 8:47
  Python's
• 8:48
  compile()
• 8:48
  function.
• 8:49
  Including
• 8:49
  10
• 8:50
  billion
• 8:50
  tokens
• 8:50
  of
• 8:50
  this
• 8:51
  data
• 8:51
  in
• 8:51
  the
• 8:51
  final
• 8:52
  100
• 8:52
  billion
• 8:52
  tokens
• 8:53
  of
• 8:53
  Nemotron-Nano
• 8:54
  pretraining
• 8:54
  yielded
• 8:55
  a
• 8:55
  six-point
• 8:55
  improvement
• 8:56
  on
• 8:56
  HumanEval
• 8:56
  (73
• 8:57
  to
• 8:57
  79)
• 8:58
  with
• 8:58
  most
• 8:58
  other
• 8:58
  benchmarks
• 8:59
  unchanged.
• 9:00
  The
• 9:00
  workflow
• 9:01
  is
• 9:01
  released
• 9:01
  under
• 9:01
  CC-BY-4.0,
• 9:04
  positioning
• 9:05
  it
• 9:05
  as
• 9:05
  a
• 9:05
  reusable
• 9:06
  methodology
• 9:06
  rather
• 9:06
  than
• 9:07
  a
• 9:07
  one-off
• 9:07
  artifact
• 9:07
  —
• 9:08
  the
• 9:08
  taxonomy
• 9:09
  encodes
• 9:09
  what
• 9:09
  to
• 9:09
  generate,
• 9:10
  concept
• 9:11
  combinations
• 9:11
  control
• 9:12
  difficulty
• 9:12
  and
• 9:12
  diversity,
• 9:13
  and
• 9:13
  the
• 9:13
  whole
• 9:14
  pipeline
• 9:14
  can
• 9:14
  target
• 9:14
  domains
• 9:15
  beyond
• 9:15
  code.
• 9:16
  On
• 9:16
  the
• 9:17
  alignment
• 9:17
  front,
• 9:18
  researchers
• 9:18
  from
• 9:18
  Ohio
• 9:19
  State
• 9:19
  and
• 9:19
  University
• 9:19
  of
• 9:20
  Kentucky
• 9:20
  propose
• 9:21
  an
• 9:21
  optimistic
• 9:22
  primal-dual
• 9:22
  (OPD)
• 9:23
  algorithm
• 9:23
  for
• 9:23
  safe
• 9:24
  RLHF
• 9:25
  that
• 9:25
  addresses
• 9:25
  a
• 9:25
  genuine
• 9:26
  practical
• 9:26
  gap:
• 9:27
  standard
• 9:27
  primal-dual
• 9:28
  methods
• 9:28
  for
• 9:28
  constrained
• 9:29
  alignment
• 9:29
  only
• 9:30
  guarantee
• 9:30
  average-iterate
• 9:31
  convergence,
• 9:32
  but
• 9:32
  the
• 9:32
  deployed
• 9:32
  model
• 9:32
  is
• 9:32
  always
• 9:33
  the
• 9:33
  last
• 9:33
  iterate.
• 9:34
  Their
• 9:34
  framework
• 9:35
  unifies
• 9:35
  safe-RLHF,
• 9:36
  one-shot,
• 9:37
  and
• 9:37
  multi-shot
• 9:38
  alignment
• 9:38
  methods
• 9:38
  under
• 9:39
  a
• 9:39
  single
• 9:39
  Lagrangian
• 9:40
  relaxation
• 9:40
  lens,
• 9:41
  then
• 9:41
  adds
• 9:41
  predictive
• 9:42
  updates
• 9:42
  for
• 9:42
  both
• 9:42
  policy
• 9:43
  and
• 9:43
  dual
• 9:44
  variables
• 9:44
  that
• 9:44
  stabilize
• 9:45
  the
• 9:45
  oscillatory
• 9:45
  dynamics
• 9:46
  inherent
• 9:46
  to
• 9:46
  multi-objective
• 9:47
  alignment.
• 9:48
  The
• 9:48
  theoretical
• 9:49
  contribution
• 9:50
  is
• 9:50
  a
• 9:50
  provable
• 9:50
  last-iterate
• 9:51
  convergence
• 9:52
  guarantee
• 9:52
  —
• 9:53
  in
• 9:53
  distributional
• 9:54
  policy
• 9:54
  space
• 9:54
  exactly,
• 9:55
  and
• 9:55
  in
• 9:55
  parameterized
• 9:56
  policy
• 9:56
  space
• 9:56
  to
• 9:57
  a
• 9:57
  neighborhood
• 9:57
  whose
• 9:57
  gap
• 9:58
  is
• 9:58
  characterized
• 9:58
  by
• 9:59
  estimation
• 9:59
  error
• 10:00
  and
• 10:00
  parameterization
• 10:00
  bias.
• 10:01
  For
• 10:02
  practitioners,
• 10:03
  the
• 10:03
  implication
• 10:03
  is
• 10:03
  that
• 10:04
  balancing
• 10:04
  helpfulness
• 10:05
  against
• 10:05
  safety
• 10:05
  constraints
• 10:06
  need
• 10:06
  not
• 10:06
  produce
• 10:07
  the
• 10:07
  training
• 10:07
  instability
• 10:08
  that
• 10:08
  has
• 10:08
  plagued
• 10:08
  constrained
• 10:09
  RLHF
• 10:10
  in
• 10:10
  practice.
• 10:11
  A
• 10:11
  neuro-symbolic
• 10:12
  experiment
• 10:12
  on
• 10:13
  fraud
• 10:13
  detection
• 10:14
  takes
• 10:14
  the
• 10:14
  opposite
• 10:15
  approach
• 10:15
  to
• 10:15
  interpretability:
• 10:16
  instead
• 10:16
  of
• 10:17
  having
• 10:17
  humans
• 10:17
  write
• 10:17
  rules
• 10:18
  that
• 10:18
  a
• 10:18
  system
• 10:18
  follows,
• 10:19
  a
• 10:19
  neural
• 10:20
  network
• 10:20
  learns
• 10:20
  to
• 10:21
  extract
• 10:21
  its
• 10:21
  own
• 10:21
  IF-THEN
• 10:24
  rules
• 10:24
  from
• 10:25
  its
• 10:25
  predictions.
• 10:26
  A
• 10:26
  standard
• 10:27
  MLP
• 10:27
  handles
• 10:28
  fraud
• 10:28
  classification
• 10:29
  while
• 10:29
  a
• 10:29
  parallel
• 10:29
  differentiable
• 10:30
  rule
• 10:30
  module
• 10:31
  learns
• 10:31
  to
• 10:31
  approximate
• 10:32
  it,
• 10:32
  trained
• 10:33
  with
• 10:33
  consistency
• 10:33
  loss
• 10:34
  and
• 10:34
  temperature
• 10:34
  annealing
• 10:35
  that
• 10:35
  turns
• 10:35
  soft
• 10:36
  thresholds
• 10:36
  into
• 10:36
  readable
• 10:37
  rules.
• 10:38
  On
• 10:38
  the
• 10:38
  Kaggle
• 10:39
  credit
• 10:39
  card
• 10:39
  dataset,
• 10:40
  it
• 10:40
  rediscovered
• 10:40
  V14
• 10:41
  (a
• 10:41
  known
• 10:41
  strong
• 10:42
  fraud
• 10:42
  signal)
• 10:42
  without
• 10:43
  feature
• 10:43
  guidance,
• 10:44
  producing
• 10:44
  rules
• 10:45
  like
• 10:45
  "IF
• 10:45
  V14
• 10:46
  -1.5σ
• 10:46
  AND
• 10:46
  V4
• 10:47
  >
• 10:47
  +0.5σ
• 10:47
  →
• 10:48
  Fraud"
• 10:48
  with
• 10:49
  ~99%
• 10:50
  fidelity
• 10:50
  to
• 10:50
  the
• 10:50
  neural
• 10:51
  network.
• 10:52
  The
• 10:52
  honest
• 10:52
  caveat:
• 10:53
  only
• 10:54
  2
• 10:54
  of
• 10:54
  5
• 10:54
  runs
• 10:54
  produced
• 10:55
  clean
• 10:55
  rules,
• 10:56
  as
• 10:56
  strong
• 10:56
  sparsity
• 10:57
  constraints
• 10:57
  can
• 10:58
  collapse
• 10:58
  the
• 10:58
  rule
• 10:58
  path
• 10:59
  entirely.
• 11:00
  Whether
• 11:00
  this
• 11:00
  approach
• 11:01
  scales
• 11:01
  beyond
• 11:02
  credit
• 11:02
  card
• 11:02
  fraud
• 11:03
  to
• 11:03
  real
• 11:03
  compliance
• 11:04
  settings
• 11:04
  —
• 11:05
  where
• 11:05
  rule
• 11:05
  auditability
• 11:06
  is
• 11:06
  a
• 11:06
  regulatory
• 11:07
  requirement,
• 11:08
  not
• 11:08
  a
• 11:08
  nice-to-have
• 11:08
  —
• 11:10
  remains
• 11:10
  open.
• 11:17
  Unsloth
• 11:17
  Studio
• 11:18
  launched
• 11:18
  in
• 11:18
  beta
• 11:19
  as
• 11:19
  an
• 11:19
  open-source,
• 11:19
  no-code
• 11:20
  web
• 11:20
  UI
• 11:20
  that
• 11:21
  unifies
• 11:21
  training,
• 11:21
  inference,
• 11:22
  and
• 11:22
  export
• 11:23
  for
• 11:23
  local
• 11:23
  models.
• 11:24
  The
• 11:24
  pitch:
• 11:25
  load
• 11:25
  any
• 11:25
  GGUF
• 11:26
  or
• 11:26
  safetensor
• 11:27
  model,
• 11:27
  train
• 11:28
  500+
• 11:29
  architectures
• 11:29
  2x
• 11:29
  faster
• 11:30
  with
• 11:30
  70%
• 11:31
  less
• 11:31
  VRAM
• 11:31
  (no
• 11:31
  accuracy
• 11:32
  loss),
• 11:32
  run
• 11:33
  text/vision/TTS/audio/embedding
• 11:36
  models,
• 11:37
  and
• 11:37
  export
• 11:38
  to
• 11:38
  GGUF,
• 11:39
  safetensors,
• 11:39
  or
• 11:39
  16-bit
• 11:40
  for
• 11:40
  use
• 11:40
  with
• 11:41
  llama.cpp,
• 11:42
  vLLM,
• 11:42
  Ollama,
• 11:43
  or
• 11:43
  LM
• 11:43
  Studio.
• 11:45
  The
• 11:45
  data
• 11:45
  pipeline
• 11:45
  is
• 11:46
  notable
• 11:46
  —
• 11:47
  upload
• 11:47
  PDFs,
• 11:48
  CSVs,
• 11:49
  JSON,
• 11:49
  or
• 11:50
  DOCX
• 11:50
  files
• 11:51
  and
• 11:51
  a
• 11:51
  graph-node
• 11:52
  workflow
• 11:52
  powered
• 11:52
  by
• 11:52
  NVIDIA
• 11:53
  NeMo
• 11:53
  transforms
• 11:54
  them
• 11:54
  into
• 11:54
  training-ready
• 11:54
  datasets.
• 11:56
  A
• 11:56
  model
• 11:56
  arena
• 11:56
  feature
• 11:57
  lets
• 11:57
  you
• 11:57
  battle
• 11:57
  a
• 11:57
  base
• 11:57
  model
• 11:58
  against
• 11:58
  your
• 11:58
  fine-tune
• 11:58
  side
• 11:59
  by
• 11:59
  side.
• 12:00
  It
• 12:00
  runs
• 12:00
  100%
• 12:00
  offline
• 12:01
  with
• 12:01
  token-based
• 12:01
  local
• 12:02
  auth;
• 12:02
  the
• 12:03
  dual
• 12:03
  license
• 12:03
  (Apache
• 12:04
  2.0
• 12:04
  for
• 12:04
  core,
• 12:05
  AGPL-3.0
• 12:07
  for
• 12:07
  Studio
• 12:07
  UI)
• 12:08
  is
• 12:08
  the
• 12:08
  funding
• 12:08
  mechanism.
• 12:09
  Current
• 12:10
  gaps:
• 12:10
  Mac
• 12:11
  training
• 12:11
  requires
• 12:11
  MLX
• 12:12
  (coming
• 12:12
  soon),
• 12:13
  and
• 12:13
  first
• 12:13
  install
• 12:13
  takes
• 12:14
  5-10
• 12:14
  minutes
• 12:14
  while
• 12:14
  llama.cpp
• 12:16
  compiles.
• 12:17
  A
• 12:17
  practitioner's
• 12:18
  journey
• 12:18
  building
• 12:18
  a
• 12:18
  locally
• 12:18
  hosted
• 12:19
  voice
• 12:19
  assistant
• 12:19
  for
• 12:20
  Home
• 12:20
  Assistant
• 12:20
  documents
• 12:21
  the
• 12:21
  current
• 12:21
  state
• 12:21
  of
• 12:21
  the
• 12:21
  art
• 12:22
  for
• 12:22
  private,
• 12:22
  on-device
• 12:23
  voice
• 12:23
  control
• 12:23
  —
• 12:24
  the
• 12:24
  kind
• 12:24
  of
• 12:24
  system
• 12:24
  where
• 12:24
  latency,
• 12:25
  wake-word
• 12:26
  reliability,
• 12:26
  and
• 12:27
  offline
• 12:27
  capability
• 12:27
  matter
• 12:28
  more
• 12:28
  than
• 12:28
  benchmark
• 12:28
  scores.
• 12:29
  On
• 12:29
  the
• 12:29
  creative
• 12:29
  side,
• 12:30
  a
• 12:30
  developer
• 12:31
  built
• 12:31
  an
• 12:31
  open-source
• 12:31
  pipeline
• 12:32
  that
• 12:32
  re-voices
• 12:33
  videos
• 12:33
  using
• 12:33
  Ollama
• 12:34
  for
• 12:34
  translation
• 12:34
  (via
• 12:35
  translategemma)
• 12:36
  and
• 12:36
  Qwen3-TTS
• 12:37
  for
• 12:37
  speech
• 12:37
  synthesis
• 12:38
  with
• 12:38
  voice
• 12:38
  cloning.
• 12:40
  The
• 12:40
  three-stage
• 12:40
  prompt
• 12:40
  chain
• 12:41
  (clean
• 12:41
  transcript
• 12:41
  →
• 12:41
  translate
• 12:42
  →
• 12:42
  adapt
• 12:42
  for
• 12:43
  natural
• 12:43
  speech)
• 12:43
  is
• 12:43
  straightforward,
• 12:44
  but
• 12:45
  the
• 12:45
  practical
• 12:45
  lessons
• 12:45
  are
• 12:45
  useful:
• 12:46
  large
• 12:47
  models
• 12:47
  (27B)
• 12:48
  are
• 12:48
  too
• 12:48
  slow
• 12:49
  for
• 12:49
  TTS
• 12:49
  pipelines,
• 12:50
  batch
• 12:51
  sizes
• 12:51
  that
• 12:51
  are
• 12:51
  too
• 12:51
  large
• 12:52
  cause
• 12:52
  mid-generation
• 12:53
  hallucinations,
• 12:54
  and
• 12:54
  sometimes
• 12:54
  reloading
• 12:55
  the
• 12:55
  model
• 12:55
  beats
• 12:56
  long
• 12:56
  inference
• 12:56
  runs.
• 12:57
  The
• 12:57
  original
• 12:58
  motivation
• 12:58
  —
• 12:59
  localizing
• 13:00
  a
• 13:00
  Fireship
• 13:00
  video
• 13:00
  into
• 13:01
  Russian
• 13:01
  —
• 13:02
  evolved
• 13:02
  from
• 13:02
  19,784
• 13:04
  World
• 13:04
  of
• 13:04
  Warcraft
• 13:05
  quest
• 13:05
  voice-overs
• 13:06
  built
• 13:06
  two
• 13:06
  years
• 13:06
  earlier.
• 13:08
  An
• 13:08
  "AI
• 13:08
  Debate
• 13:09
  Arena"
• 13:09
  project
• 13:09
  takes
• 13:10
  a
• 13:10
  different
• 13:10
  angle
• 13:10
  on
• 13:10
  local
• 13:11
  model
• 13:11
  utility:
• 13:12
  instead
• 13:12
  of
• 13:13
  one-shot
• 13:13
  answers,
• 13:14
  2-6
• 13:14
  Ollama-hosted
• 13:15
  models
• 13:16
  debate
• 13:16
  a
• 13:16
  topic
• 13:16
  in
• 13:16
  structured
• 13:17
  rounds
• 13:17
  (opening
• 13:17
  arguments,
• 13:18
  technical
• 13:19
  deep
• 13:19
  dives,
• 13:20
  crossfire,
• 13:21
  rebuttals,
• 13:22
  closing
• 13:22
  statements),
• 13:23
  with
• 13:23
  a
• 13:23
  randomly
• 13:24
  chosen
• 13:24
  participant
• 13:24
  model
• 13:25
  serving
• 13:25
  as
• 13:25
  judge.
• 13:26
  The
• 13:26
  motivation
• 13:27
  is
• 13:27
  sound
• 13:27
  —
• 13:28
  it
• 13:28
  is
• 13:28
  genuinely
• 13:29
  hard
• 13:29
  to
• 13:29
  tell
• 13:29
  whether
• 13:29
  a
• 13:30
  single
• 13:30
  model
• 13:30
  considered
• 13:31
  serious
• 13:31
  counterarguments
• 13:31
  —
• 13:32
  though
• 13:32
  the
• 13:33
  value
• 13:33
  depends
• 13:33
  heavily
• 13:33
  on
• 13:34
  whether
• 13:34
  the
• 13:34
  debating
• 13:34
  models
• 13:34
  actually
• 13:35
  have
• 13:35
  different
• 13:35
  knowledge
• 13:36
  versus
• 13:36
  producing
• 13:36
  confident
• 13:37
  variations
• 13:37
  on
• 13:37
  the
• 13:38
  same
• 13:38
  training
• 13:38
  data.
• 13:39
  Meanwhile,
• 13:40
  someone
• 13:40
  taught
• 13:40
  Claude
• 13:40
  to
• 13:41
  paint
• 13:41
  using
• 13:41
  p5.brush,
• 13:43
  generating
• 13:44
  stroke-by-stroke
• 13:44
  canvas
• 13:45
  compositions
• 13:45
  —
• 13:46
  sky
• 13:46
  first,
• 13:47
  then
• 13:47
  trees,
• 13:48
  then
• 13:48
  details
• 13:48
  —
• 13:49
  that
• 13:49
  come
• 13:50
  alive
• 13:50
  with
• 13:50
  animated
• 13:50
  rain,
• 13:51
  butterflies,
• 13:52
  and
• 13:52
  breathing
• 13:52
  cats.
• 13:53
  It
• 13:53
  is
• 13:53
  a
• 13:53
  skill
• 13:53
  file,
• 13:54
  not
• 13:54
  a
• 13:54
  product,
• 13:55
  but
• 13:55
  it
• 13:56
  is
• 13:56
  a
• 13:56
  charming
• 13:56
  demonstration
• 13:57
  of
• 13:57
  what
• 13:57
  structured
• 13:57
  creative
• 13:58
  prompting
• 13:58
  can
• 13:58
  produce.
• 14:05
  Hunter
• 14:05
  Alpha,
• 14:06
  a
• 14:06
  stealth
• 14:06
  model
• 14:07
  that
• 14:07
  appeared
• 14:07
  on
• 14:07
  benchmarks
• 14:08
  March
• 14:08
  18th,
• 14:08
  was
• 14:08
  revealed
• 14:09
  as
• 14:09
  an
• 14:09
  early
• 14:09
  testing
• 14:10
  version
• 14:10
  of
• 14:10
  MiMo-V2-Pro
• 14:11
  —
• 14:12
  Xiaomi's
• 14:13
  next-generation
• 14:13
  reasoning
• 14:13
  model.
• 14:14
  The
• 14:15
  original
• 14:15
  MiMo-7B
• 14:16
  already
• 14:16
  demonstrated
• 14:17
  that
• 14:17
  small
• 14:17
  models
• 14:17
  with
• 14:18
  reasoning-focused
• 14:18
  RL
• 14:18
  training
• 14:19
  could
• 14:19
  match
• 14:19
  32B
• 14:20
  counterparts;
• 14:21
  the
• 14:21
  poster
• 14:22
  reports
• 14:22
  V2-Pro
• 14:23
  was
• 14:23
  "10x
• 14:24
  better
• 14:24
  than
• 14:24
  MiniMax
• 14:24
  2.5"
• 14:25
  for
• 14:26
  their
• 14:26
  OpenClaw
• 14:26
  use
• 14:26
  case,
• 14:27
  with
• 14:27
  an
• 14:27
  open-weight
• 14:28
  variant
• 14:28
  planned
• 14:28
  once
• 14:28
  the
• 14:29
  model
• 14:29
  stabilizes.
• 14:30
  Mistral
• 14:30
  dropped
• 14:30
  Mistral-Small-4-119B,
• 14:33
  continuing
• 14:34
  the
• 14:34
  MoE
• 14:34
  pattern
• 14:34
  where
• 14:34
  large
• 14:35
  total
• 14:35
  parameter
• 14:35
  counts
• 14:36
  hide
• 14:36
  modest
• 14:36
  per-token
• 14:37
  active
• 14:37
  compute
• 14:37
  —
• 14:38
  the
• 14:38
  architectural
• 14:38
  approach
• 14:39
  that
• 14:39
  has
• 14:39
  become
• 14:39
  the
• 14:39
  default
• 14:40
  efficiency
• 14:40
  strategy
• 14:41
  for
• 14:41
  open-weight
• 14:41
  labs
• 14:42
  trying
• 14:42
  to
• 14:42
  compete
• 14:42
  with
• 14:42
  frontier
• 14:43
  closed
• 14:43
  models.
• 14:44
  LiquidAI's
• 14:46
  LFM2-24B-A2B
• 14:48
  rounds
• 14:48
  out
• 14:48
  the
• 14:48
  week's
• 14:48
  releases
• 14:49
  as
• 14:49
  a
• 14:49
  sparse
• 14:49
  MoE
• 14:49
  designed
• 14:50
  to
• 14:50
  concentrate
• 14:50
  capacity
• 14:51
  without
• 14:51
  inflating
• 14:52
  per-token
• 14:52
  cost,
• 14:53
  targeting
• 14:53
  edge
• 14:53
  and
• 14:53
  local
• 14:54
  deployment
• 14:54
  where
• 14:54
  inference
• 14:55
  latency
• 14:55
  and
• 14:55
  energy
• 14:55
  matter
• 14:56
  more
• 14:56
  than
• 14:56
  peak
• 14:56
  benchmark
• 14:57
  scores.
• 15:03
  SK
• 15:03
  Hynix's
• 15:04
  chairman
• 15:04
  warned
• 15:04
  that
• 15:05
  the
• 15:05
  memory
• 15:05
  chip
• 15:05
  crunch
• 15:06
  will
• 15:06
  persist
• 15:06
  until
• 15:06
  2030
• 15:07
  —
• 15:08
  a
• 15:08
  timeline
• 15:09
  that
• 15:09
  extends
• 15:09
  the
• 15:09
  supply
• 15:10
  pressure
• 15:10
  well
• 15:10
  beyond
• 15:10
  most
• 15:11
  industry
• 15:11
  forecasts.
• 15:12
  HBM
• 15:13
  capacity
• 15:13
  constrains
• 15:14
  AI
• 15:14
  scaling
• 15:14
  at
• 15:15
  the
• 15:15
  datacenter
• 15:15
  tier,
• 15:16
  and
• 15:16
  the
• 15:16
  downstream
• 15:17
  price
• 15:17
  pressure
• 15:17
  on
• 15:17
  conventional
• 15:18
  DRAM
• 15:18
  and
• 15:18
  GDDR
• 15:19
  hits
• 15:19
  everyone
• 15:19
  building
• 15:20
  local
• 15:20
  inference
• 15:20
  rigs
• 15:21
  too.
• 15:21
  Meta
• 15:22
  published
• 15:22
  a
• 15:22
  mea
• 15:22
  culpa
• 15:23
  on
• 15:23
  jemalloc,
• 15:24
  the
• 15:24
  high-performance
• 15:25
  memory
• 15:25
  allocator
• 15:25
  that
• 15:25
  has
• 15:25
  been
• 15:26
  a
• 15:26
  foundational
• 15:26
  component
• 15:27
  of
• 15:27
  their
• 15:27
  infrastructure
• 15:28
  stack.
• 15:28
  The
• 15:28
  admission:
• 15:29
  "In
• 15:29
  recent
• 15:29
  years,
• 15:30
  there
• 15:30
  has
• 15:30
  been
• 15:30
  a
• 15:30
  gradual
• 15:31
  shift
• 15:31
  away
• 15:31
  from
• 15:31
  the
• 15:31
  core
• 15:32
  engineering
• 15:32
  principles
• 15:33
  that
• 15:33
  have
• 15:33
  long
• 15:33
  guided
• 15:33
  jemalloc's
• 15:34
  development.
• 15:35
  While
• 15:35
  some
• 15:36
  decisions
• 15:36
  delivered
• 15:36
  immediate
• 15:37
  benefits,
• 15:37
  the
• 15:37
  resulting
• 15:38
  technical
• 15:38
  debt
• 15:38
  eventually
• 15:39
  slowed
• 15:39
  progress."
• 15:40
  After
• 15:41
  conversations
• 15:41
  with
• 15:41
  the
• 15:41
  community
• 15:42
  and
• 15:42
  the
• 15:42
  project's
• 15:43
  original
• 15:43
  founder,
• 15:44
  the
• 15:44
  canonical
• 15:44
  repository
• 15:45
  has
• 15:45
  been
• 15:45
  unarchived.
• 15:46
  The
• 15:46
  roadmap
• 15:47
  focuses
• 15:47
  on
• 15:47
  cleaning
• 15:48
  up
• 15:48
  technical
• 15:48
  debt,
• 15:49
  improving
• 15:49
  the
• 15:49
  hugepage
• 15:50
  allocator
• 15:50
  for
• 15:50
  better
• 15:50
  transparent
• 15:51
  hugepage
• 15:51
  utilization,
• 15:52
  optimizing
• 15:53
  packing/caching/purging
• 15:55
  for
• 15:55
  memory
• 15:55
  efficiency,
• 15:56
  and
• 15:56
  ensuring
• 15:57
  good
• 15:57
  out-of-the-box
• 15:57
  ARM64
• 15:59
  performance.
• 16:00
  The
• 16:01
  subtext:
• 16:02
  even
• 16:02
  Meta,
• 16:02
  with
• 16:02
  essentially
• 16:03
  unlimited
• 16:03
  engineering
• 16:04
  resources,
• 16:05
  can
• 16:05
  accumulate
• 16:06
  technical
• 16:06
  debt
• 16:06
  in
• 16:06
  foundational
• 16:07
  infrastructure
• 16:07
  when
• 16:08
  short-term
• 16:08
  optimization
• 16:09
  overrides
• 16:10
  principled
• 16:10
  engineering.
• 16:11
  At
• 16:11
  the
• 16:11
  GPU
• 16:12
  communication
• 16:12
  layer,
• 16:13
  a
• 16:13
  vLLM
• 16:14
  user
• 16:14
  discovered
• 16:14
  that
• 16:15
  the
• 16:15
  widely
• 16:15
  circulated
• 16:15
  NCCL
• 16:16
  P2P
• 16:17
  DISABLE=0
• 16:17
  advice
• 16:18
  for
• 16:18
  multi-GPU
• 16:19
  setups
• 16:19
  was
• 16:19
  wrong
• 16:19
  —
• 16:20
  or
• 16:20
  at
• 16:20
  least
• 16:20
  incomplete.
• 16:21
  vLLM
• 16:22
  relies
• 16:22
  on
• 16:22
  NCCL,
• 16:23
  which
• 16:23
  assumes
• 16:23
  NVLink
• 16:24
  for
• 16:24
  peer-to-peer
• 16:24
  communication.
• 16:25
  Without
• 16:26
  an
• 16:26
  NVLink
• 16:26
  bridge,
• 16:27
  it
• 16:27
  hangs.
• 16:28
  The
• 16:28
  fix:
• 16:29
  NCCL
• 16:29
  P2P
• 16:30
  LEVEL=SYS
• 16:31
  combined
• 16:31
  with
• 16:31
  VLLM
• 16:32
  SKIP
• 16:32
  P2P
• 16:33
  CHECK=1,
• 16:34
  which
• 16:34
  tells
• 16:34
  NCCL
• 16:35
  that
• 16:35
  crossing
• 16:35
  NUMA
• 16:35
  nodes
• 16:35
  via
• 16:36
  the
• 16:36
  SMP
• 16:36
  interconnect
• 16:37
  (QPI/UPI)
• 16:38
  is
• 16:39
  acceptable.
• 16:40
  The
• 16:40
  hierarchy
• 16:40
  of
• 16:40
  P2P
• 16:41
  levels
• 16:41
  —
• 16:42
  LOC
• 16:42
  (disabled),
• 16:43
  NVL
• 16:44
  (NVLink
• 16:44
  only),
• 16:45
  PIX
• 16:45
  (same
• 16:45
  PCIe
• 16:46
  switch),
• 16:47
  PXB
• 16:47
  (multiple
• 16:48
  PCIe
• 16:48
  hops),
• 16:49
  PHB
• 16:50
  (same
• 16:50
  NUMA
• 16:50
  node),
• 16:51
  SYS
• 16:51
  (cross-NUMA)
• 16:51
  —
• 16:52
  is
• 16:52
  documented
• 16:53
  in
• 16:53
  the
• 16:53
  NCCL
• 16:53
  user
• 16:54
  guide
• 16:54
  but
• 16:54
  apparently
• 16:54
  not
• 16:55
  widely
• 16:55
  known
• 16:55
  among
• 16:55
  hobbyist
• 16:56
  multi-GPU
• 16:56
  builders.
• 16:57
  One
• 16:58
  caveat:
• 16:59
  Sapphire
• 16:59
  Rapids
• 17:00
  PCIe
• 17:00
  P2P
• 17:01
  is
• 17:01
  limited
• 17:01
  to
• 17:01
  Gen
• 17:01
  4
• 17:02
  due
• 17:02
  to
• 17:02
  NTB
• 17:02
  limitations.