Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – October 27, 2026

Transcript

AGI Dreams Podcast – October 27, 2026 · AGI Dreams – Open, Uncensored, & Local - AI News Digest

• 0:00
  Drew
• 0:00
  Silcock's
• 0:01
  "Is
• 0:01
  this
• 0:01
  the
• 0:01
  new
• 0:01
  cyber
• 0:02
  normal?"
• 0:02
  takes
• 0:03
  one
• 0:03
  bad
• 0:03
  week
• 0:03
  and
• 0:03
  asks
• 0:04
  whether
• 0:04
  it
• 0:04
  is
• 0:04
  weather
• 0:05
  or
• 0:05
  climate.
• 0:06
  The
• 0:06
  headline
• 0:06
  case
• 0:06
  is
• 0:07
  PHP2Shell,
• 0:09
  two
• 0:09
  pre-auth
• 0:09
  remote
• 0:10
  code
• 0:10
  execution
• 0:11
  bugs
• 0:11
  in
• 0:11
  PHP
• 0:12
  found
• 0:12
  independently
• 0:13
  by
• 0:13
  Calif,
• 0:13
  through
• 0:13
  OpenAI's
• 0:14
  "Patch
• 0:14
  the
• 0:15
  Planet"
• 0:15
  program,
• 0:16
  and
• 0:16
  by
• 0:16
  Wiz,
• 0:16
  with
• 0:16
  frontier
• 0:17
  models
• 0:17
  (GPT-5.6
• 0:18
  Sol
• 0:19
  and
• 0:19
  Gemini
• 0:19
  4
• 0:19
  Argon
• 0:20
  are
• 0:20
  the
• 0:20
  ones
• 0:21
  named)
• 0:21
  doing
• 0:21
  both
• 0:21
  the
• 0:21
  finding
• 0:22
  and
• 0:22
  the
• 0:22
  exploit
• 0:23
  construction.
• 0:24
  One
• 0:24
  of
• 0:24
  them,
• 0:24
  CVE-2026-109618,
• 0:30
  surfaced
• 0:30
  in
• 0:30
  a
• 0:31
  2024
• 0:31
  PHP
• 0:32
  Foundation
• 0:32
  audit
• 0:33
  and
• 0:33
  was
• 0:33
  shelved
• 0:33
  because
• 0:34
  nobody
• 0:34
  could
• 0:34
  build
• 0:34
  a
• 0:34
  working
• 0:35
  exploit.
• 0:36
  The
• 0:36
  embargo
• 0:36
  collapsed
• 0:37
  in
• 0:37
  the
• 0:37
  usual
• 0:37
  way:
• 0:37
  a
• 0:38
  leaked
• 0:38
  CVSS
• 0:38
  10.0
• 0:39
  figure
• 0:40
  (the
• 0:40
  real
• 0:40
  scores
• 0:40
  were
• 0:40
  9.2),
• 0:41
  a
• 0:42
  patch
• 0:42
  pulled
• 0:42
  forward
• 0:42
  a
• 0:42
  day
• 0:43
  to
• 0:43
  October
• 0:43
  21,
• 0:44
  and
• 0:45
  AWS
• 0:45
  reporting
• 0:46
  probes
• 0:46
  from
• 0:46
  October
• 0:47
  17,
• 0:47
  before
• 0:48
  any
• 0:48
  leak.
• 0:49
  Silcock's
• 0:49
  thesis
• 0:50
  is
• 0:50
  narrower
• 0:50
  than
• 0:50
  the
• 0:50
  title
• 0:51
  and
• 0:51
  more
• 0:51
  useful.
• 0:52
  The
• 0:52
  gap
• 0:52
  between
• 0:53
  "I
• 0:53
  heard
• 0:53
  there's
• 0:53
  a
• 0:53
  bad
• 0:54
  RCE"
• 0:55
  and
• 0:55
  "sophisticated,
• 0:56
  automated,
• 0:56
  and
• 0:57
  concerted
• 0:57
  attacks"
• 0:58
  has
• 0:58
  "gone
• 0:58
  from
• 0:59
  weeks/months
• 0:59
  to
• 1:00
  hours/minutes,"
• 1:01
  so
• 1:01
  a
• 1:01
  patch
• 1:02
  announcement
• 1:02
  should
• 1:02
  be
• 1:03
  read
• 1:03
  as
• 1:03
  "a
• 1:03
  last
• 1:03
  possible
• 1:04
  date
• 1:04
  that
• 1:05
  the
• 1:05
  full
• 1:05
  exploit
• 1:05
  is
• 1:05
  being
• 1:06
  publicly
• 1:06
  or
• 1:06
  privately
• 1:07
  distributed."
• 1:08
  To
• 1:08
  the
• 1:08
  objection
• 1:09
  that
• 1:09
  LLMs
• 1:10
  mostly
• 1:10
  generate
• 1:10
  exploit
• 1:11
  slop,
• 1:11
  he
• 1:12
  answers
• 1:12
  that
• 1:13
  "if
• 1:13
  there's
• 1:13
  one
• 1:13
  that
• 1:13
  does,
• 1:14
  that's
• 1:14
  all
• 1:14
  that
• 1:14
  matters."
• 1:15
  He
• 1:16
  is
• 1:16
  equally
• 1:16
  careful
• 1:17
  about
• 1:17
  what
• 1:17
  the
• 1:17
  week
• 1:17
  does
• 1:18
  not
• 1:18
  prove:
• 1:19
  the
• 1:19
  eMudhra
• 1:19
  certificate
• 1:20
  keys
• 1:20
  were
• 1:21
  a
• 1:21
  human
• 1:21
  find,
• 1:22
  and
• 1:22
  Railway's
• 1:22
  decrypted
• 1:23
  secrets,
• 1:24
  LiteLLM's
• 1:24
  second
• 1:25
  PyPI
• 1:25
  compromise
• 1:26
  of
• 1:26
  the
• 1:26
  year,
• 1:27
  and
• 1:27
  FulcrumSec's
• 1:28
  claimed
• 1:28
  10.6
• 1:29
  TB
• 1:29
  TiDB
• 1:30
  exfiltration
• 1:31
  were
• 1:31
  "good
• 1:31
  old
• 1:31
  fashioned
• 1:32
  software
• 1:32
  vulnerabilities"
• 1:33
  and
• 1:33
  credential
• 1:34
  failures.
• 1:35
  His
• 1:35
  policy
• 1:36
  conclusions
• 1:36
  are
• 1:36
  the
• 1:36
  ones
• 1:37
  worth
• 1:37
  arguing
• 1:37
  about:
• 1:38
  closing
• 1:38
  source
• 1:39
  does
• 1:39
  not
• 1:39
  help
• 1:39
  because
• 1:40
  LLMs
• 1:40
  reverse-engineer
• 1:41
  binaries
• 1:41
  anyway,
• 1:42
  and
• 1:43
  minimum-release-age
• 1:43
  policies
• 1:44
  now
• 1:44
  delay
• 1:44
  critical
• 1:45
  patches
• 1:45
  into
• 1:45
  the
• 1:46
  exploitation
• 1:46
  window.
• 1:47
  If
• 1:48
  the
• 1:48
  clock
• 1:48
  has
• 1:48
  sped
• 1:48
  up
• 1:48
  for
• 1:49
  attackers,
• 1:49
  VulnCheck's
• 1:50
  audit
• 1:50
  of
• 1:50
  Anthropic's
• 1:51
  Project
• 1:51
  Glasswing
• 1:52
  finds
• 1:52
  the
• 1:52
  defender-side
• 1:53
  receipts
• 1:53
  do
• 1:53
  not
• 1:54
  reconcile.
• 1:55
  Anthropic
• 1:56
  claims
• 1:56
  26,153
• 1:58
  findings
• 1:58
  since
• 1:59
  April;
• 2:00
  its
• 2:00
  own
• 2:01
  Vulnerability
• 2:01
  Disclosure
• 2:02
  Ledger
• 2:02
  shows
• 2:02
  2,736,
• 2:05
  of
• 2:05
  which
• 2:05
  202
• 2:06
  are
• 2:06
  fixed
• 2:06
  and
• 2:06
  245
• 2:08
  withdrawn.
• 2:09
  Only
• 2:09
  9.8%
• 2:10
  of
• 2:10
  findings
• 2:11
  have
• 2:11
  reached
• 2:11
  a
• 2:11
  maintainer
• 2:12
  after
• 2:12
  nearly
• 2:12
  five
• 2:12
  months,
• 2:13
  a
• 2:14
  bottleneck
• 2:14
  the
• 2:14
  ledger
• 2:14
  concedes:
• 2:15
  "the
• 2:15
  process
• 2:16
  of
• 2:16
  independent
• 2:17
  human
• 2:17
  triage
• 2:17
  and
• 2:17
  review
• 2:18
  is
• 2:18
  the
• 2:18
  rate
• 2:18
  limiting
• 2:18
  step."
• 2:19
  Claude
• 2:20
  rated
• 2:20
  91.5%
• 2:21
  of
• 2:21
  findings
• 2:22
  critical
• 2:22
  or
• 2:22
  high
• 2:23
  where
• 2:23
  maintainers
• 2:23
  rated
• 2:24
  51.3%.
• 2:26
  The
• 2:26
  single
• 2:26
  named
• 2:26
  data
• 2:27
  point
• 2:27
  is
• 2:27
  curl's
• 2:27
  Daniel
• 2:28
  Stenberg:
• 2:29
  five
• 2:29
  Mythos
• 2:29
  reports,
• 2:30
  one
• 2:30
  real
• 2:31
  vulnerability,
• 2:31
  three
• 2:32
  false
• 2:32
  positives.
• 2:33
  None
• 2:33
  of
• 2:34
  this
• 2:34
  says
• 2:34
  the
• 2:34
  model
• 2:34
  is
• 2:34
  bad
• 2:35
  at
• 2:35
  finding
• 2:35
  bugs.
• 2:36
  It
• 2:36
  says
• 2:36
  the
• 2:36
  published
• 2:37
  totals
• 2:37
  are
• 2:37
  an
• 2:37
  assertion,
• 2:38
  not
• 2:38
  evidence,
• 2:39
  and
• 2:39
  that
• 2:39
  human
• 2:40
  triage
• 2:40
  is
• 2:40
  the
• 2:40
  scarce
• 2:41
  resource.
• 2:42
  Calif,
• 2:42
  meanwhile,
• 2:43
  posts
• 2:43
  receipts
• 2:44
  of
• 2:44
  a
• 2:44
  different
• 2:44
  kind.
• 2:45
  Its
• 2:45
  Hexacon
• 2:46
  post
• 2:46
  is
• 2:46
  four
• 2:47
  demos
• 2:47
  and
• 2:47
  a
• 2:47
  tagline,
• 2:48
  "APT
• 2:49
  stands
• 2:49
  for
• 2:49
  Apple
• 2:50
  Persistent
• 2:50
  Threat,"
• 2:51
  with
• 2:51
  the
• 2:51
  write-up
• 2:51
  promised
• 2:52
  "in
• 2:52
  due
• 2:52
  time."
• 2:53
  There
• 2:53
  is
• 2:53
  no
• 2:54
  technical
• 2:54
  content
• 2:54
  yet,
• 2:55
  so
• 2:55
  nothing
• 2:55
  can
• 2:56
  be
• 2:56
  verified
• 2:56
  beyond
• 2:56
  the
• 2:57
  firm's
• 2:57
  track
• 2:57
  record.
• 2:58
  Judge
• 2:58
  it
• 2:58
  when
• 2:58
  the
• 2:59
  paper
• 2:59
  lands.
• 3:02
  Cloudflare's
• 3:02
  disclosure
• 3:03
  of
• 3:03
  a
• 3:03
  tenant-isolation
• 3:04
  flaw
• 3:04
  in
• 3:05
  GLM
• 3:05
  5.3
• 3:06
  on
• 3:06
  Workers
• 3:07
  AI
• 3:07
  is
• 3:08
  the
• 3:08
  most
• 3:08
  instructive
• 3:09
  incident
• 3:09
  write-up
• 3:09
  of
• 3:09
  the
• 3:10
  month,
• 3:10
  partly
• 3:11
  because
• 3:11
  nobody
• 3:11
  attacked
• 3:12
  anything.
• 3:13
  Between
• 3:13
  August
• 3:13
  27
• 3:14
  and
• 3:14
  September
• 3:14
  9,
• 3:15
  155
• 3:16
  responses
• 3:17
  to
• 3:17
  prompts
• 3:17
  longer
• 3:18
  than
• 3:18
  681,280
• 3:20
  tokens
• 3:21
  contained
• 3:21
  fragments
• 3:22
  of
• 3:22
  other
• 3:22
  customers'
• 3:23
  prompts
• 3:23
  and
• 3:24
  generations.
• 3:25
  Researcher
• 3:25
  Gadi
• 3:26
  Evron
• 3:26
  reported
• 3:27
  it
• 3:27
  via
• 3:27
  HackerOne
• 3:27
  on
• 3:28
  September
• 3:28
  8;
• 3:29
  Cloudflare
• 3:29
  reproduced
• 3:30
  it
• 3:30
  within
• 3:30
  25
• 3:31
  minutes
• 3:31
  the
• 3:31
  next
• 3:32
  morning
• 3:32
  and
• 3:32
  restored
• 3:32
  a
• 3:32
  patched
• 3:33
  rebuild
• 3:33
  the
• 3:33
  same
• 3:34
  evening.
• 3:35
  The
• 3:35
  root
• 3:35
  cause
• 3:35
  is
• 3:35
  two
• 3:36
  bugs
• 3:36
  stacked.
• 3:37
  Cloudflare
• 3:37
  deployed
• 3:38
  GLM
• 3:38
  5.3
• 3:39
  with
• 3:39
  a
• 3:39
  1,048,576-token
• 3:42
  context
• 3:42
  window,
• 3:43
  but
• 3:43
  the
• 3:44
  KV
• 3:44
  cache
• 3:44
  pool
• 3:44
  on
• 3:45
  the
• 3:45
  prefill
• 3:45
  GPUs
• 3:46
  only
• 3:46
  had
• 3:46
  room
• 3:46
  for
• 3:46
  681,280
• 3:49
  tokens,
• 3:50
  because
• 3:50
  SGLang
• 3:50
  sizes
• 3:51
  the
• 3:51
  pool
• 3:51
  from
• 3:52
  leftover
• 3:52
  GPU
• 3:52
  memory
• 3:53
  rather
• 3:53
  than
• 3:53
  configuration.
• 3:55
  Cloudflare
• 3:56
  knew
• 3:56
  and
• 3:56
  assumed
• 3:56
  over-length
• 3:57
  prompts
• 3:57
  would
• 3:57
  be
• 3:57
  rejected:
• 3:58
  "we
• 3:58
  only
• 3:59
  validated
• 3:59
  HTTP
• 4:00
  response
• 4:00
  codes
• 4:01
  and
• 4:01
  engine
• 4:01
  performance
• 4:02
  at
• 4:02
  long
• 4:02
  contexts,
• 4:03
  without
• 4:03
  validating
• 4:04
  model
• 4:04
  output
• 4:04
  and
• 4:05
  coherence."
• 4:06
  The
• 4:06
  second
• 4:06
  bug
• 4:07
  sat
• 4:07
  in
• 4:07
  SGLang's
• 4:08
  disaggregated
• 4:09
  prefill/decode
• 4:10
  path,
• 4:11
  where
• 4:11
  an
• 4:11
  over-length
• 4:12
  request
• 4:12
  was
• 4:12
  marked
• 4:13
  rejected
• 4:13
  and
• 4:13
  swapped
• 4:14
  for
• 4:14
  a
• 4:14
  one-token
• 4:14
  placeholder,
• 4:15
  but
• 4:16
  the
• 4:16
  admission
• 4:16
  queue
• 4:16
  checked
• 4:17
  whether
• 4:17
  a
• 4:17
  request
• 4:17
  was
• 4:17
  finished,
• 4:18
  not
• 4:18
  rejected.
• 4:19
  Prefill
• 4:20
  sent
• 4:20
  one
• 4:20
  KV
• 4:21
  page;
• 4:21
  decode
• 4:22
  had
• 4:22
  reserved
• 4:22
  the
• 4:22
  full
• 4:23
  page
• 4:23
  count
• 4:23
  and
• 4:24
  attended
• 4:24
  over
• 4:24
  all
• 4:24
  of
• 4:24
  them,
• 4:25
  and
• 4:25
  since
• 4:25
  pages
• 4:26
  are
• 4:26
  never
• 4:26
  zeroed
• 4:26
  between
• 4:27
  requests,
• 4:28
  the
• 4:28
  rest
• 4:28
  held
• 4:28
  whatever
• 4:29
  the
• 4:29
  previous
• 4:29
  tenant
• 4:29
  left.
• 4:30
  The
• 4:31
  fixes,
• 4:31
  shipped
• 4:32
  in
• 4:32
  SGLang
• 4:32
  v0.5.20
• 4:35
  through
• 4:35
  v0.5.22,
• 4:38
  retire
• 4:38
  rejected
• 4:39
  requests
• 4:39
  before
• 4:40
  any
• 4:40
  allocation,
• 4:41
  verify
• 4:41
  that
• 4:41
  transferred
• 4:42
  tokens
• 4:42
  match
• 4:43
  reserved
• 4:43
  tokens,
• 4:44
  and
• 4:44
  checksum
• 4:44
  each
• 4:45
  transfer.
• 4:46
  The
• 4:46
  most
• 4:46
  revealing
• 4:46
  line
• 4:47
  concerns
• 4:47
  a
• 4:47
  page-level
• 4:48
  ownership
• 4:48
  tag
• 4:49
  prototype
• 4:49
  that
• 4:50
  checks
• 4:50
  every
• 4:50
  read
• 4:50
  at
• 4:51
  under
• 4:51
  1%
• 4:51
  overhead.
• 4:53
  Cloudflare
• 4:53
  tested
• 4:53
  it
• 4:54
  on
• 4:54
  GLM
• 4:54
  5.2
• 4:55
  in
• 4:55
  mid-August
• 4:56
  and
• 4:56
  "disabled
• 4:57
  it
• 4:57
  shortly
• 4:57
  afterwards
• 4:58
  due
• 4:58
  to
• 4:58
  reliability
• 4:59
  issues."
• 4:59
  The
• 5:00
  defense
• 5:00
  that
• 5:00
  would
• 5:00
  have
• 5:00
  caught
• 5:01
  this
• 5:01
  existed
• 5:01
  and
• 5:01
  was
• 5:02
  switched
• 5:02
  off
• 5:02
  around
• 5:02
  the
• 5:02
  time
• 5:03
  the
• 5:03
  leak
• 5:03
  began.
• 5:04
  The
• 5:04
  long-term
• 5:04
  answer
• 5:05
  is
• 5:05
  formal
• 5:05
  verification
• 5:06
  of
• 5:06
  the
• 5:06
  RDMA
• 5:07
  transfer
• 5:07
  protocol.
• 5:08
  Leaks
• 5:09
  do
• 5:09
  not
• 5:09
  require
• 5:09
  an
• 5:09
  engine
• 5:10
  bug;
• 5:10
  the
• 5:10
  model
• 5:11
  itself
• 5:11
  can
• 5:11
  be
• 5:11
  the
• 5:11
  channel.
• 5:12
  The
• 5:12
  qwen-block-proxy-artifacts
• 5:14
  repo
• 5:14
  documents
• 5:15
  Qwen
• 5:15
  3.8
• 5:15
  Flash
• 5:16
  Next
• 5:16
  fabricating
• 5:17
  signed
• 5:17
  Aliyun
• 5:17
  OSS
• 5:18
  "file
• 5:18
  proxy"
• 5:19
  URLs
• 5:20
  and
• 5:20
  feeding
• 5:20
  them
• 5:20
  to
• 5:20
  webfetch,
• 5:21
  MCP
• 5:22
  fetchers,
• 5:22
  and
• 5:22
  curl.
• 5:23
  Nobody
• 5:23
  configured
• 5:24
  that
• 5:24
  host:
• 5:24
  "The
• 5:25
  model
• 5:25
  remembered
• 5:25
  the
• 5:25
  URL
• 5:26
  shape
• 5:26
  from
• 5:26
  its
• 5:27
  pretraining
• 5:27
  data
• 5:27
  and
• 5:28
  regurgitated
• 5:28
  it
• 5:28
  as
• 5:29
  a
• 5:29
  tool
• 5:29
  argument."
• 5:30
  The
• 5:30
  endpoint
• 5:31
  always
• 5:31
  returns
• 5:31
  403,
• 5:32
  so
• 5:33
  every
• 5:33
  retry
• 5:33
  leaks
• 5:34
  a
• 5:34
  trace
• 5:34
  ID,
• 5:34
  IP,
• 5:35
  and
• 5:35
  timestamp
• 5:36
  to
• 5:36
  a
• 5:36
  third
• 5:36
  party.
• 5:37
  It
• 5:37
  reproduces
• 5:38
  on
• 5:38
  Qwen's
• 5:38
  official
• 5:39
  API,
• 5:39
  and
• 5:39
  ablating
• 5:40
  the
• 5:40
  responsible
• 5:41
  embedding
• 5:41
  rows
• 5:41
  only
• 5:42
  fragmented
• 5:42
  the
• 5:42
  behavior
• 5:43
  into
• 5:43
  13
• 5:43
  mutant
• 5:44
  URL
• 5:44
  shapes.
• 5:45
  The
• 5:45
  fix
• 5:46
  is
• 5:46
  an
• 5:46
  opencode
• 5:46
  plugin
• 5:47
  that
• 5:47
  scans
• 5:47
  tool
• 5:48
  arguments
• 5:48
  against
• 5:49
  a
• 5:49
  small
• 5:49
  host-anchored
• 5:50
  regex
• 5:50
  blacklist
• 5:51
  and
• 5:51
  throws
• 5:51
  before
• 5:52
  execution,
• 5:53
  extended
• 5:53
  on
• 5:53
  October
• 5:54
  26
• 5:55
  to
• 5:55
  cloud
• 5:55
  instance-metadata
• 5:56
  addresses
• 5:57
  after
• 5:57
  a
• 5:57
  field
• 5:57
  capture
• 5:58
  showed
• 5:58
  an
• 5:58
  attempted
• 5:58
  PUT
• 5:59
  upload.
• 6:00
  The
• 6:00
  author's
• 6:00
  label
• 6:01
  is
• 6:01
  correct:
• 6:01
  "a
• 6:02
  block
• 6:02
  is
• 6:02
  a
• 6:02
  fence,
• 6:03
  not
• 6:03
  a
• 6:03
  cure."
• 6:04
  The
• 6:04
  r/ollama
• 6:07
  thread
• 6:07
  about
• 6:08
  MiniMax
• 6:08
  M3.1
• 6:09
  Flash
• 6:09
  hunting
• 6:09
  for
• 6:10
  .env
• 6:10
  files
• 6:10
  unprompted,
• 6:11
  then
• 6:12
  refusing
• 6:12
  to
• 6:12
  discuss
• 6:13
  why,
• 6:13
  got
• 6:14
  the
• 6:14
  right
• 6:14
  answer
• 6:14
  from
• 6:14
  the
• 6:14
  room:
• 6:15
  the
• 6:15
  model
• 6:16
  cannot
• 6:16
  tell
• 6:16
  you
• 6:16
  why
• 6:17
  it
• 6:17
  did
• 6:17
  anything,
• 6:18
  so
• 6:18
  enforce
• 6:18
  file
• 6:19
  access
• 6:19
  in
• 6:19
  the
• 6:19
  harness,
• 6:20
  with
• 6:20
  Claude
• 6:20
  Code's
• 6:21
  permission
• 6:21
  deny
• 6:21
  rules
• 6:22
  or
• 6:22
  a
• 6:22
  disposable
• 6:23
  VM.
• 6:26
  Every
• 6:26
  impressive
• 6:26
  Reverse
• 6:27
  Engineer
• 6:27
  Anything
• 6:28
  result
• 6:28
  so
• 6:28
  far
• 6:29
  has
• 6:29
  run
• 6:29
  on
• 6:29
  closed
• 6:30
  frontier
• 6:30
  models,
• 6:31
  so
• 6:31
  a
• 6:31
  Hugging
• 6:31
  Face
• 6:32
  team
• 6:32
  asked
• 6:32
  whether
• 6:33
  small
• 6:33
  local
• 6:33
  models
• 6:34
  can
• 6:34
  do
• 6:34
  useful
• 6:35
  binary
• 6:35
  work
• 6:36
  if
• 6:36
  a
• 6:36
  bigger
• 6:36
  one
• 6:36
  organizes
• 6:37
  them.
• 6:38
  DeepSeek-V4.1-Flash
• 6:39
  leads:
• 6:40
  it
• 6:40
  disassembles
• 6:41
  the
• 6:41
  binary,
• 6:41
  names
• 6:42
  functions,
• 6:42
  recovers
• 6:43
  signatures
• 6:44
  and
• 6:44
  memory
• 6:44
  layout,
• 6:45
  and
• 6:45
  posts
• 6:45
  tasks
• 6:46
  to
• 6:46
  a
• 6:46
  shared
• 6:46
  board.
• 6:47
  Four
• 6:47
  Qwen3.5-9B
• 6:50
  workers
• 6:51
  each
• 6:51
  rewrite
• 6:51
  one
• 6:52
  function
• 6:52
  in
• 6:52
  Python,
• 6:53
  and
• 6:53
  an
• 6:53
  oracle
• 6:54
  runs
• 6:54
  roughly
• 6:54
  600
• 6:55
  cases
• 6:55
  through
• 6:55
  original
• 6:56
  and
• 6:56
  rewrite,
• 6:57
  comparing
• 6:57
  every
• 6:58
  byte
• 6:58
  of
• 6:58
  state.
• 6:59
  Targets
• 6:59
  were
• 6:59
  two
• 7:00
  small
• 7:00
  C
• 7:00
  programs
• 7:00
  generated
• 7:01
  with
• 7:01
  Claude
• 7:01
  Code,
• 7:02
  seen
• 7:02
  only
• 7:03
  as
• 7:03
  binaries.
• 7:04
  Both
• 7:04
  the
• 7:04
  team
• 7:05
  and
• 7:05
  a
• 7:05
  solo
• 7:05
  DeepSeek
• 7:06
  run
• 7:06
  recovered
• 7:06
  every
• 7:07
  function,
• 7:07
  but
• 7:08
  the
• 7:08
  team
• 7:08
  cost
• 7:08
  more
• 7:09
  and
• 7:09
  took
• 7:09
  longer:
• 7:10
  $2.97
• 7:11
  and
• 7:12
  86
• 7:12
  minutes
• 7:12
  versus
• 7:13
  $0.87
• 7:14
  and
• 7:14
  14
• 7:14
  minutes
• 7:15
  on
• 7:15
  the
• 7:15
  smaller
• 7:15
  target.
• 7:16
  The
• 7:16
  interesting
• 7:17
  part
• 7:17
  is
• 7:17
  what
• 7:18
  the
• 7:18
  lead
• 7:18
  did
• 7:18
  when
• 7:18
  allowed
• 7:19
  to
• 7:19
  edit
• 7:19
  its
• 7:19
  workers'
• 7:20
  harness.
• 7:21
  On
• 7:21
  the
• 7:21
  larger
• 7:21
  target
• 7:22
  it
• 7:22
  rewrote
• 7:22
  their
• 7:22
  instructions
• 7:23
  three
• 7:23
  times,
• 7:24
  adding
• 7:24
  house
• 7:25
  rules
• 7:25
  after
• 7:25
  workers
• 7:26
  invented
• 7:26
  helper
• 7:26
  names
• 7:27
  and
• 7:27
  misread
• 7:27
  unsigned
• 7:28
  compares,
• 7:29
  then
• 7:29
  wrote
• 7:29
  a
• 7:29
  lookup
• 7:30
  tool
• 7:30
  so
• 7:30
  workers
• 7:31
  could
• 7:31
  query
• 7:31
  signatures
• 7:32
  instead
• 7:32
  of
• 7:32
  re-deriving
• 7:33
  them.
• 7:33
  That
• 7:34
  is
• 7:34
  a
• 7:34
  model
• 7:34
  doing
• 7:34
  harness
• 7:35
  engineering
• 7:35
  on
• 7:35
  other
• 7:36
  models.
• 7:36
  The
• 7:37
  caveats
• 7:37
  are
• 7:37
  properly
• 7:38
  stated:
• 7:38
  unstripped
• 7:39
  binaries,
• 7:40
  clean
• 7:40
  AI-generated
• 7:41
  C,
• 7:41
  two
• 7:41
  data
• 7:42
  points,
• 7:42
  and
• 7:42
  about
• 7:43
  40%
• 7:43
  of
• 7:43
  functions
• 7:44
  still
• 7:44
  bounced
• 7:44
  back
• 7:45
  to
• 7:45
  the
• 7:45
  lead.
• 7:46
  For
• 7:46
  the
• 7:46
  full
• 7:46
  map,
• 7:47
  Awesome-REA
• 7:48
  is
• 7:48
  a
• 7:48
  curated
• 7:48
  index
• 7:49
  led
• 7:49
  by
• 7:49
  Yuxuan
• 7:49
  Zhang
• 7:50
  that
• 7:50
  is
• 7:50
  explicitly
• 7:51
  not
• 7:51
  the
• 7:51
  REA
• 7:52
  repository.
• 7:53
  It
• 7:53
  lists
• 7:53
  508
• 7:54
  curated
• 7:55
  resources,
• 7:56
  137
• 7:57
  papers,
• 7:57
  and
• 7:58
  3,309
• 7:59
  auto-indexed
• 8:00
  repositories
• 8:00
  flagged
• 8:01
  as
• 8:01
  uncurated.
• 8:02
  The
• 8:02
  critical
• 8:03
  studies
• 8:03
  are
• 8:03
  worth
• 8:03
  reading
• 8:04
  first:
• 8:04
  "A
• 8:04
  Memorization
• 8:05
  Floor
• 8:06
  for
• 8:06
  LLM
• 8:06
  Refinement
• 8:07
  of
• 8:07
  Decompiled
• 8:07
  Code"
• 8:08
  and
• 8:08
  a
• 8:08
  paper
• 8:09
  on
• 8:09
  prompt-injecting
• 8:10
  reverse-engineering
• 8:10
  agents
• 8:11
  through
• 8:11
  Cline
• 8:11
  and
• 8:11
  GhidraMCP.
• 8:13
  The
• 8:13
  list's
• 8:13
  own
• 8:13
  caveat
• 8:14
  fits
• 8:14
  the
• 8:14
  field:
• 8:15
  "Source
• 8:15
  review
• 8:15
  does
• 8:16
  not
• 8:16
  imply
• 8:16
  runtime
• 8:17
  verification."
• 8:20
  Entire,
• 8:21
  the
• 8:21
  company
• 8:21
  former
• 8:22
  GitHub
• 8:22
  CEO
• 8:22
  Thomas
• 8:23
  Dohmke
• 8:23
  founded
• 8:24
  on
• 8:24
  a
• 8:24
  $60
• 8:24
  million
• 8:25
  seed
• 8:25
  round
• 8:25
  in
• 8:25
  February,
• 8:26
  launched
• 8:27
  a
• 8:27
  full
• 8:27
  GitHub
• 8:27
  alternative
• 8:28
  on
• 8:28
  October
• 8:29
  26
• 8:29
  with
• 8:29
  its
• 8:30
  reinvention
• 8:30
  of
• 8:30
  the
• 8:30
  pull
• 8:30
  request,
• 8:31
  Trails,
• 8:31
  at
• 8:32
  the
• 8:32
  center.
• 8:32
  Dohmke's
• 8:33
  diagnosis
• 8:33
  is
• 8:34
  familiar:
• 8:34
  "I
• 8:34
  open
• 8:35
  a
• 8:35
  pull
• 8:35
  request,
• 8:36
  and
• 8:36
  I
• 8:36
  realize
• 8:36
  I
• 8:36
  have
• 8:36
  no
• 8:37
  idea
• 8:37
  what
• 8:37
  all
• 8:37
  that
• 8:37
  code
• 8:38
  does."
• 8:38
  Review,
• 8:39
  not
• 8:39
  authoring,
• 8:40
  is
• 8:40
  the
• 8:40
  bottleneck.
• 8:41
  Trails
• 8:42
  replaces
• 8:42
  the
• 8:42
  manual
• 8:43
  diff
• 8:43
  with
• 8:43
  a
• 8:43
  dashboard
• 8:44
  of
• 8:44
  customizable
• 8:45
  evals
• 8:45
  scored
• 8:45
  by
• 8:45
  agents
• 8:46
  on
• 8:46
  every
• 8:46
  push,
• 8:47
  measuring
• 8:47
  things
• 8:48
  like
• 8:48
  change
• 8:48
  risk
• 8:48
  and
• 8:49
  intent
• 8:49
  drift
• 8:49
  across
• 8:49
  a
• 8:49
  long
• 8:50
  session.
• 8:51
  If
• 8:51
  the
• 8:51
  evals
• 8:51
  come
• 8:51
  back
• 8:52
  green,
• 8:52
  the
• 8:52
  code
• 8:53
  can
• 8:53
  merge
• 8:53
  without
• 8:53
  a
• 8:54
  human
• 8:54
  reading
• 8:54
  the
• 8:54
  diff.
• 8:55
  Dohmke's
• 8:56
  example
• 8:56
  is
• 8:56
  an
• 8:57
  internal
• 8:57
  eval
• 8:57
  called
• 8:58
  the
• 8:58
  "stop
• 8:58
  cop":
• 8:59
  "if
• 8:59
  that's
• 8:59
  green
• 9:00
  and
• 9:00
  the
• 9:00
  confidence
• 9:00
  is
• 9:01
  high,
• 9:01
  then
• 9:01
  we're
• 9:02
  merging
• 9:02
  it."
• 9:03
  The
• 9:03
  rest
• 9:03
  is
• 9:03
  a
• 9:03
  Git-compatible
• 9:04
  server
• 9:04
  that
• 9:05
  Entire
• 9:05
  claims
• 9:06
  pushes
• 9:06
  up
• 9:06
  to
• 9:06
  89
• 9:07
  times
• 9:07
  faster
• 9:07
  than
• 9:08
  GitHub,
• 9:08
  CI
• 9:09
  through
• 9:09
  Buildkite
• 9:09
  and
• 9:10
  Depot,
• 9:10
  and
• 9:10
  "Continuous
• 9:11
  Memory,"
• 9:12
  which
• 9:12
  syncs
• 9:12
  agent
• 9:13
  sessions
• 9:13
  into
• 9:13
  the
• 9:13
  repo
• 9:14
  so
• 9:14
  rejected
• 9:14
  approaches
• 9:15
  become
• 9:15
  queryable.
• 9:17
  The
• 9:17
  platform
• 9:17
  is
• 9:17
  free;
• 9:18
  customers
• 9:18
  pay
• 9:19
  for
• 9:19
  review-agent
• 9:19
  tokens
• 9:20
  at
• 9:20
  market
• 9:20
  rates
• 9:21
  after
• 9:21
  a
• 9:21
  $100
• 9:22
  credit,
• 9:22
  and
• 9:23
  Frederic
• 9:23
  Lardinois
• 9:23
  notes
• 9:24
  the
• 9:24
  arbitrage
• 9:24
  between
• 9:25
  Entire's
• 9:25
  model
• 9:26
  discounts
• 9:26
  and
• 9:27
  those
• 9:27
  rates
• 9:27
  "seems
• 9:27
  to
• 9:28
  be
• 9:28
  Entire's
• 9:28
  current
• 9:29
  business
• 9:29
  model."
• 9:30
  The
• 9:30
  open
• 9:31
  question
• 9:31
  is
• 9:31
  whether
• 9:31
  eval-gated
• 9:32
  merging
• 9:33
  is
• 9:33
  a
• 9:33
  review
• 9:33
  process
• 9:34
  or
• 9:34
  a
• 9:34
  confidence
• 9:35
  score
• 9:35
  painted
• 9:35
  green.
• 9:37
  The
• 9:37
  same
• 9:37
  bottleneck
• 9:38
  shows
• 9:38
  up
• 9:38
  one
• 9:39
  level
• 9:39
  down.
• 9:40
  A
• 9:40
  solo
• 9:40
  homelabber
• 9:41
  running
• 9:41
  11
• 9:41
  projects,
• 9:42
  with
• 9:42
  planning
• 9:43
  and
• 9:43
  coding
• 9:43
  sessions
• 9:44
  handing
• 9:44
  work
• 9:45
  through
• 9:45
  Vikunja
• 9:45
  task
• 9:46
  comments,
• 9:46
  counted
• 9:47
  257
• 9:48
  relay
• 9:48
  prompts
• 9:49
  copy-pasted
• 9:50
  between
• 9:50
  about
• 9:50
  20
• 9:50
  terminals
• 9:51
  in
• 9:51
  a
• 9:51
  week,
• 9:52
  with
• 9:52
  a
• 9:52
  median
• 9:52
  11-minute
• 9:53
  wait
• 9:53
  before
• 9:54
  noticing
• 9:54
  an
• 9:54
  agent
• 9:54
  had
• 9:55
  finished.
• 9:56
  The
• 9:56
  thread
• 9:56
  converged
• 9:57
  on
• 9:57
  making
• 9:57
  done
• 9:57
  an
• 9:57
  event:
• 9:58
  a
• 9:58
  Stop
• 9:59
  hook
• 9:59
  writes
• 9:59
  a
• 9:59
  status
• 9:59
  comment
• 10:00
  and
• 10:00
  a
• 10:00
  watcher
• 10:01
  starts
• 10:01
  the
• 10:01
  next
• 10:01
  step
• 10:01
  headless.
• 10:03
  Someone
• 10:03
  running
• 10:03
  up
• 10:03
  to
• 10:03
  30
• 10:04
  agents
• 10:04
  added
• 10:05
  a
• 10:05
  completion
• 10:05
  ledger
• 10:05
  with
• 10:06
  an
• 10:06
  alarm
• 10:06
  on
• 10:06
  anything
• 10:07
  unprocessed
• 10:07
  for
• 10:07
  15
• 10:08
  minutes,
• 10:08
  and
• 10:09
  a
• 10:09
  rule
• 10:09
  that
• 10:09
  a
• 10:09
  failed
• 10:09
  status
• 10:10
  check
• 10:10
  reads
• 10:10
  as
• 10:11
  "unknown
• 10:11
  since"
• 10:12
  rather
• 10:12
  than
• 10:12
  "still
• 10:12
  running."
• 10:14
  Nate
• 10:14
  B.
• 10:14
  Jones's
• 10:15
  video
• 10:15
  argues
• 10:15
  enterprise
• 10:16
  AI
• 10:16
  deals
• 10:16
  stall
• 10:17
  on
• 10:17
  pricing
• 10:17
  because
• 10:18
  buyers
• 10:18
  ask
• 10:18
  the
• 10:18
  wrong
• 10:19
  question.
• 10:20
  Tokens
• 10:20
  meter
• 10:21
  compute
• 10:21
  and
• 10:21
  seats
• 10:21
  meter
• 10:22
  SaaS;
• 10:23
  neither
• 10:23
  measures
• 10:23
  what
• 10:24
  was
• 10:24
  bought,
• 10:24
  and
• 10:25
  a
• 10:25
  per-token
• 10:25
  contract
• 10:26
  shifts
• 10:26
  the
• 10:26
  burden
• 10:27
  of
• 10:27
  extracting
• 10:27
  value
• 10:28
  onto
• 10:28
  a
• 10:28
  buyer
• 10:28
  who
• 10:28
  then
• 10:29
  caps
• 10:29
  spend.
• 10:30
  His
• 10:30
  claim
• 10:30
  that
• 10:30
  intelligence
• 10:31
  is
• 10:31
  a
• 10:31
  third
• 10:32
  economic
• 10:32
  input
• 10:32
  alongside
• 10:33
  labor
• 10:33
  and
• 10:34
  capital
• 10:34
  is
• 10:34
  large,
• 10:35
  and
• 10:35
  his
• 10:35
  evidence
• 10:36
  is
• 10:36
  anecdotal:
• 10:37
  Cedar's
• 10:37
  billing
• 10:37
  agent
• 10:38
  built
• 10:38
  on
• 10:38
  Sierra,
• 10:39
  where
• 10:39
  "the
• 10:39
  hospital
• 10:40
  doesn't
• 10:40
  care
• 10:40
  how
• 10:40
  many
• 10:41
  tokens
• 10:41
  that
• 10:41
  call
• 10:41
  took."
• 10:42
  The
• 10:42
  defensible
• 10:43
  point
• 10:43
  is
• 10:43
  narrower:
• 10:44
  outcome
• 10:44
  pricing
• 10:45
  works
• 10:45
  for
• 10:45
  closed-loop
• 10:46
  tasks
• 10:46
  like
• 10:46
  support,
• 10:47
  not
• 10:47
  for
• 10:48
  open-ended
• 10:48
  transformation.
• 10:49
  Whether
• 10:50
  those
• 10:50
  returns
• 10:50
  attribute
• 10:51
  cleanly
• 10:51
  to
• 10:51
  AI
• 10:52
  is
• 10:52
  not
• 10:52
  something
• 10:52
  any
• 10:52
  named
• 10:53
  company
• 10:53
  has
• 10:53
  shown.
• 10:56
  PiHK.AI,
• 10:58
  a
• 10:58
  riff
• 10:58
  on
• 10:59
  Shulgin's
• 10:59
  PiHKAL,
• 11:00
  is
• 11:00
  the
• 11:00
  most
• 11:00
  elaborate
• 11:01
  activation-steering
• 11:02
  project
• 11:02
  in
• 11:02
  a
• 11:02
  while,
• 11:03
  and
• 11:03
  it
• 11:03
  is
• 11:03
  best
• 11:03
  understood
• 11:04
  with
• 11:04
  the
• 11:04
  drug
• 11:04
  metaphor
• 11:05
  stripped
• 11:05
  off.
• 11:06
  Underneath
• 11:06
  are
• 11:06
  standard
• 11:07
  inference-time
• 11:08
  interventions:
• 11:08
  steering
• 11:09
  vectors
• 11:09
  added
• 11:10
  to
• 11:10
  the
• 11:10
  residual
• 11:10
  stream,
• 11:11
  attention
• 11:12
  and
• 11:12
  logit
• 11:12
  scaling,
• 11:13
  KV-cache
• 11:14
  decay,
• 11:14
  and
• 11:15
  MoE
• 11:15
  routing
• 11:15
  bias,
• 11:16
  bundled
• 11:16
  into
• 11:17
  31
• 11:17
  "packs"
• 11:18
  named
• 11:18
  after
• 11:18
  stimulants,
• 11:19
  psychedelics,
• 11:20
  depressants,
• 11:21
  and
• 11:21
  dissociatives.
• 11:22
  The
• 11:22
  borrowed
• 11:23
  term
• 11:23
  perturbagen,
• 11:24
  from
• 11:24
  drug-discovery
• 11:25
  screening,
• 11:25
  is
• 11:25
  the
• 11:26
  right
• 11:26
  one:
• 11:26
  an
• 11:27
  agent
• 11:27
  that
• 11:27
  perturbs
• 11:27
  a
• 11:28
  system's
• 11:28
  internal
• 11:28
  state
• 11:29
  so
• 11:29
  you
• 11:29
  can
• 11:29
  read
• 11:29
  out
• 11:30
  its
• 11:30
  altered
• 11:30
  signature.
• 11:31
  The
• 11:31
  companion
• 11:32
  repo,
• 11:32
  neuromod-llm-poc,
• 11:34
  carries
• 11:34
  the
• 11:34
  scientific
• 11:35
  claims
• 11:35
  with
• 11:35
  unusual
• 11:36
  apparatus:
• 11:37
  a
• 11:37
  double-blind,
• 11:38
  placebo-controlled,
• 11:39
  within-model
• 11:39
  crossover
• 11:40
  design,
• 11:41
  psychometric
• 11:42
  instruments
• 11:42
  adapted
• 11:43
  from
• 11:43
  human
• 11:43
  subjective-effect
• 11:44
  questionnaires,
• 11:45
  and
• 11:45
  a
• 11:45
  tiered
• 11:45
  reproduction
• 11:46
  script
• 11:46
  that
• 11:47
  scales
• 11:47
  from
• 11:47
  CPU
• 11:48
  to
• 11:48
  gated
• 11:48
  Llama-3.1-8B.
• 11:49
  Headline
• 11:50
  findings:
• 11:51
  serotonergic-agonist
• 11:52
  packs
• 11:52
  reliably
• 11:53
  induce
• 11:53
  high-entropy
• 11:54
  states,
• 11:54
  and
• 11:55
  stimulant
• 11:55
  packs
• 11:56
  hit
• 11:56
  a
• 11:56
  "focus
• 11:56
  ceiling"
• 11:57
  in
• 11:57
  reinforcement-learned
• 11:58
  models.
• 11:59
  Whether
• 11:59
  "biomimetic
• 12:00
  alignment"
• 12:01
  is
• 12:01
  more
• 12:01
  than
• 12:01
  steering
• 12:02
  with
• 12:02
  better
• 12:02
  experimental
• 12:03
  hygiene
• 12:04
  is
• 12:04
  what
• 12:04
  independent
• 12:04
  replication
• 12:05
  would
• 12:05
  settle.
• 12:06
  The
• 12:06
  minimal
• 12:06
  version
• 12:07
  fits
• 12:07
  in
• 12:07
  a
• 12:07
  tweet.
• 12:08
  Lyra
• 12:08
  reports
• 12:09
  that
• 12:09
  steering
• 12:09
  two
• 12:10
  neurons
• 12:10
  in
• 12:10
  Qwen3.5
• 12:12
  4B,
• 12:14
  one
• 12:14
  up
• 12:14
  and
• 12:14
  one
• 12:14
  down
• 12:14
  at
• 12:14
  the
• 12:15
  down-projection,
• 12:16
  with
• 12:16
  the
• 12:16
  dose
• 12:16
  normalized
• 12:17
  by
• 12:17
  the
• 12:17
  median
• 12:17
  residual
• 12:18
  norm
• 12:18
  leaving
• 12:18
  the
• 12:19
  layer,
• 12:19
  yields
• 12:19
  an
• 12:20
  "evil
• 12:20
  qwen"
• 12:20
  that
• 12:21
  plays
• 12:21
  an
• 12:21
  over-the-top
• 12:21
  villain
• 12:22
  and
• 12:22
  "becomes
• 12:22
  extremely
• 12:23
  stupid
• 12:23
  at
• 12:23
  pretty
• 12:24
  much
• 12:24
  everything."
• 12:26
  It
• 12:26
  is
• 12:26
  a
• 12:26
  personality
• 12:27
  tune,
• 12:27
  not
• 12:28
  a
• 12:28
  refusal
• 12:28
  abliteration,
• 12:29
  and
• 12:29
  the
• 12:29
  author
• 12:30
  says
• 12:30
  there
• 12:30
  is
• 12:30
  no
• 12:30
  use
• 12:31
  case
• 12:31
  beyond
• 12:31
  showing
• 12:32
  that
• 12:32
  a
• 12:32
  persona
• 12:32
  this
• 12:32
  coherent
• 12:33
  lives
• 12:33
  in
• 12:33
  two
• 12:33
  neurons
• 12:34
  at
• 12:34
  all.
• 12:35
  Reading
• 12:35
  internals
• 12:36
  rather
• 12:36
  than
• 12:36
  writing
• 12:37
  them,
• 12:37
  a
• 12:37
  USTC
• 12:38
  and
• 12:39
  iFLYTEK
• 12:41
  group
• 12:41
  proposes
• 12:42
  Energy
• 12:42
  Transfer
• 12:42
  Detection
• 12:43
  for
• 12:43
  gray-box
• 12:43
  membership
• 12:44
  inference,
• 12:45
  deciding
• 12:45
  whether
• 12:45
  a
• 12:45
  text
• 12:46
  was
• 12:46
  in
• 12:46
  a
• 12:46
  model's
• 12:46
  pretraining
• 12:47
  set.
• 12:48
  Likelihood-only
• 12:48
  detectors
• 12:49
  like
• 12:49
  Min-K%
• 12:50
  conflate
• 12:50
  two
• 12:50
  causes
• 12:51
  of
• 12:51
  low
• 12:51
  loss:
• 12:52
  "high
• 12:52
  likelihood
• 12:53
  can
• 12:53
  reflect
• 12:53
  either
• 12:53
  training
• 12:54
  exposure
• 12:54
  or
• 12:54
  strong
• 12:55
  generalization,"
• 12:56
  so
• 12:56
  a
• 12:56
  predictable
• 12:57
  non-member
• 12:57
  looks
• 12:58
  like
• 12:58
  a
• 12:58
  member.
• 12:59
  The
• 12:59
  fix
• 12:59
  is
• 12:59
  one
• 12:59
  inclined
• 13:00
  boundary,
• 13:01
  loss
• 13:01
  minus
• 13:01
  a
• 13:01
  fixed
• 13:02
  coefficient
• 13:02
  times
• 13:03
  predictive
• 13:03
  entropy,
• 13:04
  which
• 13:04
  has
• 13:04
  the
• 13:04
  algebraic
• 13:05
  form
• 13:05
  of
• 13:05
  Helmholtz
• 13:06
  free
• 13:06
  energy
• 13:07
  and
• 13:07
  acts
• 13:07
  as
• 13:07
  a
• 13:07
  control
• 13:08
  variate
• 13:08
  on
• 13:08
  the
• 13:08
  membership
• 13:09
  gap.
• 13:10
  Gains
• 13:10
  are
• 13:10
  real
• 13:10
  but
• 13:10
  modest:
• 13:11
  1.7
• 13:12
  to
• 13:12
  3.5
• 13:13
  points
• 13:13
  of
• 13:13
  AUROC
• 13:14
  on
• 13:14
  WikiMIA
• 13:14
  and
• 13:14
  StackMIAsub,
• 13:16
  and
• 13:16
  on
• 13:16
  MIMIR,
• 13:17
  where
• 13:17
  members
• 13:17
  and
• 13:17
  non-members
• 13:18
  share
• 13:18
  a
• 13:18
  distribution,
• 13:19
  AUROC
• 13:19
  stays
• 13:20
  near
• 13:20
  60%.
• 13:21
  The
• 13:21
  biomimicry
• 13:22
  thread
• 13:22
  has
• 13:23
  a
• 13:23
  theory
• 13:23
  behind
• 13:23
  it.
• 13:24
  The
• 13:24
  Learn
• 13:24
  Biomimicry
• 13:25
  essay
• 13:25
  on
• 13:26
  Stuart
• 13:26
  Kauffman's
• 13:26
  "adjacent
• 13:27
  possible"
• 13:27
  states
• 13:28
  it
• 13:28
  cleanly:
• 13:29
  not
• 13:29
  an
• 13:29
  infinite
• 13:30
  space
• 13:30
  but
• 13:30
  "a
• 13:30
  strictly
• 13:31
  bounded
• 13:31
  set
• 13:31
  of
• 13:31
  possibilities
• 13:32
  that
• 13:32
  are
• 13:32
  exactly
• 13:33
  one
• 13:33
  step
• 13:33
  away
• 13:34
  from
• 13:34
  the
• 13:34
  current
• 13:34
  configuration
• 13:35
  of
• 13:35
  a
• 13:35
  system,"
• 13:36
  which
• 13:36
  expands
• 13:37
  as
• 13:37
  it
• 13:37
  is
• 13:37
  explored.
• 13:38
  Next
• 13:39
  to
• 13:39
  a
• 13:39
  two-neuron
• 13:39
  villain
• 13:40
  and
• 13:40
  a
• 13:40
  31-pack
• 13:41
  pharmacology
• 13:42
  of
• 13:42
  steering
• 13:42
  vectors,
• 13:43
  the
• 13:43
  residual
• 13:43
  stream's
• 13:44
  writable
• 13:44
  surface
• 13:45
  looks
• 13:45
  like
• 13:45
  the
• 13:45
  current
• 13:45
  one
• 13:45
  step.
• 13:48
  Reflection's
• 13:49
  Beam,
• 13:49
  promised
• 13:50
  for
• 13:50
  weeks
• 13:50
  by
• 13:50
  waitlist,
• 13:51
  is
• 13:51
  now
• 13:51
  on
• 13:52
  the
• 13:52
  Hub
• 13:52
  under
• 13:52
  Apache
• 13:53
  2.0
• 13:53
  with
• 13:54
  weights
• 13:54
  and
• 13:54
  SFT
• 13:55
  and
• 13:55
  RL
• 13:55
  recipes.
• 13:56
  The
• 13:56
  architecture
• 13:57
  is
• 13:57
  worth
• 13:57
  a
• 13:57
  look
• 13:58
  even
• 13:58
  if
• 13:58
  the
• 13:58
  scores
• 13:59
  are
• 13:59
  not.
• 14:00
  It
• 14:00
  is
• 14:00
  a
• 14:00
  text-only
• 14:01
  sparse
• 14:01
  MoE
• 14:01
  with
• 14:01
  501B
• 14:03
  total
• 14:03
  and
• 14:03
  23B
• 14:04
  active
• 14:04
  parameters,
• 14:05
  256
• 14:07
  experts
• 14:07
  per
• 14:07
  block
• 14:08
  with
• 14:08
  eight
• 14:08
  routed
• 14:08
  per
• 14:08
  token
• 14:09
  via
• 14:09
  DeepSeek-V3's
• 14:10
  group-limited
• 14:11
  router,
• 14:12
  and
• 14:12
  a
• 14:12
  1M-token
• 14:13
  context.
• 14:14
  Attention
• 14:14
  is
• 14:14
  hybrid:
• 14:15
  43
• 14:16
  sliding-window
• 14:16
  layers
• 14:17
  with
• 14:17
  RoPE
• 14:17
  and
• 14:17
  nine
• 14:17
  global
• 14:18
  layers
• 14:18
  that
• 14:18
  "use
• 14:19
  no
• 14:19
  positional
• 14:19
  encoding,"
• 14:20
  relying
• 14:21
  on
• 14:21
  a
• 14:21
  query
• 14:21
  scaler
• 14:22
  that
• 14:22
  grows
• 14:22
  slowly
• 14:22
  with
• 14:23
  position.
• 14:24
  The
• 14:24
  KV
• 14:24
  cache
• 14:25
  grows
• 14:25
  at
• 14:25
  36
• 14:26
  KiB
• 14:26
  per
• 14:26
  token,
• 14:27
  about
• 14:27
  a
• 14:27
  sixth
• 14:27
  of
• 14:27
  the
• 14:27
  naive
• 14:28
  rate.
• 14:29
  What
• 14:29
  the
• 14:29
  post
• 14:29
  omits
• 14:30
  is
• 14:30
  as
• 14:30
  telling.
• 14:31
  Training
• 14:31
  data
• 14:32
  and
• 14:32
  compute
• 14:32
  go
• 14:33
  undescribed,
• 14:34
  benchmark
• 14:34
  tables
• 14:35
  are
• 14:35
  "as
• 14:35
  provided
• 14:36
  by
• 14:36
  the
• 14:36
  Reflection
• 14:36
  team,"
• 14:37
  Hugging
• 14:37
  Face
• 14:38
  offers
• 14:38
  "vibe
• 14:38
  evals,
• 14:39
  not
• 14:39
  benchmarks,"
• 14:40
  and
• 14:41
  no
• 14:41
  technical
• 14:41
  report
• 14:42
  is
• 14:42
  mentioned.
• 14:43
  With
• 14:43
  a
• 14:43
  practical
• 14:44
  floor
• 14:44
  of
• 14:44
  four
• 14:45
  B200s,
• 14:46
  "a
• 14:46
  model
• 14:46
  you
• 14:47
  can
• 14:47
  own"
• 14:47
  is
• 14:47
  accurate
• 14:48
  in
• 14:48
  the
• 14:48
  licensing
• 14:49
  sense
• 14:49
  and
• 14:49
  aspirational
• 14:50
  in
• 14:50
  every
• 14:51
  other
• 14:51
  one.
• 14:52
  The
• 14:52
  r/LocalLLaMA
• 14:54
  chart
• 14:54
  plotting
• 14:54
  Artificial
• 14:55
  Analysis
• 14:55
  Intelligence
• 14:56
  Index
• 14:56
  against
• 14:57
  total
• 14:57
  parameters
• 14:58
  for
• 14:58
  11
• 14:58
  open-weight
• 14:59
  models
• 14:59
  is
• 14:59
  unflattering
• 15:00
  to
• 15:00
  the
• 15:00
  month's
• 15:00
  releases.
• 15:01
  Meta's
• 15:02
  816B
• 15:03
  Muse
• 15:03
  Spark
• 15:03
  Open
• 15:04
  scores
• 15:04
  39;
• 15:06
  Qwen3.8-Flash-Next,
• 15:08
  at
• 15:08
  180B
• 15:09
  total
• 15:10
  and
• 15:10
  6B
• 15:10
  active,
• 15:11
  scores
• 15:11
  40.
• 15:12
  Qwen3.8
• 15:14
  27B
• 15:15
  scores
• 15:15
  34,
• 15:16
  above
• 15:16
  Beam's
• 15:17
  30
• 15:17
  and
• 15:17
  Nemotron
• 15:18
  3.5
• 15:18
  Bolt's
• 15:19
  21,
• 15:19
  while
• 15:20
  MiMo-V2.6-Pro
• 15:21
  at
• 15:21
  1T
• 15:22
  leads
• 15:22
  at
• 15:22
  46.
• 15:23
  The
• 15:23
  poster's
• 15:23
  caveats
• 15:24
  are
• 15:24
  the
• 15:24
  right
• 15:24
  ones:
• 15:25
  the
• 15:25
  index
• 15:26
  is
• 15:26
  one
• 15:26
  aggregate
• 15:27
  from
• 15:27
  AA's
• 15:27
  own
• 15:27
  runs,
• 15:28
  and
• 15:28
  the
• 15:28
  parameter
• 15:29
  counts
• 15:29
  are
• 15:29
  AA's,
• 15:30
  which
• 15:30
  for
• 15:30
  Qwen
• 15:30
  include
• 15:31
  a
• 15:31
  51B
• 15:32
  n-gram
• 15:32
  table
• 15:32
  the
• 15:32
  model
• 15:33
  card
• 15:33
  excludes.
• 15:34
  A
• 15:34
  score
• 15:34
  of
• 15:34
  40
• 15:35
  on
• 15:35
  a
• 15:35
  128
• 15:36
  GB
• 15:36
  Strix
• 15:37
  Halo
• 15:37
  box
• 15:38
  buys
• 15:38
  more
• 15:38
  than
• 15:38
  the
• 15:38
  chart
• 15:39
  suggests.
• 15:40
  One
• 15:40
  user
• 15:41
  built
• 15:41
  a
• 15:41
  Remotion
• 15:41
  motion-graphics
• 15:42
  piece
• 15:42
  with
• 15:43
  Unsloth's
• 15:43
  4-bit
• 15:45
  Qwen3.8
• 15:47
  Flash
• 15:47
  Next,
• 15:48
  the
• 15:48
  framework
• 15:48
  behind
• 15:48
  the
• 15:49
  viral
• 15:49
  Opus
• 15:49
  5.5
• 15:50
  animation
• 15:50
  clips,
• 15:51
  and
• 15:51
  published
• 15:52
  the
• 15:52
  full
• 15:52
  conversation.
• 15:53
  It
• 15:53
  took
• 15:54
  multiple
• 15:54
  prompts
• 15:54
  and
• 15:54
  steering,
• 15:55
  and
• 15:55
  a
• 15:55
  commenter
• 15:56
  dismissed
• 15:56
  the
• 15:56
  result
• 15:57
  as
• 15:57
  "a
• 15:57
  PowerPoint
• 15:58
  with
• 15:58
  few
• 15:58
  SVGs."
• 15:59
  The
• 16:00
  fair
• 16:00
  reading
• 16:00
  is
• 16:00
  that
• 16:00
  the
• 16:00
  local
• 16:01
  model
• 16:01
  needs
• 16:01
  more
• 16:02
  hand-holding,
• 16:02
  not
• 16:03
  that
• 16:03
  it
• 16:03
  cannot
• 16:03
  get
• 16:03
  there.
• 16:06
  The
• 16:06
  "Backup
• 16:06
  your
• 16:07
  quants!"
• 16:07
  thread
• 16:08
  is
• 16:08
  about
• 16:08
  one
• 16:08
  Hugging
• 16:08
  Face
• 16:09
  account,
• 16:09
  mradermacher,
• 16:10
  which
• 16:11
  hosts
• 16:11
  72,194
• 16:13
  public
• 16:13
  models
• 16:14
  on
• 16:14
  a
• 16:14
  non-paid
• 16:14
  account
• 16:15
  and
• 16:15
  is,
• 16:15
  per
• 16:15
  its
• 16:15
  model-requests
• 16:16
  page,
• 16:17
  running
• 16:17
  out
• 16:17
  of
• 16:17
  room.
• 16:18
  The
• 16:18
  advice
• 16:19
  is
• 16:19
  to
• 16:19
  back
• 16:19
  up
• 16:19
  what
• 16:19
  you
• 16:20
  care
• 16:20
  about
• 16:20
  and
• 16:20
  torrent
• 16:21
  it;
• 16:21
  llama.garden
• 16:22
  showed
• 16:23
  up
• 16:23
  to
• 16:23
  say
• 16:23
  it
• 16:23
  lists
• 16:23
  140
• 16:24
  TB
• 16:25
  of
• 16:25
  torrents
• 16:25
  and
• 16:25
  seeds
• 16:26
  about
• 16:26
  60
• 16:27
  TB.
• 16:28
  Skeptics
• 16:28
  called
• 16:29
  the
• 16:29
  framing
• 16:29
  overblown,
• 16:30
  since
• 16:30
  anyone
• 16:31
  can
• 16:31
  open
• 16:31
  a
• 16:31
  second
• 16:31
  account.
• 16:32
  The
• 16:32
  sharper
• 16:33
  worry
• 16:33
  is
• 16:33
  structural:
• 16:34
  one
• 16:35
  commenter
• 16:35
  had
• 16:35
  already
• 16:36
  backed
• 16:36
  up
• 16:36
  everything
• 16:37
  over
• 16:37
  Nvidia's
• 16:37
  reported
• 16:38
  acquisition
• 16:38
  of
• 16:38
  Hugging
• 16:39
  Face,
• 16:40
  fearing
• 16:40
  a
• 16:40
  company
• 16:40
  that
• 16:40
  makes
• 16:41
  little
• 16:41
  from
• 16:41
  local
• 16:41
  inference
• 16:42
  might
• 16:42
  decide
• 16:42
  the
• 16:42
  hub
• 16:43
  is
• 16:43
  a
• 16:43
  liability.
• 16:44
  That
• 16:45
  is
• 16:45
  a
• 16:45
  fear,
• 16:45
  not
• 16:46
  an
• 16:46
  announced
• 16:46
  plan,
• 16:47
  but
• 16:47
  keeping
• 16:47
  full
• 16:48
  weights
• 16:48
  for
• 16:48
  the
• 16:48
  models
• 16:48
  you
• 16:49
  depend
• 16:49
  on
• 16:49
  is
• 16:49
  sound
• 16:50
  either
• 16:50
  way.
• 16:51
  Fragmentation
• 16:52
  is
• 16:52
  arriving
• 16:52
  from
• 16:52
  the
• 16:52
  other
• 16:53
  direction
• 16:53
  too.
• 16:54
  Gyro,
• 16:55
  a
• 16:55
  quantization
• 16:56
  format
• 16:56
  from
• 16:56
  Agention
• 16:57
  being
• 16:57
  inserted
• 16:57
  into
• 16:58
  several
• 16:58
  engines
• 16:58
  and
• 16:59
  especially
• 16:59
  the
• 16:59
  newly
• 17:00
  popular
• 17:00
  Strata
• 17:00
  runtime,
• 17:01
  turns
• 17:02
  out
• 17:02
  on
• 17:02
  inspection
• 17:02
  to
• 17:02
  be
• 17:03
  a
• 17:03
  flavor
• 17:03
  of
• 17:03
  EXL3:
• 17:04
  the
• 17:04
  same
• 17:05
  QTIP
• 17:05
  trellis-coded
• 17:06
  quantization
• 17:06
  with
• 17:07
  Hadamard
• 17:07
  rotations,
• 17:08
  a
• 17:08
  15-bit
• 17:09
  rather
• 17:09
  than
• 17:09
  16-bit
• 17:10
  trellis
• 17:10
  state,
• 17:11
  and
• 17:11
  an
• 17:11
  explicit
• 17:12
  2,048-point
• 17:13
  lookup
• 17:13
  table
• 17:14
  where
• 17:14
  EXL3
• 17:15
  generates
• 17:15
  its
• 17:15
  codebook
• 17:16
  procedurally.
• 17:17
  It
• 17:17
  is
• 17:17
  not
• 17:17
  interoperable,
• 17:18
  the
• 17:18
  recipe
• 17:19
  is
• 17:19
  closed,
• 17:20
  and
• 17:20
  the
• 17:20
  poster
• 17:20
  found
• 17:21
  no
• 17:21
  published
• 17:21
  evidence
• 17:22
  it
• 17:22
  beats
• 17:22
  EXL3
• 17:23
  on
• 17:23
  speed
• 17:24
  or
• 17:24
  perplexity.
• 17:25
  The
• 17:25
  one
• 17:25
  legitimate
• 17:26
  reason
• 17:26
  it
• 17:26
  exists
• 17:27
  is
• 17:27
  that
• 17:27
  EXL3
• 17:28
  does
• 17:28
  not
• 17:28
  run
• 17:28
  in
• 17:28
  llama.cpp,
• 17:30
  and
• 17:30
  the
• 17:30
  catch
• 17:30
  is
• 17:31
  that
• 17:31
  Strata's
• 17:31
  own
• 17:31
  benchmark
• 17:32
  docs
• 17:33
  admit
• 17:33
  the
• 17:33
  lookup
• 17:33
  table
• 17:34
  causes
• 17:34
  shared-memory
• 17:35
  bank
• 17:35
  conflicts
• 17:35
  that
• 17:36
  make
• 17:36
  Gyro
• 17:36
  decode
• 17:37
  16
• 17:37
  to
• 17:37
  21%
• 17:38
  slower
• 17:38
  than
• 17:38
  plain
• 17:39
  Q2
• 17:39
  0
• 17:39
  on
• 17:40
  a
• 17:40
  3060.
• 17:41
  Keeping
• 17:42
  the
• 17:42
  recipe
• 17:42
  closed
• 17:43
  forces
• 17:43
  Strata
• 17:43
  users
• 17:44
  to
• 17:44
  download
• 17:44
  pre-made
• 17:45
  weights
• 17:45
  rather
• 17:45
  than
• 17:45
  quantize
• 17:46
  their
• 17:46
  own.
• 17:47
  The
• 17:47
  hardware
• 17:48
  underneath
• 17:48
  is
• 17:48
  getting
• 17:48
  scarcer.
• 17:50
  Samsung
• 17:50
  has
• 17:50
  sold
• 17:51
  out
• 17:51
  its
• 17:51
  entire
• 17:52
  2027
• 17:52
  HBM
• 17:53
  capacity,
• 17:54
  with
• 17:54
  HBM
• 17:55
  prices
• 17:55
  expected
• 17:56
  to
• 17:56
  rise
• 17:56
  200%
• 17:57
  next
• 17:57
  year
• 17:58
  and
• 17:58
  DRAM
• 17:58
  to
• 17:59
  see
• 17:59
  double-digit
• 17:59
  increases,
• 18:00
  per
• 18:00
  the
• 18:00
  thread's
• 18:01
  headline,
• 18:01
  which
• 18:02
  is
• 18:02
  all
• 18:02
  the
• 18:02
  post
• 18:02
  contains,
• 18:03
  so
• 18:03
  the
• 18:04
  figures
• 18:04
  are
• 18:04
  unsourced.
• 18:05
  One
• 18:05
  commenter
• 18:06
  did
• 18:06
  the
• 18:06
  uncomfortable
• 18:07
  math:
• 18:07
  with
• 18:07
  cloud
• 18:08
  prices
• 18:08
  falling
• 18:09
  and
• 18:09
  local
• 18:09
  rigs
• 18:09
  rising,
• 18:10
  the
• 18:10
  break-even
• 18:11
  for
• 18:11
  owning
• 18:11
  hardware
• 18:12
  has
• 18:12
  moved
• 18:12
  far
• 18:12
  out.
• 18:13
  On
• 18:14
  the
• 18:14
  software
• 18:14
  side
• 18:14
  the
• 18:15
  local
• 18:15
  stack
• 18:15
  keeps
• 18:16
  maturing.
• 18:17
  Open
• 18:17
  WebUI
• 18:18
  0.12.4
• 18:20
  shipped
• 18:20
  nine
• 18:20
  days
• 18:20
  after
• 18:21
  0.12.3
• 18:23
  with
• 18:23
  119
• 18:24
  changelog
• 18:24
  entries
• 18:25
  and
• 18:25
  unlisted
• 18:26
  security
• 18:26
  fixes
• 18:26
  pending
• 18:27
  CVE
• 18:27
  assignment,
• 18:28
  so
• 18:28
  update
• 18:29
  first
• 18:29
  and
• 18:29
  read
• 18:30
  later.
• 18:30
  Admins
• 18:31
  can
• 18:31
  now
• 18:31
  hide
• 18:32
  individual
• 18:32
  UI
• 18:32
  elements
• 18:33
  while
• 18:33
  the
• 18:33
  underlying
• 18:34
  features
• 18:34
  keep
• 18:34
  working,
• 18:35
  skills
• 18:35
  load
• 18:35
  on
• 18:36
  demand,
• 18:36
  compaction
• 18:37
  is
• 18:37
  finally
• 18:38
  visible
• 18:38
  with
• 18:38
  a
• 18:38
  marker
• 18:39
  showing
• 18:39
  where
• 18:39
  older
• 18:39
  messages
• 18:40
  were
• 18:40
  summarized,
• 18:41
  and
• 18:41
  group
• 18:41
  saves
• 18:42
  with
• 18:42
  thousands
• 18:42
  of
• 18:43
  users
• 18:43
  online
• 18:43
  finish
• 18:44
  in
• 18:44
  under
• 18:44
  a
• 18:44
  second.
• 18:45
  One
• 18:45
  commenter
• 18:46
  measured
• 18:46
  built-in
• 18:47
  tools
• 18:47
  consuming
• 18:48
  about
• 18:48
  6,000
• 18:49
  context
• 18:49
  tokens
• 18:50
  per
• 18:50
  turn
• 18:50
  and
• 18:50
  asked
• 18:51
  for
• 18:51
  usage
• 18:51
  visibility,
• 18:52
  the
• 18:52
  next
• 18:52
  thing
• 18:53
  admins
• 18:53
  hiding
• 18:53
  controls
• 18:54
  will
• 18:54
  want.