Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – June 02, 2026
Transcript
- 0:00An
- 0:0018-year-old
- 0:00heap
- 0:01buffer
- 0:01overflow
- 0:01in
- 0:01NGINX's
- 0:02ngx
- 0:02http
- 0:03rewrite
- 0:04module
- 0:04has
- 0:04been
- 0:04sitting
- 0:04in
- 0:05production
- 0:05since
- 0:052008,
- 0:06and
- 0:06it's
- 0:07a
- 0:07full
- 0:07unauthenticated
- 0:07RCE.
- 0:09CVE-2026-42945
- 0:12exploits
- 0:12a
- 0:12mismatch
- 0:13between
- 0:13NGINX's
- 0:13two-pass
- 0:14script
- 0:14engine:
- 0:15the
- 0:15length-calculation
- 0:16pass
- 0:16runs
- 0:16on
- 0:17a
- 0:17freshly
- 0:17zeroed
- 0:17sub-engine
- 0:18where
- 0:18is
- 0:18args
- 0:18is
- 0:180,
- 0:19so
- 0:19it
- 0:19returns
- 0:20the
- 0:20raw
- 0:20capture
- 0:20length.
- 0:21The
- 0:21copy
- 0:22pass
- 0:22sees
- 0:22is
- 0:22args
- 0:23=
- 0:231
- 0:23from
- 0:24the
- 0:24parent
- 0:24engine
- 0:25and
- 0:25calls
- 0:25ngx
- 0:25escape
- 0:26uri
- 0:26with
- 0:26NGX
- 0:27ESCAPE
- 0:27ARGS,
- 0:28expanding
- 0:29each
- 0:29escapable
- 0:29byte
- 0:30to
- 0:30three
- 0:30bytes.
- 0:31The
- 0:31copy
- 0:31overflows
- 0:32the
- 0:32undersized
- 0:32heap
- 0:32buffer
- 0:33with
- 0:33attacker-controlled
- 0:34URI
- 0:34data.
- 0:35Exploitation
- 0:36uses
- 0:36cross-request
- 0:37heap
- 0:37feng
- 0:37shui
- 0:37—
- 0:38spraying
- 0:38ngx
- 0:39pool
- 0:39t
- 0:39structures
- 0:40via
- 0:40POST
- 0:40bodies
- 0:40to
- 0:40corrupt
- 0:41an
- 0:41adjacent
- 0:41pool's
- 0:42cleanup
- 0:42pointer,
- 0:43redirecting
- 0:43it
- 0:43to
- 0:43a
- 0:44fake
- 0:44cleanup
- 0:44handler
- 0:44that
- 0:44invokes
- 0:45system().
- 0:46Every
- 0:46NGINX
- 0:47Open
- 0:47Source
- 0:47build
- 0:47from
- 0:480.6.27
- 0:49through
- 0:491.30.0,
- 0:51and
- 0:51NGINX
- 0:52Plus
- 0:52R32
- 0:53through
- 0:53R36,
- 0:54is
- 0:54affected.
- 0:55The
- 0:55vulnerability
- 0:56was
- 0:56autonomously
- 0:56discovered
- 0:57by
- 0:57DepthFirst's
- 0:58security
- 0:58analysis
- 0:58system
- 0:59along
- 0:59with
- 0:59three
- 1:00additional
- 1:00memory
- 1:00corruption
- 1:01issues
- 1:04(CVE-2026-42946,
- 1:07CVE-2026-40701,
- 1:10CVE-2026-42934),
- 1:14all
- 1:14from
- 1:14a
- 1:14single
- 1:14onboarding
- 1:15of
- 1:15the
- 1:15NGINX
- 1:16source
- 1:16.
- 1:16The
- 1:17IoT
- 1:17security
- 1:17narrative
- 1:18got
- 1:18another
- 1:18chapter
- 1:19courtesy
- 1:19of
- 1:19a
- 1:19Honeywell
- 1:20X2S
- 1:20smart
- 1:20thermostat
- 1:21teardown.
- 1:22The
- 1:22device
- 1:22packs
- 1:23a
- 1:23200
- 1:23MHz
- 1:24Renesas
- 1:24Cortex-M33
- 1:26with
- 1:26TrustZone
- 1:26and
- 1:26a
- 1:26Realtek
- 1:27RTL8721DM
- 1:29Wi-Fi/BLE
- 1:30SoC
- 1:32—
- 1:34two
- 1:34brains,
- 1:35two
- 1:35Winbond
- 1:36flash
- 1:36chips,
- 1:36all
- 1:37encrypted.
- 1:38Cracking
- 1:38the
- 1:38Realtek
- 1:39turned
- 1:39out
- 1:39to
- 1:39be
- 1:39trivially
- 1:40easy
- 1:40using
- 1:41its
- 1:41own
- 1:41RSIP
- 1:42decrypt-on-the-fly
- 1:43feature,
- 1:43which
- 1:44led
- 1:44to
- 1:44the
- 1:44discovery
- 1:45of
- 1:45a
- 1:45TLS
- 1:45certificate
- 1:46issue
- 1:46enabling
- 1:47man-in-the-middle
- 1:47attacks
- 1:48and
- 1:48a
- 1:48seeding
- 1:49bug
- 1:49that
- 1:49makes
- 1:49session
- 1:50key
- 1:50recovery
- 1:50possible.
- 1:51The
- 1:51Renesas
- 1:52firmware
- 1:52still
- 1:53needs
- 1:53decrypting,
- 1:54but
- 1:54the
- 1:54partial
- 1:55results
- 1:55are
- 1:55already
- 1:56damning
- 1:56enough
- 1:56to
- 1:56confirm
- 1:57that
- 1:57the
- 1:57"S"
- 1:58in
- 1:58IoT
- 1:58still
- 1:58stands
- 1:59for
- 1:59"security"
- 1:59.
- 2:00On
- 2:00the
- 2:00defensive
- 2:01side,
- 2:01a
- 2:01new
- 2:01open-source
- 2:02tool
- 2:02called
- 2:03lockbit-rescue
- 2:04exploits
- 2:04the
- 2:05documented
- 2:05keystream-reuse
- 2:06weakness
- 2:06in
- 2:07LockBit
- 2:073.0
- 2:08("Black")
- 2:09to
- 2:09decrypt
- 2:10files
- 2:10without
- 2:11the
- 2:11attacker's
- 2:11private
- 2:11key.
- 2:13LockBit's
- 2:13file
- 2:13encryption
- 2:14uses
- 2:14a
- 2:14modified
- 2:15Salsa20
- 2:15cipher
- 2:16where
- 2:16the
- 2:16same
- 2:17keystream
- 2:17gets
- 2:17reused
- 2:18across
- 2:18files
- 2:19in
- 2:19an
- 2:19encryption
- 2:19batch.
- 2:21The
- 2:21tool
- 2:21groups
- 2:21encrypted
- 2:22files
- 2:22by
- 2:22their
- 2:22RSA-encrypted
- 2:25KEK
- 2:25fingerprint,
- 2:26picks
- 2:26the
- 2:26longest-named
- 2:27file
- 2:27in
- 2:27each
- 2:27group
- 2:28as
- 2:28a
- 2:28known-plaintext
- 2:29oracle
- 2:29(the
- 2:30original
- 2:30filename
- 2:31is
- 2:31apLib-compressed
- 2:33UTF-16LE
- 2:35in
- 2:35the
- 2:35footer),
- 2:36XORs
- 2:36it
- 2:36against
- 2:37ciphertext
- 2:37to
- 2:37recover
- 2:38keystream
- 2:38bytes,
- 2:39and
- 2:39decrypts
- 2:40every
- 2:40other
- 2:40file
- 2:40in
- 2:41the
- 2:41group
- 2:41whose
- 2:41footer
- 2:41fits
- 2:42within
- 2:42the
- 2:42recovered
- 2:42coverage.
- 2:43Real-world
- 2:44recovery
- 2:44rates
- 2:45run
- 2:455–40%
- 2:47depending
- 2:47on
- 2:47original
- 2:48filename
- 2:48lengths,
- 2:49and
- 2:49a
- 2:49Phase
- 2:502
- 2:50brute-force
- 2:50extension
- 2:51can
- 2:51push
- 2:51further
- 2:52by
- 2:52climbing
- 2:52a
- 2:52ladder
- 2:53of
- 2:53intermediate
- 2:53files.
- 2:54It's
- 2:55resumable,
- 2:55read-only
- 2:56on
- 2:56source
- 2:56files,
- 2:57and
- 2:57includes
- 2:58a
- 2:58libmagic-based
- 2:59verification
- 2:59sweep
- 3:00.
- 3:02A
- 3:02new
- 3:03paper
- 3:03on
- 3:03the
- 3:03Elliptic
- 3:03Bitcoin
- 3:04Dataset
- 3:04delivers
- 3:05one
- 3:05of
- 3:05the
- 3:05cleaner
- 3:05methodological
- 3:06takedowns
- 3:07in
- 3:07recent
- 3:07fraud-detection
- 3:08literature.
- 3:09The
- 3:09consensus
- 3:09that
- 3:10GCN,
- 3:10GraphSAGE,
- 3:11GAT,
- 3:11and
- 3:11EvolveGCN
- 3:12beat
- 3:12feature-only
- 3:13baselines
- 3:13on
- 3:14Elliptic
- 3:14has
- 3:14been
- 3:15cited
- 3:15for
- 3:15years
- 3:15—
- 3:16GCN
- 3:17at
- 3:17F1=0.70,
- 3:19GraphSAGE+SSL
- 3:21at
- 3:210.75,
- 3:22EvolveGCN
- 3:23at
- 3:230.77.
- 3:25Those
- 3:25numbers
- 3:26are
- 3:26artifacts
- 3:26of
- 3:26the
- 3:26evaluation
- 3:27protocol,
- 3:27not
- 3:28evidence
- 3:28that
- 3:28graph
- 3:28structure
- 3:29helps
- 3:29detect
- 3:29fraud.
- 3:31Every
- 3:31prior
- 3:31Elliptic
- 3:32study
- 3:32trains
- 3:32with
- 3:32transductive
- 3:33message
- 3:33passing,
- 3:34meaning
- 3:34the
- 3:34full
- 3:34graph
- 3:34—
- 3:36including
- 3:36test-period
- 3:36nodes
- 3:37and
- 3:37edges
- 3:37—
- 3:38is
- 3:38visible
- 3:38at
- 3:39every
- 3:39training
- 3:39forward
- 3:39pass.
- 3:41Several
- 3:41setups
- 3:41labeled
- 3:42"inductive"
- 3:43still
- 3:43leak
- 3:44test-period
- 3:44statistics
- 3:45through
- 3:45batch
- 3:45normalization
- 3:46and
- 3:46neighborhood
- 3:46aggregation.
- 3:48When
- 3:49the
- 3:49authors
- 3:49run
- 3:49a
- 3:49strictly
- 3:50inductive
- 3:50protocol
- 3:51(encoder
- 3:51trained
- 3:52only
- 3:52on
- 3:52the
- 3:52time-step
- 3:52≤
- 3:5334
- 3:53subgraph,
- 3:54with
- 3:5410
- 3:54seeds
- 3:55and
- 3:55per-timestep
- 3:55reporting),
- 3:56Random
- 3:57Forest
- 3:57on
- 3:57the
- 3:57raw
- 3:57165-dimensional
- 3:59features
- 3:59reaches
- 4:00F1=0.821
- 4:02and
- 4:02beats
- 4:02every
- 4:03GNN
- 4:03tested.
- 4:04GraphSAGE,
- 4:05the
- 4:05strongest
- 4:05graph
- 4:06encoder
- 4:06under
- 4:06strict
- 4:07inductive
- 4:07evaluation,
- 4:08manages
- 4:09only
- 4:09F1=0.689
- 4:10±
- 4:120.017.
- 4:14A
- 4:14paired
- 4:14controlled
- 4:14experiment
- 4:15quantifies
- 4:15the
- 4:15leakage
- 4:16directly:
- 4:17across
- 4:1710
- 4:17matched
- 4:18seeds
- 4:18holding
- 4:18architecture,
- 4:19optimizer,
- 4:20loss,
- 4:21and
- 4:21seed
- 4:21constant,
- 4:22GraphSAGE
- 4:23scores
- 4:23F1=0.294
- 4:26transductively
- 4:26versus
- 4:27F1=0.689
- 4:28inductively
- 4:29—
- 4:31a
- 4:3139.5-point
- 4:32gap
- 4:33(Cohen's
- 4:33d
- 4:34=
- 4:3415.8,
- 4:35p
- 4:35=
- 4:362.6
- 4:37×
- 4:3710⁻¹²)
- 4:38explained
- 4:39entirely
- 4:39by
- 4:39training-time
- 4:40exposure
- 4:40to
- 4:40test-period
- 4:41adjacency.
- 4:42The
- 4:42edge-shuffle
- 4:43ablation
- 4:43is
- 4:43perhaps
- 4:44the
- 4:44most
- 4:44devastating
- 4:44finding.
- 4:46Randomly
- 4:46shuffled
- 4:46edges
- 4:47outperform
- 4:47the
- 4:47real
- 4:48transaction
- 4:48graph
- 4:48by
- 4:488.9
- 4:49F1
- 4:49points,
- 4:50and
- 4:50removing
- 4:51edges
- 4:51entirely
- 4:51still
- 4:52beats
- 4:52real
- 4:52edges
- 4:52by
- 4:532.5
- 4:53points.
- 4:54The
- 4:55original
- 4:55graph's
- 4:55mean
- 4:56degree
- 4:56of
- 4:562.3
- 4:57produces
- 4:57neighborhoods
- 4:58that
- 4:58are
- 4:58simultaneously
- 4:59sparse
- 4:59and
- 5:00semantically
- 5:00misleading
- 5:01under
- 5:01temporal
- 5:01shift
- 5:01—
- 5:02each
- 5:02fraud
- 5:03node
- 5:03is
- 5:03surrounded
- 5:03by
- 5:04licit
- 5:04counterparties,
- 5:05so
- 5:05message
- 5:05passing
- 5:06actively
- 5:06pulls
- 5:07fraud
- 5:07representations
- 5:08toward
- 5:08the
- 5:08licit
- 5:08manifold.
- 5:09The
- 5:10paper's
- 5:10feature
- 5:10attribution
- 5:11confirms
- 5:11where
- 5:11the
- 5:12discriminative
- 5:12signal
- 5:12actually
- 5:13lives:
- 5:14local
- 5:14features
- 5:14account
- 5:15for
- 5:1582.4%
- 5:16of
- 5:16total
- 5:17Random
- 5:17Forest
- 5:18importance,
- 5:19and
- 5:19the
- 5:19top
- 5:19five
- 5:19features
- 5:20are
- 5:20all
- 5:20local.
- 5:21A
- 5:21concatenation
- 5:22hybrid
- 5:22of
- 5:22GraphSAGE
- 5:23embeddings
- 5:23and
- 5:24raw
- 5:24features
- 5:24drops
- 5:25from
- 5:25the
- 5:25previously
- 5:25reported
- 5:26F1=0.807
- 5:29to
- 5:300.699
- 5:31under
- 5:31the
- 5:31clean
- 5:31protocol,
- 5:32and
- 5:32the
- 5:33GNN
- 5:33contributes
- 5:34only
- 5:34+0.018
- 5:35F1
- 5:36over
- 5:37a
- 5:37matched-capacity
- 5:38MLP
- 5:38—
- 5:39real,
- 5:39reliable,
- 5:40and
- 5:40practically
- 5:41inconsequential.
- 5:43For
- 5:43anyone
- 5:44building
- 5:44fraud
- 5:44pipelines
- 5:45on
- 5:45transaction
- 5:45graphs:
- 5:46test
- 5:47under
- 5:47strict
- 5:47inductive
- 5:48protocol
- 5:48before
- 5:49you
- 5:49invest
- 5:49in
- 5:49graph
- 5:49machinery,
- 5:50because
- 5:51the
- 5:51feature
- 5:51engineering
- 5:52you
- 5:52already
- 5:52have
- 5:52might
- 5:53be
- 5:53the
- 5:53strongest
- 5:53signal
- 5:54in
- 5:54the
- 5:54room
- 5:54.
- 5:57Someone
- 5:58went
- 5:58spelunking
- 5:58through
- 5:59Claude
- 5:59Code's
- 5:59node
- 5:59modules
- 6:00and
- 6:00surfaced
- 6:01a
- 6:01surprisingly
- 6:01deep
- 6:01configuration
- 6:02surface
- 6:02area
- 6:03that
- 6:03the
- 6:03official
- 6:03docs
- 6:04never
- 6:04mention.
- 6:05The
- 6:05auto-mode
- 6:05permission
- 6:06system
- 6:06is
- 6:06internally
- 6:07called
- 6:07the
- 6:07"YOLO
- 6:07Classifier"
- 6:08(that's
- 6:08the
- 6:09actual
- 6:09variable
- 6:09name
- 6:09in
- 6:10yoloClassifier.ts),
- 6:13and
- 6:14it
- 6:14accepts
- 6:14plain
- 6:14English
- 6:15environment
- 6:15descriptions
- 6:15—
- 6:16strings
- 6:16like
- 6:16"this
- 6:16is
- 6:17a
- 6:17staging
- 6:17server,
- 6:17destructive
- 6:18operations
- 6:18are
- 6:18acceptable"
- 6:19—
- 6:19that
- 6:19the
- 6:19classifier
- 6:20reads
- 6:20to
- 6:20decide
- 6:21what
- 6:21gets
- 6:21auto-approved.
- 6:22PreToolUse
- 6:22hooks
- 6:23can
- 6:23return
- 6:23updatedInput
- 6:24to
- 6:24rewrite
- 6:24commands
- 6:25mid-flight
- 6:25(so
- 6:26git
- 6:26push
- 6:26silently
- 6:26becomes
- 6:27git
- 6:27push
- 6:27--dry-run),
- 6:28permissionDecision
- 6:29to
- 6:29force
- 6:29allow/deny
- 6:30without
- 6:31user
- 6:31prompts,
- 6:31and
- 6:32additionalContext
- 6:32to
- 6:32inject
- 6:33text
- 6:33into
- 6:33the
- 6:33conversation.
- 6:35Three
- 6:35undocumented
- 6:36hook
- 6:36fields
- 6:36change
- 6:36behavior
- 6:37fundamentally:
- 6:38once:
- 6:38true
- 6:39fires
- 6:39a
- 6:39hook
- 6:39exactly
- 6:40once
- 6:40then
- 6:40auto-removes
- 6:40it,
- 6:42async:
- 6:42true
- 6:42runs
- 6:43hooks
- 6:43in
- 6:43the
- 6:43background
- 6:44without
- 6:44blocking,
- 6:44and
- 6:44asyncRewake:
- 6:45true
- 6:45runs
- 6:46non-blocking
- 6:46but
- 6:47wakes
- 6:47the
- 6:47model
- 6:47and
- 6:47blocks
- 6:48if
- 6:48the
- 6:48hook
- 6:48exits
- 6:48with
- 6:48code
- 6:492
- 6:49—
- 6:49non-blocking
- 6:50on
- 6:50the
- 6:50happy
- 6:50path,
- 6:51blocking
- 6:51when
- 6:51something's
- 6:52wrong.
- 6:52Custom
- 6:53agents
- 6:53support
- 6:53persistent
- 6:54memory
- 6:54across
- 6:54invocations
- 6:55(user,
- 6:56project,
- 6:56or
- 6:56local
- 6:57scopes),
- 6:57omitClaudeMd:
- 6:58true
- 6:59for
- 6:59"fresh
- 6:59eyes"
- 6:59reviews,
- 7:00and
- 7:00a
- 7:00criticalSystemReminder
- 7:01EXPERIMENTAL
- 7:02field
- 7:02that
- 7:02gets
- 7:02re-injected
- 7:03at
- 7:03every
- 7:03turn
- 7:04even
- 7:04after
- 7:04context
- 7:05compaction.
- 7:06Two
- 7:06undocumented
- 7:07settings.json
- 7:07fields
- 7:08—
- 7:09autoMemoryEnabled
- 7:10and
- 7:10autoDreamEnabled
- 7:11—
- 7:12activate
- 7:12a
- 7:12compound
- 7:13learning
- 7:13loop:
- 7:13sessions
- 7:14produce
- 7:14memories,
- 7:15dreams
- 7:15consolidate
- 7:15them
- 7:16every
- 7:1624
- 7:16hours,
- 7:17and
- 7:17consolidated
- 7:18memories
- 7:18inform
- 7:18future
- 7:19sessions
- 7:19.
- 7:20The
- 7:20configuration
- 7:21deep-dive
- 7:21arrives
- 7:21at
- 7:21the
- 7:22exact
- 7:22moment
- 7:22organizations
- 7:23are
- 7:23discovering
- 7:23what
- 7:24unrestricted
- 7:24AI
- 7:24coding
- 7:25tool
- 7:25access
- 7:25actually
- 7:26costs.
- 7:27Microsoft
- 7:27reportedly
- 7:28pulled
- 7:28internal
- 7:28Claude
- 7:29Code
- 7:29licenses
- 7:29after
- 7:30the
- 7:30token
- 7:30bill
- 7:30ran
- 7:30past
- 7:31anything
- 7:31anyone
- 7:31had
- 7:31budgeted
- 7:32for
- 7:32—
- 7:33the
- 7:33tool
- 7:33didn't
- 7:33fail,
- 7:34it
- 7:34worked
- 7:34so
- 7:34well
- 7:34that
- 7:34engineers
- 7:35leaned
- 7:35on
- 7:35it
- 7:35constantly.
- 7:37The
- 7:37post
- 7:37promoting
- 7:37this
- 7:38disclosure
- 7:38also
- 7:38introduces
- 7:39SpectralQuant,
- 7:40a
- 7:40KV-cache
- 7:41compression
- 7:41library
- 7:42claiming
- 7:426x
- 7:42compression
- 7:43on
- 7:43production
- 7:43H200s
- 7:45where
- 7:45the
- 7:45cache
- 7:45eats
- 7:45roughly
- 7:4664%
- 7:47of
- 7:47GPU
- 7:47memory.
- 7:48On
- 7:48Mistral
- 7:497B
- 7:49at
- 7:495.95x
- 7:50compression,
- 7:51it
- 7:51reports
- 7:5240.2
- 7:53tokens/sec
- 7:54versus
- 7:5418.9
- 7:55for
- 7:55the
- 7:55uncompressed
- 7:55baseline
- 7:56—
- 7:57same
- 7:57model,
- 7:57same
- 7:58accuracy,
- 7:58roughly
- 7:59double
- 7:59the
- 7:59speed
- 7:59.
- 8:00Meanwhile,
- 8:01the
- 8:01local-AI
- 8:02community
- 8:02is
- 8:02pushing
- 8:03in
- 8:03the
- 8:03opposite
- 8:03direction
- 8:04entirely:
- 8:05building
- 8:05agents
- 8:06that
- 8:06optimize
- 8:06their
- 8:06own
- 8:06prompts
- 8:07and
- 8:07tool
- 8:07usage
- 8:08over
- 8:08time
- 8:08using
- 8:09feedback
- 8:09loops,
- 8:10turning
- 8:10the
- 8:10cost
- 8:10problem
- 8:11into
- 8:11an
- 8:11engineering
- 8:11problem
- 8:12that
- 8:12runs
- 8:13on
- 8:13hardware
- 8:13you
- 8:13already
- 8:14own
- 8:14.
- 8:16A
- 8:16blog
- 8:17series
- 8:17culminating
- 8:18in
- 8:18"A
- 8:1810
- 8:18year
- 8:18old
- 8:18Xeon
- 8:19is
- 8:19all
- 8:19you
- 8:19need"
- 8:20lays
- 8:20out
- 8:20exactly
- 8:21what
- 8:21it
- 8:21takes
- 8:21to
- 8:21run
- 8:21Gemma
- 8:224
- 8:2226B
- 8:23on
- 8:23a
- 8:23single
- 8:23Intel
- 8:24Xeon
- 8:24E5-2620
- 8:25v4
- 8:26from
- 8:272016
- 8:27—
- 8:288
- 8:28cores,
- 8:29DDR3,
- 8:29no
- 8:30GPU.
- 8:31The
- 8:31author's
- 8:31magic
- 8:32spell
- 8:32requires
- 8:3325
- 8:33flags
- 8:34across
- 8:34speculative
- 8:34decoding
- 8:35(--spec-type
- 8:36mtp
- 8:36--draft-max
- 8:373
- 8:38--spec-autotune),
- 8:39CPU-aware
- 8:39MoE
- 8:40routing
- 8:41(--cpu-moe
- 8:42--merge-up-gate-experts),
- 8:43memory
- 8:43pinning
- 8:45(--mlock
- 8:46--run-time-repack),
- 8:47and
- 8:47Flash
- 8:48Attention
- 8:48ported
- 8:48to
- 8:49CPU
- 8:49(--flash-attn
- 8:50on
- 8:50--mla-use
- 8:513).
- 8:52The
- 8:53argument
- 8:53for
- 8:53speculative
- 8:54decoding
- 8:54is
- 8:54stronger
- 8:55on
- 8:55CPU
- 8:55than
- 8:55GPU:
- 8:57CPU
- 8:57compute
- 8:58is
- 8:58cheap
- 8:58relative
- 8:58to
- 8:59streaming
- 8:59verifier
- 8:59weights
- 9:00through
- 9:00cache,
- 9:01so
- 9:01the
- 9:01drafter's
- 9:02working
- 9:02set
- 9:02fits
- 9:02in
- 9:02L3
- 9:03while
- 9:03the
- 9:03verifier
- 9:04spills
- 9:04out
- 9:04of
- 9:04everything.
- 9:06Runtime
- 9:06repacking
- 9:06reorganizes
- 9:07weight
- 9:07matrices
- 9:08to
- 9:08align
- 9:08with
- 9:08CPU
- 9:09cache
- 9:09layout,
- 9:10paying
- 9:10a
- 9:10small
- 9:10startup
- 9:11penalty
- 9:11for
- 9:11maximum
- 9:11bandwidth
- 9:12during
- 9:12generation.
- 9:14The
- 9:14result:
- 9:15an
- 9:1582
- 9:15GB
- 9:16footprint
- 9:16in
- 9:16DDR3
- 9:17generating
- 9:18text
- 9:18at
- 9:18reading
- 9:19speed
- 9:19on
- 9:19hardware
- 9:20that
- 9:20was
- 9:20old
- 9:20when
- 9:20the
- 9:21architecture
- 9:21hadn't
- 9:21been
- 9:21invented
- 9:22yet
- 9:22.
- 9:23In
- 9:23the
- 9:23same
- 9:23vein,
- 9:24a
- 9:24community
- 9:25member
- 9:25reports
- 9:2510.33
- 9:27tokens/sec
- 9:28on
- 9:28Qwen
- 9:283.5
- 9:2935B
- 9:29running
- 9:30on
- 9:30a
- 9:30$300
- 9:31laptop
- 9:31.
- 9:32On
- 9:32the
- 9:32research
- 9:33side,
- 9:33Huawei's
- 9:34OSC
- 9:34framework
- 9:35tackles
- 9:35W4A4
- 9:36quantization
- 9:37by
- 9:37systematically
- 9:38characterizing
- 9:38where
- 9:39activation
- 9:39outliers
- 9:40actually
- 9:40cluster.
- 9:41Their
- 9:42key
- 9:42insight:
- 9:43outliers
- 9:43aren't
- 9:43uniformly
- 9:44distributed
- 9:44—
- 9:45they
- 9:45exhibit
- 9:46"token-persistent
- 9:47structural
- 9:47clustering"
- 9:48where
- 9:48high-magnitude
- 9:49values
- 9:49consistently
- 9:50occupy
- 9:50fixed
- 9:51channels
- 9:51across
- 9:51tokens,
- 9:52with
- 9:52clustering
- 9:53density
- 9:53exceeding
- 9:5460%
- 9:54in
- 9:54attention
- 9:55and
- 9:55FFN
- 9:56up-projection
- 9:56inputs.
- 9:57OSC
- 9:58exploits
- 9:58this
- 9:59by
- 9:59building
- 9:59an
- 9:59offline
- 10:00lookup
- 10:00table
- 10:00that
- 10:01identifies
- 10:01the
- 10:01single
- 10:02most
- 10:02statistically
- 10:03significant
- 10:03outlier
- 10:03channel
- 10:04per
- 10:04quantization
- 10:05group,
- 10:05extracting
- 10:06it
- 10:06to
- 10:06a
- 10:06high-precision
- 10:07buffer
- 10:07before
- 10:08calculating
- 10:08scaling
- 10:08factors.
- 10:10The
- 10:10result
- 10:10is
- 10:10a
- 10:10dual-path
- 10:11computation:
- 10:12a
- 10:13low-precision
- 10:134-bit
- 10:14GEMM
- 10:14path
- 10:15and
- 10:15a
- 10:15compact
- 10:16high-precision
- 10:1616-bit
- 10:17branch
- 10:17GEMM.
- 10:19For
- 10:19W2
- 10:19down-projection
- 10:20inputs
- 10:21where
- 10:21outliers
- 10:21are
- 10:21more
- 10:21diffused
- 10:23(20–35%
- 10:24clustering),
- 10:25OSC
- 10:26falls
- 10:26back
- 10:26to
- 10:26FP8.
- 10:28On
- 10:28Qwen3-8B
- 10:30and
- 10:30Qwen3-30B,
- 10:33OSC
- 10:34restricts
- 10:34the
- 10:34average
- 10:35accuracy
- 10:35drop
- 10:36to
- 10:362.19
- 10:37and
- 10:371.12
- 10:38points
- 10:38respectively
- 10:39while
- 10:39achieving
- 10:401.78x
- 10:41speedup
- 10:41over
- 10:42the
- 10:42W8A8
- 10:42baseline
- 10:43.
- 10:44NVIDIA's
- 10:44Lightning
- 10:45OPD
- 10:45addresses
- 10:46a
- 10:46different
- 10:46efficiency
- 10:47bottleneck:
- 10:48the
- 10:48live
- 10:48teacher
- 10:49server
- 10:49required
- 10:49during
- 10:50on-policy
- 10:50distillation.
- 10:52Standard
- 10:52OPD
- 10:53trains
- 10:53a
- 10:53student
- 10:53model
- 10:54to
- 10:54match
- 10:54a
- 10:54stronger
- 10:55teacher's
- 10:55token-level
- 10:56distribution,
- 10:57but
- 10:57keeping
- 10:57the
- 10:57teacher
- 10:58running
- 10:58throughout
- 10:58training
- 10:59is
- 10:59expensive.
- 11:00Lightning
- 11:01OPD
- 11:01identifies
- 11:02a
- 11:02previously
- 11:03overlooked
- 11:03condition
- 11:04called
- 11:04"teacher
- 11:04consistency"
- 11:05—
- 11:06the
- 11:06SFT-stage
- 11:08and
- 11:08OPD-stage
- 11:09teachers
- 11:10must
- 11:10be
- 11:10the
- 11:10same
- 11:10model.
- 11:11Violating
- 11:12this
- 11:12introduces
- 11:13irreducible
- 11:14gradient
- 11:14bias
- 11:15causing
- 11:15convergence
- 11:16to
- 11:16a
- 11:16suboptimal
- 11:17fixed
- 11:17point
- 11:17regardless
- 11:18of
- 11:18training
- 11:18duration.
- 11:20With
- 11:20teacher
- 11:20consistency
- 11:21enforced,
- 11:22teacher
- 11:22log-probabilities
- 11:23can
- 11:23be
- 11:23precomputed
- 11:24once
- 11:24over
- 11:24SFT
- 11:25rollouts
- 11:25and
- 11:26reused,
- 11:27eliminating
- 11:27the
- 11:27live
- 11:28server
- 11:28entirely.
- 11:29Starting
- 11:30from
- 11:30Qwen3-8B-Base,
- 11:33Lightning
- 11:33OPD
- 11:34reaches
- 11:3469.9%
- 11:36on
- 11:36AIME
- 11:362024
- 11:37in
- 11:38just
- 11:3830
- 11:38GPU
- 11:39hours
- 11:39—
- 11:40a
- 11:404.0x
- 11:41speedup
- 11:41over
- 11:41standard
- 11:42OPD
- 11:42.
- 11:43Separately,
- 11:43the
- 11:44quantization
- 11:44precision
- 11:45debate
- 11:45got
- 11:45concrete
- 11:46data:
- 11:46Qwen3.6
- 11:49shows
- 11:49a
- 11:49measurable
- 11:50quality
- 11:50jump
- 11:50from
- 11:51Q4
- 11:51to
- 11:51Q6
- 11:52quantization
- 11:52specifically
- 11:53for
- 11:53coding
- 11:53agent
- 11:54workloads,
- 11:55suggesting
- 11:55that
- 11:55the
- 11:55"good
- 11:56enough"
- 11:56threshold
- 11:57for
- 11:57agentic
- 11:57use
- 11:57cases
- 11:58sits
- 11:58higher
- 11:58than
- 11:59for
- 11:59conversational
- 11:59ones
- 12:00.
- 12:02JetBrains
- 12:02released
- 12:03Mellum2,
- 12:03a
- 12:0412B-parameter
- 12:05Mixture-of-Experts
- 12:06model
- 12:06that
- 12:06activates
- 12:07only
- 12:072.5B
- 12:08parameters
- 12:08per
- 12:08token,
- 12:09under
- 12:09Apache
- 12:092.0.
- 12:10It's
- 12:11the
- 12:11first
- 12:11model
- 12:11from
- 12:11an
- 12:11IDE
- 12:12vendor
- 12:12designed
- 12:12explicitly
- 12:13as
- 12:13infrastructure
- 12:14for
- 12:14AI-powered
- 12:14development
- 12:15tools
- 12:15rather
- 12:15than
- 12:15as
- 12:15a
- 12:15standalone
- 12:16assistant.
- 12:17JetBrains
- 12:17positions
- 12:18it
- 12:18as
- 12:18a
- 12:18"focal
- 12:18model"
- 12:18—
- 12:19fast
- 12:19and
- 12:19well-scoped
- 12:20for
- 12:20high-frequency
- 12:20tasks
- 12:21inside
- 12:21larger
- 12:21AI
- 12:22systems:
- 12:22routing,
- 12:23RAG
- 12:23post-processing,
- 12:24tool
- 12:24selection,
- 12:25context
- 12:25compression,
- 12:26and
- 12:26agent
- 12:27subtasks
- 12:27like
- 12:27planning
- 12:28and
- 12:28validation.
- 12:29Benchmarks
- 12:30show
- 12:30competitive
- 12:30performance
- 12:31against
- 12:31similar-sized
- 12:32models
- 12:32with
- 12:32over
- 12:322x
- 12:33faster
- 12:33inference,
- 12:34targeting
- 12:35the
- 12:35latency-sensitive
- 12:35slots
- 12:36in
- 12:36multi-model
- 12:36architectures
- 12:37where
- 12:37calling
- 12:37a
- 12:37frontier
- 12:38model
- 12:38for
- 12:38every
- 12:39intermediate
- 12:39step
- 12:39is
- 12:39wasteful
- 12:39.
- 12:40Tencent's
- 12:40Hy-MT2
- 12:41also
- 12:42moved
- 12:42to
- 12:42Apache
- 12:42License
- 12:432.0,
- 12:44continuing
- 12:44the
- 12:44trend
- 12:45of
- 12:45major
- 12:45labs
- 12:45opening
- 12:46their
- 12:46model
- 12:46weights
- 12:46under
- 12:46permissive
- 12:47terms
- 12:47.
- 12:47The
- 12:47tooling
- 12:48layer
- 12:48beneath
- 12:48models
- 12:49continues
- 12:49filling
- 12:49in.
- 12:50LogicPipe
- 12:51tackles
- 12:51multi-device
- 12:52LLM
- 12:52inference
- 12:53by
- 12:53splitting
- 12:53transformer
- 12:54layers
- 12:54across
- 12:54ranks,
- 12:55using
- 12:55DAG
- 12:56scheduling
- 12:56with
- 12:56dependency-aware
- 12:57task
- 12:57dispatch
- 12:58and
- 12:58contextual
- 12:58KV-cache
- 12:59reuse
- 12:59between
- 13:00points
- 13:00—
- 13:01a
- 13:01structured
- 13:01approach
- 13:01to
- 13:02pipeline
- 13:02parallelism
- 13:03on
- 13:03heterogeneous
- 13:03edge
- 13:04hardware
- 13:04.
- 13:04dlmserve
- 13:05launches
- 13:05as
- 13:05the
- 13:05first
- 13:06dedicated
- 13:06serving
- 13:07engine
- 13:07for
- 13:07diffusion
- 13:07language
- 13:08models,
- 13:08a
- 13:09class
- 13:09of
- 13:09models
- 13:09that
- 13:09has
- 13:10lacked
- 13:10the
- 13:10vLLM/SGLang-equivalent
- 13:14infrastructure
- 13:15that
- 13:15autoregressive
- 13:15models
- 13:16enjoy
- 13:16.
- 13:17Genspark
- 13:18AI
- 13:18ships
- 13:18an
- 13:18open-source
- 13:19"Super
- 13:19Agent"
- 13:20framework
- 13:20with
- 13:2080+
- 13:21built-in
- 13:21tools,
- 13:22multi-LLM
- 13:23routing,
- 13:24and
- 13:24a
- 13:24planner-executor
- 13:25architecture
- 13:25that
- 13:26decomposes
- 13:26goals
- 13:27into
- 13:27DAGs
- 13:27of
- 13:27subtasks
- 13:28dispatched
- 13:28to
- 13:28specialist
- 13:29agents
- 13:29—
- 13:30positioned
- 13:31as
- 13:31a
- 13:31self-hosted
- 13:31alternative
- 13:32to
- 13:32the
- 13:32commercial
- 13:33Genspark.ai
- 13:33service
- 13:34.
- 13:35And
- 13:35Qwen
- 13:35released
- 13:35Qwen-Image-Bench,
- 13:38a
- 13:38new
- 13:38benchmark
- 13:38for
- 13:38evaluating
- 13:39visual
- 13:39language
- 13:40models
- 13:40.
- 13:42NVIDIA's
- 13:43Cosmos
- 13:433
- 13:43represents
- 13:44a
- 13:44significant
- 13:45architectural
- 13:45leap
- 13:46from
- 13:46its
- 13:46predecessors.
- 13:47Where
- 13:47earlier
- 13:48Cosmos
- 13:48releases
- 13:49required
- 13:49separate
- 13:49models
- 13:50for
- 13:50world
- 13:50generation
- 13:51(Predict),
- 13:51controlled
- 13:51generation
- 13:52(Transfer),
- 13:53scene
- 13:53understanding
- 13:54(Reason),
- 13:55and
- 13:55policy
- 13:55generation
- 13:56(Policy),
- 13:57Cosmos
- 13:573
- 13:58unifies
- 13:58everything
- 13:59into
- 13:59a
- 13:59single
- 13:59Mixture-of-Transformers
- 14:00architecture.
- 14:01The
- 14:01model
- 14:02processes
- 14:02text,
- 14:03image,
- 14:03video,
- 14:04audio,
- 14:05and
- 14:05action
- 14:05modalities
- 14:06in
- 14:06one
- 14:06forward
- 14:06pass,
- 14:07splitting
- 14:07the
- 14:07input
- 14:08sequence
- 14:08into
- 14:08an
- 14:08autoregressive
- 14:09subsequence
- 14:09for
- 14:09reasoning
- 14:10and
- 14:10a
- 14:10diffusion
- 14:11subsequence
- 14:11for
- 14:11generation.
- 14:12AR
- 14:13and
- 14:13DM
- 14:13tokens
- 14:13use
- 14:13separate
- 14:14parameter
- 14:14sets
- 14:14per
- 14:15layer
- 14:15but
- 14:15interact
- 14:16through
- 14:16joint
- 14:16attention,
- 14:17letting
- 14:17the
- 14:17same
- 14:17model
- 14:18serve
- 14:18as
- 14:18a
- 14:18VLM,
- 14:19video
- 14:19generator,
- 14:20forward/inverse
- 14:21dynamics
- 14:21model,
- 14:21or
- 14:22robot
- 14:22policy
- 14:22without
- 14:22architectural
- 14:23changes.
- 14:24Two
- 14:24sizes
- 14:25ship:
- 14:25Cosmos
- 14:263
- 14:26Nano
- 14:27(16B,
- 14:27workstation-grade)
- 14:28and
- 14:28Cosmos
- 14:293
- 14:29Super
- 14:30(64B,
- 14:30datacenter-scale),
- 14:31both
- 14:32with
- 14:32Diffusers
- 14:32integration
- 14:33and
- 14:33post-training
- 14:33scripts
- 14:33for
- 14:33domain
- 14:34adaptation.
- 14:35NVIDIA
- 14:35also
- 14:36released
- 14:36accompanying
- 14:36synthetic
- 14:37data
- 14:37generation
- 14:38datasets
- 14:38covering
- 14:38robotics,
- 14:39physics
- 14:40simulation,
- 14:40autonomous
- 14:41driving,
- 14:42warehouse
- 14:42operations,
- 14:43and
- 14:43human
- 14:43motion
- 14:43—
- 14:44the
- 14:44kind
- 14:45of
- 14:45training
- 14:45data
- 14:45that
- 14:45physical
- 14:46AI
- 14:46has
- 14:46chronically
- 14:47lacked
- 14:47.
- 14:48At
- 14:48Computex
- 14:49in
- 14:49Taipei,
- 14:49Jensen
- 14:50Huang
- 14:50unveiled
- 14:51RTX
- 14:51Spark,
- 14:52a
- 14:52chip
- 14:52designed
- 14:52for
- 14:52what
- 14:53NVIDIA
- 14:53calls
- 14:53"the
- 14:53era
- 14:54of
- 14:54personal
- 14:54AI
- 14:54agents."
- 14:55Lenovo,
- 14:56HP,
- 14:57Dell,
- 14:57Microsoft
- 14:58Surface,
- 14:59Asus,
- 14:59and
- 15:00MSI
- 15:00will
- 15:00ship
- 15:01Windows
- 15:01PCs
- 15:02with
- 15:02RTX
- 15:02Spark
- 15:02beginning
- 15:03this
- 15:03autumn,
- 15:04with
- 15:04Acer
- 15:04and
- 15:04Gigabyte
- 15:05following.
- 15:06Forrester's
- 15:06Charlie
- 15:07Dai
- 15:07called
- 15:07it
- 15:07a
- 15:07"paradigm
- 15:08shift"
- 15:08from
- 15:09"component
- 15:09supplier"
- 15:10to
- 15:10"architecture
- 15:10owner
- 15:11in
- 15:11the
- 15:11PC
- 15:11market,"
- 15:12putting
- 15:12NVIDIA
- 15:12in
- 15:13direct
- 15:13competition
- 15:13with
- 15:13Intel,
- 15:14AMD,
- 15:14and
- 15:15Qualcomm.
- 15:16Analyst
- 15:17Ian
- 15:17Fogg
- 15:17tempered
- 15:17expectations,
- 15:19noting
- 15:19the
- 15:19machines
- 15:20will
- 15:20likely
- 15:20carry
- 15:20a
- 15:20significant
- 15:21price
- 15:21tag
- 15:21and
- 15:22target
- 15:22workstation-class
- 15:23buyers
- 15:23.
- 15:24NVIDIA
- 15:24also
- 15:25released
- 15:25LocateAnything,
- 15:26a
- 15:26vision-language
- 15:27grounding
- 15:27model
- 15:27using
- 15:28parallel
- 15:28box
- 15:29decoding
- 15:29that
- 15:29claims
- 15:3010x
- 15:30faster
- 15:30inference
- 15:31than
- 15:31Qwen3-VL
- 15:33for
- 15:33object
- 15:34detection
- 15:34and
- 15:34spatial
- 15:35understanding
- 15:35tasks
- 15:35.
- 15:38Higgsfield,
- 15:38a
- 15:38San
- 15:39Francisco
- 15:39startup
- 15:39valued
- 15:40at
- 15:40$1.3
- 15:41billion,
- 15:42announced
- 15:42it
- 15:42had
- 15:42premiered
- 15:43a
- 15:43fully
- 15:43AI-generated
- 15:44feature
- 15:45film
- 15:45at
- 15:45Cannes.
- 15:46The
- 15:46Wall
- 15:46Street
- 15:47Journal
- 15:47covered
- 15:47it.
- 15:48The
- 15:48founder
- 15:48posted
- 15:49on
- 15:49LinkedIn
- 15:49about
- 15:49how
- 15:50"for
- 15:50decades,
- 15:50Cannes
- 15:51has
- 15:51been
- 15:51the
- 15:51room
- 15:51where
- 15:51new
- 15:52cinema
- 15:52gets
- 15:52legitimized."
- 15:53Then
- 15:53Cannes
- 15:54said
- 15:54it
- 15:54never
- 15:54happened.
- 15:55A
- 15:55festival
- 15:56spokesperson
- 15:56confirmed
- 15:57to
- 15:57Futurism
- 15:58that
- 15:58"Hell
- 15:58Grind
- 15:59was
- 15:59not
- 15:59screened
- 16:00as
- 16:00part
- 16:00of
- 16:00the
- 16:00official
- 16:00Festival
- 16:01de
- 16:01Cannes
- 16:01program."
- 16:02The
- 16:03film
- 16:03screened
- 16:03at
- 16:03the
- 16:03Marche
- 16:04du
- 16:04Film,
- 16:05a
- 16:05separate
- 16:05commercial
- 16:06marketplace
- 16:06that
- 16:06will
- 16:06screen
- 16:07anything
- 16:07that
- 16:07pays
- 16:07the
- 16:08fee
- 16:08—
- 16:08it
- 16:08has
- 16:08screened
- 16:09Sharknado.
- 16:10Calling
- 16:10it
- 16:10a
- 16:10Cannes
- 16:11premiere
- 16:11is
- 16:11roughly
- 16:11equivalent
- 16:12to
- 16:12buying
- 16:12an
- 16:12ad
- 16:13in
- 16:13the
- 16:13New
- 16:13York
- 16:13Times
- 16:13and
- 16:13describing
- 16:14yourself
- 16:14as
- 16:14a
- 16:14Times
- 16:15journalist.
- 16:16The
- 16:16underlying
- 16:16work
- 16:16was
- 16:16real.
- 16:17Higgsfield
- 16:17made
- 16:18a
- 16:1895-minute
- 16:18action
- 16:19film
- 16:19in
- 16:19two
- 16:19weeks
- 16:19using
- 16:19AI
- 16:20video
- 16:20generation
- 16:20tools
- 16:21including
- 16:21Google's
- 16:21Veo
- 16:223,
- 16:22at
- 16:23a
- 16:23total
- 16:23cost
- 16:23of
- 16:23$500,000
- 16:24($400,000
- 16:25in
- 16:25compute).
- 16:26Each
- 16:26prompt
- 16:27averaged
- 16:273,000
- 16:28words.
- 16:29The
- 16:29first
- 16:2925
- 16:30minutes
- 16:30required
- 16:3016,181
- 16:32initial
- 16:32video
- 16:33generations
- 16:33to
- 16:33produce
- 16:34253
- 16:35final
- 16:35shots.
- 16:36Maintaining
- 16:36visual
- 16:37consistency
- 16:37across
- 16:38feature
- 16:38length
- 16:38required
- 16:39detailed
- 16:39style
- 16:39prefixes
- 16:40defining
- 16:40lighting,
- 16:41camera
- 16:41type,
- 16:42and
- 16:42physics
- 16:42behavior
- 16:43for
- 16:43every
- 16:43prompt.
- 16:44"You
- 16:44can't
- 16:44go
- 16:45into
- 16:45AI
- 16:45and
- 16:45say
- 16:45make
- 16:45me
- 16:46a
- 16:4695-minute
- 16:46cool
- 16:47video,"
- 16:47one
- 16:47content
- 16:48lead
- 16:48acknowledged.
- 16:49But
- 16:49director
- 16:50John
- 16:50Washburn's
- 16:51response
- 16:51to
- 16:51the
- 16:51festival
- 16:51claims
- 16:52was
- 16:52more
- 16:52direct:
- 16:53"The
- 16:53suggestion
- 16:54that
- 16:54paying
- 16:54for
- 16:54a
- 16:54screening
- 16:55at
- 16:55some
- 16:55random
- 16:55theatre
- 16:56in
- 16:56the
- 16:56same
- 16:56town
- 16:57and
- 16:57at
- 16:57the
- 16:57same
- 16:57time
- 16:57as
- 16:57a
- 16:57major
- 16:58festival
- 16:58is
- 16:59somehow
- 16:59the
- 16:59same
- 16:59thing
- 16:59as
- 16:59being
- 17:00selected
- 17:00by
- 17:00that
- 17:00festival
- 17:01is
- 17:01misleading
- 17:02at
- 17:02best.
- 17:03Spurious
- 17:03bullshittery,
- 17:04really."
- 17:05The
- 17:05Wall
- 17:05Street
- 17:05Journal
- 17:06later
- 17:06added
- 17:06a
- 17:06correction
- 17:07clarifying
- 17:07the
- 17:07distinction.
- 17:08The
- 17:08pattern
- 17:09is
- 17:09familiar
- 17:09—
- 17:10real
- 17:10capability
- 17:11dressed
- 17:11in
- 17:11borrowed
- 17:11prestige,
- 17:12traveling
- 17:13faster
- 17:13than
- 17:13anyone
- 17:14can
- 17:14check
- 17:14.