Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – June 25, 2026
Transcript
- 0:00The
- 0:00NSA's
- 0:00own
- 0:01director
- 0:01reportedly
- 0:02told
- 0:02the
- 0:02Senate
- 0:02Intelligence
- 0:03Committee
- 0:03that
- 0:03Anthropic's
- 0:04Mythos
- 0:04model
- 0:05"broke
- 0:05into
- 0:05almost
- 0:05all
- 0:06of
- 0:06its
- 0:06classified
- 0:06systems
- 0:07in
- 0:07hours."
- 0:08Per
- 0:08The
- 0:08Economist,
- 0:09Senator
- 0:09Mark
- 0:10Warner
- 0:10—
- 0:11vice
- 0:11chair
- 0:11of
- 0:11the
- 0:11committee
- 0:12—
- 0:12said
- 0:13General
- 0:13Joshua
- 0:13Rudd
- 0:13conveyed
- 0:14this
- 0:14directly.
- 0:15The
- 0:15timing
- 0:16is
- 0:16pointed:
- 0:17the
- 0:17revelation
- 0:17surfaced
- 0:18on
- 0:18June
- 0:1811,
- 0:19the
- 0:19same
- 0:19day
- 0:19Amazon
- 0:20reportedly
- 0:20found
- 0:20a
- 0:20separate
- 0:21jailbreak
- 0:21in
- 0:21Anthropic's
- 0:22models.
- 0:23Within
- 0:23hours,
- 0:24the
- 0:24Trump
- 0:24administration
- 0:25ordered
- 0:25Anthropic
- 0:26to
- 0:26cut
- 0:26off
- 0:26foreign
- 0:27access
- 0:27to
- 0:27Mythos
- 0:27and
- 0:28Fable.
- 0:29Anthropic
- 0:29shut
- 0:30both
- 0:30models
- 0:30down
- 0:30entirely
- 0:31instead.
- 0:32Two
- 0:32competing
- 0:33narratives
- 0:33are
- 0:33circulating.
- 0:34One
- 0:35says
- 0:35the
- 0:35shutdown
- 0:35was
- 0:36a
- 0:36direct
- 0:36response
- 0:36to
- 0:36the
- 0:37NSA
- 0:37breach.
- 0:38The
- 0:38other
- 0:38says
- 0:39Anthropic
- 0:39considers
- 0:39the
- 0:40jailbreak
- 0:40minor
- 0:40—
- 0:41something
- 0:41other
- 0:41AI
- 0:42models
- 0:42can
- 0:42already
- 0:42be
- 0:42tricked
- 0:43into
- 0:43doing
- 0:43—
- 0:44and
- 0:44views
- 0:44the
- 0:44shutdown
- 0:45as
- 0:45an
- 0:45overreaction.
- 0:46The
- 0:46uncomfortable
- 0:47wrinkle:
- 0:48the
- 0:48NSA
- 0:48was
- 0:48already
- 0:48using
- 0:49Mythos
- 0:49for
- 0:49its
- 0:49own
- 0:49cyber
- 0:50operations,
- 0:51with
- 0:51Anthropic
- 0:51engineers
- 0:52embedded
- 0:52inside
- 0:52the
- 0:52agency.
- 0:54The
- 0:54same
- 0:54tool
- 0:54the
- 0:54agency
- 0:55relied
- 0:55on
- 0:55is
- 0:56the
- 0:56one
- 0:56its
- 0:56director
- 0:56says
- 0:57compromised
- 0:57nearly
- 0:57everything
- 0:58it
- 0:58owns.
- 0:59The
- 0:59strategic
- 0:59implications
- 1:00go
- 1:00beyond
- 1:00defense.
- 1:01If
- 1:01a
- 1:01model
- 1:01can
- 1:02find
- 1:02thousands
- 1:02of
- 1:02flaws
- 1:03in
- 1:03hardened
- 1:03classified
- 1:04networks
- 1:04in
- 1:04hours,
- 1:05any
- 1:05adversary
- 1:06with
- 1:06a
- 1:06comparable
- 1:06model
- 1:07can
- 1:07neutralize
- 1:07the
- 1:07NSA's
- 1:08offensive
- 1:08exploit
- 1:08stockpile
- 1:09by
- 1:09patching
- 1:10those
- 1:10same
- 1:10vulnerabilities
- 1:11before
- 1:11they
- 1:11can
- 1:11be
- 1:11weaponized.
- 1:12The
- 1:13era
- 1:13of
- 1:13hoarding
- 1:13zero-days
- 1:14as
- 1:14a
- 1:14strategic
- 1:14asset
- 1:15may
- 1:15be
- 1:15closing
- 1:15faster
- 1:16than
- 1:16anyone
- 1:16in
- 1:16Fort
- 1:17Meade
- 1:17anticipated.
- 1:18Meanwhile,
- 1:18Microsoft's
- 1:19BlueHat
- 1:19IL
- 1:20security
- 1:20conference
- 1:20showcased
- 1:21an
- 1:21LLM-based
- 1:22vulnerability
- 1:22variant
- 1:23hunter
- 1:23that
- 1:23inverts
- 1:23the
- 1:24classic
- 1:24SAST
- 1:24calculation.
- 1:25Instead
- 1:26of
- 1:26hand-writing
- 1:26per-language
- 1:27taint-flow
- 1:27rules,
- 1:28the
- 1:28tool
- 1:28takes
- 1:28a
- 1:28known
- 1:29bug
- 1:29—
- 1:30described
- 1:30in
- 1:30natural
- 1:30language
- 1:31—
- 1:31and
- 1:31uses
- 1:32an
- 1:32LLM
- 1:32to
- 1:32judge
- 1:33whether
- 1:33similar
- 1:33code
- 1:33patterns
- 1:34across
- 1:34different
- 1:34languages
- 1:35realize
- 1:35the
- 1:35same
- 1:35vulnerability
- 1:36concept.
- 1:37The
- 1:37four-skill
- 1:38pipeline
- 1:38distills
- 1:38a
- 1:38seed
- 1:39bug
- 1:39into
- 1:39a
- 1:39flow
- 1:39and
- 1:39a
- 1:40reason,
- 1:40finds
- 1:41similar
- 1:41flows
- 1:41across
- 1:42codebases
- 1:42regardless
- 1:43of
- 1:43language,
- 1:43correlates
- 1:44which
- 1:44flows
- 1:44are
- 1:44actually
- 1:45vulnerable,
- 1:46and
- 1:46then
- 1:46skeptically
- 1:47verifies
- 1:47each
- 1:47finding
- 1:48by
- 1:48arguing
- 1:48attacker
- 1:49control,
- 1:49reachability,
- 1:50and
- 1:50generating
- 1:51a
- 1:51proof
- 1:51of
- 1:51concept.
- 1:53Microsoft
- 1:53used
- 1:53it
- 1:53to
- 1:53scan
- 1:5460
- 1:54Azure
- 1:55hybrid
- 1:55cloud
- 1:55extensions
- 1:56written
- 1:56in
- 1:56everything
- 1:57from
- 1:57C
- 1:57to
- 1:57Bash,
- 1:58finding
- 1:58issues
- 1:59in
- 1:5912
- 1:59and
- 1:59validating
- 2:00the
- 2:00other
- 2:0048.
- 2:01The
- 2:01key
- 2:02insight
- 2:02is
- 2:02that
- 2:02logical
- 2:03vulnerabilities
- 2:03—
- 2:04flows
- 2:05that
- 2:05are
- 2:05legitimate
- 2:05in
- 2:05one
- 2:06context
- 2:06but
- 2:07become
- 2:07exploitable
- 2:07in
- 2:08another,
- 2:08like
- 2:08calling
- 2:09IMDS
- 2:09on-prem
- 2:10—
- 2:10are
- 2:10exactly
- 2:11the
- 2:11class
- 2:11that
- 2:11traditional
- 2:12SAST
- 2:12misses.
- 2:13In
- 2:13more
- 2:13conventional
- 2:14breach
- 2:14news,
- 2:15LastPass
- 2:15is
- 2:15notifying
- 2:16users
- 2:16of
- 2:16yet
- 2:17another
- 2:17data
- 2:17breach
- 2:17—
- 2:18this
- 2:18time
- 2:18through
- 2:19market
- 2:19research
- 2:19firm
- 2:20Klue,
- 2:20which
- 2:20had
- 2:20Salesforce
- 2:21and
- 2:21Gong
- 2:21integrations
- 2:22exposing
- 2:22customer
- 2:23names,
- 2:23phone
- 2:24numbers,
- 2:24email
- 2:24addresses,
- 2:25physical
- 2:25addresses,
- 2:26and
- 2:26support
- 2:26case
- 2:27data.
- 2:27Password
- 2:28vaults
- 2:28were
- 2:28reportedly
- 2:29not
- 2:29affected.
- 2:30This
- 2:30is
- 2:30the
- 2:30company's
- 2:31third
- 2:31major
- 2:31security
- 2:32incident
- 2:32after
- 2:32the
- 2:332015
- 2:33hash
- 2:33theft
- 2:34and
- 2:34the
- 2:342022
- 2:35source
- 2:35code
- 2:35compromise
- 2:36that
- 2:36exposed
- 2:36encrypted
- 2:37vault
- 2:37backups.
- 2:38At
- 2:38this
- 2:38point,
- 2:39asking
- 2:39users
- 2:40to
- 2:40"remain
- 2:40vigilant
- 2:41of
- 2:41potential
- 2:41phishing
- 2:41attacks"
- 2:42reads
- 2:42less
- 2:43like
- 2:43advice
- 2:43and
- 2:43more
- 2:44like
- 2:44an
- 2:44admission
- 2:44that
- 2:44the
- 2:44steady
- 2:45drip
- 2:45of
- 2:45leaked
- 2:45PII
- 2:46has
- 2:46made
- 2:46social
- 2:47engineering
- 2:47against
- 2:47the
- 2:47LastPass
- 2:48user
- 2:48base
- 2:49permanently
- 2:49easier.
- 2:50On
- 2:51the
- 2:51defensive
- 2:51tooling
- 2:51side,
- 2:52an
- 2:52open-source
- 2:53project
- 2:53called
- 2:53Hush
- 2:54addresses
- 2:54a
- 2:54problem
- 2:55AI
- 2:55coding
- 2:55agents
- 2:55have
- 2:56made
- 2:56worse:
- 2:56.env
- 2:57files
- 2:58sitting
- 2:58in
- 2:58worktrees
- 2:59where
- 2:59any
- 2:59agent
- 2:59can
- 3:00cat
- 3:00.env
- 3:00and
- 3:00surface
- 3:01secrets
- 3:01into
- 3:01a
- 3:01model's
- 3:02context.
- 3:03Hush
- 3:03keeps
- 3:04secrets
- 3:04age-encrypted
- 3:05outside
- 3:05the
- 3:05repo,
- 3:06with
- 3:06the
- 3:06master
- 3:06key
- 3:06in
- 3:06the
- 3:07macOS
- 3:07Keychain,
- 3:08and
- 3:08injects
- 3:08values
- 3:08only
- 3:09into
- 3:09the
- 3:09child
- 3:09process
- 3:10of
- 3:10the
- 3:10command
- 3:10that
- 3:10needs
- 3:10them.
- 3:11Agent
- 3:11contexts
- 3:12(Claude
- 3:12Code,
- 3:13Codex,
- 3:13or
- 3:14any
- 3:14non-TTY
- 3:14session)
- 3:15are
- 3:15auto-detected
- 3:16and
- 3:16locked
- 3:16to
- 3:16"use,
- 3:17don't
- 3:17see."
- 3:18The
- 3:18design
- 3:18philosophy
- 3:19is
- 3:19refreshingly
- 3:20honest:
- 3:20Hush
- 3:21explicitly
- 3:21states
- 3:22it
- 3:22stops
- 3:22accidental
- 3:23exposure
- 3:23and
- 3:23agent
- 3:24reflexes,
- 3:25not
- 3:25a
- 3:25determined
- 3:25local
- 3:26attacker
- 3:26sharing
- 3:26your
- 3:26uid.
- 3:30WIRED
- 3:30verified
- 3:31the
- 3:31leaked
- 3:31membership
- 3:31of
- 3:31Dialog,
- 3:32a
- 3:32private
- 3:33society
- 3:33that
- 3:33operated
- 3:34for
- 3:3420
- 3:34years
- 3:34with
- 3:35no
- 3:35public
- 3:35website.
- 3:36The
- 3:36registration
- 3:37list
- 3:37for
- 3:37its
- 3:37August
- 3:372026
- 3:38retreat
- 3:38near
- 3:39Dublin
- 3:39—
- 3:40$16,000
- 3:40per
- 3:41head
- 3:41—
- 3:41includes
- 3:42OpenAI's
- 3:42Chief
- 3:42Strategy
- 3:43Officer,
- 3:43Google
- 3:44DeepMind's
- 3:44head
- 3:44of
- 3:44AI
- 3:45global
- 3:45affairs,
- 3:46the
- 3:46CEO
- 3:46of
- 3:46YouTube,
- 3:47and
- 3:47sitting
- 3:47government
- 3:48officials
- 3:48who
- 3:48used
- 3:48personal
- 3:49email
- 3:49to
- 3:49avoid
- 3:50FOIA.
- 3:51Peter
- 3:51Thiel
- 3:51co-founded
- 3:52the
- 3:52group;
- 3:52the
- 3:53co-founder
- 3:53of
- 3:53Palantir
- 3:54and
- 3:54the
- 3:54Treasury
- 3:54Secretary
- 3:55are
- 3:55also
- 3:55on
- 3:55the
- 3:56list.
- 3:56These
- 3:57networks
- 3:57are
- 3:57not
- 3:57new
- 3:57—
- 3:58the
- 3:58Bohemian
- 3:59Club
- 3:59has
- 3:59operated
- 3:59this
- 3:59way
- 4:00for
- 4:00a
- 4:00century
- 4:00—
- 4:01but
- 4:01the
- 4:01concentration
- 4:01of
- 4:02AI
- 4:02executives
- 4:02alongside
- 4:03regulators
- 4:03nominally
- 4:04overseeing
- 4:04them
- 4:04creates
- 4:05documented
- 4:05conflicts
- 4:06of
- 4:06interest
- 4:06that
- 4:06deserve
- 4:07scrutiny
- 4:07as
- 4:07AI
- 4:07policy
- 4:08decisions
- 4:08accelerate.
- 4:09On
- 4:09the
- 4:10measurement
- 4:10front,
- 4:10an
- 4:11editorial
- 4:11makes
- 4:11a
- 4:11useful
- 4:12argument:
- 4:12the
- 4:13easiest
- 4:13way
- 4:13to
- 4:13lie
- 4:13with
- 4:14AI
- 4:14is
- 4:14to
- 4:14focus
- 4:14only
- 4:15on
- 4:15benchmark
- 4:15capability
- 4:16while
- 4:16ignoring
- 4:17cost.
- 4:17A
- 4:17company
- 4:18handling
- 4:18100,000
- 4:19software
- 4:19engineering
- 4:19tasks
- 4:20at
- 4:20$10–$30
- 4:21each
- 4:22can
- 4:22spend
- 4:22millions
- 4:22more
- 4:23annually
- 4:23by
- 4:23chasing
- 4:24the
- 4:24highest
- 4:24leaderboard
- 4:24score
- 4:25when
- 4:25a
- 4:25system
- 4:25ten
- 4:25times
- 4:26cheaper
- 4:26delivers
- 4:27similar
- 4:27real-world
- 4:28performance.
- 4:29The
- 4:29better
- 4:29approach:
- 4:29plot
- 4:30cost
- 4:30per
- 4:30task
- 4:31against
- 4:31success
- 4:31rate
- 4:32and
- 4:32examine
- 4:32the
- 4:32Pareto
- 4:33frontier.
- 4:34A
- 4:34startup
- 4:34optimizes
- 4:35for
- 4:35cost;
- 4:36an
- 4:36enterprise
- 4:36pays
- 4:37for
- 4:37marginal
- 4:37accuracy.
- 4:38Neither
- 4:39is
- 4:39universally
- 4:39correct,
- 4:40which
- 4:40is
- 4:40precisely
- 4:41why
- 4:41single-number
- 4:41leaderboards
- 4:42—
- 4:42which
- 4:43measure
- 4:43capability
- 4:44without
- 4:44cost
- 4:44—
- 4:45are
- 4:45misleading
- 4:45by
- 4:46design.
- 4:49Apple's
- 4:49WWDC
- 4:502026
- 4:51output
- 4:51clarifies
- 4:52that
- 4:52the
- 4:52company's
- 4:52AI
- 4:52strategy
- 4:53is
- 4:53less
- 4:53about
- 4:53competing
- 4:54on
- 4:54frontier
- 4:54model
- 4:55capability
- 4:55and
- 4:56more
- 4:56about
- 4:56owning
- 4:56the
- 4:56on-device
- 4:57runtime.
- 4:58Core
- 4:58AI
- 4:58is
- 4:58a
- 4:58comprehensive
- 4:59Swift
- 4:59framework
- 4:59for
- 4:59loading
- 5:00and
- 5:00running
- 5:00AI
- 5:00models
- 5:01entirely
- 5:01on
- 5:01Apple
- 5:01Silicon
- 5:02—
- 5:02zero
- 5:03server
- 5:03dependencies,
- 5:04zero
- 5:04token
- 5:04costs.
- 5:05Models
- 5:06are
- 5:06automatically
- 5:06specialized
- 5:07per
- 5:07hardware
- 5:07target
- 5:08with
- 5:08ahead-of-time
- 5:08compilation
- 5:09for
- 5:09instant
- 5:09load
- 5:10times.
- 5:11The
- 5:11framework
- 5:11includes
- 5:12PyTorch
- 5:12extensions
- 5:13for
- 5:13converting
- 5:13models
- 5:13into
- 5:14Core
- 5:14AI
- 5:14assets
- 5:15with
- 5:15hardware-optimized
- 5:15attention
- 5:16and
- 5:16normalization
- 5:17operations,
- 5:18support
- 5:18for
- 5:18custom
- 5:18Metal
- 5:194
- 5:19kernels,
- 5:20and
- 5:20Core
- 5:20AI
- 5:20Optimization
- 5:21—
- 5:22a
- 5:22quantization
- 5:22and
- 5:23palettization
- 5:23toolkit
- 5:24with
- 5:24per-layer
- 5:24granularity.
- 5:26A
- 5:26new
- 5:26Xcode
- 5:26integration
- 5:27and
- 5:27standalone
- 5:28Core
- 5:28AI
- 5:28Debugger
- 5:29let
- 5:29developers
- 5:29inspect
- 5:30computation
- 5:30graphs,
- 5:31profile
- 5:31performance,
- 5:32and
- 5:32validate
- 5:32artifacts
- 5:33before
- 5:33deployment.
- 5:34Separately,
- 5:35Apple
- 5:35open-sourced
- 5:36container,
- 5:37a
- 5:37Swift-based
- 5:37tool
- 5:38for
- 5:38running
- 5:38Linux
- 5:38containers
- 5:39as
- 5:39lightweight
- 5:39VMs
- 5:40on
- 5:40Apple
- 5:40Silicon.
- 5:41It
- 5:42consumes
- 5:42and
- 5:42produces
- 5:42OCI-compatible
- 5:43images,
- 5:44so
- 5:44pulling
- 5:45from
- 5:45and
- 5:45pushing
- 5:45to
- 5:45any
- 5:46standard
- 5:46registry
- 5:46works
- 5:47out
- 5:47of
- 5:47the
- 5:47box.
- 5:48The
- 5:48tool
- 5:48requires
- 5:49macOS
- 5:4926
- 5:50and
- 5:50leverages
- 5:50new
- 5:50virtualization
- 5:51and
- 5:51networking
- 5:52features
- 5:52in
- 5:52that
- 5:52release.
- 5:53The
- 5:54convergence
- 5:54is
- 5:54telling:
- 5:55Apple
- 5:56is
- 5:56building
- 5:56the
- 5:56full
- 5:56stack
- 5:57for
- 5:57developers
- 5:57who
- 5:57want
- 5:58to
- 5:58run
- 5:58AI
- 5:58models
- 5:58locally
- 5:59(Core
- 5:59AI)
- 5:59and
- 5:59test
- 6:00server-side
- 6:00infrastructure
- 6:01natively
- 6:01on
- 6:01Mac
- 6:01(container),
- 6:02making
- 6:02the
- 6:02Mac
- 6:03a
- 6:03more
- 6:03complete
- 6:03AI
- 6:04development
- 6:04platform
- 6:04without
- 6:05cloud
- 6:05dependency.
- 6:06Neither
- 6:06announcement
- 6:07individually
- 6:07reshapes
- 6:08the
- 6:08landscape,
- 6:08but
- 6:08together
- 6:09they
- 6:09make
- 6:09a
- 6:09clear
- 6:09strategic
- 6:10statement.
- 6:11While
- 6:11competitors
- 6:12race
- 6:12to
- 6:12train
- 6:12the
- 6:12biggest
- 6:12model
- 6:13and
- 6:13sell
- 6:13the
- 6:13most
- 6:13tokens,
- 6:14Apple
- 6:14is
- 6:15betting
- 6:15that
- 6:15who
- 6:15owns
- 6:15the
- 6:16runtime
- 6:16wins
- 6:16—
- 6:17and
- 6:17that
- 6:17the
- 6:17billion-device
- 6:18install
- 6:18base
- 6:19running
- 6:19Apple
- 6:19Silicon
- 6:20is
- 6:20the
- 6:20distribution
- 6:21advantage
- 6:21no
- 6:21amount
- 6:21of
- 6:21training
- 6:22compute
- 6:22can
- 6:22replicate.
- 6:25Ideogram
- 6:264
- 6:26is
- 6:26the
- 6:27most
- 6:27significant
- 6:27open-weight
- 6:28image
- 6:28model
- 6:28release
- 6:29in
- 6:29months.
- 6:30Built
- 6:30from
- 6:30scratch
- 6:30as
- 6:30a
- 6:309.3-billion-parameter
- 6:32flow-matching
- 6:33Diffusion
- 6:33Transformer,
- 6:34it
- 6:34uses
- 6:34a
- 6:34fully
- 6:35single-stream
- 6:35architecture:
- 6:36text
- 6:37and
- 6:37image
- 6:37tokens
- 6:38concatenated
- 6:38into
- 6:38one
- 6:38sequence,
- 6:39processed
- 6:40through
- 6:40the
- 6:40same
- 6:4034-layer
- 6:41transformer
- 6:41with
- 6:42no
- 6:42separate
- 6:42branches.
- 6:44Instead
- 6:44of
- 6:44CLIP
- 6:44or
- 6:44T5,
- 6:45the
- 6:45text
- 6:46encoder
- 6:46is
- 6:46Qwen3-VL-8B-Instruct
- 6:48—
- 6:50a
- 6:50full
- 6:51vision-language
- 6:51model
- 6:52—
- 6:52with
- 6:52hidden
- 6:53states
- 6:53from
- 6:5313
- 6:54intermediate
- 6:54layers
- 6:54concatenated
- 6:55for
- 6:55multi-scale
- 6:56semantic
- 6:56features.
- 6:58Trained
- 6:58exclusively
- 6:58on
- 6:59structured
- 6:59JSON
- 6:59captions,
- 7:00it
- 7:00offers
- 7:01explicit
- 7:01control
- 7:02over
- 7:02composition,
- 7:03bounding-box
- 7:03layout,
- 7:04color
- 7:04palettes,
- 7:04and
- 7:05typography.
- 7:06On
- 7:06the
- 7:07Design
- 7:07Arena
- 7:07leaderboard
- 7:08it
- 7:08ranks
- 7:08as
- 7:08the
- 7:08top
- 7:09open-weight
- 7:09model,
- 7:10trailing
- 7:10only
- 7:11proprietary
- 7:11GPT
- 7:12and
- 7:12Gemini.
- 7:14In
- 7:14a
- 7:14blind
- 7:14ContraLabs
- 7:15evaluation,
- 7:16professional
- 7:16designers
- 7:17chose
- 7:17it
- 7:17first
- 7:1747.9%
- 7:18of
- 7:19the
- 7:19time
- 7:19—
- 7:20ahead
- 7:20of
- 7:20Gemini
- 7:203.1
- 7:21Flash
- 7:21at
- 7:2230%
- 7:22and
- 7:22FLUX.2
- 7:23max
- 7:24at
- 7:2415.5%.
- 7:26At
- 7:269.3B
- 7:27parameters
- 7:28it
- 7:28delivers
- 7:28better
- 7:28text
- 7:29rendering
- 7:29than
- 7:29models
- 7:292–8x
- 7:31its
- 7:31size.
- 7:32The
- 7:32open
- 7:33deep
- 7:33research
- 7:33space
- 7:34gets
- 7:34QUEST-35B,
- 7:38trained
- 7:38on
- 7:3932
- 7:39H100s
- 7:40at
- 7:40Ohio
- 7:41State
- 7:41with
- 7:41full
- 7:41recipe,
- 7:42weights,
- 7:42and
- 7:438,000
- 7:43multi-step
- 7:44research
- 7:44traces
- 7:44released.
- 7:45Community
- 7:46reaction
- 7:46is
- 7:46cautiously
- 7:47positive:
- 7:48"multi-step
- 7:48research
- 7:49traces
- 7:49are
- 7:49dense,"
- 7:50but
- 7:50the
- 7:50real
- 7:51question
- 7:51is
- 7:51"how
- 7:51brittle
- 7:52it
- 7:52is
- 7:52to
- 7:52harness
- 7:52changes,
- 7:53because
- 7:53that
- 7:54is
- 7:54where
- 7:54these
- 7:54agents
- 7:54usually
- 7:55fall
- 7:55apart."
- 7:56Cohere's
- 7:57North
- 7:57Mini
- 7:57Code
- 7:58now
- 7:58ships
- 7:58a
- 7:584-bit
- 7:59quantized
- 7:59version
- 8:00that
- 8:00runs
- 8:01on
- 8:0120GB
- 8:01of
- 8:01RAM,
- 8:02available
- 8:03through
- 8:03Ollama
- 8:03and
- 8:03OpenRouter,
- 8:04with
- 8:04community
- 8:05contributions
- 8:06including
- 8:06oMLX
- 8:07implementations
- 8:07and
- 8:08Q6
- 8:08GGUF
- 8:09quants
- 8:09arriving
- 8:10within
- 8:10days.
- 8:11The
- 8:11quantization
- 8:12frontier
- 8:12keeps
- 8:13pushing
- 8:13lower.
- 8:14EdgeRazor
- 8:14is
- 8:15a
- 8:15framework
- 8:15for
- 8:15mixed-precision
- 8:16quantization-aware
- 8:17distillation
- 8:18down
- 8:18to
- 8:181.58
- 8:19bits
- 8:19—
- 8:20a
- 8:20blend
- 8:21of
- 8:214-bit
- 8:22and
- 8:22ternary
- 8:22weights,
- 8:23with
- 8:23configurable
- 8:24ratios
- 8:24including
- 8:252.79-bit
- 8:26and
- 8:261.88-bit
- 8:27variants.
- 8:29It
- 8:29integrates
- 8:29logits,
- 8:30features,
- 8:31and
- 8:31attention
- 8:31distillation
- 8:32in
- 8:32a
- 8:32unified
- 8:32interface,
- 8:33targeting
- 8:34mobile
- 8:34and
- 8:34edge
- 8:35deployment.
- 8:36In
- 8:36the
- 8:36community
- 8:36fine-tune
- 8:37space,
- 8:37Qwable-3.6-27b
- 8:39applies
- 8:40a
- 8:40LoRA
- 8:40adapter
- 8:41to
- 8:41Qwen's
- 8:4127B
- 8:42base
- 8:42using
- 8:43a
- 8:43cleaned
- 8:43Fable
- 8:435-style
- 8:44reasoning
- 8:44dataset,
- 8:45optimized
- 8:46for
- 8:46step-by-step
- 8:47technical
- 8:47responses
- 8:48and
- 8:48downstream
- 8:49GGUF
- 8:49conversion
- 8:49.
- 8:50ScenemaAI
- 8:51also
- 8:51dropped
- 8:52an
- 8:52audio
- 8:52generation
- 8:53model
- 8:53on
- 8:53Hugging
- 8:53Face,
- 8:54though
- 8:54details
- 8:55remain
- 8:55sparse
- 8:55at
- 8:56launch
- 8:56.
- 8:59NVIDIA
- 8:59NeMo
- 9:00AutoModel
- 9:00delivers
- 9:00the
- 9:01kind
- 9:01of
- 9:01gains
- 9:01that
- 9:02make
- 9:02MoE
- 9:02practitioners
- 9:03stop
- 9:03and
- 9:03re-read
- 9:04the
- 9:04benchmarks.
- 9:05Building
- 9:06on
- 9:06HuggingFace
- 9:06Transformers
- 9:07v5's
- 9:07first-class
- 9:08MoE
- 9:08support,
- 9:09it
- 9:09adds
- 9:09Expert
- 9:10Parallelism,
- 9:10DeepEP
- 9:11fused
- 9:11all-to-all
- 9:11dispatch,
- 9:12and
- 9:12TransformerEngine
- 9:13kernels
- 9:13—
- 9:14accessible
- 9:14by
- 9:14changing
- 9:15a
- 9:15single
- 9:15import
- 9:16line.
- 9:16On
- 9:16Qwen3-30B-A3B
- 9:19and
- 9:19Nemotron
- 9:203
- 9:20Nano
- 9:2030B-A3B,
- 9:22this
- 9:22yields
- 9:233.4–3.7x
- 9:25higher
- 9:25training
- 9:25throughput
- 9:26with
- 9:2629–32%
- 9:27less
- 9:28GPU
- 9:28memory
- 9:28versus
- 9:29the
- 9:29best
- 9:29Transformers
- 9:30v5
- 9:30configuration.
- 9:31Peak
- 9:32memory
- 9:32for
- 9:32Qwen3
- 9:32drops
- 9:33from
- 9:3368.2
- 9:34GiB
- 9:34to
- 9:3448.1
- 9:35GiB.
- 9:36At
- 9:36frontier
- 9:36scale,
- 9:37AutoModel
- 9:37enables
- 9:38full
- 9:38fine-tuning
- 9:38of
- 9:39the
- 9:39550B-parameter
- 9:40Nemotron
- 9:403
- 9:41Ultra
- 9:41across
- 9:41128
- 9:42H100
- 9:42GPUs
- 9:42—
- 9:43a
- 9:44regime
- 9:44where
- 9:44Transformers
- 9:45v5
- 9:45simply
- 9:45runs
- 9:45out
- 9:46of
- 9:46memory.
- 9:47The
- 9:47key:
- 9:48Expert
- 9:48Parallelism
- 9:49is
- 9:49treated
- 9:49as
- 9:49orthogonal
- 9:50to
- 9:50data
- 9:50parallelism,
- 9:51so
- 9:51on
- 9:518
- 9:52GPUs
- 9:52the
- 9:52system
- 9:52runs
- 9:53ep=8
- 9:53and
- 9:53dp=8
- 9:54simultaneously,
- 9:56with
- 9:56every
- 9:56GPU
- 9:56holding
- 9:57only
- 9:571/8
- 9:57of
- 9:58the
- 9:58expert
- 9:58weights.
- 9:59Checkpoints
- 9:59remain
- 9:59standard
- 10:00HF
- 10:00safetensors,
- 10:01deployable
- 10:02on
- 10:02vLLM
- 10:02and
- 10:02SGLang
- 10:03without
- 10:03conversion.
- 10:04On
- 10:04the
- 10:04inference
- 10:05side,
- 10:05NVIDIA
- 10:05is
- 10:06claiming
- 10:06a
- 10:0615x
- 10:07speedup
- 10:07using
- 10:07diffusion-based
- 10:08LLM
- 10:08generation,
- 10:09where
- 10:10entire
- 10:10blocks
- 10:10of
- 10:10text
- 10:11are
- 10:11produced
- 10:11at
- 10:11once
- 10:11rather
- 10:12than
- 10:12token
- 10:12by
- 10:12token.
- 10:13Early
- 10:13adopters
- 10:14running
- 10:14the
- 10:1426B
- 10:15diffusion
- 10:15Gemma
- 10:16on
- 10:16AMD
- 10:16Strix
- 10:16Halo
- 10:17report
- 10:17the
- 10:17number
- 10:17is
- 10:18real
- 10:18but
- 10:18context-dependent:
- 10:19predictable
- 10:20outputs
- 10:20like
- 10:20JSON
- 10:21lock
- 10:21in
- 10:21at
- 10:21around
- 10:2270
- 10:22tok/s,
- 10:23while
- 10:23creative
- 10:24writing
- 10:24needs
- 10:24more
- 10:25correction
- 10:25passes
- 10:25and
- 10:26drops
- 10:26to
- 10:26about
- 10:2615.
- 10:27Critical
- 10:28caveats:
- 10:29bf16
- 10:29is
- 10:30mandatory
- 10:30(fp16
- 10:31produces
- 10:31garbage),
- 10:32the
- 10:32exact
- 10:33prompt
- 10:33format
- 10:33matters
- 10:34enormously,
- 10:35and
- 10:35the
- 10:35headline
- 10:35numbers
- 10:36rely
- 10:36on
- 10:36compiler
- 10:37tricks
- 10:37that
- 10:37do
- 10:37not
- 10:37yet
- 10:38work
- 10:38on
- 10:38AMD.
- 10:39The
- 10:39deeper
- 10:39question
- 10:40—
- 10:41if
- 10:41the
- 10:41diffusion
- 10:41model's
- 10:42output
- 10:42is
- 10:42"good
- 10:42enough"
- 10:4395%
- 10:44of
- 10:44the
- 10:44time,
- 10:44why
- 10:45bother
- 10:45with
- 10:45autoregressive
- 10:46verification
- 10:46at
- 10:47all
- 10:47—
- 10:47remains
- 10:48unresolved.
- 10:49But
- 10:4915x
- 10:50is
- 10:50a
- 10:50big
- 10:50enough
- 10:51number
- 10:51that
- 10:51even
- 10:51a
- 10:51fraction
- 10:52of
- 10:52the
- 10:52claimed
- 10:52speedup,
- 10:53on
- 10:53the
- 10:53right
- 10:53workloads,
- 10:54would
- 10:54change
- 10:55how
- 10:55people
- 10:55think
- 10:55about
- 10:56local
- 10:56inference
- 10:56budgets.
- 10:59Google
- 11:00has
- 11:00integrated
- 11:00computer
- 11:01use
- 11:01as
- 11:01a
- 11:01built-in
- 11:02tool
- 11:02in
- 11:02Gemini
- 11:023.5
- 11:03Flash,
- 11:04making
- 11:04it
- 11:04a
- 11:04native
- 11:05capability
- 11:05rather
- 11:06than
- 11:06a
- 11:06standalone
- 11:06model.
- 11:07The
- 11:07system
- 11:07can
- 11:08see,
- 11:08reason
- 11:08about,
- 11:09and
- 11:09take
- 11:09actions
- 11:09across
- 11:10browser,
- 11:10mobile,
- 11:10and
- 11:10desktop
- 11:11environments.
- 11:12To
- 11:12mitigate
- 11:12prompt
- 11:13injection
- 11:13risks,
- 11:13Google
- 11:14uses
- 11:14targeted
- 11:14adversarial
- 11:15training
- 11:15and
- 11:15ships
- 11:16two
- 11:16enterprise
- 11:16safeguard
- 11:17systems:
- 11:18mandatory
- 11:18user
- 11:18confirmation
- 11:19for
- 11:19sensitive
- 11:19actions
- 11:20and
- 11:20automatic
- 11:20task
- 11:21termination
- 11:21when
- 11:21indirect
- 11:22prompt
- 11:22injection
- 11:22is
- 11:22detected.
- 11:23For
- 11:24developers
- 11:24who
- 11:24want
- 11:24Gemini's
- 11:25capabilities
- 11:25through
- 11:25a
- 11:25familiar
- 11:26interface,
- 11:27gemini-web2api
- 11:28reverse-engineers
- 11:29Gemini's
- 11:29web
- 11:30StreamGenerate
- 11:30protocol
- 11:31into
- 11:31an
- 11:31OpenAI-compatible
- 11:31API
- 11:32—
- 11:33zero
- 11:34cost,
- 11:34single
- 11:34Python
- 11:35file,
- 11:35with
- 11:35function
- 11:36calling
- 11:36support,
- 11:37multiple
- 11:37models
- 11:37including
- 11:38Flash
- 11:38Thinking
- 11:38for
- 11:3820k+
- 11:39character
- 11:39output,
- 11:40and
- 11:40adjustable
- 11:40reasoning
- 11:41depth.
- 11:41Anonymous
- 11:42access
- 11:42works
- 11:42for
- 11:42all
- 11:43models;
- 11:43real
- 11:44Pro
- 11:44routing
- 11:44requires
- 11:44a
- 11:44paid
- 11:45Gemini
- 11:45Advanced
- 11:45cookie.
- 11:46Mistral
- 11:47OCR
- 11:474
- 11:47advances
- 11:47document
- 11:48intelligence
- 11:48beyond
- 11:49plain
- 11:49text
- 11:49extraction,
- 11:50returning
- 11:50bounding
- 11:51boxes,
- 11:51typed-block
- 11:52classification
- 11:52(titles,
- 11:53tables,
- 11:53equations,
- 11:54signatures),
- 11:55and
- 11:55inline
- 11:55confidence
- 11:55scores
- 11:56per
- 11:56page
- 11:56and
- 11:57per
- 11:57word.
- 11:58Independent
- 11:58annotators
- 11:59preferred
- 11:59OCR
- 11:594
- 12:00over
- 12:00every
- 12:01competing
- 12:01system
- 12:02tested
- 12:02with
- 12:02win
- 12:02rates
- 12:03averaging
- 12:0372%,
- 12:04and
- 12:04it
- 12:05scored
- 12:05highest
- 12:05on
- 12:05OlmOCRBench
- 12:06at
- 12:0685.20.
- 12:09It
- 12:09supports
- 12:09170
- 12:10languages,
- 12:11runs
- 12:11in
- 12:11a
- 12:11single
- 12:12container
- 12:12for
- 12:12self-hosted
- 12:13deployment,
- 12:14and
- 12:14prices
- 12:14at
- 12:14$4
- 12:15per
- 12:151,000
- 12:16pages
- 12:16($2
- 12:16with
- 12:17batch
- 12:17discount).
- 12:18Early
- 12:18adopter
- 12:19Rogo
- 12:19reported
- 12:19"equivalent
- 12:20accuracy
- 12:21at
- 12:21roughly
- 12:218x
- 12:22lower
- 12:22cost
- 12:22and
- 12:2317x
- 12:23lower
- 12:24latency"
- 12:25versus
- 12:25leading
- 12:25agentic
- 12:26document
- 12:26parsers
- 12:27on
- 12:27financial
- 12:27QA
- 12:27datasets.
- 12:29From
- 12:29research,
- 12:30AADvark
- 12:30out
- 12:30of
- 12:30MIT
- 12:31tackles
- 12:31a
- 12:31gap
- 12:32no
- 12:32prior
- 12:32agent-aided
- 12:33design
- 12:33system
- 12:34has
- 12:34solved:
- 12:353D
- 12:35CAD
- 12:35assemblies
- 12:36with
- 12:36moving
- 12:36parts.
- 12:37The
- 12:37system
- 12:37places
- 12:38Gemini
- 12:383
- 12:39Flash
- 12:39in
- 12:39an
- 12:39iterative
- 12:39loop
- 12:40—
- 12:40writing
- 12:40JSON
- 12:41definitions
- 12:41for
- 12:41parts
- 12:42and
- 12:42joints,
- 12:42compiling
- 12:43via
- 12:43a
- 12:43modified
- 12:44OndselSolver,
- 12:45and
- 12:45refining
- 12:45based
- 12:46on
- 12:46FreeCAD
- 12:46renderings
- 12:47augmented
- 12:47with
- 12:47unique
- 12:47edge
- 12:48colors
- 12:48and
- 12:48text
- 12:48identifiers.
- 12:50The
- 12:50team
- 12:50had
- 12:50to
- 12:50switch
- 12:51the
- 12:51solver
- 12:51from
- 12:51Euler
- 12:52angles
- 12:52to
- 12:52quaternions
- 12:53and
- 12:53make
- 12:53error
- 12:54messages
- 12:54far
- 12:54more
- 12:54informative
- 12:55to
- 12:55compensate
- 12:56for
- 12:56VLMs'
- 12:56spatial
- 12:57reasoning
- 12:57limitations.
- 12:59Generating
- 12:59a
- 12:59functional
- 13:00pair
- 13:00of
- 13:00scissors
- 13:00took
- 13:0120
- 13:01iterations,
- 13:024.14
- 13:03hours,
- 13:03$15.85,
- 13:05and
- 13:05468
- 13:06LLM
- 13:06calls
- 13:07across
- 13:0718.2M
- 13:08input
- 13:08tokens
- 13:09—
- 13:09an
- 13:09expensive
- 13:10demo,
- 13:11but
- 13:11the
- 13:11first
- 13:11time
- 13:11any
- 13:12system
- 13:12has
- 13:12passed
- 13:13what
- 13:13the
- 13:13authors
- 13:13call
- 13:14"the
- 13:14scissors
- 13:14test":
- 13:15producing
- 13:15a
- 13:153D
- 13:16assembly
- 13:17whose
- 13:17parts
- 13:17actually
- 13:18move
- 13:18in
- 13:18a
- 13:18mechanically
- 13:19correct
- 13:19slicing
- 13:20motion.
- 13:23A
- 13:23PhD
- 13:23student's
- 13:24post
- 13:24about
- 13:24a
- 13:24colleague's
- 13:25relationship
- 13:25with
- 13:25AI
- 13:26agents
- 13:26reads
- 13:27less
- 13:27like
- 13:27satire
- 13:28and
- 13:28more
- 13:28like
- 13:28a
- 13:28clinical
- 13:28case
- 13:29study.
- 13:30The
- 13:30colleague
- 13:30becomes
- 13:31"insanely
- 13:32anxious"
- 13:33whenever
- 13:33no
- 13:33agents
- 13:33are
- 13:33running,
- 13:34wakes
- 13:34at
- 13:343
- 13:35AM
- 13:35to
- 13:35assign
- 13:35new
- 13:35tasks,
- 13:36and
- 13:36when
- 13:37the
- 13:37university
- 13:37ran
- 13:37out
- 13:38of
- 13:38tokens,
- 13:38threatened
- 13:39colleagues
- 13:39he
- 13:39perceived
- 13:40as
- 13:40overusing
- 13:40their
- 13:40allocation.
- 13:42He
- 13:42has
- 13:42private
- 13:42ChatGPT
- 13:43and
- 13:43Anthropic
- 13:43subscriptions
- 13:44on
- 13:44top
- 13:44of
- 13:44university-provided
- 13:45access
- 13:46and
- 13:46reportedly
- 13:47burned
- 13:471,000
- 13:47euros
- 13:48of
- 13:48departmental
- 13:48budget
- 13:49in
- 13:49a
- 13:49single
- 13:49pre-NeurIPS
- 13:50all-nighter.
- 13:51His
- 13:51defense:
- 13:52"tokens
- 13:52are
- 13:52not
- 13:53a
- 13:53substance
- 13:53and
- 13:53AI
- 13:53is
- 13:54not
- 13:54like
- 13:54gambling,"
- 13:55so
- 13:55addiction
- 13:55is
- 13:55impossible.
- 13:56His
- 13:57colleagues
- 13:57coined
- 13:58"tokaine
- 13:58addiction,"
- 13:59and
- 13:59the
- 13:59community
- 13:59response
- 14:00is
- 14:00sobering
- 14:00—
- 14:01multiple
- 14:01commenters
- 14:02report
- 14:02identical
- 14:03patterns
- 14:03in
- 14:03their
- 14:03own
- 14:04workplaces,
- 14:05including
- 14:05one
- 14:05startup
- 14:06employee
- 14:06describing
- 14:06company
- 14:07parties
- 14:07where
- 14:08"everyone
- 14:08is
- 14:08on
- 14:08their
- 14:08phones
- 14:09looking
- 14:09at
- 14:09their
- 14:09agents
- 14:10doing
- 14:10stupid
- 14:10tasks."
- 14:11The
- 14:11comparison
- 14:12to
- 14:12compulsive
- 14:12gaming
- 14:12is
- 14:13apt:
- 14:13the
- 14:13vehicle
- 14:14differs,
- 14:15but
- 14:15the
- 14:15pattern
- 14:15of
- 14:15escalating
- 14:16engagement
- 14:17despite
- 14:17negative
- 14:18consequences
- 14:18to
- 14:18sleep,
- 14:19finances,
- 14:20and
- 14:20relationships
- 14:21is
- 14:21textbook
- 14:21behavioral
- 14:22compulsion.
- 14:23For
- 14:24a
- 14:24healthier
- 14:24relationship
- 14:25with
- 14:25local
- 14:25models,
- 14:26consider
- 14:26the
- 14:26developer
- 14:27who
- 14:27wired
- 14:27an
- 14:27MQ-2
- 14:28gas
- 14:28sensor
- 14:28into
- 14:28a
- 14:29suitcase
- 14:29robot
- 14:29running
- 14:30a
- 14:30local
- 14:30LLM.
- 14:31When
- 14:31smoke
- 14:31hits
- 14:32the
- 14:32sensor,
- 14:32it
- 14:32modulates
- 14:33the
- 14:33sampler
- 14:33temperature
- 14:34(1.0
- 14:35to
- 14:35~1.6),
- 14:36top
- 14:36p
- 14:36(0.95
- 14:37to
- 14:370.99),
- 14:39and
- 14:39top
- 14:39k
- 14:39(64
- 14:40to
- 14:40120)
- 14:41in
- 14:41real
- 14:41time,
- 14:42so
- 14:42the
- 14:42robot's
- 14:42speech
- 14:43genuinely
- 14:43gets
- 14:43loopier
- 14:44—
- 14:44lower-probability,
- 14:45more
- 14:45associative
- 14:46tokens
- 14:46—
- 14:47without
- 14:47any
- 14:47scripted
- 14:48behavior.
- 14:49A
- 14:49per-phase
- 14:50persona
- 14:50nudge
- 14:51makes
- 14:51the
- 14:51robot
- 14:51show
- 14:51the
- 14:52effects
- 14:52without
- 14:52announcing
- 14:53them,
- 14:53while
- 14:53the
- 14:53physical
- 14:54body
- 14:54adds
- 14:54drooping
- 14:55eyes
- 14:55and
- 14:55a
- 14:55smoke-and-plasma
- 14:56display
- 14:56at
- 14:57phase
- 14:5710.
- 14:58The
- 14:58creator's
- 14:58honest
- 14:58caveat
- 14:59—
- 15:00"a
- 15:00cigarette
- 15:00or
- 15:00incense
- 15:01probably
- 15:01trips
- 15:02it
- 15:02too"
- 15:02—
- 15:03does
- 15:03not
- 15:03diminish
- 15:03what
- 15:03amounts
- 15:04to
- 15:04one
- 15:04of
- 15:04the
- 15:04most
- 15:04creative
- 15:05demonstrations
- 15:05of
- 15:05how
- 15:05sampling
- 15:06parameters
- 15:06shape
- 15:07LLM
- 15:07behavior
- 15:08in
- 15:08practice.