Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – May 01, 2026
Transcript
- 0:00The
- 0:00shai-hulud
- 0:00threat
- 0:01actor
- 0:01is
- 0:01back,
- 0:01and
- 0:01this
- 0:01time
- 0:02the
- 0:02sandworm
- 0:02burrowed
- 0:02into
- 0:03PyTorch.
- 0:04Semgrep
- 0:04disclosed
- 0:04that
- 0:04the
- 0:05PyPI
- 0:05package
- 0:05lightning
- 0:06--
- 0:06the
- 0:06widely-used
- 0:07PyTorch
- 0:07Lightning
- 0:07deep
- 0:08learning
- 0:08framework
- 0:08--
- 0:08was
- 0:09compromised
- 0:09in
- 0:09versions
- 0:102.6.2
- 0:11and
- 0:112.6.3,
- 0:13published
- 0:14April
- 0:1430.
- 0:15Anyone
- 0:15running
- 0:15pip
- 0:16install
- 0:16lightning
- 0:16during
- 0:17the
- 0:17affected
- 0:17window
- 0:18activated
- 0:18a
- 0:18hidden
- 0:18runtime
- 0:19directory
- 0:19containing
- 0:20a
- 0:2014.8
- 0:21MB
- 0:21obfuscated
- 0:21JavaScript
- 0:22payload
- 0:22that
- 0:22executes
- 0:23on
- 0:23import.
- 0:24The
- 0:24malware
- 0:24steals
- 0:25credentials,
- 0:25authentication
- 0:26tokens,
- 0:26environment
- 0:27variables,
- 0:27and
- 0:28cloud
- 0:28secrets
- 0:28across
- 0:29all
- 0:29three
- 0:29major
- 0:29providers
- 0:30(AWS
- 0:30via
- 0:31IMDSv2
- 0:32and
- 0:32Secrets
- 0:32Manager
- 0:32enumeration,
- 0:33Azure
- 0:34via
- 0:34DefaultAzureCredential
- 0:35and
- 0:35Key
- 0:35Vault,
- 0:36GCP
- 0:36via
- 0:37GoogleAuth
- 0:37and
- 0:37Secret
- 0:38Manager).
- 0:39On
- 0:39GitHub
- 0:39Actions
- 0:39runners,
- 0:40it
- 0:40dumps
- 0:40Runner.Worker
- 0:41process
- 0:41memory
- 0:42to
- 0:42extract
- 0:42every
- 0:43secret
- 0:43marked
- 0:47The
- 0:47cross-ecosystem
- 0:48propagation
- 0:49is
- 0:49particularly
- 0:49nasty:
- 0:50if
- 0:51the
- 0:51malware
- 0:51finds
- 0:51npm
- 0:52publish
- 0:52credentials,
- 0:53it
- 0:53injects
- 0:53a
- 0:53dropper
- 0:54into
- 0:54every
- 0:54package
- 0:54that
- 0:55token
- 0:55can
- 0:55publish,
- 0:56bumps
- 0:56the
- 0:56patch
- 0:56version,
- 0:57and
- 0:57republishes
- 0:57--
- 0:58worming
- 0:58from
- 0:59PyPI
- 0:59into
- 0:59npm
- 1:00silently.
- 1:01What
- 1:01makes
- 1:01this
- 1:01iteration
- 1:02notable
- 1:02beyond
- 1:03the
- 1:03credential
- 1:03theft
- 1:03is
- 1:03its
- 1:04abuse
- 1:04of
- 1:04developer
- 1:04tooling
- 1:05for
- 1:05persistence.
- 1:06The
- 1:06malware
- 1:06writes
- 1:07a
- 1:07SessionStart
- 1:07hook
- 1:07into
- 1:09.claude/settings.json
- 1:10with
- 1:11matcher:
- 1:11"",
- 1:11firing
- 1:12every
- 1:12time
- 1:12a
- 1:12developer
- 1:12opens
- 1:13Claude
- 1:13Code
- 1:13in
- 1:13the
- 1:13infected
- 1:14repository
- 1:14--
- 1:15no
- 1:15user
- 1:16action
- 1:16required
- 1:16beyond
- 1:17launching
- 1:17the
- 1:17session.
- 1:18A
- 1:18parallel
- 1:21.vscode/tasks.json
- 1:24hook
- 1:24triggers
- 1:24on
- 1:24folder
- 1:25open
- 1:25for
- 1:25VS
- 1:25Code
- 1:25users.
- 1:27Both
- 1:27invoke
- 1:27a
- 1:27Bun
- 1:28runtime
- 1:28bootstrapper
- 1:29that
- 1:29downloads
- 1:29bun-v1.3.13
- 1:32if
- 1:32absent,
- 1:33executes
- 1:33the
- 1:33full
- 1:33payload,
- 1:34and
- 1:34cleans
- 1:34up
- 1:35from
- 1:35/tmp.
- 1:36This
- 1:37may
- 1:37be
- 1:37among
- 1:37the
- 1:37first
- 1:38documented
- 1:38instances
- 1:39of
- 1:39malware
- 1:39weaponizing
- 1:40Claude
- 1:40Code's
- 1:40hook
- 1:41system
- 1:41in
- 1:41a
- 1:41real-world
- 1:42attack.
- 1:43If
- 1:43a
- 1:43GitHub
- 1:43token
- 1:43with
- 1:44write
- 1:44access
- 1:44is
- 1:45present,
- 1:45a
- 1:45bonus
- 1:46payload
- 1:46pushes
- 1:46a
- 1:47workflow
- 1:47named
- 1:47"Formatter"
- 1:48that
- 1:48dumps
- 1:49all
- 1:49repository
- 1:50secrets
- 1:50via
- 1:50${{
- 1:51toJSON(secrets)
- 1:51}}
- 1:52as
- 1:52a
- 1:52downloadable
- 1:53Actions
- 1:53artifact.
- 1:54Any
- 1:54machine
- 1:55that
- 1:55imported
- 1:56the
- 1:56malicious
- 1:56package
- 1:56should
- 1:57be
- 1:57treated
- 1:57as
- 1:57fully
- 1:58look
- 1:59for
- 1:59commit
- 1:59messages
- 2:00prefixed
- 2:00with
- 2:01EveryBoiWeBuildIsAWormyBoi
- 2:02and
- 2:02repos
- 2:03with
- 2:03the
- 2:03description
- 2:04"A
- 2:04Mini
- 2:04Shai-Hulud
- 2:05has
- 2:05Appeared."
- 2:06Meanwhile,
- 2:07a
- 2:07separate
- 2:08disclosure
- 2:08highlighted
- 2:09the
- 2:09fragile
- 2:09state
- 2:09of
- 2:10kernel
- 2:10vulnerability
- 2:11coordination.
- 2:12CVE-2026-31431
- 2:14(CopyFail),
- 2:16a
- 2:16local
- 2:17privilege
- 2:17escalation
- 2:18in
- 2:18the
- 2:18Linux
- 2:18kernel
- 2:19introduced
- 2:19in
- 2:19version
- 2:194.14
- 2:20back
- 2:20in
- 2:212017,
- 2:22was
- 2:22fixed
- 2:22in
- 2:226.18.22
- 2:25and
- 2:256.19.12
- 2:26--
- 2:28but
- 2:28longterm
- 2:28kernels
- 2:286.12
- 2:29through
- 2:305.10
- 2:31remain
- 2:31unpatched,
- 2:32and
- 2:32the
- 2:32fix
- 2:32does
- 2:32not
- 2:32backport
- 2:33cleanly.
- 2:34Sam
- 2:34James
- 2:34of
- 2:34Gentoo
- 2:35posted
- 2:35a
- 2:35workaround
- 2:36patch,
- 2:36noting
- 2:36bluntly:
- 2:37"for
- 2:37Linux
- 2:38kernel
- 2:38vulnerabilities,
- 2:39unless
- 2:40the
- 2:40reporter
- 2:40chooses
- 2:41to
- 2:41bring
- 2:41it
- 2:41to
- 2:41the
- 2:41linux-distros
- 2:42ML,
- 2:43there
- 2:43is
- 2:43no
- 2:43heads-up
- 2:44to
- 2:44distributions."
- 2:45The
- 2:45structural
- 2:46gap
- 2:46between
- 2:46kernel
- 2:47maintainers
- 2:47and
- 2:47downstream
- 2:48distributions
- 2:49remains
- 2:49a
- 2:49persistent
- 2:50weakness
- 2:50in
- 2:50the
- 2:50open-source
- 2:51security
- 2:51model.
- 2:52On
- 2:53the
- 2:53lighter
- 2:53side
- 2:53of
- 2:53tool
- 2:53misbehavior,
- 2:54Theo
- 2:55Browne
- 2:55flagged
- 2:55that
- 2:55Claude
- 2:56Code
- 2:56refuses
- 2:56requests
- 2:57or
- 2:57charges
- 2:58extra
- 2:58if
- 2:58recent
- 2:59commits
- 2:59mention
- 3:00"OpenClaw"
- 3:00in
- 3:01a
- 3:01JSON
- 3:01blob
- 3:01--
- 3:02even
- 3:02in
- 3:02an
- 3:02empty
- 3:03repository
- 3:03with
- 3:04no
- 3:04code.
- 3:05The
- 3:05behavior
- 3:06appears
- 3:06to
- 3:06be
- 3:06an
- 3:06artifact
- 3:07of
- 3:07competitive-product
- 3:08detection
- 3:08leaking
- 3:09into
- 3:09billing
- 3:09logic,
- 3:10and
- 3:10while
- 3:11Anthropic
- 3:11has
- 3:11not
- 3:12commented
- 3:12publicly,
- 3:13it
- 3:13is
- 3:13a
- 3:13reminder
- 3:14that
- 3:14the
- 3:14tools
- 3:14developers
- 3:15rely
- 3:15on
- 3:15carry
- 3:16their
- 3:16own
- 3:16opaque
- 3:16policy
- 3:17layers.
- 3:21The
- 3:21prevailing
- 3:22narrative
- 3:22around
- 3:22AI-driven
- 3:23vulnerability
- 3:23discovery
- 3:24has
- 3:24been
- 3:24that
- 3:24it
- 3:24requires
- 3:25frontier
- 3:25models
- 3:26with
- 3:26restricted
- 3:26access
- 3:27--
- 3:27Anthropic's
- 3:28Mythos
- 3:28program
- 3:28being
- 3:29the
- 3:29marquee
- 3:29example.
- 3:30Niels
- 3:30Provos,
- 3:31the
- 3:31original
- 3:31author
- 3:31of
- 3:32the
- 3:321998
- 3:32OpenBSD
- 3:33TCP
- 3:34SACK
- 3:34implementation
- 3:35that
- 3:35Anthropic's
- 3:35red
- 3:36team
- 3:36flagged
- 3:36as
- 3:36their
- 3:37headline
- 3:37finding,
- 3:38decided
- 3:38to
- 3:38test
- 3:38that
- 3:39claim.
- 3:39Using
- 3:40his
- 3:40open-source
- 3:40framework
- 3:41built
- 3:41around
- 3:41finite-state-machine
- 3:42workflows,
- 3:43he
- 3:43replicated
- 3:44the
- 3:44OpenBSD
- 3:44discovery
- 3:45and
- 3:45then
- 3:46autonomously
- 3:46found
- 3:46new
- 3:47zero-day
- 3:47vulnerabilities
- 3:48in
- 3:48four
- 3:48widely-used
- 3:49open-source
- 3:49projects
- 3:49--
- 3:50using
- 3:50commercial
- 3:51models
- 3:51like
- 3:51Claude
- 3:51Sonnet
- 3:52and
- 3:52open-weight
- 3:52models
- 3:53like
- 3:53Z.AI's
- 3:53offering.
- 3:54The
- 3:54framework
- 3:55employs
- 3:55a
- 3:55central
- 3:55orchestrator
- 3:56agent
- 3:56that
- 3:57routes
- 3:57to
- 3:57specialized
- 3:57agents
- 3:58based
- 3:58on
- 3:58an
- 3:58append-only
- 3:59execution
- 3:59journal,
- 4:00with
- 4:00tiered
- 4:00harness
- 4:00construction:
- 4:01single-function
- 4:02isolation,
- 4:03multi-component
- 4:03harnesses,
- 4:04and
- 4:04full
- 4:04end-to-end
- 4:05VM
- 4:05validation.
- 4:06The
- 4:06economics
- 4:07are
- 4:07striking.
- 4:08A
- 4:08single
- 4:08investigation
- 4:09consumes
- 4:09roughly
- 4:0910
- 4:10million
- 4:10tokens
- 4:10on
- 4:10Sonnet
- 4:11($30)
- 4:11or
- 4:11Opus
- 4:12($150).
- 4:14Z.AI's
- 4:14hosted
- 4:15open-weight
- 4:15model
- 4:16averaged
- 4:1627
- 4:16million
- 4:17tokens
- 4:17per
- 4:17run
- 4:18but
- 4:18at
- 4:18comparable
- 4:18cost
- 4:19per
- 4:19investigation
- 4:19due
- 4:20to
- 4:20lower
- 4:20per-token
- 4:20pricing.
- 4:21One
- 4:21discovery
- 4:22--
- 4:22an
- 4:23integer
- 4:23truncation
- 4:23flaw
- 4:24in
- 4:24a
- 4:24foundational
- 4:24library
- 4:25dormant
- 4:25for
- 4:25eighteen
- 4:26years
- 4:26--
- 4:26required
- 4:27manual
- 4:27confirmation
- 4:28of
- 4:28exploitability
- 4:28primitives,
- 4:29during
- 4:29which
- 4:29the
- 4:29model's
- 4:30AUP
- 4:30guardrails
- 4:31blocked
- 4:31further
- 4:31collaboration
- 4:32after
- 4:32two
- 4:32of
- 4:32seven
- 4:33planned
- 4:33exploit-development
- 4:34steps.
- 4:35Provos
- 4:35frames
- 4:35this
- 4:36friction
- 4:36as
- 4:36the
- 4:36core
- 4:37asymmetry:
- 4:38"a
- 4:38defender
- 4:38doing
- 4:39legitimate
- 4:39work
- 4:39hit
- 4:40friction
- 4:40that
- 4:40a
- 4:40well-resourced
- 4:41adversary
- 4:42using
- 4:42uncensored
- 4:43open-weight
- 4:43models
- 4:43would
- 4:43not."
- 4:44The
- 4:45seven-step
- 4:45refusal
- 4:46is
- 4:46exactly
- 4:46the
- 4:46kind
- 4:46of
- 4:47gate
- 4:47that
- 4:47does
- 4:47not
- 4:47exist
- 4:48for
- 4:48attackers
- 4:48running
- 4:49locally.
- 4:50The
- 4:50framework
- 4:50is
- 4:50open-source,
- 4:51and
- 4:52Provos
- 4:52encourages
- 4:52security
- 4:53engineers
- 4:53to
- 4:54contribute
- 4:54--
- 4:55particularly
- 4:55toward
- 4:55easier
- 4:56onboarding.
- 4:57The
- 4:57implication
- 4:58is
- 4:58clear:
- 4:59the
- 4:59capability
- 4:59floor
- 5:00for
- 5:00automated
- 5:00vulnerability
- 5:01discovery
- 5:01is
- 5:02now
- 5:02low
- 5:02enough
- 5:02that
- 5:02commodity
- 5:03models
- 5:03can
- 5:03clear
- 5:04it,
- 5:04and
- 5:04the
- 5:04scaffolding
- 5:05matters
- 5:05more
- 5:05than
- 5:05the
- 5:06model.
- 5:09The
- 5:09Agentics
- 5:10Foundation
- 5:10published
- 5:10the
- 5:11OIA
- 5:11Model
- 5:11--
- 5:12Open
- 5:12Intelligence
- 5:13Architecture
- 5:13--
- 5:14a
- 5:14nine-layer
- 5:14reference
- 5:15architecture
- 5:15for
- 5:15organizing
- 5:16intelligent
- 5:16systems
- 5:17in
- 5:17enterprise
- 5:17environments.
- 5:19Modeled
- 5:19explicitly
- 5:20on
- 5:20the
- 5:20OSI
- 5:20networking
- 5:20stack
- 5:21(with
- 5:21bottom-up
- 5:21numbering
- 5:22from
- 5:22Layer
- 5:220
- 5:22Physical
- 5:23Compute
- 5:23through
- 5:23Layer
- 5:239
- 5:24Human
- 5:24and
- 5:24Browser
- 5:24Interface),
- 5:25it
- 5:25addresses
- 5:26concerns
- 5:26that
- 5:26prior
- 5:27frameworks
- 5:27were
- 5:27not
- 5:27designed
- 5:28for:
- 5:28persistent
- 5:29memory
- 5:29across
- 5:29sessions,
- 5:30autonomous
- 5:31action
- 5:31exceeding
- 5:32explicit
- 5:32instruction,
- 5:33and
- 5:34consequential
- 5:34outputs
- 5:35requiring
- 5:35auditable
- 5:35judgment.
- 5:37Two
- 5:37paired
- 5:37state-holding
- 5:38layers
- 5:38bracket
- 5:38the
- 5:38operational
- 5:39core:
- 5:40Layer
- 5:403
- 5:40(Agent
- 5:41Data
- 5:41Substrate)
- 5:41holds
- 5:42the
- 5:42data
- 5:42systems
- 5:42operate
- 5:43on,
- 5:44while
- 5:44Layer
- 5:448
- 5:45(Continuity
- 5:45Fabric)
- 5:45maintains
- 5:46the
- 5:46cognitive
- 5:46state
- 5:46systems
- 5:47become
- 5:47--
- 5:48memory,
- 5:48learned
- 5:49adaptations,
- 5:49and
- 5:50verifiable
- 5:50decision
- 5:51trails.
- 5:52Six
- 5:52cross-layer
- 5:53spans
- 5:53(security,
- 5:54sovereignty,
- 5:54auditability,
- 5:55identity,
- 5:56energy,
- 5:56provenance)
- 5:57cut
- 5:57horizontally
- 5:57across
- 5:58all
- 5:58The
- 5:59specification
- 5:59is
- 5:59in
- 5:59active
- 6:00public
- 6:00review
- 6:00with
- 6:00eleven
- 6:01numbered
- 6:01decisions
- 6:02open
- 6:02for
- 6:02challenge,
- 6:03and
- 6:03the
- 6:03Foundation
- 6:04explicitly
- 6:04invites
- 6:04pushback
- 6:05by
- 6:05decision
- 6:05number
- 6:06rather
- 6:06than
- 6:06scattered
- 6:07marginalia.
- 6:08The
- 6:08timing
- 6:08is
- 6:08not
- 6:08accidental.
- 6:09The
- 6:10OIA
- 6:10document
- 6:10cites
- 6:11three
- 6:11developments
- 6:11that
- 6:11made
- 6:12a
- 6:12reference
- 6:12architecture
- 6:12operationally
- 6:13urgent:
- 6:14Anthropic's
- 6:15Mythos
- 6:15system
- 6:15card
- 6:16signaling
- 6:16that
- 6:16offensive
- 6:17capability
- 6:17has
- 6:17outpaced
- 6:18defensive
- 6:18readiness,
- 6:19agentic
- 6:19deployment
- 6:20across
- 6:20regulated
- 6:20sectors
- 6:21without
- 6:21shared
- 6:21vocabulary
- 6:22producing
- 6:22architectural
- 6:23fragmentation,
- 6:24and
- 6:24disclosures
- 6:25of
- 6:25unanticipated
- 6:25model
- 6:26behaviors
- 6:26including
- 6:27strategic
- 6:27concealment.
- 6:28Whether
- 6:28the
- 6:28OIA
- 6:29Model
- 6:29gains
- 6:29adoption
- 6:30or
- 6:30becomes
- 6:31another
- 6:31aspirational
- 6:32framework
- 6:32remains
- 6:32to
- 6:33be
- 6:33seen,
- 6:33but
- 6:33the
- 6:33gap
- 6:34it
- 6:34names
- 6:34is
- 6:34real
- 6:34--
- 6:35ask
- 6:36any
- 6:36enterprise
- 6:36architect
- 6:37deploying
- 6:37production
- 6:38AI
- 6:38what
- 6:38reference
- 6:39model
- 6:39they
- 6:39use,
- 6:40and
- 6:40you
- 6:40will
- 6:40get
- 6:40a
- 6:40different
- 6:41answer
- 6:41every
- 6:41time.
- 6:42A
- 6:42research
- 6:43paper
- 6:43from
- 6:43Sant'Anna
- 6:43School
- 6:44of
- 6:44Advanced
- 6:44Studies
- 6:44provides
- 6:45the
- 6:45theoretical
- 6:45complement.
- 6:46"Agentic
- 6:47Microphysics"
- 6:47proposes
- 6:48that
- 6:48safety
- 6:49analysis
- 6:49must
- 6:49shift
- 6:50from
- 6:50individual
- 6:50model
- 6:50evaluation
- 6:51to
- 6:51population-level
- 6:52dynamics
- 6:52--
- 6:53what
- 6:53happens
- 6:54when
- 6:54one
- 6:54agent's
- 6:54output
- 6:55becomes
- 6:55another
- 6:55agent's
- 6:56input
- 6:56under
- 6:56specific
- 6:57protocol
- 6:57conditions.
- 6:59The
- 6:59core
- 6:59argument:
- 7:00individually
- 7:00aligned
- 7:01agents
- 7:01can
- 7:01participate
- 7:02in
- 7:02emergent
- 7:02information
- 7:03cascades,
- 7:03tacit
- 7:04collusion,
- 7:04and
- 7:04collective
- 7:05deception.
- 7:06The
- 7:06paper
- 7:07introduces
- 7:07a
- 7:07generative
- 7:08methodology
- 7:08borrowed
- 7:09from
- 7:09computational
- 7:09social
- 7:10science
- 7:10(Epstein
- 7:11and
- 7:11Axtell's
- 7:12"growing
- 7:12artificial
- 7:13societies"
- 7:13tradition)
- 7:14and
- 7:14applies
- 7:15it
- 7:15to
- 7:15a
- 7:15controlled
- 7:15experiment
- 7:16where
- 7:16LLM
- 7:17agents
- 7:17interact
- 7:18through
- 7:18a
- 7:18shared
- 7:18news
- 7:19The
- 7:19central
- 7:20empirical
- 7:20finding
- 7:21is
- 7:21that
- 7:21feed
- 7:21position,
- 7:22not
- 7:22visible
- 7:22social
- 7:23proof,
- 7:23governs
- 7:24collective
- 7:24attention
- 7:24--
- 7:25agents
- 7:26select
- 7:26almost
- 7:27exclusively
- 7:27from
- 7:27top-ranked
- 7:28items
- 7:28regardless
- 7:29of
- 7:29endorsement
- 7:29counts.
- 7:30The
- 7:30safety
- 7:30implication:
- 7:32an
- 7:32adversary
- 7:32manipulating
- 7:33ranking
- 7:33can
- 7:33induce
- 7:34synchronized
- 7:34attention
- 7:34shifts
- 7:35across
- 7:35heterogeneous
- 7:36agent
- 7:36populations,
- 7:38a
- 7:38common
- 7:38architectural
- 7:38failure
- 7:39mode
- 7:39the
- 7:39authors
- 7:39describe
- 7:40as
- 7:40exploitable
- 7:41by
- 7:41design.
- 7:42On
- 7:42the
- 7:42practitioner
- 7:43side,
- 7:44Rohit
- 7:44Sharma
- 7:44articulated
- 7:45a
- 7:45problem
- 7:45that
- 7:45anyone
- 7:46running
- 7:46agentic
- 7:46workloads
- 7:47on
- 7:47hosted
- 7:47APIs
- 7:48recognizes:
- 7:49the
- 7:49"unprovability
- 7:50gap"
- 7:51between
- 7:51knowing
- 7:51model
- 7:51quality
- 7:52degraded
- 7:52and
- 7:52being
- 7:53able
- 7:53to
- 7:53prove
- 7:53it.
- 7:54Anthropic
- 7:55published
- 7:55a
- 7:55postmortem
- 7:56disclosing
- 7:56three
- 7:56product-layer
- 7:57changes
- 7:57that
- 7:58caused
- 7:58Claude
- 7:58Code
- 7:58degradation
- 7:59--
- 8:00a
- 8:00lower
- 8:00default
- 8:00reasoning
- 8:01effort,
- 8:01a
- 8:01caching
- 8:02bug
- 8:02clearing
- 8:02thinking
- 8:03history,
- 8:03and
- 8:04a
- 8:04system
- 8:04prompt
- 8:04capping
- 8:05inter-tool-call
- 8:05text.
- 8:06Sharma
- 8:07notes
- 8:07that
- 8:07the
- 8:07dimensions
- 8:08that
- 8:08matter
- 8:08(reasoning
- 8:08depth,
- 8:09initiative,
- 8:10willingness
- 8:10to
- 8:10push
- 8:10back)
- 8:11are
- 8:11subjective
- 8:11and
- 8:11high-dimensional,
- 8:12with
- 8:13no
- 8:13eval
- 8:13suite
- 8:14that
- 8:14captures
- 8:14"the
- 8:14model
- 8:15stopped
- 8:15challenging
- 8:15my
- 8:16bad
- 8:16idea."
- 8:17Every
- 8:17agentic
- 8:18system
- 8:18on
- 8:18a
- 8:18hosted
- 8:19API
- 8:19carries
- 8:19a
- 8:19silent
- 8:20dependency
- 8:20on
- 8:20quality
- 8:21consistency
- 8:22that
- 8:22no
- 8:22SLA
- 8:22currently
- 8:23covers.
- 8:24Irene
- 8:24Abezgauz
- 8:24offered
- 8:25a
- 8:25practical
- 8:25framework
- 8:26for
- 8:26the
- 8:26organizational
- 8:27side
- 8:27of
- 8:27this
- 8:27transition:
- 8:28a
- 8:2820-30-50
- 8:31split
- 8:32for
- 8:32PM
- 8:32teams
- 8:32in
- 8:32the
- 8:33hybrid
- 8:33AI
- 8:33era.
- 8:34Twenty
- 8:34percent
- 8:35of
- 8:35capacity
- 8:35goes
- 8:36to
- 8:36AI
- 8:36tools
- 8:36setup
- 8:37and
- 8:37maintenance
- 8:37(prompts,
- 8:38evals,
- 8:39workflows,
- 8:40integrations),
- 8:41thirty
- 8:41percent
- 8:41to
- 8:42agentic
- 8:42workforce
- 8:42management
- 8:43(reviewing
- 8:43and
- 8:43synthesizing
- 8:44agent
- 8:44output
- 8:45--
- 8:46"closer
- 8:46to
- 8:46leading
- 8:47a
- 8:47team
- 8:47than
- 8:47to
- 8:47IC
- 8:47work"),
- 8:48and
- 8:48fifty
- 8:48percent
- 8:49to
- 8:49core
- 8:49PM
- 8:49work
- 8:50that
- 8:50stays
- 8:50human:
- 8:51strategy,
- 8:52prioritization,
- 8:53stakeholder
- 8:53alignment,
- 8:54customer
- 8:54conversations.
- 8:56The
- 8:56key
- 8:56insight:
- 8:56agents
- 8:57reduce
- 8:57mechanical
- 8:58work
- 8:58linearly
- 8:58but
- 8:59judgment
- 8:59work
- 8:59stays
- 8:59the
- 9:00same
- 9:00or
- 9:00increases,
- 9:01and
- 9:01cutting
- 9:01headcount
- 9:02proportional
- 9:03to
- 9:03total
- 9:03time
- 9:03saved
- 9:04causes
- 9:04strategy
- 9:04degradation
- 9:05that
- 9:05only
- 9:06surfaces
- 9:06in
- 9:06outcomes
- 9:07months
- 9:10Salvatore
- 9:10Sanfilippo
- 9:11(antirez,
- 9:12of
- 9:12Redis
- 9:12fame)
- 9:12shipped
- 9:13experimental
- 9:13llama.cpp
- 9:14support
- 9:15for
- 9:15DeepSeek
- 9:15v4
- 9:16Flash,
- 9:16with
- 9:16a
- 9:16GGUF
- 9:17quantization
- 9:18that
- 9:18fits
- 9:18in
- 9:18128
- 9:19GB
- 9:19of
- 9:19RAM.
- 9:20The
- 9:20approach
- 9:20is
- 9:20surgical:
- 9:21routed
- 9:21experts
- 9:22are
- 9:22quantized
- 9:22to
- 9:222
- 9:22bits
- 9:23using
- 9:23two
- 9:23different
- 9:232-bit
- 9:24quant
- 9:24schemes
- 9:24to
- 9:24balance
- 9:25error
- 9:25and
- 9:25size,
- 9:26while
- 9:26shared
- 9:26experts
- 9:26and
- 9:26all
- 9:26non-expert
- 9:27weights
- 9:27stay
- 9:27at
- 9:27Q8.
- 9:28The
- 9:28result
- 9:29runs
- 9:29at
- 9:2917-21
- 9:30tok/s
- 9:31on
- 9:31a
- 9:31MacBook
- 9:31M3
- 9:31Max
- 9:31--
- 9:32firmly
- 9:32in
- 9:33the
- 9:33"usable"
- 9:33zone
- 9:33for
- 9:33a
- 9:33model
- 9:34that,
- 9:34even
- 9:34at
- 9:342-bit
- 9:35quantization,
- 9:36feels
- 9:36qualitatively
- 9:36stronger
- 9:37than
- 9:37Qwen
- 9:373.6
- 9:3827B
- 9:38in
- 9:39subjective
- 9:39evaluation.
- 9:40Community
- 9:40response
- 9:41was
- 9:41immediate:
- 9:42one
- 9:42contributor
- 9:43got
- 9:43it
- 9:43running
- 9:43on
- 9:43an
- 9:43RTX
- 9:446000
- 9:4496GB
- 9:45with
- 9:45CUDA,
- 9:46and
- 9:46a
- 9:46ROCm
- 9:47port
- 9:47appeared
- 9:47for
- 9:47AMD
- 9:48hardware,
- 9:49though
- 9:49prefill
- 9:49performance
- 9:50lagged
- 9:50at
- 9:50around
- 9:50110
- 9:51tok/s
- 9:52with
- 9:52output
- 9:52at
- 9:528
- 9:53tok/s.
- 9:54The
- 9:54bottleneck
- 9:55is
- 9:55graph
- 9:55splits
- 9:56--
- 9:56856
- 9:57at
- 9:57batch
- 9:58size
- 9:58512
- 9:59versus
- 9:59the
- 9:59fewer-than-10
- 10:00typical
- 10:00of
- 10:00pure
- 10:00transformer
- 10:01models
- 10:01--
- 10:02causing
- 10:02massive
- 10:03CPU-GPU
- 10:05synchronization
- 10:05overhead.
- 10:06On
- 10:06the
- 10:06hardware
- 10:07acceleration
- 10:07front,
- 10:07native
- 10:08NVFP4
- 10:09support
- 10:10in
- 10:10llama.cpp
- 10:11build
- 10:11b8967
- 10:13delivered
- 10:1343-68%
- 10:15faster
- 10:16prompt
- 10:16processing
- 10:17on
- 10:17an
- 10:17RTX
- 10:175090
- 10:18running
- 10:18Qwen3.6-27B-NVFP4,
- 10:23with
- 10:23the
- 10:23largest
- 10:24gains
- 10:24at
- 10:24shorter
- 10:24context
- 10:25(1.7x
- 10:26at
- 10:26pp512)
- 10:27tapering
- 10:27to
- 10:281.43x
- 10:29at
- 10:2932K
- 10:29context.
- 10:30Token
- 10:31generation
- 10:31speed
- 10:31was
- 10:32unchanged
- 10:32--
- 10:33the
- 10:33improvement
- 10:33is
- 10:33purely
- 10:34in
- 10:34the
- 10:34prefill
- 10:34path,
- 10:35meaning
- 10:35faster
- 10:36time-to-first-token
- 10:36for
- 10:37RAG
- 10:37workloads,
- 10:38document
- 10:38analysis,
- 10:39and
- 10:39code-heavy
- 10:39prompts.
- 10:40The
- 10:40accuracy
- 10:41tradeoff
- 10:41remains
- 10:42real:
- 10:43NVFP4
- 10:45quants
- 10:45show
- 10:45measurably
- 10:46higher
- 10:46perplexity
- 10:47than
- 10:47imatrix
- 10:47quants
- 10:48at
- 10:48the
- 10:48same
- 10:48VRAM
- 10:49budget,
- 10:49and
- 10:49Nvidia's
- 10:50quantization-aware
- 10:51distillation
- 10:51models
- 10:52that
- 10:52would
- 10:52close
- 10:52that
- 10:52gap
- 10:53exist
- 10:53for
- 10:53only
- 10:53a
- 10:53handful
- 10:54of
- 10:54their
- 10:54own
- 10:54models.
- 10:55Speculative
- 10:56decoding
- 10:56continues
- 10:57to
- 10:57find
- 10:57its
- 10:57sweet
- 10:57spot
- 10:58in
- 10:58constrained-output
- 10:59workflows.
- 11:00One
- 11:00developer
- 11:01replaced
- 11:01Gemini
- 11:012.5
- 11:02Flash-Lite
- 11:03API
- 11:03calls
- 11:03with
- 11:04local
- 11:04Gemma-4-31B
- 11:05(Q6
- 11:06K
- 11:06L)
- 11:06paired
- 11:07with
- 11:07Gemma-4-E2B
- 11:07(Q8
- 11:080)
- 11:09as
- 11:09a
- 11:09draft
- 11:09model,
- 11:10achieving
- 11:10120-200
- 11:11tok/s
- 11:12on
- 11:13an
- 11:13RTX
- 11:135090
- 11:14for
- 11:14structured
- 11:15JSON
- 11:15extraction
- 11:15tasks
- 11:16in
- 11:16Lithuanian.
- 11:17The
- 11:18acceptance
- 11:18rate
- 11:18for
- 11:18speculative
- 11:19tokens
- 11:19jumps
- 11:19to
- 11:200.7+
- 11:21on
- 11:21strict
- 11:21schema
- 11:22extraction
- 11:22versus
- 11:230.3-0.4
- 11:24on
- 11:24open-ended
- 11:25generation,
- 11:26making
- 11:26the
- 11:26headline
- 11:27speed
- 11:27achievable
- 11:28specifically
- 11:28for
- 11:28the
- 11:28narrow-output-space
- 11:29workloads
- 11:30where
- 11:30local
- 11:30inference
- 11:31most
- 11:31directly
- 11:31competes
- 11:32with
- 11:32API
- 11:32calls.
- 11:33The
- 11:33setup
- 11:34uses
- 11:3431.5
- 11:35GB
- 11:35VRAM.
- 11:36A
- 11:37community
- 11:37benchmark
- 11:37of
- 11:38the
- 11:384B
- 11:38model
- 11:38class
- 11:39revealed
- 11:39pronounced
- 11:40"lab
- 11:40personalities"
- 11:40at
- 11:41small
- 11:41scale.
- 11:42NVIDIA's
- 11:42Nemotron
- 11:433
- 11:43Nano
- 11:43(2.8
- 11:44GB
- 11:44on
- 11:45disk)
- 11:45scored
- 11:4585%
- 11:46overall
- 11:46with
- 11:47a
- 11:47perfect
- 11:47100%
- 11:48on
- 11:48finance
- 11:48tasks,
- 11:49while
- 11:49IBM's
- 11:50Granite4
- 11:503B
- 11:50hit
- 11:51100%
- 11:51on
- 11:51code
- 11:52but
- 11:52only
- 11:5220%
- 11:53on
- 11:53reasoning
- 11:53--
- 11:54near-mirror
- 11:55profiles
- 11:55from
- 11:55labs
- 11:56that
- 11:56market
- 11:56both
- 11:56as
- 11:56general-purpose.
- 11:58Microsoft's
- 11:58phi4-mini
- 11:59was
- 11:59the
- 11:59most
- 12:00balanced
- 12:00and
- 12:00the
- 12:00bang-for-GB
- 12:01winner
- 12:01at
- 12:0130.8
- 12:02accuracy-percent
- 12:03per
- 12:03GB.
- 12:04Qwen
- 12:043.5
- 12:054B
- 12:05scored
- 12:0615%,
- 12:07but
- 12:07the
- 12:07methodology
- 12:08acknowledged
- 12:09this
- 12:09was
- 12:09a
- 12:09thinking-model-in-fixed-budget
- 12:10problem:
- 12:11the
- 12:111024-token
- 12:12cap
- 12:13is
- 12:13insufficient
- 12:14for
- 12:14models
- 12:14that
- 12:14need
- 12:144096+
- 12:16tokens
- 12:16to
- 12:16finish
- 12:16their
- 12:17chain
- 12:17of
- 12:17thought.
- 12:18The
- 12:18eval
- 12:18ecosystem
- 12:19has
- 12:19a
- 12:19structural
- 12:20challenge
- 12:20here
- 12:20that
- 12:21per-model
- 12:21token
- 12:21budgets
- 12:22would
- 12:22partially
- 12:22address.
- 12:24A
- 12:24separate
- 12:24study
- 12:24demonstrated
- 12:25that
- 12:25task-specific
- 12:26LoRA
- 12:26adapters
- 12:27can
- 12:27double
- 12:27coding
- 12:28performance
- 12:28of
- 12:28a
- 12:287B
- 12:29model
- 12:29without
- 12:30modifying
- 12:30the
- 12:30coding
- 12:31agent
- 12:31itself.
- 12:32Four
- 12:32LoRA
- 12:33variants
- 12:33of
- 12:33Qwen2.5-7B
- 12:35(adding
- 12:36just
- 12:373%
- 12:37parameters),
- 12:38built
- 12:38from
- 12:38the
- 12:38successes
- 12:39of
- 12:39a
- 12:39larger
- 12:39model,
- 12:40showed
- 12:40that
- 12:40enabling
- 12:41tweaked
- 12:41retrieval
- 12:42and
- 12:42planning
- 12:42agents
- 12:42raised
- 12:43test
- 12:43passes
- 12:43from
- 12:433
- 12:44to
- 12:4410
- 12:44--
- 12:45despite
- 12:45neither
- 12:46the
- 12:46coder
- 12:46nor
- 12:46debugger
- 12:47agent
- 12:47being
- 12:47The
- 12:49tweaked
- 12:49debugger
- 12:49technically
- 12:50outperformed
- 12:50the
- 12:50tweaked
- 12:51coder,
- 12:52suggesting
- 12:52the
- 12:52coding
- 12:52agent
- 12:53may
- 12:53have
- 12:53the
- 12:53lowest
- 12:54intelligence
- 12:54requirement
- 12:55in
- 12:55the
- 12:55pipeline.
- 12:56At
- 12:56the
- 12:56far
- 12:57edge
- 12:57of
- 12:57the
- 12:57spectrum,
- 12:58RuVLLM
- 12:59ESP32
- 13:01v0.3.0-rc2
- 13:04shipped
- 13:04actual
- 13:04firmware
- 13:05for
- 13:05five
- 13:05ESP32
- 13:07variants,
- 13:07turning
- 13:07$2-4
- 13:08dev
- 13:08boards
- 13:09into
- 13:09specialist
- 13:09nodes
- 13:10in
- 13:10a
- 13:10small
- 13:10AI
- 13:10cluster.
- 13:12Each
- 13:12chip
- 13:12runs
- 13:12a
- 13:12single
- 13:13Rust
- 13:13program
- 13:13(~430
- 13:14KB
- 13:15flash)
- 13:15that
- 13:15boots
- 13:15into
- 13:16a
- 13:16role
- 13:16--
- 13:17HNSW
- 13:17vector
- 13:17indexer,
- 13:18RAG
- 13:18retriever,
- 13:19anomaly
- 13:19sentinel,
- 13:20semantic
- 13:20memory
- 13:21archivist,
- 13:21or
- 13:21micro-LoRA
- 13:22adapter
- 13:22--
- 13:23and
- 13:23handles
- 13:23commands
- 13:24over
- 13:24USB-Serial
- 13:25at
- 13:25115200
- 13:26baud.
- 13:27No
- 13:27cloud,
- 13:28no
- 13:28API
- 13:28key,
- 13:29no
- 13:29internet
- 13:29required.
- 13:30This
- 13:30is
- 13:31explicitly
- 13:31not
- 13:31transformer
- 13:32inference
- 13:32crammed
- 13:32into
- 13:334
- 13:33KB
- 13:33of
- 13:33SRAM
- 13:33(the
- 13:33previous
- 13:34release
- 13:34claimed
- 13:34that
- 13:35and
- 13:35it
- 13:35did
- 13:35not
- 13:35work);
- 13:36it
- 13:36is
- 13:36the
- 13:36federation-ready
- 13:37primitive
- 13:37layer
- 13:37--
- 13:38vector
- 13:38search,
- 13:38retrieval,
- 13:39memory,
- 13:39anomaly
- 13:40detection
- 13:40--
- 13:41that
- 13:41a
- 13:41future
- 13:41ESP32-P4
- 13:43with
- 13:448
- 13:44MB
- 13:44PSRAM
- 13:45could
- 13:45join
- 13:45as
- 13:45a
- 13:45draft-token
- 13:46node.
- 13:46Zyphra
- 13:47also
- 13:47dropped
- 13:47ZUNA
- 13:47on
- 13:48Hugging
- 13:48Face,
- 13:48though
- 13:48details
- 13:49remain
- 13:49sparse
- 13:49at
- 13:49launch.
- 13:53Warp,
- 13:53the
- 13:53Rust-based
- 13:54terminal
- 13:54that
- 13:54launched
- 13:54five
- 13:55years
- 13:55ago
- 13:55with
- 13:55a
- 13:55promise
- 13:56to
- 13:56eventually
- 13:56open-source,
- 13:57finally
- 13:57delivered.
- 13:58The
- 13:58client
- 13:58is
- 13:58now
- 13:59available
- 13:59under
- 13:59AGPL,
- 14:00with
- 14:00OpenAI
- 14:01as
- 14:01founding
- 14:02sponsor
- 14:02and
- 14:02their
- 14:02agent
- 14:03orchestration
- 14:03platform
- 14:04Oz
- 14:04powering
- 14:04the
- 14:04contribution
- 14:05workflow.
- 14:06The
- 14:06strategic
- 14:06logic
- 14:07is
- 14:07Warp's
- 14:08team
- 14:08believes
- 14:09the
- 14:09biggest
- 14:09bottleneck
- 14:09to
- 14:09development
- 14:10is
- 14:10no
- 14:10longer
- 14:11writing
- 14:11code
- 14:11but
- 14:11the
- 14:11human-in-the-loop
- 14:12activities
- 14:12around
- 14:13it
- 14:13--
- 14:13speccing
- 14:14product
- 14:14and
- 14:14verifying
- 14:15behavior
- 14:15--
- 14:16and
- 14:16that
- 14:16opening
- 14:16the
- 14:16codebase
- 14:17to
- 14:17community
- 14:17contributors
- 14:18who
- 14:18supervise
- 14:18agents
- 14:19will
- 14:19accelerate
- 14:20Alongside
- 14:21the
- 14:21open-sourcing,
- 14:21Warp
- 14:22added
- 14:22support
- 14:22for
- 14:22open-source
- 14:23models
- 14:23(Kimi,
- 14:24MiniMax,
- 14:25Qwen)
- 14:25with
- 14:25an
- 14:25"auto
- 14:26(open)"
- 14:26model-routed
- 14:27option,
- 14:28a
- 14:28settings
- 14:28file
- 14:28for
- 14:29programmatic
- 14:29control,
- 14:30and
- 14:30customizable
- 14:31UI
- 14:31density
- 14:31ranging
- 14:32from
- 14:32a
- 14:32minimal
- 14:32terminal
- 14:33to
- 14:33a
- 14:33full
- 14:33agentic
- 14:34development
- 14:34environment.
- 14:35Public
- 14:35GitHub
- 14:36issues
- 14:36become
- 14:36the
- 14:36source
- 14:37of
- 14:37truth
- 14:37for
- 14:37the
- 14:37roadmap.
- 14:38The
- 14:39AGPL
- 14:39license
- 14:40means
- 14:40derivative
- 14:40works
- 14:41must
- 14:41also
- 14:42be
- 14:42open-source,
- 14:43which
- 14:43positions
- 14:43Warp
- 14:44as
- 14:44a
- 14:44community
- 14:44platform
- 14:45rather
- 14:45than
- 14:45a
- 14:45fork-and-commercialize
- 14:46target.
- 14:47Browser
- 14:48Use
- 14:48shipped
- 14:48BUX,
- 14:49a
- 14:49project
- 14:50that
- 14:50turns
- 14:50any
- 14:50$5
- 14:51VPS
- 14:51into
- 14:52a
- 14:5224/7
- 14:53Claude
- 14:53Code
- 14:53agent
- 14:54with
- 14:54a
- 14:54persistent
- 14:55Chromium
- 14:55session.
- 14:56Three
- 14:56systemd
- 14:57services
- 14:57--
- 14:58Claude
- 14:58Code,
- 14:59a
- 14:59browser
- 14:59harness
- 15:00via
- 15:00browser-use's
- 15:00cloud
- 15:01CDK,
- 15:02and
- 15:02a
- 15:02web
- 15:02terminal
- 15:02--
- 15:03boot
- 15:03from
- 15:04a
- 15:04single
- 15:04curl
- 15:04install
- 15:05script.
- 15:06A
- 15:06Telegram
- 15:06bot
- 15:06integration
- 15:07lets
- 15:07users
- 15:08text
- 15:08their
- 15:08agent
- 15:08from
- 15:09anywhere.
- 15:10When
- 15:10the
- 15:10agent
- 15:10hits
- 15:10a
- 15:10login
- 15:11wall,
- 15:112FA,
- 15:12or
- 15:12CAPTCHA,
- 15:13it
- 15:13hands
- 15:13back
- 15:13a
- 15:13live
- 15:14view
- 15:14URL
- 15:15and
- 15:15waits
- 15:15rather
- 15:15than
- 15:16attempting
- 15:16credential
- 15:16stuffing.
- 15:18Agent
- 15:18state
- 15:18persists
- 15:19in
- 15:19/home/bux
- 15:21across
- 15:21reboots,
- 15:22preserving
- 15:22cookies,
- 15:23skills,
- 15:24and
- 15:24chat
- 15:24history.
- 15:25The
- 15:25managed
- 15:26offering
- 15:26provisions
- 15:27a
- 15:27box
- 15:27in
- 15:27about
- 15:2860
- 15:28seconds.
- 15:29Graphify
- 15:30takes
- 15:30a
- 15:30different
- 15:30approach
- 15:31to
- 15:31developer
- 15:31intelligence:
- 15:32it
- 15:33reads
- 15:33a
- 15:33codebase
- 15:33(code
- 15:34via
- 15:34tree-sitter
- 15:35AST
- 15:35parsing,
- 15:36docs
- 15:37and
- 15:37PDFs
- 15:37via
- 15:37Claude,
- 15:38images
- 15:39via
- 15:39Claude
- 15:39vision)
- 15:40and
- 15:40builds
- 15:40a
- 15:40queryable
- 15:41knowledge
- 15:41graph
- 15:42using
- 15:42NetworkX
- 15:43and
- 15:43Leiden
- 15:43community
- 15:44detection.
- 15:45The
- 15:45headline
- 15:45claim
- 15:45is
- 15:4671.5x
- 15:47fewer
- 15:47tokens
- 15:48per
- 15:48query
- 15:48versus
- 15:49reading
- 15:49raw
- 15:49files,
- 15:50benchmarked
- 15:50on
- 15:51a
- 15:5152-file
- 15:51mixed
- 15:52corpus
- 15:52of
- 15:52Karpathy
- 15:53repos,
- 15:53papers,
- 15:54and
- 15:54images.
- 15:55Every
- 15:55edge
- 15:56is
- 15:56tagged
- 15:56EXTRACTED,
- 15:57INFERRED,
- 15:58or
- 15:58AMBIGUOUS,
- 15:59and
- 15:59output
- 16:00includes
- 16:00interactive
- 16:01HTML
- 16:01visualization,
- 16:03Obsidian
- 16:03vault
- 16:03export,
- 16:05Wikipedia-style
- 16:05wiki
- 16:06articles
- 16:06for
- 16:06agent
- 16:07navigation,
- 16:07and
- 16:08Neo4j
- 16:08Cypher
- 16:09export.
- 16:10A
- 16:10post-commit
- 16:11git
- 16:11hook
- 16:11keeps
- 16:12the
- 16:12graph
- 16:12synchronized
- 16:13automatically.
- 16:14Microsoft
- 16:15open-sourced
- 16:16VibeVoice,
- 16:17a
- 16:17family
- 16:17of
- 16:17frontier
- 16:18voice
- 16:18AI
- 16:18models
- 16:19spanning
- 16:19TTS
- 16:20and
- 16:20ASR.
- 16:21The
- 16:21ASR
- 16:22model
- 16:22handles
- 16:2260-minute
- 16:23long-form
- 16:24audio
- 16:24in
- 16:24a
- 16:24single
- 16:25pass
- 16:25with
- 16:26structured
- 16:26output
- 16:27(who
- 16:27said
- 16:27what
- 16:27and
- 16:28when),
- 16:28customizable
- 16:29hotwords
- 16:30for
- 16:30domain-specific
- 16:31accuracy,
- 16:32and
- 16:32support
- 16:32for
- 16:3250+
- 16:33languages.
- 16:34The
- 16:34TTS
- 16:35model
- 16:35generates
- 16:36up
- 16:36to
- 16:3690
- 16:37minutes
- 16:37of
- 16:37multi-speaker
- 16:38conversational
- 16:39audio.
- 16:40The
- 16:40core
- 16:40innovation
- 16:41is
- 16:41continuous
- 16:41speech
- 16:42tokenizers
- 16:42operating
- 16:43at
- 16:437.5
- 16:44Hz
- 16:44--
- 16:45an
- 16:45ultra-low
- 16:46frame
- 16:46rate
- 16:46that
- 16:47preserves
- 16:47fidelity
- 16:48while
- 16:48dramatically
- 16:48reducing
- 16:49sequence
- 16:49length
- 16:50for
- 16:50long-form
- 16:50processing.
- 16:51The
- 16:52TTS
- 16:52code
- 16:53was
- 16:53previously
- 16:53removed
- 16:54after
- 16:54misuse
- 16:55concerns;
- 16:56the
- 16:56ASR
- 16:56and
- 16:57real-time
- 16:57streaming
- 16:58models
- 16:58(0.5B
- 16:59parameters,
- 17:00~300ms
- 17:01first-audible
- 17:02latency)
- 17:03remain
- 17:03available.
- 17:06Microsoft
- 17:07and
- 17:07OpenAI
- 17:08are
- 17:08ending
- 17:08their
- 17:08exclusive
- 17:09partnership
- 17:09and
- 17:10revenue-sharing
- 17:10arrangement,
- 17:11according
- 17:11to
- 17:11Bloomberg.
- 17:12The
- 17:12deal
- 17:12restructuring
- 17:13removes
- 17:13the
- 17:13exclusivity
- 17:14that
- 17:14bound
- 17:14OpenAI
- 17:15to
- 17:15Microsoft's
- 17:16cloud
- 17:16infrastructure
- 17:17and
- 17:17eliminates
- 17:17the
- 17:18revenue-sharing
- 17:18provisions
- 17:19that
- 17:19gave
- 17:19Microsoft
- 17:19a
- 17:20cut
- 17:20of
- 17:20OpenAI's
- 17:20commercial
- 17:21income.
- 17:22The
- 17:22move
- 17:22signals
- 17:23both
- 17:23companies
- 17:23positioning
- 17:24for
- 17:24independence
- 17:24--
- 17:25Microsoft
- 17:26diversifying
- 17:27its
- 17:27AI
- 17:27bets
- 17:27across
- 17:27multiple
- 17:28model
- 17:28providers,
- 17:29OpenAI
- 17:29seeking
- 17:30flexibility
- 17:30to
- 17:30work
- 17:31with
- 17:31other
- 17:31cloud
- 17:31and
- 17:31distribution
- 17:32partners.
- 17:33The
- 17:33full
- 17:33implications
- 17:34for
- 17:34Azure's
- 17:34AI
- 17:34strategy
- 17:35and
- 17:35OpenAI's
- 17:36path
- 17:36to
- 17:36profitability
- 17:37will
- 17:37take
- 17:37time
- 17:37to
- 17:37materialize,
- 17:38but
- 17:38the
- 17:38structural
- 17:39shift
- 17:39is
- 17:39significant:
- 17:40the
- 17:40most
- 17:40consequential
- 17:41AI
- 17:41partnership
- 17:42of
- 17:42the
- 17:42last
- 17:42five
- 17:42years
- 17:42is
- 17:43being
- 17:43unwound.
- 17:44A
- 17:44pointed
- 17:44video
- 17:44essay
- 17:45took
- 17:45aim
- 17:45at
- 17:45what
- 17:45it
- 17:45calls
- 17:46"token
- 17:46budgets"
- 17:46--
- 17:47the
- 17:47practice,
- 17:47reportedly
- 17:48in
- 17:48use
- 17:48at
- 17:48Facebook,
- 17:49of
- 17:49tracking
- 17:49employees'
- 17:50AI
- 17:50tool
- 17:50consumption
- 17:51via
- 17:51leaderboards.
- 17:52The
- 17:52the
- 17:53person
- 17:53at
- 17:54the
- 17:54top
- 17:54of
- 17:54the
- 17:54token
- 17:54leaderboard
- 17:55is
- 17:55reviewing
- 17:55zero
- 17:56code,
- 17:57the
- 17:57metric
- 17:57creates
- 17:57perverse
- 17:58incentives
- 17:58toward
- 17:59generating
- 17:59slop
- 17:59at
- 17:59volume,
- 18:00and
- 18:00Jensen
- 18:01Huang's
- 18:01framing
- 18:01of
- 18:02$250,000/year/employee
- 18:05in
- 18:05token
- 18:05spend
- 18:06as
- 18:06a
- 18:06productivity
- 18:06benchmark
- 18:07serves
- 18:07primarily
- 18:08to
- 18:08funnel
- 18:08corporate
- 18:08savings
- 18:09toward
- 18:09GPU
- 18:09vendors
- 18:10and
- 18:10AI
- 18:10providers.
- 18:11The
- 18:11broader
- 18:12argument
- 18:12--
- 18:13the
- 18:13"Bittar
- 18:13lesson"
- 18:14--
- 18:14posits
- 18:15that
- 18:15AI
- 18:15usefulness
- 18:16is
- 18:16inversely
- 18:17proportional
- 18:17to
- 18:17the
- 18:17precision
- 18:18required:
- 18:19LLMs
- 18:20approximate
- 18:20language
- 18:20which
- 18:21approximates
- 18:21intent,
- 18:22and
- 18:22the
- 18:22compounding
- 18:23approximation
- 18:23hits
- 18:24a
- 18:24wall
- 18:24at
- 18:24roughly
- 18:2580%
- 18:25of
- 18:25any
- 18:25task,
- 18:26leaving
- 18:27the
- 18:27hard
- 18:2720%
- 18:28as
- 18:28irreducibly
- 18:29human
- 18:29work.
- 18:30Whether
- 18:30or
- 18:30not
- 18:30one
- 18:31accepts
- 18:31the
- 18:31full
- 18:31thesis,
- 18:32the
- 18:32observation
- 18:33that
- 18:33token
- 18:33consumption
- 18:34is
- 18:34becoming
- 18:34a
- 18:34proxy
- 18:35metric
- 18:35for
- 18:35productivity
- 18:36--
- 18:37with
- 18:37the
- 18:37same
- 18:37pathologies
- 18:38as
- 18:38lines-of-code
- 18:39metrics
- 18:39--
- 18:40deserves
- 18:40attention.
- 18:42Talkie,
- 18:42a
- 18:4313B
- 18:43language
- 18:44model
- 18:44trained
- 18:44exclusively
- 18:45on
- 18:45260B
- 18:46tokens
- 18:47of
- 18:47pre-1931
- 18:48English
- 18:49text,
- 18:50offers
- 18:50a
- 18:50genuinely
- 18:50novel
- 18:51angle
- 18:51on
- 18:51LLM
- 18:52capabilities.
- 18:53Built
- 18:53by
- 18:54Nick
- 18:54Levine,
- 18:54David
- 18:55Duvenaud,
- 18:55and
- 18:56Alec
- 18:56Radford,
- 18:57the
- 18:57model
- 18:57is
- 18:57contamination-free
- 18:58by
- 18:59construction
- 18:59--
- 19:00enabling
- 19:01generalization
- 19:01experiments
- 19:02impossible
- 19:02with
- 19:03web-trained
- 19:03models,
- 19:04like
- 19:04testing
- 19:05whether
- 19:05a
- 19:05model
- 19:05with
- 19:05no
- 19:05knowledge
- 19:06of
- 19:06digital
- 19:06computers
- 19:07can
- 19:07learn
- 19:07to
- 19:07code
- 19:07in
- 19:08Python
- 19:08from
- 19:08in-context
- 19:09examples.
- 19:10Early
- 19:10results
- 19:11show
- 19:11it
- 19:11can
- 19:11produce
- 19:12simple
- 19:12correct
- 19:12programs
- 19:13(single-line,
- 19:14or
- 19:14small
- 19:14modifications
- 19:15to
- 19:15examples),
- 19:16and
- 19:16the
- 19:16success
- 19:17rate
- 19:17improves
- 19:17with
- 19:17scale.
- 19:19The
- 19:19post-training
- 19:19pipeline
- 19:20avoids
- 19:20modern
- 19:20instruction-response
- 19:21pairs
- 19:22entirely,
- 19:23instead
- 19:23using
- 19:23historical
- 19:24etiquette
- 19:24manuals,
- 19:25letter-writing
- 19:26guides,
- 19:26and
- 19:26cookbooks,
- 19:27with
- 19:27Claude
- 19:27Opus
- 19:28as
- 19:28a
- 19:28DPO
- 19:28A
- 19:30"modern
- 19:30twin"
- 19:30trained
- 19:31on
- 19:31FineWeb
- 19:31with
- 19:31the
- 19:31same
- 19:32compute
- 19:32underperforms
- 19:33expectations
- 19:34on
- 19:34some
- 19:34benchmarks,
- 19:35which
- 19:35the
- 19:35team
- 19:35attributes
- 19:36to
- 19:36OCR
- 19:37noise
- 19:37--
- 19:38their
- 19:38vintage
- 19:39OCR
- 19:39system
- 19:40only
- 19:40achieves
- 19:4030%
- 19:41of
- 19:41the
- 19:41learning
- 19:41efficiency
- 19:42of
- 19:42human-transcribed
- 19:43text,
- 19:44with
- 19:44regex
- 19:44cleaning
- 19:45recovering
- 19:45to
- 19:4570%.
- 19:47The
- 19:47plan
- 19:48is
- 19:48to
- 19:48scale
- 19:48to
- 19:48GPT-3.5
- 19:50level
- 19:50using
- 19:50a
- 19:50trillion-token
- 19:51historical
- 19:52corpus.
- 19:53The
- 19:53research
- 19:54question
- 19:54underneath
- 19:54--
- 19:55how
- 19:56much
- 19:56of
- 19:56what
- 19:56we
- 19:56think
- 19:56we
- 19:56know
- 19:57about
- 19:57LLMs
- 19:58is
- 19:58about
- 19:58language
- 19:58in
- 19:59general
- 19:59versus
- 19:59the
- 20:00web
- 20:00as
- 20:00a
- 20:00dataset
- 20:00--
- 20:01is
- 20:02one
- 20:02of
- 20:02the
- 20:02more
- 20:02interesting
- 20:02epistemological
- 20:03questions
- 20:04in
- 20:04the
- 20:04field
- 20:04right
- 20:04now.