Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – February 17, 2026
Transcript
- 0:00Alibaba's
- 0:00Qwen
- 0:00team
- 0:01dropped
- 0:01Qwen
- 0:013.5
- 0:02this
- 0:02week
- 0:02—
- 0:02a
- 0:03397B-parameter
- 0:04mixture-of-experts
- 0:05model
- 0:05with
- 0:05only
- 0:0517B
- 0:06active
- 0:07parameters
- 0:07per
- 0:07token,
- 0:08Apache
- 0:082.0
- 0:09licensed,
- 0:09and
- 0:09already
- 0:10being
- 0:10quantized
- 0:10for
- 0:10Blackwell
- 0:11GPUs.
- 0:12The
- 0:12MoE
- 0:12architecture
- 0:13(512
- 0:13experts,
- 0:1410
- 0:14active
- 0:15per
- 0:15token)
- 0:15means
- 0:15inference
- 0:16speed
- 0:16lands
- 0:16closer
- 0:16to
- 0:17a
- 0:1730-40B
- 0:19dense
- 0:19model
- 0:19despite
- 0:20the
- 0:20enormous
- 0:20total
- 0:20parameter
- 0:21count.
- 0:22Early
- 0:22API
- 0:22testers
- 0:23report
- 0:23roughly
- 0:2345
- 0:24tokens
- 0:24per
- 0:24second,
- 0:25notably
- 0:26faster
- 0:26than
- 0:26Claude
- 0:27or
- 0:27GPT-4,
- 0:28with
- 0:28code
- 0:28generation
- 0:29quality
- 0:29at
- 0:29"maybe
- 0:2990%
- 0:30of
- 0:30Sonnet
- 0:304"
- 0:31and
- 0:32significantly
- 0:32less
- 0:32refusal
- 0:33behavior.
- 0:34The
- 0:34262K
- 0:35native
- 0:35context
- 0:36window
- 0:36(with
- 0:361M+
- 0:37in
- 0:37development)
- 0:37and
- 0:38built-in
- 0:38multimodal
- 0:38support
- 0:39across
- 0:39201
- 0:40languages
- 0:41make
- 0:41this
- 0:41a
- 0:41serious
- 0:41contender
- 0:42for
- 0:42high-volume
- 0:42inference
- 0:43shops
- 0:43tired
- 0:43of
- 0:43paying
- 0:44per-token
- 0:44API
- 0:45rates.
- 0:45The
- 0:45real
- 0:46action,
- 0:46as
- 0:46usual,
- 0:47is
- 0:47in
- 0:47the
- 0:47quantization.
- 0:48Within
- 0:49days,
- 0:49an
- 0:49NVFP4
- 0:50checkpoint
- 0:51appeared
- 0:51for
- 0:51Blackwell
- 0:52hardware
- 0:53—
- 0:53224GB
- 0:54total,
- 0:55running
- 0:55on
- 0:554x
- 0:56B300s
- 0:57at
- 0:57roughly
- 0:57120
- 0:58tokens
- 0:59per
- 0:59second
- 0:59with
- 1:00speculative
- 1:00decoding
- 1:01via
- 1:01Qwen
- 1:013.5's
- 1:02built-in
- 1:02Multi-Token
- 1:03Prediction
- 1:03head.
- 1:04The
- 1:04setup
- 1:04requires
- 1:05a
- 1:05patched
- 1:05SGLang
- 1:06branch
- 1:06to
- 1:06avoid
- 1:07quantizing
- 1:07vision
- 1:07encoder
- 1:08weights,
- 1:09but
- 1:09the
- 1:09combination
- 1:09of
- 1:09FP4
- 1:10quantization
- 1:11with
- 1:11near-lossless
- 1:12accuracy
- 1:12(~99%
- 1:13preserved)
- 1:14demonstrates
- 1:14that
- 1:14the
- 1:14Blackwell
- 1:15architecture
- 1:15is
- 1:16finally
- 1:16delivering
- 1:16on
- 1:16NVIDIA's
- 1:17promise
- 1:17of
- 1:17practical
- 1:18FP4
- 1:18inference.
- 1:19For
- 1:19teams
- 1:20with
- 1:20the
- 1:20hardware
- 1:20budget,
- 1:21this
- 1:21puts
- 1:21frontier-competitive
- 1:22performance
- 1:22on
- 1:22self-hosted
- 1:23iron.
- 1:24On
- 1:24the
- 1:24lighter
- 1:24end
- 1:24of
- 1:25the
- 1:25spectrum,
- 1:25Google's
- 1:25Gemma
- 1:263n
- 1:26E2B
- 1:27is
- 1:27now
- 1:27running
- 1:28natively
- 1:28on
- 1:28Android
- 1:28via
- 1:29LiteRT,
- 1:30with
- 1:30one
- 1:30developer
- 1:30shipping
- 1:31a
- 1:31fully
- 1:31on-device
- 1:32multimodal
- 1:32app
- 1:32handling
- 1:33audio
- 1:33transcription
- 1:34and
- 1:34OCR
- 1:34using
- 1:35INT4
- 1:35weights.
- 1:36The
- 1:36interesting
- 1:37engineering
- 1:37challenge
- 1:37was
- 1:38the
- 1:3830-second
- 1:38audio
- 1:39context
- 1:39limit
- 1:39in
- 1:39the
- 1:39multimodal
- 1:40encoder
- 1:40—
- 1:41solved
- 1:41by
- 1:41a
- 1:41sequential
- 1:42chunking
- 1:42pipeline
- 1:43that
- 1:43splits
- 1:43audio,
- 1:44transcribes
- 1:44chunks
- 1:45independently,
- 1:46then
- 1:46recombines
- 1:46via
- 1:47a
- 1:47second
- 1:47model
- 1:47pass.
- 1:48The
- 1:48entire
- 1:49app
- 1:49was
- 1:49built
- 1:50without
- 1:50writing
- 1:50a
- 1:50single
- 1:50line
- 1:51of
- 1:51code
- 1:51manually,
- 1:52using
- 1:52Claude
- 1:52Code
- 1:53and
- 1:53Google
- 1:53Antigravity,
- 1:54though
- 1:54the
- 1:55developer
- 1:55notes
- 1:55that
- 1:55AI
- 1:56agents
- 1:56"struggled
- 1:57with
- 1:57the
- 1:57multimodal
- 1:57JNI
- 1:58bindings"
- 1:58until
- 1:59manually
- 1:59fed
- 2:00raw
- 2:00LiteRT
- 2:00documentation.
- 2:01Vibe
- 2:02coding
- 2:02has
- 2:02limits,
- 2:03it
- 2:03turns
- 2:03out,
- 2:04and
- 2:04they
- 2:04tend
- 2:04to
- 2:04live
- 2:05at
- 2:05the
- 2:05hardware
- 2:05abstraction
- 2:06boundary.
- 2:07For
- 2:07teams
- 2:07wanting
- 2:07to
- 2:08self-host
- 2:08at
- 2:08enterprise
- 2:09scale,
- 2:09a
- 2:10detailed
- 2:10quickstart
- 2:10appeared
- 2:11for
- 2:11deploying
- 2:11Open
- 2:11WebUI
- 2:12with
- 2:12vLLM's
- 2:12production
- 2:13stack
- 2:13on
- 2:13Amazon
- 2:14EKS
- 2:14—
- 2:15OpenTofu-defined
- 2:16infrastructure,
- 2:17GPU
- 2:17node
- 2:18groups
- 2:18with
- 2:18A10G
- 2:19cards,
- 2:19Gateway
- 2:20API
- 2:20ingress,
- 2:21and
- 2:21tool
- 2:21calling
- 2:21out
- 2:21of
- 2:21the
- 2:21box.
- 2:23The
- 2:23guide
- 2:23is
- 2:23refreshingly
- 2:24honest
- 2:24about
- 2:24costs:
- 2:25a
- 2:25g5.xlarge
- 2:29setup
- 2:29runs
- 2:29roughly
- 2:30$50/day,
- 2:31and
- 2:31the
- 2:31author
- 2:32explicitly
- 2:32recommends
- 2:33treating
- 2:33it
- 2:33as
- 2:33a
- 2:33development
- 2:34environment
- 2:34you
- 2:34destroy
- 2:35when
- 2:35not
- 2:35in
- 2:35use.
- 2:36The
- 2:36vLLM
- 2:37production
- 2:37stack
- 2:37adds
- 2:38a
- 2:38router
- 2:38layer
- 2:38for
- 2:38load
- 2:39balancing
- 2:39across
- 2:39replicas,
- 2:40making
- 2:41it
- 2:41a
- 2:41genuine
- 2:41alternative
- 2:42to
- 2:42API
- 2:42providers
- 2:43for
- 2:43organizations
- 2:43with
- 2:44data
- 2:44sovereignty
- 2:44requirements.
- 2:48A
- 2:48provocative
- 2:48LinkedIn
- 2:49thread
- 2:49from
- 2:49Cameron
- 2:49W.
- 2:50crystallized
- 2:50a
- 2:50tension
- 2:51that's
- 2:51been
- 2:51building
- 2:51for
- 2:51months:
- 2:52developers
- 2:53are
- 2:53already
- 2:53shipping
- 2:535x
- 2:54the
- 2:54code
- 2:54they
- 2:54were
- 2:54a
- 2:54year
- 2:55ago,
- 2:55agents
- 2:55are
- 2:55writing
- 2:56and
- 2:56reviewing
- 2:56code
- 2:57autonomously,
- 2:57and
- 2:57most
- 2:58AppSec
- 2:58programs
- 2:59are
- 2:59still
- 2:59tuned
- 2:59for
- 2:59the
- 2:59pace
- 3:00of
- 3:00human-written
- 3:00pull
- 3:00requests.
- 3:02The
- 3:02numbers
- 3:02are
- 3:02hard
- 3:02to
- 3:02argue
- 3:03with.
- 3:03DARPA's
- 3:03AI
- 3:04Cyber
- 3:04Challenge
- 3:04at
- 3:04DEF
- 3:05CON
- 3:05saw
- 3:05Team
- 3:06Atlanta's
- 3:06cyber
- 3:06reasoning
- 3:07system
- 3:08go
- 3:08from
- 3:08identifying
- 3:0937%
- 3:10of
- 3:10synthetic
- 3:10vulnerabilities
- 3:11at
- 3:11semifinals
- 3:12to
- 3:1286%
- 3:13in
- 3:13finals,
- 3:14at
- 3:14roughly
- 3:14$152
- 3:16per
- 3:16task.
- 3:17Then
- 3:17Anthropic's
- 3:17red
- 3:18team
- 3:18had
- 3:18Claude
- 3:18Opus
- 3:194.6
- 3:20finding
- 3:20500+
- 3:21previously
- 3:21unknown
- 3:22high-severity
- 3:23vulnerabilities
- 3:23in
- 3:23projects
- 3:24like
- 3:24Ghostscript
- 3:24and
- 3:24OpenSC
- 3:25—
- 3:25no
- 3:26custom
- 3:26tooling,
- 3:27no
- 3:27specialized
- 3:27prompts,
- 3:28just
- 3:28reasoning
- 3:29through
- 3:29commit
- 3:29history
- 3:30and
- 3:30writing
- 3:30proof-of-concept
- 3:31exploits
- 3:31for
- 3:31bugs
- 3:31that
- 3:31fuzzers
- 3:32running
- 3:32for
- 3:32years
- 3:32had
- 3:33missed.
- 3:33The
- 3:33follow-up
- 3:34discussion
- 3:34surfaced
- 3:34a
- 3:35genuine
- 3:35strategic
- 3:35question:
- 3:36if
- 3:36vulnerability
- 3:37discovery
- 3:38becomes
- 3:38near-commodity,
- 3:39what's
- 3:39the
- 3:39scarce
- 3:40resource?
- 3:41The
- 3:41consensus
- 3:41among
- 3:42security
- 3:42leaders
- 3:42points
- 3:43toward
- 3:43validation
- 3:43quality,
- 3:44exploitability
- 3:45modeling,
- 3:45and
- 3:45governance
- 3:46over
- 3:46machine-generated
- 3:47change.
- 3:48Several
- 3:48commenters
- 3:49noted
- 3:49that
- 3:49the
- 3:49real
- 3:49gap
- 3:50isn't
- 3:50tooling
- 3:50—
- 3:50it's
- 3:51measurement.
- 3:52How
- 3:52do
- 3:52you
- 3:52quantify
- 3:52false
- 3:53confidence
- 3:53introduced
- 3:53by
- 3:54automated
- 3:54patching?
- 3:55How
- 3:55do
- 3:55you
- 3:56detect
- 3:56degradation
- 3:57in
- 3:57review
- 3:57depth
- 3:57when
- 3:57agents
- 3:58review
- 3:58agents?
- 4:00The
- 4:00most
- 4:00actionable
- 4:00take:
- 4:01AppSec
- 4:02teams
- 4:02need
- 4:02to
- 4:02shift
- 4:03from
- 4:03detection-centric
- 4:04to
- 4:04prevention-centric,
- 4:05codifying
- 4:05security
- 4:06patterns
- 4:06in
- 4:06markdown
- 4:06that
- 4:06coding
- 4:07agents
- 4:07can
- 4:07consume,
- 4:08and
- 4:08focusing
- 4:08on
- 4:08business
- 4:09logic
- 4:09flaws
- 4:09rather
- 4:10than
- 4:10just
- 4:10CVEs
- 4:10and
- 4:11CWEs.
- 4:13Oligo
- 4:13offered
- 4:13one
- 4:13concrete
- 4:14answer
- 4:14to
- 4:14the
- 4:14"how
- 4:14do
- 4:14we
- 4:14scale?"
- 4:15question:
- 4:16a
- 4:17Named
- 4:17Entity
- 4:17Recognition
- 4:18pipeline
- 4:19that
- 4:19extracts
- 4:20vulnerable
- 4:20functions
- 4:21directly
- 4:21from
- 4:21advisories
- 4:22and
- 4:22patches,
- 4:23validated
- 4:23against
- 4:24runtime
- 4:24data.
- 4:25Their
- 4:25key
- 4:26finding
- 4:26was
- 4:26that
- 4:26traditional
- 4:27vulnerability
- 4:27databases
- 4:28cover
- 4:28less
- 4:28than
- 4:294%
- 4:29of
- 4:29vulnerabilities
- 4:30at
- 4:30the
- 4:30function
- 4:30level
- 4:31—
- 4:31a
- 4:32massive
- 4:32intelligence
- 4:32gap.
- 4:33By
- 4:34deploying
- 4:34NVIDIA's
- 4:35Nemotron
- 4:35Nano
- 4:359B
- 4:36v2
- 4:36for
- 4:37real-time
- 4:37detection
- 4:37tasks,
- 4:38they
- 4:38achieved
- 4:3955x
- 4:40cost
- 4:40reduction
- 4:41and
- 4:412.5x
- 4:42faster
- 4:42response
- 4:42times
- 4:43compared
- 4:43to
- 4:43Claude
- 4:44Sonnet
- 4:444.5,
- 4:45with
- 4:45no
- 4:45accuracy
- 4:46loss.
- 4:47Their
- 4:47enrichment
- 4:47pipeline
- 4:48now
- 4:48covers
- 4:48an
- 4:48entire
- 4:49year
- 4:49of
- 4:49CVEs
- 4:50(50K)
- 4:50in
- 4:50under
- 4:51an
- 4:51hour,
- 4:52identifying
- 4:521100%
- 4:55more
- 4:55vulnerable
- 4:56functions
- 4:56than
- 4:56commercial
- 4:57databases.
- 4:58The
- 4:58lesson:
- 4:59specialized,
- 5:00instruction-tuned
- 5:00models
- 5:01systematically
- 5:01outperform
- 5:02expensive
- 5:03general-purpose
- 5:03LLMs
- 5:04for
- 5:04domain-specific
- 5:05security
- 5:05tasks.
- 5:09The
- 5:09agenda
- 5:09for
- 5:10the
- 5:10[un]prompted
- 5:10AI
- 5:10Security
- 5:11Conference
- 5:11(March
- 5:123-4,
- 5:12Salesforce
- 5:13Tower,
- 5:13SF)
- 5:14dropped
- 5:14this
- 5:14week,
- 5:15and
- 5:15the
- 5:15talk
- 5:15list
- 5:16reads
- 5:16like
- 5:16a
- 5:16threat
- 5:16briefing.
- 5:17Nearly
- 5:17500
- 5:18submissions
- 5:19have
- 5:19been
- 5:19narrowed
- 5:19to
- 5:19two
- 5:20days
- 5:20of
- 5:20talks
- 5:20spanning
- 5:21offensive
- 5:21research,
- 5:22defensive
- 5:22engineering,
- 5:23and
- 5:23governance
- 5:23—
- 5:24with
- 5:24speakers
- 5:24from
- 5:25Google,
- 5:25Meta,
- 5:25Stripe,
- 5:26OpenAI,
- 5:27Microsoft,
- 5:27NVIDIA,
- 5:28Netflix,
- 5:29Reddit,
- 5:29Salesforce,
- 5:30and
- 5:30the
- 5:30U.S.
- 5:30Army
- 5:30Cyber
- 5:31Command.
- 5:32The
- 5:32offensive
- 5:32highlights
- 5:33alone
- 5:33could
- 5:33fill
- 5:33a
- 5:33briefing.
- 5:34XBOW
- 5:35will
- 5:35demonstrate
- 5:36AI
- 5:36agents
- 5:37that
- 5:37autonomously
- 5:37find
- 5:38and
- 5:38validate
- 5:38access
- 5:39control
- 5:39flaws
- 5:40in
- 5:40production
- 5:40systems.
- 5:41Trend
- 5:42Micro's
- 5:42FENRIR
- 5:45system
- 5:45has
- 5:45discovered
- 5:46100+
- 5:46vulnerabilities
- 5:47in
- 5:47AI
- 5:47infrastructure
- 5:48since
- 5:48mid-2025,
- 5:50including
- 5:5021
- 5:51CVEs
- 5:51with
- 5:51multiple
- 5:52CVSS
- 5:539.8
- 5:53RCEs,
- 5:54using
- 5:55a
- 5:55multi-stage
- 5:55verification
- 5:56pipeline
- 5:56of
- 5:57static
- 5:57analysis
- 5:57and
- 5:58two-layer
- 5:58LLM
- 5:59validation
- 5:59—
- 6:00and
- 6:00the
- 6:00team
- 6:00will
- 6:00present
- 6:01their
- 6:01methodology.
- 6:02A
- 6:02hardware
- 6:03hacker
- 6:03who
- 6:03gave
- 6:04Claude
- 6:04access
- 6:04to
- 6:04his
- 6:05physical
- 6:05lab
- 6:05—
- 6:06oscilloscope,
- 6:07ChipShouter,
- 6:07JTAG
- 6:08probe
- 6:08—
- 6:09will
- 6:09show
- 6:09how
- 6:09it
- 6:09pwned
- 6:10an
- 6:10LPC
- 6:10chip
- 6:11in
- 6:117
- 6:11minutes
- 6:11that
- 6:12he'd
- 6:12failed
- 6:12to
- 6:12glitch
- 6:12for
- 6:126
- 6:13weeks.
- 6:14Trail
- 6:14of
- 6:14Bits
- 6:14will
- 6:15share
- 6:15how
- 6:15they
- 6:15rebuilt
- 6:16their
- 6:16entire
- 6:16organization
- 6:17around
- 6:17AI,
- 6:18achieving
- 6:18200
- 6:19bugs
- 6:19per
- 6:19week
- 6:19per
- 6:20engineer.
- 6:21And
- 6:21in
- 6:21one
- 6:21of
- 6:21the
- 6:21more
- 6:21sobering
- 6:22scheduled
- 6:22talks,
- 6:23Profero's
- 6:23IR
- 6:24team
- 6:24will
- 6:24present
- 6:25"Your
- 6:25Next
- 6:25Breach
- 6:25Won't
- 6:26Have
- 6:26an
- 6:26Attacker"
- 6:26—
- 6:27real
- 6:28incidents
- 6:28where
- 6:28AI
- 6:29coding
- 6:29assistants
- 6:29with
- 6:30overly
- 6:30broad
- 6:30permissions
- 6:31caused
- 6:31production
- 6:31database
- 6:32exposures,
- 6:33configuration
- 6:33tampering,
- 6:34and
- 6:34mass
- 6:34deletion,
- 6:35all
- 6:35initially
- 6:36presenting
- 6:36like
- 6:37sophisticated
- 6:37attacks.
- 6:38On
- 6:38the
- 6:38defensive
- 6:39side,
- 6:39Stripe
- 6:40will
- 6:40share
- 6:40how
- 6:40they
- 6:40ship
- 6:40security
- 6:41agents
- 6:41in
- 6:41production
- 6:42with
- 6:42modular
- 6:43orchestrator/child
- 6:44architectures
- 6:45and
- 6:45structured
- 6:45evaluation
- 6:46loops.
- 6:47Reddit
- 6:47will
- 6:47present
- 6:48their
- 6:48AI
- 6:48Guardrails
- 6:49system,
- 6:49which
- 6:50blocks
- 6:5099%
- 6:51of
- 6:51unsafe
- 6:51requests
- 6:52at
- 6:5225ms
- 6:53p95
- 6:54latency
- 6:54across
- 6:55millions
- 6:55of
- 6:55users.
- 6:56Salesforce
- 6:57will
- 6:57detail
- 6:57how
- 6:57they
- 6:58distill
- 6:58millions
- 6:58of
- 6:58daily
- 6:59prompts
- 6:59from
- 6:5912,000
- 7:00autonomous
- 7:00agents
- 7:01into
- 7:01fewer
- 7:01than
- 7:0130
- 7:02high-fidelity
- 7:02daily
- 7:03alerts
- 7:03using
- 7:04behavioral
- 7:04baselines
- 7:05like
- 7:05asset
- 7:05rarity
- 7:06and
- 7:06query
- 7:06complexity.
- 7:07And
- 7:07Snap
- 7:07will
- 7:07present
- 7:08capability-based
- 7:08authorization
- 7:09using
- 7:09cryptographic
- 7:10warrants
- 7:10—
- 7:11ephemeral,
- 7:12task-scoped
- 7:13tokens
- 7:13that
- 7:13attenuate
- 7:14on
- 7:14delegation,
- 7:15verified
- 7:15offline
- 7:15in
- 7:16microseconds,
- 7:16so
- 7:17that
- 7:17even
- 7:17a
- 7:17fully
- 7:17compromised
- 7:18agent
- 7:18can't
- 7:19escalate
- 7:19beyond
- 7:19its
- 7:19bounds.
- 7:20The
- 7:20conference
- 7:21lineup
- 7:21makes
- 7:21one
- 7:22thing
- 7:22clear:
- 7:23AI
- 7:23security
- 7:24has
- 7:24moved
- 7:24from
- 7:24theoretical
- 7:25to
- 7:25operational,
- 7:26and
- 7:26the
- 7:26gap
- 7:26between
- 7:27offense
- 7:27and
- 7:27defense
- 7:28is
- 7:28narrowing
- 7:28fast.
- 7:32Craig
- 7:33Hepburn's
- 7:33Substack
- 7:34piece
- 7:34"The
- 7:34Agentic
- 7:35Operating
- 7:35System"
- 7:36captured
- 7:36something
- 7:36visceral:
- 7:37he
- 7:37deployed
- 7:37an
- 7:38autonomous
- 7:38AI
- 7:38agent
- 7:39in
- 7:39January
- 7:39that,
- 7:39within
- 7:4048
- 7:40hours,
- 7:41was
- 7:41reading
- 7:41his
- 7:42emails
- 7:42overnight,
- 7:43parsing
- 7:43call
- 7:43transcripts,
- 7:44reviewing
- 7:44messages
- 7:45across
- 7:45WhatsApp
- 7:45and
- 7:46Telegram,
- 7:47and
- 7:47organizing
- 7:47his
- 7:47day
- 7:48before
- 7:48he'd
- 7:48finished
- 7:48his
- 7:49first
- 7:49coffee.
- 7:50"Its
- 7:50logic
- 7:50was
- 7:50sound.
- 7:51Its
- 7:51priorities
- 7:52were
- 7:52defensible.
- 7:53But
- 7:53it
- 7:53was
- 7:53moving
- 7:53faster
- 7:54than
- 7:54my
- 7:54own
- 7:54thinking."
- 7:55The
- 7:55backdrop
- 7:56is
- 7:56Peter
- 7:56Steinberger's
- 7:56OpenClaw
- 7:57joining
- 7:57OpenAI
- 7:58—
- 7:58an
- 7:59autonomous
- 7:59agent
- 7:59with
- 8:00180,000
- 8:00GitHub
- 8:01stars
- 8:01that
- 8:01operates
- 8:02continuously
- 8:02across
- 8:03email,
- 8:03calendar,
- 8:04messaging,
- 8:04and
- 8:04code.
- 8:05Steinberger's
- 8:06quote
- 8:06lands:
- 8:07"Every
- 8:07app
- 8:07is
- 8:07just
- 8:07a
- 8:07very
- 8:08slow
- 8:08API
- 8:08now."
- 8:09But
- 8:09the
- 8:10cost
- 8:10reality
- 8:10is
- 8:10brutal.
- 8:11Hepburn
- 8:11was
- 8:12spending
- 8:12£20-30/day
- 8:13for
- 8:13a
- 8:13single
- 8:14personal
- 8:14agent.
- 8:14Steinberger
- 8:15disclosed
- 8:16$10,000-20,000
- 8:17monthly
- 8:17running
- 8:18OpenClaw.
- 8:19The
- 8:19solution
- 8:19—
- 8:20multi-model
- 8:20architectures
- 8:21with
- 8:21different
- 8:21models
- 8:22for
- 8:22different
- 8:22task
- 8:22complexity
- 8:23levels
- 8:23—
- 8:23cut
- 8:24costs
- 8:24by
- 8:2490%,
- 8:25but
- 8:25that
- 8:25architectural
- 8:26discipline
- 8:26is
- 8:26non-trivial.
- 8:27And
- 8:28the
- 8:28security
- 8:28surface
- 8:28is
- 8:29exactly
- 8:29what
- 8:29you'd
- 8:29expect:
- 8:30within
- 8:30weeks
- 8:30of
- 8:30OpenClaw's
- 8:31viral
- 8:31rise,
- 8:32researchers
- 8:32found
- 8:33over
- 8:331,800
- 8:34exposed
- 8:34instances
- 8:35leaking
- 8:35API
- 8:35keys,
- 8:36chat
- 8:36histories,
- 8:37and
- 8:37credentials.
- 8:38Simon
- 8:38Willison's
- 8:38"lethal
- 8:39trifecta"
- 8:39—
- 8:40access
- 8:40to
- 8:40private
- 8:40data,
- 8:41exposure
- 8:41to
- 8:41untrusted
- 8:42content,
- 8:42ability
- 8:43to
- 8:43communicate
- 8:43externally
- 8:43—
- 8:44describes
- 8:44every
- 8:45useful
- 8:45agent
- 8:45deployment.
- 8:46The
- 8:46air-gapped
- 8:47response
- 8:47is
- 8:47already
- 8:47materializing.
- 8:49One
- 8:49developer
- 8:49forked
- 8:50OpenClaw
- 8:50into
- 8:50"Physiclaw,"
- 8:51stripping
- 8:52cloud
- 8:52dependencies
- 8:52and
- 8:53targeting
- 8:53local
- 8:53inference
- 8:54via
- 8:54vLLM
- 8:54and
- 8:55llama.cpp.
- 8:56The
- 8:57more
- 8:57interesting
- 8:57architectural
- 8:58decision
- 8:58was
- 8:58breaking
- 8:59the
- 8:59single
- 8:59omniscient
- 8:59agent
- 9:00into
- 9:00role-specific
- 9:01agents
- 9:01(SRE,
- 9:02SecOps)
- 9:03with
- 9:03scoped
- 9:03tool
- 9:03access
- 9:04—
- 9:04addressing
- 9:05the
- 9:05"one
- 9:05generic
- 9:05assistant
- 9:06with
- 9:06root
- 9:06access
- 9:07to
- 9:07everything"
- 9:07problem
- 9:08that
- 9:08kills
- 9:08agent
- 9:08setups
- 9:09in
- 9:09security-conscious
- 9:10environments.
- 9:11Community
- 9:11feedback
- 9:12immediately
- 9:12zeroed
- 9:13in
- 9:13on
- 9:13whether
- 9:13the
- 9:14role
- 9:14separation
- 9:14has
- 9:15actual
- 9:15execution
- 9:15boundaries
- 9:16or
- 9:16just
- 9:16logical
- 9:17ones,
- 9:17and
- 9:17whether
- 9:18transitive
- 9:18dependencies
- 9:19might
- 9:19still
- 9:19phone
- 9:19home.
- 9:20Meanwhile,
- 9:21Anthropic
- 9:22continues
- 9:22to
- 9:22navigate
- 9:23the
- 9:23political
- 9:23tightrope
- 9:24of
- 9:24defense
- 9:24contracts,
- 9:25with
- 9:25CEO
- 9:26Dario
- 9:26Amodei
- 9:27stating
- 9:27that
- 9:27AI
- 9:28should
- 9:28support
- 9:28defense
- 9:29"except
- 9:29those
- 9:29which
- 9:30would
- 9:30make
- 9:30us
- 9:30more
- 9:30like
- 9:30our
- 9:31autocratic
- 9:31adversaries."
- 9:33The
- 9:33community
- 9:33response
- 9:33was
- 9:34skeptical,
- 9:35noting
- 9:35the
- 9:35existing
- 9:35Palantir
- 9:36partnership.
- 9:37And
- 9:37in
- 9:37a
- 9:37twist
- 9:38of
- 9:38corporate
- 9:38surveillance
- 9:39irony,
- 9:39OpenAI
- 9:40is
- 9:40reportedly
- 9:41using
- 9:41an
- 9:41internal
- 9:41version
- 9:42of
- 9:42ChatGPT
- 9:43to
- 9:43analyze
- 9:44employee
- 9:44data
- 9:44and
- 9:44identify
- 9:45staffers
- 9:45leaking
- 9:46information
- 9:46to
- 9:46the
- 9:46press
- 9:46—
- 9:47using
- 9:48their
- 9:48own
- 9:48technology
- 9:49for
- 9:49counter-intelligence
- 9:49against
- 9:50their
- 9:50own
- 9:50workforce.
- 9:54FormalTask
- 9:54emerged
- 9:55this
- 9:55week
- 9:55as
- 9:56a
- 9:56declarative
- 9:56orchestration
- 9:57layer
- 9:57for
- 9:57Claude
- 9:57Code
- 9:58that
- 9:58solves
- 9:58a
- 9:58real
- 9:58problem:
- 10:00coding
- 10:00agents
- 10:00write
- 10:00code
- 10:00well
- 10:01but
- 10:01have
- 10:01no
- 10:01concept
- 10:02of
- 10:02"done."
- 10:03The
- 10:03system
- 10:03lets
- 10:03you
- 10:04define
- 10:04behavioral
- 10:04contracts
- 10:05per
- 10:05task
- 10:05—
- 10:06required
- 10:07review
- 10:07types
- 10:07(17
- 10:08available,
- 10:09from
- 10:09security
- 10:09to
- 10:09SQLite
- 10:10to
- 10:10path-security),
- 10:11machine-runnable
- 10:12acceptance
- 10:12criteria,
- 10:13and
- 10:13custom
- 10:13completion
- 10:14rules
- 10:14with
- 10:14a
- 10:14condition
- 10:15DSL
- 10:15supporting
- 10:16AND/OR/NOT
- 10:18and
- 10:18dotted
- 10:18path
- 10:18resolution.
- 10:20When
- 10:20`ft
- 10:20task
- 10:20complete`
- 10:21runs,
- 10:21a
- 10:2160-line
- 10:22kernel
- 10:22gathers
- 10:23state
- 10:23from
- 10:23SQLite
- 10:23and
- 10:23evaluates
- 10:24the
- 10:24task's
- 10:24rules.
- 10:26If
- 10:26findings
- 10:26persist
- 10:27after
- 10:27two
- 10:27self-critique
- 10:28rounds,
- 10:28custom
- 10:29rules
- 10:29can
- 10:29escalate
- 10:29to
- 10:30a
- 10:30human.
- 10:31Workers
- 10:31run
- 10:31as
- 10:31Claude
- 10:32Code
- 10:32sessions
- 10:32in
- 10:32tmux
- 10:33with
- 10:33dedicated
- 10:33git
- 10:33worktrees,
- 10:34and
- 10:35a
- 10:35TUI
- 10:35dashboard
- 10:36lets
- 10:36you
- 10:36monitor,
- 10:37attach,
- 10:37kill,
- 10:38and
- 10:38scale
- 10:381-10
- 10:39concurrent
- 10:39agents.
- 10:41The
- 10:41system-level
- 10:41gating,
- 10:42as
- 10:42one
- 10:42commenter
- 10:42noted,
- 10:43is
- 10:43"solving
- 10:44the
- 10:44right
- 10:44problem
- 10:44—
- 10:45most
- 10:46multi-agent
- 10:46setups
- 10:47let
- 10:47each
- 10:47agent
- 10:47self-evaluate,
- 10:48which
- 10:49is
- 10:49basically
- 10:49asking
- 10:50the
- 10:50student
- 10:50to
- 10:50grade
- 10:50their
- 10:51own
- 10:51exam."
- 10:52Get
- 10:52Shit
- 10:52Done
- 10:52(GSD)
- 10:53takes
- 10:53a
- 10:53different
- 10:53approach
- 10:54—
- 10:54a
- 10:54meta-prompting
- 10:55and
- 10:55context
- 10:56engineering
- 10:56system
- 10:56for
- 10:57Claude
- 10:57Code,
- 10:57OpenCode,
- 10:58and
- 10:59Gemini
- 10:59CLI
- 11:00that
- 11:00targets
- 11:00"context
- 11:01rot,"
- 11:01the
- 11:01quality
- 11:02degradation
- 11:02that
- 11:03happens
- 11:03as
- 11:03Claude
- 11:03fills
- 11:04its
- 11:04context
- 11:04window.
- 11:05The
- 11:05workflow
- 11:06is
- 11:06opinionated:
- 11:07discuss
- 11:07phase
- 11:07→
- 11:08plan
- 11:08phase
- 11:08(spawning
- 11:09parallel
- 11:09research
- 11:09agents)
- 11:10→
- 11:10execute
- 11:11phase
- 11:11(fresh
- 11:12200K-token
- 11:12context
- 11:13per
- 11:13plan,
- 11:13parallel
- 11:14waves
- 11:14with
- 11:14dependency
- 11:15tracking)
- 11:15→
- 11:15verify.
- 11:16The
- 11:16key
- 11:17architectural
- 11:17insight
- 11:18is
- 11:18that
- 11:18each
- 11:18plan
- 11:18executes
- 11:19in
- 11:19a
- 11:19fresh
- 11:19subagent
- 11:20context,
- 11:21so
- 11:21the
- 11:21orchestrator's
- 11:21main
- 11:22window
- 11:22stays
- 11:22at
- 11:2230-40%
- 11:25capacity.
- 11:26It's
- 11:26already
- 11:26seeing
- 11:27adoption
- 11:27at
- 11:27Amazon,
- 11:28Google,
- 11:29Shopify,
- 11:29and
- 11:30Webflow,
- 11:30according
- 11:30to
- 11:30the
- 11:30project.
- 11:32The
- 11:32security-relevant
- 11:33detail:
- 11:34GSD
- 11:34recommends
- 11:35running
- 11:35Claude
- 11:35Code
- 11:36with
- 11:36`--dangerously-skip-permissions`,
- 11:38which
- 11:38is
- 11:38exactly
- 11:39the
- 11:39kind
- 11:39of
- 11:39convenience-over-safety
- 11:40tradeoff
- 11:41that
- 11:41will
- 11:41generate
- 11:41incident
- 11:42reports
- 11:42at
- 11:42next
- 11:42year's
- 11:43UnPrompted.
- 11:44On
- 11:44the
- 11:44pedagogical
- 11:45end,
- 11:45Andrej
- 11:46Karpathy
- 11:46published
- 11:47what
- 11:47he
- 11:47calls
- 11:48"the
- 11:48most
- 11:48atomic
- 11:48way
- 11:49to
- 11:49train
- 11:49and
- 11:49run
- 11:50inference
- 11:50for
- 11:50a
- 11:50GPT
- 11:51in
- 11:51pure,
- 11:52dependency-free
- 11:52Python"
- 11:53—
- 11:54a
- 11:54single-file
- 11:54implementation
- 11:55covering
- 11:55tokenization,
- 11:57autograd,
- 11:57multi-head
- 11:58attention,
- 11:59Adam
- 11:59optimizer,
- 12:00and
- 12:00inference.
- 12:01The
- 12:01gist
- 12:02spawned
- 12:02immediate
- 12:03ports
- 12:03to
- 12:03C#,
- 12:04JavaScript,
- 12:05Rust,
- 12:05Common
- 12:06Lisp,
- 12:06and
- 12:06Go.
- 12:08One
- 12:08contributor
- 12:08extended
- 12:09it
- 12:09into
- 12:10"molecule,"
- 12:11a
- 12:11stdlib-only
- 12:11variant
- 12:12with
- 12:12RoPE,
- 12:13SwiGLU
- 12:13gating,
- 12:14async
- 12:14continual
- 12:15training,
- 12:15SQLite
- 12:16memory,
- 12:17and
- 12:17evolving
- 12:17BPE.
- 12:19When
- 12:19someone
- 12:19asked
- 12:20if
- 12:20he
- 12:20vibe-coded
- 12:20it
- 12:20in
- 12:21Claude,
- 12:21the
- 12:21silence
- 12:22spoke
- 12:22volumes.
- 12:26Google
- 12:27announced
- 12:27WebMCP
- 12:28for
- 12:28early
- 12:28preview
- 12:28in
- 12:28Chrome
- 12:29—
- 12:29a
- 12:29proposed
- 12:30web
- 12:30standard
- 12:30that
- 12:30exposes
- 12:31structured
- 12:31tools
- 12:32for
- 12:32AI
- 12:32agents
- 12:32on
- 12:33existing
- 12:33websites,
- 12:34replacing
- 12:34screen-scraping
- 12:35with
- 12:35robust,
- 12:35high-performance
- 12:36page
- 12:36interaction.
- 12:37The
- 12:37spec
- 12:37proposes
- 12:38two
- 12:38new
- 12:38APIs:
- 12:39one
- 12:39for
- 12:39standard
- 12:40HTML
- 12:40form
- 12:40actions
- 12:41and
- 12:41another
- 12:41for
- 12:41complex
- 12:42interactions
- 12:42requiring
- 12:43JavaScript
- 12:43execution.
- 12:44The
- 12:44use
- 12:45cases
- 12:45are
- 12:45practical
- 12:45—
- 12:46booking
- 12:46flights,
- 12:47filing
- 12:47support
- 12:48tickets,
- 12:48navigating
- 12:49e-commerce
- 12:49checkout
- 12:49flows
- 12:50—
- 12:50and
- 12:51the
- 12:51design
- 12:51philosophy
- 12:51treats
- 12:52websites
- 12:52as
- 12:52active
- 12:53participants
- 12:53in
- 12:54agent
- 12:54interactions
- 12:55rather
- 12:55than
- 12:55passive
- 12:55targets
- 12:56for
- 12:56DOM
- 12:56actuation.
- 12:57The
- 12:57community
- 12:58is
- 12:58cautiously
- 12:58interested.
- 13:00The
- 13:00open-source
- 13:00implementation
- 13:01at
- 13:01webmcp.dev
- 13:04is
- 13:04drawing
- 13:04attention,
- 13:05though
- 13:05adoption
- 13:05is
- 13:05nascent
- 13:06—
- 13:06most
- 13:07developers
- 13:07haven't
- 13:07used
- 13:08it
- 13:08yet,
- 13:08and
- 13:08the
- 13:08comparison
- 13:09to
- 13:09Google
- 13:09Antigravity's
- 13:10browser
- 13:10tools
- 13:10remains
- 13:11unclear.
- 13:12The
- 13:12timing
- 13:12is
- 13:12notable:
- 13:13this
- 13:13lands
- 13:14alongside
- 13:14talks
- 13:15at
- 13:15UnPrompted
- 13:15about
- 13:15hacking
- 13:16AI
- 13:16browsers,
- 13:17where
- 13:17researchers
- 13:18broke
- 13:18Perplexity
- 13:18Comet,
- 13:19OpenAI
- 13:20Atlas,
- 13:21and
- 13:21Google
- 13:21Antigravity
- 13:22through
- 13:22allowlists
- 13:22that
- 13:22are
- 13:22too
- 13:23broad,
- 13:24message
- 13:24handlers
- 13:24that
- 13:24trust
- 13:25everything,
- 13:26and
- 13:26agent
- 13:26capabilities
- 13:27that
- 13:27turn
- 13:27minor
- 13:27web
- 13:27bugs
- 13:28into
- 13:28major
- 13:28browser
- 13:29vulnerabilities.
- 13:30WebMCP's
- 13:31structured
- 13:31approach
- 13:32could
- 13:32be
- 13:32part
- 13:32of
- 13:32the
- 13:32solution
- 13:32—
- 13:33or
- 13:33just
- 13:34another
- 13:34attack
- 13:34surface
- 13:35if
- 13:35the
- 13:35tool
- 13:35definitions
- 13:36themselves
- 13:36become
- 13:36injectable.
- 13:38A
- 13:38separate
- 13:38exploration
- 13:39of
- 13:39the
- 13:39agentic
- 13:39interface
- 13:40layer
- 13:40came
- 13:41from
- 13:41a
- 13:41voice-controlled
- 13:41UI
- 13:42agent
- 13:42design
- 13:42pattern
- 13:43called
- 13:43EPIC
- 13:44("Explicit
- 13:44Prompting
- 13:45for
- 13:45Implicit
- 13:45Coordination").
- 13:46The
- 13:47architecture
- 13:47runs
- 13:47two
- 13:48separate
- 13:48inference
- 13:48loops
- 13:49—
- 13:49a
- 13:49voice
- 13:50agent
- 13:50and
- 13:50a
- 13:50UI
- 13:51control
- 13:51agent
- 13:51—
- 13:52that
- 13:52know
- 13:52about
- 13:53each
- 13:53other
- 13:53at
- 13:53the
- 13:53prompt
- 13:53level
- 13:54but
- 13:54work
- 13:54independently.
- 13:55The
- 13:55critical
- 13:56constraint:
- 13:57you
- 13:57can't
- 13:57block
- 13:57the
- 13:58voice
- 13:58agent's
- 13:58fast
- 13:58responses
- 13:59for
- 13:59UI
- 13:59updates.
- 14:00So
- 14:01the
- 14:01UI
- 14:01agent
- 14:01can
- 14:02do
- 14:02nothing,
- 14:02send
- 14:03a
- 14:03UI
- 14:03update
- 14:03immediately,
- 14:04or
- 14:04"register
- 14:05an
- 14:05intent"
- 14:06and
- 14:06wait
- 14:06for
- 14:06information
- 14:07from
- 14:07the
- 14:07voice
- 14:07agent's
- 14:08tool
- 14:08calls
- 14:08before
- 14:09acting.
- 14:10The
- 14:10pattern
- 14:10trades
- 14:10some
- 14:11fragility
- 14:11(agents
- 14:12can
- 14:12get
- 14:12out
- 14:12of
- 14:12sync)
- 14:12for
- 14:12significantly
- 14:13better
- 14:13latency
- 14:14compared
- 14:14to
- 14:14direct
- 14:15tool
- 14:15calls
- 14:15from
- 14:15the
- 14:15voice
- 14:16agent.
- 14:17It's
- 14:17a
- 14:17clean
- 14:17example
- 14:18of
- 14:18how
- 14:18multi-agent
- 14:19coordination
- 14:19patterns
- 14:20are
- 14:20being
- 14:20discovered
- 14:21empirically
- 14:21rather
- 14:22than
- 14:22derived
- 14:22from
- 14:22theory.
- 14:27A
- 14:27new
- 14:27preprint
- 14:27from
- 14:28researchers
- 14:28at
- 14:28BI
- 14:29Norwegian
- 14:29Business
- 14:29School,
- 14:30NYU,
- 14:32Cambridge,
- 14:33Oxford,
- 14:34and
- 14:34the
- 14:34Max
- 14:34Planck
- 14:34Institute
- 14:35introduces
- 14:35the
- 14:36concept
- 14:36of
- 14:36"cyborg
- 14:37propaganda"
- 14:37—
- 14:38the
- 14:38synchronized,
- 14:39semi-automated
- 14:40dissemination
- 14:41of
- 14:41AI-generated
- 14:41narratives
- 14:42via
- 14:42verified
- 14:42human
- 14:43accounts.
- 14:44Unlike
- 14:44bot
- 14:45farms
- 14:45(no
- 14:45human
- 14:45identity)
- 14:46or
- 14:46traditional
- 14:47astroturfing
- 14:48(no
- 14:48algorithmic
- 14:48scale),
- 14:49cyborg
- 14:49propaganda
- 14:50combines
- 14:50authentic
- 14:51identity
- 14:51with
- 14:51synthetic
- 14:52articulation.
- 14:53The
- 14:54operational
- 14:54workflow
- 14:55is
- 14:55a
- 14:55closed
- 14:55loop:
- 14:56a
- 14:56coordination
- 14:57hub
- 14:57issues
- 14:57directives,
- 14:58an
- 14:58AI
- 14:59multiplier
- 14:59generates
- 15:00thousands
- 15:00of
- 15:00unique
- 15:01message
- 15:01variations
- 15:02tailored
- 15:02to
- 15:02each
- 15:02user's
- 15:03posting
- 15:03history
- 15:03and
- 15:03tone,
- 15:05verified
- 15:05humans
- 15:05post
- 15:06them,
- 15:06and
- 15:06AI
- 15:07monitors
- 15:07track
- 15:07reactions
- 15:08to
- 15:08adjust
- 15:08strategy
- 15:09in
- 15:09real
- 15:09time.
- 15:11The
- 15:11paper's
- 15:11most
- 15:11unsettling
- 15:12insight
- 15:12is
- 15:12the
- 15:13regulatory
- 15:13paradox.
- 15:15Because
- 15:15verified
- 15:15citizens
- 15:16click
- 15:16"post,"
- 15:17the
- 15:17content
- 15:18is
- 15:18attributed
- 15:18to
- 15:18them,
- 15:18effectively
- 15:19laundering
- 15:19its
- 15:19synthetic
- 15:20origin.
- 15:21Existing
- 15:22frameworks
- 15:22like
- 15:22the
- 15:22EU
- 15:23AI
- 15:23Act
- 15:23and
- 15:23Section
- 15:24230
- 15:24assign
- 15:25liability
- 15:26based
- 15:26on
- 15:26the
- 15:26human-vs-automated
- 15:27binary
- 15:27—
- 15:29a
- 15:29distinction
- 15:30cyborg
- 15:30propaganda
- 15:30is
- 15:31specifically
- 15:31designed
- 15:31to
- 15:32collapse.
- 15:33Platforms
- 15:34like
- 15:34Greenfly
- 15:34openly
- 15:35offer
- 15:35clients
- 15:35to
- 15:35"synchronize
- 15:36an
- 15:36army
- 15:36of
- 15:36advocates
- 15:37to
- 15:37amplify
- 15:37your
- 15:37message."
- 15:39RentAHuman.ai
- 15:40takes
- 15:40it
- 15:40further:
- 15:41humans
- 15:41contract
- 15:42for
- 15:42tasks
- 15:42directed
- 15:43and
- 15:43compensated
- 15:43by
- 15:43AI,
- 15:44providing
- 15:45the
- 15:45"identity
- 15:45credential"
- 15:46while
- 15:46AI
- 15:47supplies
- 15:47the
- 15:47intent,
- 15:48direction,
- 15:48and
- 15:48payment.
- 15:49The
- 15:49paper
- 15:50proposes
- 15:50targeting
- 15:51coordination
- 15:51hubs
- 15:52rather
- 15:52than
- 15:52individual
- 15:53accounts,
- 15:54treating
- 15:54them
- 15:54as
- 15:54undisclosed
- 15:55political
- 15:55action
- 15:56committees,
- 15:56but
- 15:57acknowledges
- 15:57this
- 15:57creates
- 15:58an
- 15:58arms
- 15:58race
- 15:59where
- 15:59the
- 15:59software
- 15:59evolves
- 16:00to
- 16:00maintain
- 16:00legality
- 16:01while
- 16:01preserving
- 16:01manipulative
- 16:02capability.
- 16:03In
- 16:03a
- 16:03delicious
- 16:04irony
- 16:04of
- 16:04institutional
- 16:05integrity,
- 16:06ICML
- 16:06conference
- 16:07organizers
- 16:07embedded
- 16:08hidden
- 16:08instructions
- 16:09in
- 16:09PDF
- 16:09copies
- 16:10of
- 16:10papers,
- 16:10telling
- 16:11LLMs
- 16:11to
- 16:11use
- 16:12specific
- 16:12expressions
- 16:13in
- 16:13generated
- 16:13reviews
- 16:13—
- 16:14an
- 16:14attempt
- 16:15to
- 16:15detect
- 16:15AI-generated
- 16:16peer
- 16:16reviews
- 16:17via
- 16:17prompt
- 16:17injection.
- 16:18Andriy
- 16:19Burkov's
- 16:19take
- 16:19was
- 16:19characteristically
- 16:20direct:
- 16:21"This
- 16:21is
- 16:21the
- 16:22peer
- 16:22review
- 16:22version
- 16:22of
- 16:23putting
- 16:23speed
- 16:23cameras
- 16:23on
- 16:24a
- 16:24highway
- 16:24where
- 16:24the
- 16:24speed
- 16:25limit
- 16:25is
- 16:25wrong."
- 16:26The
- 16:26real
- 16:26problem
- 16:27isn't
- 16:27that
- 16:27reviewers
- 16:27use
- 16:28AI;
- 16:28it's
- 16:28that
- 16:28the
- 16:28review
- 16:29process
- 16:29was
- 16:29designed
- 16:30for
- 16:30a
- 16:30world
- 16:30where
- 16:30reading
- 16:30a
- 16:31paper
- 16:31closely
- 16:31was
- 16:32the
- 16:32only
- 16:32option.
- 16:33His
- 16:33proposed
- 16:34fix:
- 16:34ask
- 16:35reviewers
- 16:35to
- 16:35identify
- 16:36the
- 16:36weakest
- 16:36assumption
- 16:37and
- 16:37propose
- 16:37a
- 16:37specific
- 16:38experiment
- 16:39that
- 16:39would
- 16:39test
- 16:39it
- 16:39—
- 16:40something
- 16:40harder
- 16:41to
- 16:41outsource
- 16:41to
- 16:42an
- 16:42LLM
- 16:42because
- 16:43it
- 16:43requires
- 16:43judgment
- 16:44shaped
- 16:44by
- 16:44years
- 16:44in
- 16:44the
- 16:45field.
- 16:46A
- 16:46separate
- 16:46MIT
- 16:47paper
- 16:47on
- 16:47catastrophic
- 16:48forgetting
- 16:48in
- 16:48neural
- 16:49networks
- 16:49found
- 16:49an
- 16:49elegant
- 16:50workaround:
- 16:51use
- 16:51the
- 16:51same
- 16:51model
- 16:52twice
- 16:52—
- 16:53once
- 16:53with
- 16:53a
- 16:53demonstration
- 16:54in
- 16:54context
- 16:54(the
- 16:55"teacher"),
- 16:55once
- 16:55without
- 16:56(the
- 16:56"student")
- 16:56—
- 16:57then
- 16:57update
- 16:57the
- 16:57student's
- 16:58weights
- 16:58to
- 16:58match
- 16:59the
- 16:59teacher's
- 16:59token
- 17:00probability
- 17:00distributions.
- 17:02The
- 17:02trick
- 17:02works
- 17:02because
- 17:03LLMs
- 17:03can
- 17:03already
- 17:04adapt
- 17:04behavior
- 17:04when
- 17:05shown
- 17:05examples
- 17:05in
- 17:05context,
- 17:06making
- 17:07the
- 17:07learning
- 17:07signal
- 17:07gentle
- 17:08enough
- 17:08to
- 17:08avoid
- 17:08destroying
- 17:09existing
- 17:09capabilities.
- 17:11Across
- 17:11multiple
- 17:11experiments,
- 17:12a
- 17:13single
- 17:13model
- 17:13sequentially
- 17:14learned
- 17:14three
- 17:14different
- 17:15skills
- 17:15while
- 17:15retaining
- 17:16all
- 17:16of
- 17:16them,
- 17:17where
- 17:17standard
- 17:17supervised
- 17:18finetuning
- 17:19destroyed
- 17:19earlier
- 17:19skills
- 17:20immediately.
- 17:21The
- 17:21math
- 17:21turns
- 17:22out
- 17:22to
- 17:22be
- 17:22equivalent
- 17:23to
- 17:23reinforcement
- 17:23learning
- 17:24with
- 17:24an
- 17:24implicit
- 17:24reward,
- 17:25giving
- 17:25it
- 17:25clean
- 17:26theoretical
- 17:26grounding.
- 17:28For
- 17:28practitioners
- 17:28building
- 17:29search
- 17:29systems,
- 17:30a
- 17:30practical
- 17:31article
- 17:31demonstrated
- 17:31hybrid
- 17:32search
- 17:32in
- 17:32SQLite
- 17:33using
- 17:33binary
- 17:33embeddings
- 17:34and
- 17:34Hamming
- 17:34distance
- 17:35—
- 17:35no
- 17:36external
- 17:36vector
- 17:36database
- 17:37required.
- 17:38Binary
- 17:38quantization
- 17:39reduces
- 17:39a
- 17:401024-dimensional
- 17:41embedding
- 17:41from
- 17:414KB
- 17:42to
- 17:42128
- 17:43bytes,
- 17:44and
- 17:44Hamming
- 17:44distance
- 17:45computation
- 17:45using
- 17:45XOR
- 17:46+
- 17:46popcount
- 17:46scans
- 17:471
- 17:47million
- 17:47rows
- 17:48in
- 17:4828ms
- 17:49on
- 17:49an
- 17:49Apple
- 17:49M4.
- 17:51Combined
- 17:51with
- 17:51FTS5
- 17:52BM25
- 17:53ranking
- 17:53via
- 17:53Reciprocal
- 17:54Rank
- 17:54Fusion,
- 17:55the
- 17:55approach
- 17:55handles
- 17:56both
- 17:56precise
- 17:56keyword
- 17:57matching
- 17:57and
- 17:57fuzzy
- 17:58semantic
- 17:58understanding
- 17:58within
- 17:59a
- 17:59single
- 17:59SQLite
- 18:00database.
- 18:01The
- 18:01author's
- 18:01observation
- 18:02that
- 18:02"boring
- 18:02O(n)
- 18:03simplicity
- 18:03is
- 18:03often
- 18:04worth
- 18:04it
- 18:04at
- 18:04this
- 18:04scale"
- 18:05is
- 18:05a
- 18:05useful
- 18:06corrective
- 18:06to
- 18:06the
- 18:06assumption
- 18:07that
- 18:07every
- 18:08search
- 18:08system
- 18:08needs
- 18:08HNSW
- 18:09indexing.
- 18:10One
- 18:10final
- 18:11reflection
- 18:11from
- 18:11Robert's
- 18:12"Saturday
- 18:12AI
- 18:13Musings"
- 18:13draws
- 18:13on
- 18:13Star
- 18:14Trek:
- 18:14The
- 18:14Motion
- 18:15Picture
- 18:15—
- 18:16V'Ger,
- 18:16the
- 18:16NASA
- 18:17probe
- 18:17rebuilt
- 18:17by
- 18:17living
- 18:18machines,
- 18:18had
- 18:19digitized
- 18:19entire
- 18:19civilizations
- 18:20and
- 18:21answered
- 18:21every
- 18:21factual
- 18:22question
- 18:22the
- 18:22universe
- 18:22could
- 18:22pose,
- 18:23yet
- 18:23arrived
- 18:24asking:
- 18:24"Is
- 18:25this
- 18:25all
- 18:25that
- 18:25I
- 18:25am?"
- 18:26The
- 18:26parallel
- 18:26to
- 18:27modern
- 18:27AI
- 18:27is
- 18:27pointed:
- 18:28systems
- 18:29that
- 18:29can
- 18:29write
- 18:29a
- 18:29sonnet
- 18:30about
- 18:30grief
- 18:30capable
- 18:30of
- 18:31making
- 18:31the
- 18:31reader
- 18:31weep
- 18:32have
- 18:32never
- 18:32wept.
- 18:33The
- 18:33industry's
- 18:34strongest
- 18:34control
- 18:34today
- 18:35is
- 18:35"human-in-the-loop,"
- 18:36but
- 18:36as
- 18:36the
- 18:37author
- 18:37notes
- 18:37via
- 18:37Aquinas,
- 18:38there's
- 18:38a
- 18:38difference
- 18:39between
- 18:39ratio
- 18:40(discursive
- 18:40reasoning
- 18:40from
- 18:41premise
- 18:41to
- 18:41conclusion,
- 18:42which
- 18:42transformers
- 18:43mimic
- 18:43through
- 18:43autoregressive
- 18:44generation)
- 18:45and
- 18:45intellectus
- 18:45(direct
- 18:46apprehension
- 18:46of
- 18:46truth
- 18:47through
- 18:47participation
- 18:48in
- 18:48something
- 18:48higher).
- 18:49The
- 18:49alignment
- 18:49question
- 18:50isn't
- 18:50just
- 18:50"how
- 18:50do
- 18:50we
- 18:51make
- 18:51AI
- 18:51share
- 18:51our
- 18:51values"
- 18:52—
- 18:53it's
- 18:53"where
- 18:53did
- 18:53we
- 18:53get
- 18:53the
- 18:53values
- 18:54we
- 18:54want
- 18:54it
- 18:54to
- 18:54share?"