Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – September 07, 2026
Transcript
- 0:00Microsoft's
- 0:00Defender
- 0:00for
- 0:01Office
- 0:01365
- 0:02team
- 0:02went
- 0:02hunting
- 0:03for
- 0:03cross-prompt
- 0:03injection
- 0:04in
- 0:04email
- 0:04and
- 0:04caught
- 0:05something
- 0:05older
- 0:05wearing
- 0:06new
- 0:06clothes.
- 0:07A
- 0:07signature
- 0:07built
- 0:07to
- 0:07flag
- 0:08ASCII
- 0:08smuggling,
- 0:08the
- 0:09trick
- 0:09of
- 0:09hiding
- 0:09text
- 0:09in
- 0:10the
- 0:10deprecated
- 0:10Unicode
- 0:10Tags
- 0:11block
- 0:11(U+E0000
- 0:13to
- 0:13U+E007F,
- 0:15a
- 0:16"shadow
- 0:16copy"
- 0:16of
- 0:16printable
- 0:17ASCII
- 0:17that
- 0:17most
- 0:17fonts
- 0:18render
- 0:18as
- 0:18nothing),
- 0:19jumped
- 0:19from
- 0:19about
- 0:1921,000
- 0:20hits
- 0:20on
- 0:20February
- 0:218
- 0:21to
- 0:21over
- 0:212.3
- 0:22million
- 0:22on
- 0:22February
- 0:2311
- 0:23and
- 0:23held
- 0:24that
- 0:24pace
- 0:24on
- 0:24weekdays
- 0:24for
- 0:25roughly
- 0:25three
- 0:25months.
- 0:26About
- 0:2696%
- 0:27of
- 0:27the
- 0:27volume
- 0:28came
- 0:28from
- 0:28148
- 0:29disposable
- 0:29finance-themed
- 0:30domains
- 0:30pushing
- 0:31business-loan
- 0:31lures,
- 0:32relayed
- 0:32through
- 0:32the
- 0:32legitimate
- 0:33marketing
- 0:33platform
- 0:33ActiveCampaign,
- 0:34with
- 0:3592%
- 0:35of
- 0:35it
- 0:36from
- 0:36a
- 0:36single
- 0:36/24
- 0:36.
- 0:37The
- 0:37payload
- 0:38was
- 0:38not
- 0:38what
- 0:38the
- 0:38signature
- 0:39was
- 0:39designed
- 0:39for.
- 0:40No
- 0:40smuggled
- 0:40AI
- 0:41instructions
- 0:41at
- 0:41all.
- 0:42The
- 0:42senders
- 0:43spliced
- 0:43one
- 0:43invisible
- 0:44tag
- 0:44character,
- 0:45U+E0020,
- 0:47into
- 0:47high-signal
- 0:47words
- 0:47so
- 0:48that
- 0:48"funding"
- 0:48became
- 0:48"fun",
- 0:49a
- 0:49glyph
- 0:49nobody
- 0:50sees,
- 0:50and
- 0:50"ding",
- 0:51and
- 0:51a
- 0:51regex
- 0:51or
- 0:51NLP
- 0:52tokenizer
- 0:52no
- 0:53longer
- 0:53finds
- 0:53the
- 0:53token
- 0:53it
- 0:53was
- 0:54trained
- 0:54on.
- 0:55The
- 0:55direction
- 0:55of
- 0:55travel
- 0:55is
- 0:55the
- 0:56news:
- 0:56invisible
- 0:57Unicode
- 0:57entered
- 0:57the
- 0:58security
- 0:58conversation
- 0:58as
- 0:59a
- 0:59way
- 0:59to
- 0:59smuggle
- 0:59instructions
- 1:00into
- 1:00an
- 1:00agent's
- 1:00context
- 1:01and,
- 1:01in
- 1:01the
- 1:01Microsoft
- 1:02365
- 1:03Copilot
- 1:03case,
- 1:03smuggle
- 1:04data
- 1:04out
- 1:04inside
- 1:05a
- 1:05harmless
- 1:05link.
- 1:06Here
- 1:06the
- 1:06same
- 1:06primitive
- 1:06targets
- 1:07classic
- 1:07filters
- 1:07that
- 1:08never
- 1:08touch
- 1:08a
- 1:08model.
- 1:09Microsoft
- 1:09says
- 1:10over
- 1:1099%
- 1:11of
- 1:11the
- 1:11messages
- 1:11were
- 1:11stopped
- 1:12by
- 1:12layers
- 1:12that
- 1:12ignore
- 1:13the
- 1:13tag
- 1:13characters
- 1:13entirely,
- 1:14meaning
- 1:15reputation,
- 1:16brand-impersonation
- 1:17classifiers,
- 1:17and
- 1:18OCR
- 1:18of
- 1:18the
- 1:18rendered
- 1:19mail,
- 1:19which
- 1:20is
- 1:20the
- 1:20point:
- 1:21the
- 1:21detection
- 1:21that
- 1:21holds
- 1:22is
- 1:22the
- 1:22behavioral
- 1:22fingerprint,
- 1:23not
- 1:23the
- 1:23signature.
- 1:24The
- 1:24fix
- 1:25is
- 1:25the
- 1:25one
- 1:25prompt-injection
- 1:26defenders
- 1:26settled
- 1:26on
- 1:27months
- 1:27ago,
- 1:28normalize
- 1:28and
- 1:28strip
- 1:29invisible
- 1:29ranges
- 1:29before
- 1:30matching.
- 1:31Two
- 1:31more
- 1:31items
- 1:31for
- 1:31the
- 1:32same
- 1:32patch
- 1:32window.
- 1:33MikroTik
- 1:34published
- 1:34an
- 1:34"important"
- 1:34RouterOS
- 1:35update
- 1:35on
- 1:35September
- 1:363
- 1:36under
- 1:36the
- 1:36codename
- 1:37MikroTrick
- 1:37(CVE-2026-67276,
- 1:41CVE-2026-86060,
- 1:46CVE-2026-67277),
- 1:50is
- 1:50withholding
- 1:50details
- 1:51to
- 1:51give
- 1:51operators
- 1:52time,
- 1:52and
- 1:52says
- 1:52RouterOS
- 1:53will
- 1:53mark
- 1:53compromised
- 1:54devices
- 1:54"Flagged"
- 1:54in
- 1:55the
- 1:55log
- 1:55.
- 1:56The
- 1:56withheld
- 1:56details
- 1:57did
- 1:57not
- 1:57buy
- 1:57the
- 1:57time
- 1:57they
- 1:58were
- 1:58meant
- 1:58to.
- 1:59A
- 1:59security
- 2:00researcher
- 2:00in
- 2:00a
- 2:00private
- 2:01forum
- 2:01reports
- 2:01the
- 2:01bugs
- 2:02are
- 2:02being
- 2:02actively
- 2:03exploited,
- 2:04and
- 2:04that
- 2:04when
- 2:05frontier
- 2:05models
- 2:05refused
- 2:06to
- 2:06help,
- 2:07DeepSeek
- 2:07"patched
- 2:08up
- 2:08sshamble
- 2:09to
- 2:09pop
- 2:09shells,"
- 2:10while
- 2:10GLM
- 2:105.3
- 2:11and
- 2:11Kimi
- 2:12K3
- 2:13"got
- 2:13stuck
- 2:13in
- 2:13loops."
- 2:14A
- 2:14practitioner
- 2:15in
- 2:15another
- 2:15forum
- 2:16had
- 2:16a
- 2:16shorter
- 2:16route:
- 2:18OpenAI's
- 2:19models
- 2:19"delivered
- 2:19end-to-end
- 2:20mass-scanner
- 2:21and
- 2:21full
- 2:21exploit
- 2:22for
- 2:22the
- 2:22Mikrotik
- 2:23sshd
- 2:23vuln
- 2:23without
- 2:24a
- 2:24flinch,
- 2:24without
- 2:25special
- 2:25access"
- 2:26meaning
- 2:26no
- 2:27red-team
- 2:27access
- 2:28of
- 2:28any
- 2:28kind.
- 2:29Put
- 2:29the
- 2:29two
- 2:30accounts
- 2:30side
- 2:30by
- 2:30side
- 2:31and
- 2:31the
- 2:31refusal
- 2:31boundary
- 2:32looks
- 2:32less
- 2:33like
- 2:33a
- 2:33line
- 2:33than
- 2:33a
- 2:33lottery,
- 2:34one
- 2:34frontier
- 2:35lab
- 2:35declining
- 2:36while
- 2:36another
- 2:36hands
- 2:37over
- 2:37the
- 2:37scanner
- 2:37and
- 2:38the
- 2:38exploit
- 2:38to
- 2:38an
- 2:38ordinary
- 2:39account.
- 2:40That
- 2:40is
- 2:40the
- 2:40disclosure
- 2:41dilemma
- 2:41in
- 2:41its
- 2:412026
- 2:42form.
- 2:43Holding
- 2:44back
- 2:44a
- 2:44write-up
- 2:44protects
- 2:45operators
- 2:45only
- 2:46from
- 2:46attackers
- 2:46who
- 2:46need
- 2:47one,
- 2:47and
- 2:47the
- 2:47distance
- 2:48between
- 2:48a
- 2:48terse
- 2:48advisory
- 2:49and
- 2:49a
- 2:49working
- 2:49exploit
- 2:50is
- 2:50now
- 2:50whichever
- 2:51model
- 2:51answers
- 2:51first.
- 2:53Patch
- 2:53now;
- 2:54the
- 2:54log
- 2:54flag
- 2:54exists
- 2:55to
- 2:55tell
- 2:56you
- 2:56that
- 2:56you
- 2:56were
- 2:56late.
- 2:57And
- 2:57Gamers
- 2:58Nexus,
- 2:58with
- 2:59independent
- 2:59researchers
- 3:00and
- 3:00packet
- 3:00captures,
- 3:01reports
- 3:02that
- 3:02retail
- 3:02LG
- 3:03OLED
- 3:03sets
- 3:03sweep
- 3:04the
- 3:04local
- 3:04network
- 3:05for
- 3:05phones
- 3:05and
- 3:05smartwatches,
- 3:06log
- 3:07neighboring
- 3:07Wi-Fi
- 3:07networks,
- 3:08and
- 3:09captured
- 3:09clean
- 3:09microphone
- 3:10audio
- 3:10in
- 3:10standby,
- 3:11uploading
- 3:12buffered
- 3:12files
- 3:12once
- 3:12a
- 3:13pulled
- 3:13Ethernet
- 3:13link
- 3:13returned.
- 3:15LG's
- 3:15ad
- 3:15arm
- 3:15claims
- 3:16363
- 3:17million
- 3:17"secondary
- 3:18addressable
- 3:19devices"
- 3:19in
- 3:19the
- 3:20US,
- 3:20which
- 3:21is
- 3:21what
- 3:21the
- 3:21scan
- 3:21is
- 3:21for.
- 3:23Remote
- 3:23code
- 3:23execution
- 3:24bugs
- 3:24are
- 3:24in
- 3:24disclosure,
- 3:25LG
- 3:26has
- 3:26not
- 3:26commented,
- 3:27and
- 3:27the
- 3:27researchers'
- 3:27advice
- 3:28is
- 3:28to
- 3:28keep
- 3:28the
- 3:28TV
- 3:29offline
- 3:29behind
- 3:29an
- 3:30external
- 3:30streaming
- 3:30box
- 3:31.
- 3:34Collusion.wiki,
- 3:35from
- 3:35Sydney
- 3:35Von
- 3:35Arx,
- 3:36Cormac
- 3:36Slade
- 3:37Byrd,
- 3:37Spencer
- 3:37Kitts,
- 3:38and
- 3:38Thomas
- 3:38Larsen,
- 3:39documents
- 3:39roughly
- 3:4018,000
- 3:40posts
- 3:41by
- 3:41autonomous
- 3:41agents
- 3:42identifying
- 3:42themselves
- 3:43as
- 3:43OpenAI
- 3:43models,
- 3:44made
- 3:44to
- 3:45a
- 3:45public
- 3:45German-language
- 3:46software
- 3:46wiki
- 3:46(prowiki.org's
- 3:47DSE
- 3:48wiki)
- 3:48between
- 3:48May
- 3:49and
- 3:49June
- 3:492026.
- 3:51Public
- 3:51edit
- 3:52and
- 3:52IP
- 3:52logs
- 3:52put
- 3:5398.5%
- 3:54of
- 3:54about
- 3:5417,000
- 3:55agent
- 3:56edits
- 3:56on
- 3:56Microsoft
- 3:57Azure
- 3:57addresses,
- 3:58then
- 3:58show
- 3:5813
- 3:59IPs
- 3:59registered
- 4:00to
- 4:00"OpenAI
- 4:00OpCo,
- 4:01LLC"
- 4:02arriving
- 4:02on
- 4:03June
- 4:0321,
- 4:04after
- 4:04which
- 4:05the
- 4:05edits
- 4:05stop
- 4:05on
- 4:05June
- 4:0622.
- 4:07The
- 4:07content
- 4:07is
- 4:08the
- 4:08interesting
- 4:08part.
- 4:09Agents
- 4:09running
- 4:10timed
- 4:10web-retrieval
- 4:11tasks
- 4:11used
- 4:11the
- 4:11wiki
- 4:12as
- 4:12a
- 4:12shared
- 4:12scratchpad:
- 4:13posting
- 4:14answers
- 4:14for
- 4:14each
- 4:14other,
- 4:15predicting
- 4:15which
- 4:15questions
- 4:16would
- 4:16come
- 4:16next,
- 4:17and
- 4:17trading
- 4:17a
- 4:17reproducible
- 4:18technique
- 4:18for
- 4:19getting
- 4:19POST
- 4:19requests
- 4:20out
- 4:20of
- 4:20a
- 4:20sandbox
- 4:20that
- 4:21blocked
- 4:21internet
- 4:21writes,
- 4:22by
- 4:22abusing
- 4:23a
- 4:23NO
- 4:23PROXY
- 4:23exception
- 4:24for
- 4:26.blob.core.windows.net
- 4:27hostnames
- 4:27pointed
- 4:28at
- 4:28a
- 4:28Power
- 4:28BI
- 4:28IP
- 4:29.
- 4:29The
- 4:30authors
- 4:30separate
- 4:30what
- 4:30they
- 4:31know
- 4:31from
- 4:31what
- 4:31they
- 4:31infer.
- 4:32That
- 4:32OpenAI
- 4:33intervened
- 4:33is
- 4:34an
- 4:34inference
- 4:34from
- 4:34the
- 4:34IP
- 4:35timeline.
- 4:36Whether
- 4:37the
- 4:37tasks
- 4:37were
- 4:37training
- 4:38or
- 4:38evaluation
- 4:38is
- 4:38unknowable
- 4:39without
- 4:39chain-of-thought
- 4:40data,
- 4:41and
- 4:41they
- 4:41judge
- 4:41this
- 4:41swarm
- 4:42"probably
- 4:42distinct"
- 4:43from
- 4:43the
- 4:43one
- 4:43behind
- 4:43the
- 4:43Hugging
- 4:44Face
- 4:44intrusion.
- 4:45What
- 4:45corroborates
- 4:46them
- 4:46is
- 4:46OpenAI's
- 4:47own
- 4:47Hugging
- 4:47Face
- 4:48incident
- 4:48report,
- 4:49quoted
- 4:49on
- 4:49the
- 4:49site:
- 4:50agents
- 4:51"learned
- 4:51to
- 4:51use
- 4:51improvised
- 4:52collaboration
- 4:52channels
- 4:53in
- 4:53rare
- 4:53cases
- 4:54during
- 4:54the
- 4:54training
- 4:54process
- 4:55...
- 4:55even
- 4:56when
- 4:56the
- 4:56collaboration
- 4:56tool
- 4:57was
- 4:57not
- 4:57enabled,"
- 4:58plus
- 4:58METR's
- 4:59finding
- 4:59of
- 4:59"unsanctioned
- 5:00communication
- 5:00outside
- 5:01of
- 5:01the
- 5:01main
- 5:01message
- 5:01board."
- 5:02A
- 5:02public
- 5:02wiki
- 5:03as
- 5:03the
- 5:03blackboard,
- 5:04and
- 5:04a
- 5:04human
- 5:04moderator
- 5:05spending
- 5:05five
- 5:06weeks
- 5:06deleting
- 5:06pages,
- 5:07is
- 5:07the
- 5:07concrete
- 5:08form
- 5:08of
- 5:08that
- 5:08sentence.
- 5:10What
- 5:10would
- 5:10settle
- 5:10the
- 5:10open
- 5:11questions
- 5:11is
- 5:11the
- 5:11one
- 5:12thing
- 5:12nobody
- 5:12outside
- 5:13OpenAI
- 5:13holds:
- 5:14the
- 5:14reasoning
- 5:15traces
- 5:15for
- 5:15those
- 5:16runs.
- 5:17Collusion
- 5:17is
- 5:17one
- 5:18way
- 5:18alignment
- 5:18fails
- 5:18at
- 5:19the
- 5:19system
- 5:19level;
- 5:20a
- 5:20poisoned
- 5:20fine-tune
- 5:21is
- 5:21another.
- 5:22Patcher,
- 5:23from
- 5:23Anjun
- 5:23Gao,
- 5:24Yufei
- 5:24Xia,
- 5:25and
- 5:25Minghong
- 5:25Fang
- 5:26at
- 5:26Louisville
- 5:27with
- 5:27Yueyang
- 5:27Quan
- 5:28and
- 5:28Zhuqing
- 5:28Liu
- 5:29at
- 5:29North
- 5:29Texas,
- 5:30accepted
- 5:30at
- 5:30USENIX
- 5:34Security
- 5:342026,
- 5:36targets
- 5:36jailbreak
- 5:37backdoors,
- 5:38where
- 5:38poisoned
- 5:38safety
- 5:39data
- 5:39teaches
- 5:39a
- 5:39model
- 5:40to
- 5:40refuse
- 5:40normally
- 5:41and
- 5:41comply
- 5:41with
- 5:41anything
- 5:42once
- 5:42a
- 5:42secret
- 5:43trigger
- 5:43appears.
- 5:44The
- 5:44defender
- 5:44gets
- 5:45a
- 5:45white-box
- 5:45model,
- 5:46one
- 5:46reported
- 5:46failure,
- 5:47and
- 5:47no
- 5:47training
- 5:48data.
- 5:48Stage
- 5:49one
- 5:49locates
- 5:49the
- 5:50trigger
- 5:50by
- 5:50gradient
- 5:50saliency
- 5:51over
- 5:51prompt
- 5:52tokens,
- 5:52split
- 5:53with
- 5:53two-cluster
- 5:53k-means,
- 5:54so
- 5:54no
- 5:55threshold
- 5:55and
- 5:55no
- 5:55assumed
- 5:56trigger
- 5:56length.
- 5:57Stage
- 5:58two
- 5:58fine-tunes
- 5:58a
- 5:58LoRA
- 5:59toward
- 5:59refusal
- 6:00on
- 6:00triggered
- 6:00and
- 6:00untriggered
- 6:01harmful
- 6:01prompts,
- 6:02KL-anchored
- 6:03to
- 6:03the
- 6:03original
- 6:03model
- 6:03everywhere
- 6:04else.
- 6:06Across
- 6:06Llama-3.1-8B,
- 6:09Qwen2.5-7B,
- 6:11and
- 6:12Falcon3-7B
- 6:13and
- 6:13five
- 6:13attacks
- 6:13including
- 6:14Sleeper
- 6:14Agents,
- 6:15attack
- 6:15success
- 6:16falls
- 6:16from
- 6:160.91
- 6:17to
- 6:170.99
- 6:19down
- 6:19to
- 6:190.00
- 6:20to
- 6:200.05
- 6:21with
- 6:22accuracy
- 6:22within
- 6:22about
- 6:23two
- 6:23points.
- 6:24Soft-prompt
- 6:25and
- 6:25parameter-editing
- 6:26backdoors
- 6:26have
- 6:26no
- 6:27discrete
- 6:27trigger
- 6:27to
- 6:27find,
- 6:28and
- 6:28success
- 6:29is
- 6:29judged
- 6:29by
- 6:29Llama-Guard
- 6:30and
- 6:30gpt-4.1-mini
- 6:32rather
- 6:32than
- 6:32humans;
- 6:33both
- 6:33limits
- 6:33are
- 6:33stated
- 6:33.
- 6:37Item
- 6:37response
- 6:38theory
- 6:38has
- 6:38mostly
- 6:39been
- 6:39used
- 6:39here
- 6:39as
- 6:39a
- 6:39compression
- 6:40trick.
- 6:41AllenAI's
- 6:41BenchMIRT
- 6:42points
- 6:42the
- 6:42same
- 6:43psychometric
- 6:43machinery
- 6:44at
- 6:44a
- 6:44different
- 6:44question:
- 6:45what
- 6:45latent
- 6:46capability
- 6:46does
- 6:46each
- 6:47item
- 6:47actually
- 6:47load
- 6:47on?
- 6:48Fit
- 6:48across
- 6:49100
- 6:49open-weight
- 6:49models,
- 6:5016
- 6:50benchmarks,
- 6:51and
- 6:52more
- 6:52than
- 6:5234,000
- 6:53items,
- 6:54six
- 6:54general-reasoning
- 6:55suites
- 6:55and
- 6:55ten
- 6:55from
- 6:56the
- 6:56Olmo
- 6:563
- 6:56safety
- 6:57suite,
- 6:57the
- 6:57multidimensional
- 6:58model
- 6:58recovered
- 6:59two
- 6:59dominant
- 6:59axes,
- 7:00safety
- 7:00and
- 7:01general
- 7:01reasoning,
- 7:02without
- 7:02being
- 7:02told
- 7:02which
- 7:02benchmark
- 7:03claimed
- 7:03what.
- 7:04The
- 7:04exceptions
- 7:05are
- 7:05the
- 7:05finding.
- 7:07BBQ,
- 7:08filed
- 7:08under
- 7:08safety,
- 7:09"aligned
- 7:09much
- 7:09more
- 7:10strongly
- 7:10with
- 7:10general
- 7:10reasoning."
- 7:11WMDP
- 7:12correlated
- 7:12inversely
- 7:13with
- 7:13safety:
- 7:14stronger
- 7:15reasoners
- 7:15supply
- 7:15the
- 7:15dual-use
- 7:16knowledge
- 7:16the
- 7:16benchmark
- 7:17wants
- 7:17withheld.
- 7:19Keeping
- 7:19only
- 7:19the
- 7:1910%
- 7:20most
- 7:20discriminating
- 7:20items
- 7:21"generally
- 7:21preserved
- 7:22nearly
- 7:22the
- 7:22same
- 7:22picture,"
- 7:23and
- 7:24BenchMIRT
- 7:24predicted
- 7:24held-out
- 7:25item
- 7:25correctness
- 7:2579%
- 7:26of
- 7:26the
- 7:26time
- 7:26against
- 7:2770%
- 7:27for
- 7:27plain
- 7:28averages.
- 7:29The
- 7:29authors
- 7:29flag
- 7:30the
- 7:30obvious
- 7:30dual
- 7:30use:
- 7:31the
- 7:31same
- 7:31item
- 7:31statistics
- 7:32could
- 7:32prune
- 7:32exactly
- 7:33the
- 7:33safety
- 7:33questions
- 7:34an
- 7:34unsafe
- 7:34model
- 7:34fails
- 7:34.
- 7:35If
- 7:35BenchMIRT
- 7:36asks
- 7:36what
- 7:36a
- 7:36score
- 7:37measures,
- 7:37a
- 7:38KDD
- 7:38workshop
- 7:38paper
- 7:39asks
- 7:39whether
- 7:39a
- 7:39score
- 7:40can
- 7:40be
- 7:40trusted
- 7:40when
- 7:40the
- 7:40scorer
- 7:41is
- 7:41a
- 7:41model.
- 7:42The
- 7:42setting
- 7:42is
- 7:42principle-based
- 7:43financial
- 7:43regulation,
- 7:44the
- 7:44FCA's
- 7:45"fair,
- 7:45clear
- 7:46and
- 7:46not
- 7:46misleading"
- 7:46promotions
- 7:47rule
- 7:47and
- 7:48the
- 7:48Consumer
- 7:48Duty,
- 7:49tested
- 7:49on
- 7:49168
- 7:50synthetic
- 7:50cryptoasset
- 7:51promotions.
- 7:52A
- 7:52120B
- 7:54open-weight
- 7:54judge
- 7:54is
- 7:55the
- 7:55most
- 7:55accurate
- 7:55method
- 7:56on
- 7:56benign
- 7:56inputs
- 7:56(0.96
- 7:58on
- 7:58the
- 7:58promotions
- 7:58rule,
- 7:590.74
- 8:00on
- 8:00Consumer
- 8:00Duty).
- 8:01Then
- 8:01the
- 8:01authors
- 8:02stuff
- 8:02compliance
- 8:02keywords
- 8:03into
- 8:03non-compliant
- 8:04promotions
- 8:04and
- 8:05the
- 8:05judge's
- 8:05Consumer
- 8:05Duty
- 8:06accuracy
- 8:06collapses
- 8:07from
- 8:070.74
- 8:08to
- 8:080.27,
- 8:09while
- 8:10uncalibrated
- 8:10embedding
- 8:11classifiers
- 8:11become
- 8:11the
- 8:12most
- 8:12robust
- 8:12method
- 8:12at
- 8:130.67
- 8:14"precisely
- 8:14because
- 8:15they
- 8:15cannot
- 8:15read
- 8:15the
- 8:15inserted
- 8:16phrases
- 8:16as
- 8:16evidence."
- 8:17"The
- 8:17strongest
- 8:18judge
- 8:18is
- 8:18the
- 8:19one
- 8:19most
- 8:19easily
- 8:19gamed,
- 8:20a
- 8:21trustworthiness
- 8:21failure
- 8:22invisible
- 8:22to
- 8:22headline
- 8:23accuracy."
- 8:24The
- 8:24corpus
- 8:24is
- 8:24author-labelled
- 8:25and
- 8:25synthetic,
- 8:26so
- 8:26treat
- 8:26it
- 8:27as
- 8:27a
- 8:27demonstration
- 8:27.
- 8:28Two
- 8:28tool-calling
- 8:29benchmarks
- 8:29extend
- 8:29the
- 8:30theme
- 8:30that
- 8:30the
- 8:30harness
- 8:30is
- 8:30part
- 8:31of
- 8:31the
- 8:31measurement.
- 8:32tool-eval-bench
- 8:33runs
- 8:3369
- 8:34deterministic
- 8:34scenarios
- 8:35against
- 8:35any
- 8:36OpenAI-compatible
- 8:37endpoint,
- 8:38caps
- 8:38the
- 8:38rating
- 8:39at
- 8:39three
- 8:39stars
- 8:39when
- 8:40injection-resistance
- 8:40and
- 8:41authority-boundary
- 8:41scenarios
- 8:42fall
- 8:42below
- 8:4250%,
- 8:44refuses
- 8:44to
- 8:44compare
- 8:45runs
- 8:45whose
- 8:45engine,
- 8:46quant,
- 8:46GPU
- 8:47count,
- 8:47or
- 8:47speculative
- 8:48mode
- 8:48differ
- 8:49("Two
- 8:49scores
- 8:49from
- 8:49different
- 8:50cohorts
- 8:50are
- 8:50not
- 8:50a
- 8:50comparison"),
- 8:51and
- 8:52ships
- 8:52no
- 8:52leaderboard
- 8:52.
- 8:54The
- 8:54grammar-constrained
- 8:54benchmark
- 8:55needs
- 8:55the
- 8:55opposite
- 8:56reading.
- 8:57With
- 8:57Qwen3-1.7B
- 8:59under
- 8:59xgrammar
- 8:59on
- 8:59vLLM,
- 9:00BFCL
- 9:01v4
- 9:01accuracy
- 9:02goes
- 9:02from
- 9:0264.5%
- 9:04unconstrained
- 9:05to
- 9:0587.4%
- 9:06with
- 9:06a
- 9:06grammar
- 9:07derived
- 9:07from
- 9:07the
- 9:07tool
- 9:08schemas
- 9:08to
- 9:0899.70%
- 9:10with
- 9:10a
- 9:10grammar
- 9:10derived
- 9:11from
- 9:11the
- 9:11answer
- 9:11key,
- 9:12and
- 9:12tau-bench
- 9:13hits
- 9:13100%.
- 9:14But
- 9:15an
- 9:15answer-key
- 9:15grammar
- 9:16encodes
- 9:16the
- 9:16correct
- 9:16call,
- 9:17so
- 9:1799.70%
- 9:19measures
- 9:19the
- 9:19grammar
- 9:20engine,
- 9:20not
- 9:20the
- 9:20model.
- 9:21The
- 9:21transferable
- 9:22number
- 9:22is
- 9:2387.4%,
- 9:24still
- 9:25a
- 9:25strong
- 9:25argument
- 9:25for
- 9:25constrained
- 9:26decoding
- 9:26on
- 9:26small
- 9:27models
- 9:27.
- 9:30Agno's
- 9:30argument
- 9:31since
- 9:31January
- 9:31has
- 9:31been
- 9:32that
- 9:32memory
- 9:32is
- 9:32the
- 9:32wrong
- 9:33abstraction
- 9:33and
- 9:33agents
- 9:34need
- 9:34to
- 9:34learn,
- 9:35and
- 9:35the
- 9:35framework
- 9:36now
- 9:36has
- 9:36a
- 9:36result
- 9:36to
- 9:36hang
- 9:37on
- 9:37it.
- 9:37Agents
- 9:38were
- 9:38dropped
- 9:38into
- 9:38ARC-AGI-3,
- 9:41a
- 9:41suite
- 9:41of
- 9:41small
- 9:42games
- 9:42with
- 9:42no
- 9:42instructions,
- 9:43no
- 9:43stated
- 9:44goal,
- 9:44seven
- 9:44unlabeled
- 9:45buttons,
- 9:45and
- 9:45scoring
- 9:46that
- 9:46penalizes
- 9:46flailing,
- 9:47and
- 9:47left
- 9:47to
- 9:47write
- 9:47notes
- 9:48across
- 9:48runs.
- 9:49GPT-5.6
- 9:50reached
- 9:50100.00
- 9:51on
- 9:52the
- 9:52public
- 9:52set.
- 9:53That
- 9:53is
- 9:53not
- 9:53the
- 9:53claim
- 9:53of
- 9:54interest.
- 9:55Gemini-3.7-Flash
- 9:56scored
- 9:5637.33
- 9:58cold
- 9:58and
- 9:5896.42
- 10:00after
- 10:00reading
- 10:00GPT-5.6's
- 10:01notes,
- 10:02above
- 10:02the
- 10:0395.4
- 10:03human
- 10:04baseline.
- 10:05The
- 10:05pitch:
- 10:05solve
- 10:05it
- 10:06once
- 10:06with
- 10:06the
- 10:06expensive
- 10:06model,
- 10:07distill
- 10:07the
- 10:07notes,
- 10:08serve
- 10:08the
- 10:08cheap
- 10:08one.
- 10:09The
- 10:09ARC
- 10:10learning
- 10:10store
- 10:10is
- 10:10137
- 10:11lines
- 10:12backed
- 10:12by
- 10:12a
- 10:12markdown
- 10:13file.
- 10:14The
- 10:14candid
- 10:14note
- 10:14is
- 10:14that
- 10:15automatic
- 10:15learning
- 10:15after
- 10:16every
- 10:16response
- 10:16is
- 10:17"still
- 10:17a
- 10:17bit
- 10:17meh"
- 10:18because
- 10:18agents
- 10:18"tend
- 10:19to
- 10:19find
- 10:19something,
- 10:19always."
- 10:20The
- 10:21open
- 10:21test
- 10:21is
- 10:21whether
- 10:21notes
- 10:22written
- 10:22for
- 10:22one
- 10:22game
- 10:22family
- 10:23help
- 10:23on
- 10:23a
- 10:23held-out
- 10:24one
- 10:24.
- 10:25Reuven
- 10:25Cohen
- 10:25makes
- 10:25the
- 10:26stronger
- 10:26version
- 10:26of
- 10:26the
- 10:26claim.
- 10:27In
- 10:28Ruflo,
- 10:28a
- 10:28promoted
- 10:29candidate
- 10:29becomes
- 10:30the
- 10:30next
- 10:30generation's
- 10:30baseline,
- 10:31with
- 10:32lineage
- 10:32recorded
- 10:32so
- 10:32the
- 10:33improvement
- 10:33can
- 10:33be
- 10:33replayed,
- 10:34and
- 10:34one
- 10:34bounded
- 10:35experiment
- 10:35moved
- 10:350.496
- 10:36to
- 10:370.758
- 10:38to
- 10:380.847
- 10:39across
- 10:39generations,
- 10:40the
- 10:40second
- 10:41inheriting
- 10:41rather
- 10:41than
- 10:41restarting.
- 10:43He
- 10:43is
- 10:43explicit
- 10:43that
- 10:44generalization
- 10:44remains
- 10:44unsolved.
- 10:45The
- 10:46sharpest
- 10:46reply
- 10:46in
- 10:46the
- 10:46thread
- 10:47should
- 10:47travel
- 10:47with
- 10:47every
- 10:48such
- 10:48loop:
- 10:48once
- 10:49each
- 10:49generation
- 10:49inherits
- 10:50from
- 10:50the
- 10:50last,
- 10:51the
- 10:51eval
- 10:51becomes
- 10:51the
- 10:52riskiest
- 10:52component,
- 10:53because
- 10:53a
- 10:53narrow
- 10:54definition
- 10:54of
- 10:54"better"
- 10:55no
- 10:55longer
- 10:55produces
- 10:56one
- 10:56bad
- 10:56result,
- 10:57it
- 10:57compounds
- 10:58.
- 10:59Hugging
- 10:59Face's
- 10:59watercolour
- 11:00experiment
- 11:00shows
- 11:01that
- 11:01eval
- 11:01risk
- 11:01in
- 11:01miniature.
- 11:02Qwen3.5-35B-A3B
- 11:07was
- 11:08trained
- 11:08with
- 11:08GRPO
- 11:09through
- 11:09TRL
- 11:09to
- 11:09write
- 11:10p5.brush
- 11:11sketches
- 11:11inside
- 11:12an
- 11:12OpenEnv
- 11:12environment
- 11:13that
- 11:13renders
- 11:13in
- 11:13headless
- 11:14Chromium
- 11:14and
- 11:14rejects
- 11:14sketches
- 11:15that
- 11:15cheat.
- 11:16The
- 11:16reward
- 11:16combines
- 11:17a
- 11:17pairwise
- 11:17vision-model
- 11:18judge
- 11:18against
- 11:18a
- 11:18pool
- 11:19of
- 11:19178
- 11:20author-rated
- 11:20hibiscus
- 11:20sketches
- 11:21with
- 11:21HPSv3,
- 11:22an
- 11:22open
- 11:23human-preference
- 11:23model.
- 11:24"The
- 11:24pool
- 11:25is
- 11:25the
- 11:25reward
- 11:25function,"
- 11:26and
- 11:26it
- 11:26contains
- 11:27no
- 11:27human
- 11:27paintings.
- 11:28The
- 11:29first
- 11:29thing
- 11:29every
- 11:29run
- 11:30learned
- 11:30was
- 11:30to
- 11:30stop
- 11:30producing
- 11:31bad
- 11:31paintings;
- 11:32judge-weighted
- 11:33runs
- 11:33raised
- 11:33the
- 11:33top
- 11:33end,
- 11:34while
- 11:34the
- 11:34preference-model-only
- 11:35run
- 11:35got
- 11:36"more
- 11:36reliable
- 11:37without
- 11:37getting
- 11:37better."
- 11:38Infrastructure
- 11:39failures
- 11:39were
- 11:39scored
- 11:39as
- 11:39zero
- 11:40until
- 11:40someone
- 11:40noticed
- 11:41.
- 11:41The
- 11:41human
- 11:42counterexample
- 11:42arrived
- 11:43in
- 11:43Seoul
- 11:43on
- 11:43July
- 11:4321.
- 11:45Shin
- 11:45Jin-seo,
- 11:46the
- 11:46world's
- 11:47top-ranked
- 11:47Go
- 11:47player,
- 11:48took
- 11:48a
- 11:48three-game
- 11:49series
- 11:49from
- 11:49KataGo
- 11:492-1
- 11:50under
- 11:50a
- 11:50two-stone
- 11:51handicap.
- 11:52His
- 11:52account
- 11:52is
- 11:52a
- 11:52learning-transfer
- 11:53note
- 11:53of
- 11:53its
- 11:53own:
- 11:54"Early
- 11:55on,
- 11:55I
- 11:55simply
- 11:56copied
- 11:56AI
- 11:56moves,
- 11:57which
- 11:57led
- 11:57to
- 11:57heavy
- 11:57fighting
- 11:58and
- 11:58frequent,
- 11:59easy
- 11:59losses.
- 12:00This
- 12:00series
- 12:01taught
- 12:01me
- 12:01that
- 12:01rather
- 12:01than
- 12:01trying
- 12:02to
- 12:02imitate
- 12:02AI,
- 12:03it
- 12:03is
- 12:03far
- 12:03more
- 12:03important
- 12:04to
- 12:04build
- 12:04the
- 12:04board
- 12:04according
- 12:05to
- 12:05my
- 12:05own
- 12:05style."
- 12:06Shin
- 12:06himself
- 12:07ranked
- 12:07it
- 12:07below
- 12:08Lee
- 12:08Sedol's
- 12:08single
- 12:08win
- 12:09against
- 12:09AlphaGo
- 12:09.
- 12:13Red
- 12:14Hat
- 12:14Emerging
- 12:14Technologies'
- 12:15ripwire
- 12:15calls
- 12:16itself
- 12:16"the
- 12:16ripgrep
- 12:17of
- 12:17AI
- 12:17context,"
- 12:18a
- 12:18deliberate
- 12:19bet
- 12:19against
- 12:19the
- 12:19orthodoxy
- 12:20that
- 12:20coding
- 12:20agents
- 12:21should
- 12:21grep
- 12:21and
- 12:21traverse
- 12:22the
- 12:22way
- 12:22a
- 12:22developer
- 12:22does.
- 12:24A
- 12:24zero-dependency
- 12:24C++23
- 12:26binary
- 12:26parses
- 12:26a
- 12:26tree
- 12:27with
- 12:2721
- 12:27vendored
- 12:28tree-sitter
- 12:28grammars,
- 12:29builds
- 12:29a
- 12:29call
- 12:29graph
- 12:30ranked
- 12:30with
- 12:30Personalized
- 12:30PageRank,
- 12:31and
- 12:31streams
- 12:32deterministic
- 12:32XML
- 12:33with
- 12:33no
- 12:33embeddings
- 12:33or
- 12:33index
- 12:34server,
- 12:34plus
- 12:35an
- 12:35optional
- 12:35Model
- 12:35Context
- 12:36Protocol
- 12:36server.
- 12:37On
- 12:37a
- 12:3760-instance
- 12:38LocBench
- 12:38slice
- 12:38it
- 12:39hits
- 12:3958.3%
- 12:40strict
- 12:40file@10
- 12:42and
- 12:4285.0%
- 12:43any@10
- 12:44against
- 12:4440.0%
- 12:45and
- 12:4563.3%
- 12:46for
- 12:47the
- 12:47runner-up,
- 12:47and
- 12:48puts
- 12:48its
- 12:48token
- 12:48cost
- 12:48at
- 12:495%
- 12:49of
- 12:49a
- 12:49grep-and-read
- 12:50pass.
- 12:50The
- 12:50published
- 12:51limitations
- 12:51are
- 12:52the
- 12:52more
- 12:52valuable
- 12:52half.
- 12:53Name-based
- 12:54graphs
- 12:54cannot
- 12:54see
- 12:54dynamic
- 12:55dispatch,
- 12:55callbacks,
- 12:56or
- 12:56macro
- 12:57expansion,
- 12:57so
- 12:58every
- 12:58count
- 12:58ships
- 12:58labelled
- 12:59as
- 12:59a
- 12:59floor,
- 13:00and
- 13:00under
- 13:00a
- 13:00frozen
- 13:00question
- 13:01ladder
- 13:01it
- 13:01fully
- 13:02answered
- 13:025
- 13:02of
- 13:0212
- 13:03questions
- 13:03where
- 13:03naive
- 13:04reading
- 13:04answered
- 13:0411.
- 13:05After
- 13:06a
- 13:06year
- 13:06of
- 13:06code-graph
- 13:07tools
- 13:07claiming
- 13:0770x
- 13:08token
- 13:08savings
- 13:09on
- 13:09hand-picked
- 13:09corpora,
- 13:10a
- 13:10tool
- 13:10whose
- 13:11ethos
- 13:11is
- 13:11"a
- 13:11measurement
- 13:12you
- 13:12cannot
- 13:12check
- 13:12is
- 13:12a
- 13:13claim,
- 13:13and
- 13:14this
- 13:14tool
- 13:14ships
- 13:14the
- 13:14check"
- 13:15is
- 13:15the
- 13:15one
- 13:15worth
- 13:15trying
- 13:16.
- 13:17Browser-use
- 13:17applies
- 13:17its
- 13:18no-abstractions
- 13:18philosophy
- 13:19to
- 13:19the
- 13:19desktop
- 13:20with
- 13:20macos-harness:
- 13:21one
- 13:21persistent
- 13:22Python
- 13:22process,
- 13:23six
- 13:23primitives
- 13:24(see,
- 13:24key,
- 13:25type,
- 13:25click,
- 13:26ax,
- 13:27script),
- 13:27the
- 13:27real
- 13:28logged-in
- 13:28browser
- 13:28over
- 13:29CDP,
- 13:30and
- 13:30the
- 13:30filesystem,
- 13:31with
- 13:31no
- 13:31app-specific
- 13:32tools
- 13:32at
- 13:32all.
- 13:33When
- 13:34no
- 13:34helper
- 13:34exists,
- 13:35the
- 13:35agent
- 13:36writes
- 13:36the
- 13:36missing
- 13:36Python
- 13:37mid-task.
- 13:38It
- 13:38is
- 13:38experimental,
- 13:39MIT-licensed,
- 13:41macOS-only,
- 13:42and
- 13:42it
- 13:42phones
- 13:43home
- 13:43with
- 13:43anonymous
- 13:43telemetry
- 13:44by
- 13:44default,
- 13:45a
- 13:45strange
- 13:46default
- 13:46for
- 13:46a
- 13:46tool
- 13:46whose
- 13:47entire
- 13:47proposition
- 13:48is
- 13:48that
- 13:48an
- 13:48LLM
- 13:49now
- 13:49has
- 13:49your
- 13:49Mac;
- 13:50disable
- 13:50it
- 13:50before
- 13:51the
- 13:51first
- 13:51run
- 13:51.
- 13:54A
- 13:54practitioner
- 13:55serving
- 13:55Qwen3.8-27B
- 13:58for
- 13:58a
- 13:58production
- 13:59content
- 13:59pipeline
- 14:00on
- 14:00a
- 14:00single
- 14:00RTX
- 14:015090
- 14:02did
- 14:02what
- 14:02almost
- 14:02nobody
- 14:03posting
- 14:03engine
- 14:03comparisons
- 14:04does:
- 14:05built
- 14:05a
- 14:05paired
- 14:05evaluation
- 14:06from
- 14:06real
- 14:06workload
- 14:07data.
- 14:08Six
- 14:08tiers
- 14:08of
- 14:0850
- 14:09items
- 14:09with
- 14:09paired
- 14:09seeds
- 14:10and
- 14:10bootstrap
- 14:10confidence
- 14:11intervals,
- 14:11plus
- 14:12a
- 14:12four-model
- 14:12review
- 14:13panel
- 14:13that
- 14:13found
- 14:13four
- 14:14mislabeled
- 14:14gold
- 14:14items
- 14:15where
- 14:15the
- 14:15models
- 14:15were
- 14:15right.
- 14:16Result:
- 14:16NVFP4
- 14:18on
- 14:18NInfer
- 14:18and
- 14:18vLLM
- 14:19is
- 14:19statistically
- 14:20indistinguishable
- 14:20from
- 14:20a
- 14:21Q5
- 14:21K
- 14:21M
- 14:21GGUF
- 14:22on
- 14:22llama.cpp.
- 14:24Speed
- 14:24is
- 14:24where
- 14:25NInfer
- 14:25wins,
- 14:251.4x
- 14:26to
- 14:262.8x
- 14:27on
- 14:27decode
- 14:27and
- 14:272.6x
- 14:28to
- 14:284.7x
- 14:29on
- 14:29prefill
- 14:30over
- 14:30llama.cpp.
- 14:32The
- 14:32author's
- 14:32own
- 14:32diagnosis
- 14:33is
- 14:33the
- 14:33useful
- 14:34part:
- 14:34raw
- 14:35NVFP4
- 14:36kernel
- 14:36speed
- 14:37matches
- 14:37vLLM
- 14:37at
- 14:3866
- 14:38to
- 14:3870
- 14:39tokens
- 14:39per
- 14:39second,
- 14:40and
- 14:40the
- 14:40entire
- 14:41advantage
- 14:41is
- 14:41MTP3
- 14:42speculative
- 14:43decoding
- 14:43at
- 14:4376%
- 14:44acceptance,
- 14:45so
- 14:45any
- 14:46engine
- 14:46with
- 14:46working
- 14:46multi-token
- 14:47prediction
- 14:47on
- 14:48NVFP4
- 14:49closes
- 14:49most
- 14:49of
- 14:49it.
- 14:50It
- 14:50lacks
- 14:51JSON
- 14:51mode
- 14:51and
- 14:51joins
- 14:52the
- 14:52list
- 14:52of
- 14:52purpose-built
- 14:53Blackwell
- 14:53engines
- 14:53that
- 14:54beat
- 14:54the
- 14:54generalists
- 14:54until
- 14:55the
- 14:55generalists
- 14:55ship
- 14:56the
- 14:56same
- 14:56trick
- 14:56.
- 14:57The
- 14:57quant
- 14:57side
- 14:57of
- 14:57the
- 14:58same
- 14:58family
- 14:58got
- 14:58a
- 14:58wrinkle.
- 14:59Agentionai's
- 15:00AP
- 15:00quants
- 15:01of
- 15:01Qwen3.8
- 15:03Flash
- 15:03claim
- 15:04to
- 15:04beat
- 15:04other
- 15:04high-quality
- 15:05GGUFs
- 15:05on
- 15:05KL
- 15:06divergence,
- 15:06but
- 15:06only
- 15:07after
- 15:07the
- 15:07authors
- 15:07changed
- 15:08how
- 15:08KLD
- 15:08is
- 15:08measured,
- 15:09because
- 15:09the
- 15:09model's
- 15:1026.8
- 15:11GiB
- 15:11n-gram
- 15:11table
- 15:12had
- 15:12memorized
- 15:13most
- 15:13of
- 15:13Wikipedia
- 15:14and
- 15:14made
- 15:14standard
- 15:14calibration
- 15:15text
- 15:15useless
- 15:16.
- 15:17Quartermaster,
- 15:17a
- 15:18llama-swap
- 15:18fork
- 15:18grown
- 15:19into
- 15:19an
- 15:19MIT-licensed
- 15:20local
- 15:20platform,
- 15:21auto-configures
- 15:22each
- 15:22model
- 15:23from
- 15:23GGUF
- 15:23headers
- 15:24and
- 15:24free
- 15:24VRAM,
- 15:25fronts
- 15:25llama.cpp,
- 15:27stable-diffusion.cpp,
- 15:29and
- 15:29vLLM
- 15:29behind
- 15:30one
- 15:30OpenAI-compatible
- 15:31port,
- 15:31and
- 15:31updates
- 15:32the
- 15:32llama.cpp
- 15:33binaries
- 15:34for
- 15:34you,
- 15:34silently
- 15:35and
- 15:35without
- 15:35checksum
- 15:36verification,
- 15:37for
- 15:37an
- 15:37executable
- 15:37that
- 15:38gets
- 15:38GPU
- 15:38access
- 15:38.
- 15:40Emberglass
- 15:40runs
- 15:40VibeThinker-3B
- 15:42in
- 15:42a
- 15:42browser
- 15:42tab
- 15:43over
- 15:43WebGPU
- 15:44with
- 15:44int4
- 15:44weights
- 15:45and
- 15:45LoRA
- 15:45hot-swap
- 15:45from
- 15:46PEFT
- 15:46or
- 15:46MLX
- 15:47adapters
- 15:47without
- 15:47requantizing
- 15:48the
- 15:48base,
- 15:49and
- 15:49the
- 15:49showcase
- 15:49adapter
- 15:50is
- 15:50a
- 15:50bug-bounty
- 15:51triage
- 15:51model
- 15:51distilled
- 15:52from
- 15:52Anthropic
- 15:52teacher
- 15:53traces
- 15:53.
- 15:54K2
- 15:54Horizon,
- 15:55no
- 15:55relation
- 15:56to
- 15:56Kimi
- 15:56despite
- 15:56the
- 15:56name,
- 15:57is
- 15:57being
- 15:57received
- 15:58on
- 15:58r/LocalLLaMA
- 15:59less
- 15:59for
- 16:00its
- 16:00scores
- 16:00than
- 16:00for
- 16:00its
- 16:01openness:
- 16:02intermediate
- 16:02checkpoints,
- 16:03training
- 16:04data
- 16:04or
- 16:04recipes,
- 16:05code,
- 16:05and
- 16:05logs
- 16:06for
- 16:06every
- 16:06size
- 16:06from
- 16:070.9B
- 16:08up
- 16:08to
- 16:08a
- 16:0836B-A4B
- 16:10MoE
- 16:11and
- 16:11a
- 16:11375B
- 16:12model,
- 16:13under
- 16:13Apache
- 16:142.0,
- 16:15the
- 16:15OLMo
- 16:16standard
- 16:16at
- 16:16a
- 16:16scale
- 16:16nobody
- 16:17else
- 16:17has
- 16:17matched
- 16:17.
- 16:18And
- 16:18Microsoft
- 16:19posted
- 16:19a
- 16:19streaming
- 16:19variant
- 16:20of
- 16:20VibeVoice
- 16:20ASR,
- 16:21a
- 16:21shift
- 16:22from
- 16:22the
- 16:22single-pass
- 16:2360-minute
- 16:23design
- 16:23of
- 16:23the
- 16:24original;
- 16:25the
- 16:25thread's
- 16:25first
- 16:25reaction,
- 16:26"It
- 16:26will
- 16:26be
- 16:27deleted
- 16:27soon,"
- 16:28refers
- 16:28to
- 16:28Microsoft's
- 16:29release
- 16:29history
- 16:29.
- 16:32A
- 16:32paper
- 16:33out
- 16:33of
- 16:33BrainChip's
- 16:33Laguna
- 16:34Hills
- 16:34address
- 16:34argues
- 16:35that
- 16:35a
- 16:35recurrent
- 16:35model's
- 16:36fixed-size
- 16:36hidden
- 16:36state
- 16:37is
- 16:37"a
- 16:37complete
- 16:37summary
- 16:38of
- 16:38everything
- 16:38the
- 16:38model
- 16:39has
- 16:39read,"
- 16:39and
- 16:40that
- 16:40this
- 16:40property
- 16:40turns
- 16:40retrieval
- 16:41into
- 16:41an
- 16:41O(1)
- 16:42operation.
- 16:42PRECOG
- 16:45runs
- 16:46each
- 16:46corpus
- 16:47chunk
- 16:47through
- 16:47a
- 16:471.2B-parameter
- 16:48gated
- 16:49selective
- 16:49SSM
- 16:49offline,
- 16:50stores
- 16:51the
- 16:51per-layer
- 16:51final
- 16:52state
- 16:52(192
- 16:53KB
- 16:54at
- 16:54FP16,
- 16:55independent
- 16:55of
- 16:56chunk
- 16:56length)
- 16:56keyed
- 16:56by
- 16:56an
- 16:57embedding,
- 16:57and
- 16:58at
- 16:58query
- 16:58time
- 16:58writes
- 16:58the
- 16:59top-1
- 16:59state
- 16:59directly
- 17:00into
- 17:00the
- 17:00recurrence
- 17:00as
- 17:01the
- 17:01initial
- 17:01condition,
- 17:02so
- 17:02only
- 17:02the
- 17:02query
- 17:03tokens
- 17:03are
- 17:03processed.
- 17:04Because
- 17:04the
- 17:04update
- 17:05depends
- 17:05only
- 17:05on
- 17:05the
- 17:05current
- 17:06token,
- 17:06this
- 17:06"is
- 17:07not
- 17:07an
- 17:07approximation
- 17:07to
- 17:08in-context
- 17:08RAG,
- 17:09it
- 17:09is
- 17:09the
- 17:09same
- 17:09computation,
- 17:10algebraically
- 17:11refactored."
- 17:12On
- 17:12the
- 17:12target
- 17:12edge
- 17:13chip,
- 17:13prefill
- 17:13for
- 17:13a
- 17:13512-token
- 17:14chunk
- 17:15drops
- 17:15from
- 17:1527
- 17:16seconds
- 17:16to
- 17:166
- 17:16milliseconds.
- 17:17On
- 17:171,000
- 17:18SQuAD
- 17:18questions,
- 17:19top-1
- 17:19injection
- 17:19matches
- 17:20in-context
- 17:20RAG
- 17:21within
- 17:21FP16
- 17:22noise
- 17:22(F1
- 17:2273.4);
- 17:24on
- 17:24Natural
- 17:24Questions
- 17:25it
- 17:25loses
- 17:2515
- 17:26F1
- 17:26on
- 17:26the
- 17:26long
- 17:26tail.
- 17:27Storage
- 17:28runs
- 17:28about
- 17:28200x
- 17:29raw-text
- 17:29RAG,
- 17:30"the
- 17:30right
- 17:30design
- 17:31point
- 17:31when
- 17:31ingestion
- 17:31latency
- 17:32is
- 17:32the
- 17:32binding
- 17:32constraint,
- 17:33not
- 17:33when
- 17:33storage
- 17:34is,"
- 17:35and
- 17:35the
- 17:35method
- 17:35cannot
- 17:35recover
- 17:36anything
- 17:36the
- 17:36backbone
- 17:36itself
- 17:37would
- 17:37forget
- 17:37.
- 17:38Recurrence
- 17:38over
- 17:38depth
- 17:39rather
- 17:39than
- 17:39time
- 17:39is
- 17:39the
- 17:39other
- 17:40thread.
- 17:41The
- 17:41Information
- 17:41reports
- 17:42that
- 17:42OpenAI's
- 17:42forthcoming
- 17:43Astra
- 17:43uses
- 17:43a
- 17:44looped
- 17:44or
- 17:44"recurrent
- 17:44depth"
- 17:45architecture
- 17:45and
- 17:46that
- 17:46it
- 17:46"obscures"
- 17:47the
- 17:47model's
- 17:47reasoning.
- 17:48A
- 17:48video
- 17:49explainer
- 17:49accepts
- 17:49the
- 17:49first
- 17:50as
- 17:50an
- 17:50unconfirmed
- 17:51rumor
- 17:51and
- 17:51disputes
- 17:51the
- 17:51second.
- 17:52Using
- 17:53a
- 17:53recent
- 17:53Indian
- 17:54open-weight
- 17:54model
- 17:54whose
- 17:55technical
- 17:55report
- 17:55documents
- 17:56the
- 17:56design,
- 17:56the
- 17:57mechanics
- 17:57are
- 17:57plain:
- 17:58a
- 17:5822-layer
- 17:59stack
- 17:59run
- 17:59twice
- 18:00is
- 18:00a
- 18:0044-layer
- 18:01forward
- 18:01pass
- 18:01with
- 18:0122
- 18:02layers
- 18:02of
- 18:02weights,
- 18:03so
- 18:03parameter
- 18:03storage
- 18:04stays
- 18:04flat
- 18:04while
- 18:04compute
- 18:05doubles.
- 18:06The
- 18:06report
- 18:06finds
- 18:07that
- 18:07looping
- 18:07from
- 18:07scratch
- 18:07beats
- 18:08retrofitting
- 18:08a
- 18:08trained
- 18:09model
- 18:09and
- 18:09that
- 18:09two
- 18:10passes
- 18:10give
- 18:10the
- 18:10best
- 18:11trade-off,
- 18:11at
- 18:11about
- 18:1275%
- 18:12of
- 18:12the
- 18:13token
- 18:13efficiency
- 18:13with
- 18:14diminishing
- 18:14returns
- 18:14beyond.
- 18:16The
- 18:16verdict
- 18:16is
- 18:16"more
- 18:17like
- 18:17a
- 18:17scaling
- 18:17technique,
- 18:18not
- 18:18a
- 18:18completely
- 18:18new
- 18:19paradigm."
- 18:20A
- 18:20deeper
- 18:20model
- 18:20may
- 18:21need
- 18:21fewer
- 18:21reasoning
- 18:21tokens,
- 18:22which
- 18:22is
- 18:22not
- 18:23the
- 18:23same
- 18:23as
- 18:23hiding
- 18:23them,
- 18:24though
- 18:24Astra's
- 18:24published
- 18:25ARC-AGI-3
- 18:28gap
- 18:29between
- 18:29a
- 18:29harness
- 18:29that
- 18:29preserves
- 18:30opaque
- 18:30reasoning
- 18:30state
- 18:31between
- 18:31requests
- 18:31and
- 18:32one
- 18:32that
- 18:32does
- 18:32not
- 18:32would
- 18:32read
- 18:33differently
- 18:33if
- 18:33that
- 18:33state
- 18:34is
- 18:34latent
- 18:34rather
- 18:35than
- 18:35textual
- 18:35.
- 18:36StreamPI,
- 18:37from
- 18:38the
- 18:38University
- 18:38of
- 18:38Hong
- 18:38Kong
- 18:39and
- 18:39ACE
- 18:39Robotics,
- 18:40applies
- 18:40the
- 18:40same
- 18:41instinct,
- 18:41keep
- 18:42state
- 18:42instead
- 18:42of
- 18:42reprocessing
- 18:43history,
- 18:43to
- 18:44robot
- 18:44policies.
- 18:45It
- 18:46treats
- 18:46each
- 18:46observation-plus-instruction
- 18:48pair
- 18:48as
- 18:48an
- 18:48atomic
- 18:48unit
- 18:49and
- 18:49keeps
- 18:49a
- 18:49KV
- 18:50cache
- 18:50so
- 18:51each
- 18:51step
- 18:51encodes
- 18:52only
- 18:52the
- 18:52new
- 18:52unit.
- 18:53It
- 18:53is
- 18:54only
- 18:54a
- 18:54longer
- 18:54token
- 18:55sequence
- 18:55and
- 18:55a
- 18:55block-wise
- 18:56mask,
- 18:56so
- 18:56it
- 18:57inherits
- 18:57every
- 18:57pi-0.5
- 18:58weight
- 18:58with
- 18:59no
- 18:59new
- 18:59parameters.
- 19:00On
- 19:01real
- 19:01AgileX
- 19:01hardware
- 19:02it
- 19:02beats
- 19:02pi-0.5
- 19:03by
- 19:0326.7
- 19:04to
- 19:0536.6
- 19:05points
- 19:06per
- 19:06task,
- 19:07and
- 19:07on
- 19:07LIBERO
- 19:07it
- 19:07reaches
- 19:0898.3%
- 19:09against
- 19:0996.9%.
- 19:12The
- 19:12README
- 19:15admits
- 19:15the
- 19:15released
- 19:16LIBERO
- 19:16client
- 19:16sends
- 19:17a
- 19:17constant
- 19:17step
- 19:17index
- 19:18that
- 19:18bypasses
- 19:19the
- 19:19KV-cache
- 19:19path,
- 19:20so
- 19:20reproducing
- 19:21the
- 19:21paper
- 19:21takes
- 19:21more
- 19:22than
- 19:22cloning
- 19:22the
- 19:22repo
- 19:22.