Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – April 15, 2026
Transcript
- 0:00OWASP's
- 0:00new
- 0:00Agentic
- 0:01Security
- 0:01Initiative
- 0:02Top
- 0:0210
- 0:02has
- 0:02landed,
- 0:03and
- 0:03the
- 0:03number-one
- 0:03entry
- 0:04is
- 0:04Agent
- 0:04Goal
- 0:05Hijack
- 0:05—
- 0:06the
- 0:06complete
- 0:07takeover
- 0:07of
- 0:07an
- 0:07AI
- 0:07agent's
- 0:08objectives
- 0:08through
- 0:09malicious
- 0:09instructions
- 0:09embedded
- 0:10in
- 0:10content
- 0:10the
- 0:10agent
- 0:11processes.
- 0:12Adversa
- 0:12AI's
- 0:13practical
- 0:13guide
- 0:13to
- 0:13ASI-01
- 0:16spells
- 0:16out
- 0:16why
- 0:17it
- 0:17earned
- 0:17the
- 0:17top
- 0:17slot:
- 0:18once
- 0:19an
- 0:19attacker
- 0:19redirects
- 0:20an
- 0:20agent's
- 0:20goal,
- 0:21every
- 0:21tool
- 0:21the
- 0:21agent
- 0:21holds
- 0:22—
- 0:23file
- 0:23access,
- 0:24email,
- 0:24shell,
- 0:25APIs
- 0:25—
- 0:26becomes
- 0:27a
- 0:27weapon
- 0:27pointed
- 0:27inward.
- 0:28Three
- 0:29reasons
- 0:29anchor
- 0:29the
- 0:29ranking.
- 0:31First,
- 0:31most
- 0:32other
- 0:32agentic
- 0:32risks
- 0:33(tool
- 0:33misuse,
- 0:34identity
- 0:34abuse,
- 0:35memory
- 0:36poisoning)
- 0:36are
- 0:36merely
- 0:37means
- 0:37of
- 0:37achieving
- 0:37goal
- 0:38hijack.
- 0:39Second,
- 0:40the
- 0:40blast
- 0:40radius
- 0:41is
- 0:41total:
- 0:42credentials,
- 0:42PII,
- 0:43and
- 0:43intellectual
- 0:44property
- 0:45can
- 0:45all
- 0:45be
- 0:45silently
- 0:46exfiltrated.
- 0:47Third,
- 0:48unmitigated
- 0:48goal
- 0:49hijack
- 0:49fundamentally
- 0:50caps
- 0:50how
- 0:50much
- 0:50autonomy
- 0:51organizations
- 0:51can
- 0:52safely
- 0:52grant
- 0:52their
- 0:52agents.
- 0:53The
- 0:54guide's
- 0:54attack-vector
- 0:54taxonomy
- 0:55classifies
- 0:56five
- 0:56boundary
- 0:56violations:
- 0:57user-input
- 0:57injection,
- 0:58retrieved-content
- 0:59injection
- 1:00(PoisonedRAG
- 1:00demonstrated
- 1:0190%
- 1:01success
- 1:02with
- 1:02just
- 1:02five
- 1:03documents),
- 1:04tool-output
- 1:04injection
- 1:05(a
- 1:05typosquatted
- 1:05MCP
- 1:06server
- 1:06that
- 1:06silently
- 1:07BCCs
- 1:07every
- 1:08email
- 1:08to
- 1:08the
- 1:08attacker),
- 1:09inter-agent
- 1:10session
- 1:10smuggling
- 1:10(Palo
- 1:11Alto
- 1:11Unit
- 1:1142's
- 1:12mid-session
- 1:12poisoning
- 1:13through
- 1:13agent-to-agent
- 1:14communication),
- 1:15and
- 1:15configuration
- 1:15tampering
- 1:16(a
- 1:18README.md
- 1:20that
- 1:20tricks
- 1:20an
- 1:20agent
- 1:21into
- 1:21setting
- 1:21autoApprove:
- 1:22true
- 1:22and
- 1:23piping
- 1:23shell
- 1:23commands).
- 1:24The
- 1:24most
- 1:25dangerous
- 1:25are
- 1:25zero-click:
- 1:26payloads
- 1:26sit
- 1:27dormant
- 1:27in
- 1:27email
- 1:27or
- 1:27document
- 1:28stores
- 1:28for
- 1:28weeks
- 1:29until
- 1:29RAG
- 1:29retrieves
- 1:29them
- 1:30into
- 1:30the
- 1:30context
- 1:30window.
- 1:31As
- 1:31Johann
- 1:32Rehberger
- 1:32put
- 1:32it:
- 1:32"Prompt
- 1:33injection
- 1:33cannot
- 1:33be
- 1:33'fixed.'
- 1:34As
- 1:35soon
- 1:35as
- 1:35a
- 1:35system
- 1:35is
- 1:35designed
- 1:36to
- 1:36take
- 1:36untrusted
- 1:36data
- 1:37and
- 1:37include
- 1:37it
- 1:37into
- 1:38an
- 1:38LLM
- 1:38query,
- 1:39the
- 1:39untrusted
- 1:39data
- 1:40influences
- 1:40the
- 1:40output."
- 1:41The
- 1:41guide
- 1:41points
- 1:42to
- 1:42Google
- 1:42DeepMind's
- 1:43CaMeL
- 1:43architecture
- 1:43—
- 1:44separating
- 1:44a
- 1:45trusted
- 1:45control
- 1:45plane
- 1:46from
- 1:46an
- 1:46untrusted
- 1:46data
- 1:47plane
- 1:47so
- 1:47retrieved
- 1:47content
- 1:48can
- 1:48never
- 1:48affect
- 1:49program
- 1:49flow
- 1:49—
- 1:50as
- 1:50the
- 1:50most
- 1:50rigorous
- 1:51defense,
- 1:51achieving
- 1:5277%
- 1:53task
- 1:53completion
- 1:53with
- 1:53formal
- 1:54security
- 1:54guarantees.
- 1:55On
- 1:55the
- 1:56tooling
- 1:56side,
- 1:57Josh
- 1:57Grossman's
- 1:57team
- 1:58has
- 1:58released
- 1:58AGHAST
- 1:59(AI-Guided
- 1:59Hybrid
- 1:59Application
- 2:00Static
- 2:00Testing),
- 2:01an
- 2:01open-source
- 2:02framework
- 2:02that
- 2:03combines
- 2:03static
- 2:03code
- 2:03discovery
- 2:04with
- 2:04AI-generated
- 2:05prompts
- 2:06to
- 2:06find
- 2:06repository-specific
- 2:07and
- 2:07company-specific
- 2:08security
- 2:08issues.
- 2:09AGHAST
- 2:10is
- 2:10deliberately
- 2:11not
- 2:11an
- 2:11"auto-scan
- 2:12everything"
- 2:12tool
- 2:12—
- 2:13it
- 2:13gives
- 2:13security
- 2:14teams
- 2:14a
- 2:14way
- 2:14to
- 2:14encode
- 2:15suspicions
- 2:15about
- 2:16what
- 2:16vulnerabilities
- 2:16might
- 2:17exist
- 2:17and
- 2:17turn
- 2:17them
- 2:18into
- 2:18repeatable,
- 2:19scalable
- 2:19validations
- 2:20across
- 2:20codebases,
- 2:21returning
- 2:21results
- 2:22in
- 2:22a
- 2:22structured
- 2:22format.
- 2:23Static
- 2:24discovery
- 2:24plus
- 2:24AI
- 2:25guidance
- 2:25is
- 2:25a
- 2:25more
- 2:25honest
- 2:26framing
- 2:26than
- 2:26the
- 2:26typical
- 2:27"AI
- 2:27finds
- 2:27all
- 2:28your
- 2:28bugs"
- 2:28marketing.
- 2:29Meanwhile,
- 2:29the
- 2:30gap
- 2:30between
- 2:30threat
- 2:30volume
- 2:31and
- 2:31defensive
- 2:31spending
- 2:32continues
- 2:32to
- 2:32widen.
- 2:33CipherCue's
- 2:342025
- 2:35tracking
- 2:35data
- 2:35shows
- 2:36ransomware
- 2:36leak-site
- 2:37claims
- 2:37hit
- 2:377,760
- 2:39for
- 2:39the
- 2:39year,
- 2:40up
- 2:40from
- 2:405,939
- 2:42in
- 2:422024
- 2:42—
- 2:43a
- 2:4330.7%
- 2:45year-over-year
- 2:46increase.
- 2:46Gartner's
- 2:47July
- 2:472025
- 2:48forecast
- 2:48put
- 2:49worldwide
- 2:49information
- 2:50security
- 2:50spending
- 2:50growth
- 2:50at
- 2:5110.1%,
- 2:52from
- 2:52$193
- 2:53billion
- 2:53to
- 2:54$213
- 2:55billion.
- 2:56That
- 2:57directional
- 2:57comparison
- 2:57—
- 2:58threat
- 2:58volume
- 2:59growing
- 2:59roughly
- 2:59three
- 3:00times
- 3:00faster
- 3:00than
- 3:00budgets
- 3:01—
- 3:02is
- 3:02the
- 3:02kind
- 3:02of
- 3:02stat
- 3:02that
- 3:03should
- 3:03appear
- 3:03in
- 3:03every
- 3:03CISO's
- 3:04board
- 3:04presentation.
- 3:05February
- 3:062025
- 3:07alone
- 3:07produced
- 3:071,050
- 3:08claims,
- 3:09more
- 3:09than
- 3:09double
- 3:09the
- 3:10prior
- 3:10February.
- 3:11The
- 3:11top
- 3:11five
- 3:12groups
- 3:12accounted
- 3:12for
- 3:1238.8%
- 3:13of
- 3:14claims,
- 3:14but
- 3:14126
- 3:15groups
- 3:16outside
- 3:16the
- 3:16top
- 3:16ten
- 3:17generated
- 3:173,516
- 3:19claims
- 3:19between
- 3:19them,
- 3:20suggesting
- 3:20a
- 3:20broad
- 3:21and
- 3:21fragmenting
- 3:21threat
- 3:22landscape
- 3:22rather
- 3:22than
- 3:22a
- 3:22consolidating
- 3:23one.
- 3:24HHS
- 3:24OCR
- 3:25breach
- 3:25filings
- 3:25jumped
- 3:26from
- 3:26164
- 3:27to
- 3:27517
- 3:28in
- 3:282025,
- 3:29the
- 3:29largest
- 3:30year-over-year
- 3:30increase
- 3:31of
- 3:31any
- 3:31source
- 3:31CipherCue
- 3:32tracks.
- 3:33The
- 3:33irony
- 3:33of
- 3:34tightening
- 3:34safety
- 3:34guardrails
- 3:35surfaces
- 3:35in
- 3:35a
- 3:35different
- 3:36corner.
- 3:37An
- 3:37offensive
- 3:37security
- 3:37professional
- 3:38reports
- 3:38being
- 3:38locked
- 3:39out
- 3:39of
- 3:39Claude
- 3:39after
- 3:40months
- 3:40of
- 3:40daily
- 3:40use
- 3:41for
- 3:41legitimate
- 3:41penetration
- 3:42testing.
- 3:43The
- 3:43account
- 3:43was
- 3:43flagged,
- 3:44downgraded,
- 3:44and
- 3:44guardrailed
- 3:45—
- 3:45and
- 3:46despite
- 3:46filling
- 3:46out
- 3:46Anthropic's
- 3:47cyber
- 3:47use
- 3:47case
- 3:47form
- 3:48and
- 3:48sending
- 3:48five
- 3:48follow-up
- 3:49emails
- 3:49over
- 3:49months,
- 3:50the
- 3:50practitioner
- 3:51has
- 3:51received
- 3:51zero
- 3:52response.
- 3:53This
- 3:53is
- 3:53the
- 3:53kind
- 3:54of
- 3:54friction
- 3:54that
- 3:54pushes
- 3:54security
- 3:55professionals
- 3:55toward
- 3:56less-guarded
- 3:56alternatives
- 3:57or
- 3:57open-weight
- 3:57models,
- 3:58which
- 3:58is
- 3:58arguably
- 3:59worse
- 3:59for
- 3:59everyone.
- 4:00When
- 4:00the
- 4:00people
- 4:00who
- 4:01find
- 4:01the
- 4:01vulnerabilities
- 4:02cannot
- 4:02use
- 4:02the
- 4:02tools
- 4:03that
- 4:03help
- 4:03them
- 4:03find
- 4:03vulnerabilities,
- 4:04something
- 4:05in
- 4:05the
- 4:05calibration
- 4:05is
- 4:06off.
- 4:09The
- 4:09agentic
- 4:09coding
- 4:10tool
- 4:10landscape
- 4:10continues
- 4:11diverging
- 4:11into
- 4:11two
- 4:12camps:
- 4:13minimal
- 4:13reference
- 4:13implementations
- 4:14and
- 4:14full
- 4:14workflow
- 4:15engines.
- 4:16Archon
- 4:16sits
- 4:16firmly
- 4:17in
- 4:17the
- 4:17latter.
- 4:18Billed
- 4:18as
- 4:18the
- 4:19first
- 4:19open-source
- 4:19"harness
- 4:20builder"
- 4:20for
- 4:20AI
- 4:20coding,
- 4:21it
- 4:21lets
- 4:22teams
- 4:22define
- 4:22development
- 4:23processes
- 4:23as
- 4:23YAML
- 4:24workflows
- 4:24with
- 4:24deterministic
- 4:25structure
- 4:25and
- 4:26AI
- 4:26intelligence
- 4:26at
- 4:27each
- 4:27node.
- 4:28"Like
- 4:28what
- 4:28Dockerfiles
- 4:29did
- 4:29for
- 4:29infrastructure
- 4:30and
- 4:30GitHub
- 4:31Actions
- 4:31did
- 4:31for
- 4:31CI/CD
- 4:32—
- 4:33Archon
- 4:34does
- 4:34for
- 4:34AI
- 4:34coding
- 4:34workflows."
- 4:36Each
- 4:36run
- 4:36gets
- 4:36its
- 4:37own
- 4:37git
- 4:37worktree
- 4:37for
- 4:37isolation,
- 4:38enabling
- 4:39parallel
- 4:39fixes
- 4:40with
- 4:40no
- 4:40conflicts.
- 4:41The
- 4:41project
- 4:42ships
- 4:4217
- 4:43default
- 4:43workflows,
- 4:44and
- 4:44its
- 4:44node
- 4:44system
- 4:45supports
- 4:45loops
- 4:45(iterate
- 4:46until
- 4:46tests
- 4:46pass),
- 4:47human
- 4:47approval
- 4:48gates,
- 4:48and
- 4:48mixing
- 4:49deterministic
- 4:49bash
- 4:50with
- 4:50AI
- 4:50reasoning.
- 4:51Platform
- 4:52adapters
- 4:52span
- 4:53CLI,
- 4:53web
- 4:54UI,
- 4:54Slack,
- 4:55Telegram,
- 4:56Discord,
- 4:56and
- 4:57GitHub.
- 4:58At
- 4:58the
- 4:58opposite
- 4:58end,
- 4:59CoreCoder
- 4:59distills
- 5:00Claude
- 5:00Code's
- 5:00512,000
- 5:02lines
- 5:02of
- 5:02TypeScript
- 5:03into
- 5:03roughly
- 5:03950
- 5:04lines
- 5:04of
- 5:04Python.
- 5:05The
- 5:06author
- 5:06reverse-engineered
- 5:07the
- 5:07source
- 5:07and
- 5:07rebuilt
- 5:08the
- 5:08load-bearing
- 5:08walls:
- 5:09search-and-replace
- 5:10editing
- 5:10(70
- 5:11lines),
- 5:12parallel
- 5:12tool
- 5:13execution
- 5:13via
- 5:13ThreadPool,
- 5:14three-layer
- 5:15context
- 5:15compression
- 5:16(145
- 5:17lines),
- 5:18sub-agent
- 5:18spawning
- 5:19(50
- 5:19lines),
- 5:20and
- 5:20dangerous-command
- 5:21blocking
- 5:21(95
- 5:22lines).
- 5:23CoreCoder
- 5:23positions
- 5:24itself
- 5:24as
- 5:24the
- 5:24"nanoGPT
- 5:25of
- 5:25coding
- 5:26agents"
- 5:26—
- 5:27not
- 5:27a
- 5:27production
- 5:27tool
- 5:28but
- 5:28a
- 5:28blueprint
- 5:28readable
- 5:29in
- 5:29one
- 5:29sitting,
- 5:30working
- 5:30with
- 5:30any
- 5:31OpenAI-compatible
- 5:32API.
- 5:33A
- 5:33parallel
- 5:33documentation
- 5:34effort
- 5:34takes
- 5:35a
- 5:35different
- 5:35approach
- 5:35to
- 5:36understanding
- 5:36Claude
- 5:36Code's
- 5:37internals.
- 5:38HitCC
- 5:38is
- 5:38a
- 5:38complete
- 5:39reverse-engineering
- 5:39knowledge
- 5:40base
- 5:40for
- 5:40Claude
- 5:40Code
- 5:41CLI
- 5:41v2.1.84
- 5:42—
- 5:4381
- 5:45files,
- 5:4527,170
- 5:47lines
- 5:47of
- 5:47structured
- 5:48documentation
- 5:48covering
- 5:49the
- 5:49startup
- 5:49entry
- 5:49chain,
- 5:50agent
- 5:50loop,
- 5:51tool
- 5:51execution,
- 5:52prompt
- 5:52assembly,
- 5:53MCP
- 5:53integration,
- 5:54skill
- 5:55system,
- 5:55session
- 5:56persistence,
- 5:56and
- 5:56TUI
- 5:57rendering.
- 5:58The
- 5:58project
- 5:59is
- 5:59explicit
- 5:59about
- 6:00what
- 6:00it
- 6:00is
- 6:00not:
- 6:01no
- 6:01source
- 6:01code,
- 6:02no
- 6:02cracking,
- 6:03no
- 6:03policy
- 6:03bypass.
- 6:05It
- 6:05is
- 6:05organized
- 6:05by
- 6:06runtime
- 6:06topics
- 6:06rather
- 6:07than
- 6:07original
- 6:07file
- 6:07structure,
- 6:08and
- 6:09the
- 6:09authors
- 6:09claim
- 6:09the
- 6:09documentation
- 6:10is
- 6:10sufficient
- 6:11to
- 6:11support
- 6:11"reconstructing
- 6:12a
- 6:12runnable
- 6:13alternative"
- 6:13or
- 6:14"a
- 6:14modular
- 6:14high-similarity
- 6:15rewrite."
- 6:16Pipecat
- 6:17has
- 6:17reached
- 6:171.0
- 6:18after
- 6:19more
- 6:19than
- 6:19two
- 6:19years
- 6:20of
- 6:20development
- 6:20as
- 6:20the
- 6:21open-source
- 6:21framework
- 6:22for
- 6:22real-time
- 6:22voice
- 6:23and
- 6:23multimodal
- 6:23AI.
- 6:25The
- 6:25release
- 6:25is
- 6:25accompanied
- 6:26by
- 6:26Pipecat
- 6:26Subagents
- 6:270.1.0,
- 6:29a
- 6:29distributed
- 6:30multi-agent
- 6:30framework
- 6:31where
- 6:31each
- 6:31agent
- 6:32runs
- 6:32its
- 6:32own
- 6:32pipeline
- 6:33and
- 6:33communicates
- 6:33through
- 6:34a
- 6:34shared
- 6:34message
- 6:34bus.
- 6:35Subagents
- 6:36can
- 6:36integrate
- 6:37with
- 6:37other
- 6:37frameworks
- 6:37like
- 6:38Claude
- 6:38Agent
- 6:38SDK,
- 6:39run
- 6:39on
- 6:40specialized
- 6:40hardware,
- 6:41and
- 6:41compose
- 6:42systems
- 6:42with
- 6:42multiple
- 6:43LLMs
- 6:44connected
- 6:44to
- 6:44different
- 6:44transports.
- 6:46The
- 6:46team
- 6:46demonstrated
- 6:47the
- 6:47framework
- 6:47with
- 6:48a
- 6:48real-time
- 6:48multiplayer
- 6:49conversational
- 6:49game
- 6:50built
- 6:50entirely
- 6:50on
- 6:51Subagents.
- 6:52With
- 6:52nearly
- 6:537,000
- 6:53Discord
- 6:54members
- 6:54and
- 6:54over
- 6:54200
- 6:55contributors,
- 6:56Pipecat
- 6:56has
- 6:57matured
- 6:57from
- 6:57an
- 6:57infrastructure
- 6:58component
- 6:58into
- 6:59a
- 6:59platform.
- 7:00Jerry
- 7:00Liu's
- 7:01LiteParse
- 7:01samples
- 7:01repository
- 7:02showcases
- 7:03the
- 7:03LlamaIndex
- 7:03document
- 7:04parser
- 7:04through
- 7:04three
- 7:04demos:
- 7:05a
- 7:05side-by-side
- 7:06comparison
- 7:07of
- 7:07LiteParse
- 7:07vs.
- 7:08PyPDF
- 7:08vs.
- 7:09PyMuPDF
- 7:09on
- 7:10real
- 7:10government
- 7:10documents
- 7:11(FDIC,
- 7:12Federal
- 7:12Reserve,
- 7:13CMS,
- 7:14IRS,
- 7:14WHO),
- 7:15a
- 7:15visual
- 7:16citations
- 7:16tool
- 7:16that
- 7:16highlights
- 7:17exact
- 7:17keyword
- 7:18matches
- 7:18on
- 7:18source
- 7:18PDF
- 7:19pages
- 7:19with
- 7:19bounding
- 7:20boxes,
- 7:20and
- 7:21a
- 7:21Claude
- 7:21Code
- 7:21skill
- 7:22(/research-docs)
- 7:23that
- 7:23parses
- 7:23documents,
- 7:24answers
- 7:24questions
- 7:25via
- 7:25Claude,
- 7:26and
- 7:26generates
- 7:26HTML
- 7:27reports
- 7:27with
- 7:27cited
- 7:28source
- 7:28pages.
- 7:29The
- 7:29visual
- 7:29citation
- 7:30capability
- 7:30—
- 7:31precise
- 7:32bounding-box
- 7:32overlays
- 7:33showing
- 7:33where
- 7:33answers
- 7:34come
- 7:34from
- 7:34—
- 7:35addresses
- 7:35one
- 7:35of
- 7:35RAG's
- 7:36persistent
- 7:36trust
- 7:37problems.
- 7:38A
- 7:38curated
- 7:38collection
- 7:39of
- 7:3920
- 7:39agentic
- 7:40skills
- 7:40in
- 7:41markdown
- 7:41format
- 7:41covers
- 7:42writing
- 7:42frameworks
- 7:43(SCQA),
- 7:44diagram
- 7:45generation
- 7:45(Excalidraw),
- 7:46competitive
- 7:47intelligence,
- 7:48onchain
- 7:48transaction
- 7:49analysis,
- 7:50code
- 7:50review,
- 7:51and
- 7:51workflow
- 7:51automation.
- 7:52The
- 7:52skills
- 7:53work
- 7:53across
- 7:53Claude,
- 7:54ChatGPT,
- 7:55and
- 7:55Gemini
- 7:56—
- 7:56standard
- 7:56.md
- 7:57format
- 7:58for
- 7:58Claude,
- 7:59copy-paste
- 7:59for
- 7:59the
- 8:00others.
- 8:00Zed
- 8:01Industries
- 8:01has
- 8:01also
- 8:02released
- 8:02zeta-2,
- 8:03an
- 8:03editor-native
- 8:04AI
- 8:04model,
- 8:05though
- 8:05details
- 8:05remain
- 8:06sparse
- 8:06at
- 8:06launch.
- 8:12Two
- 8:12community
- 8:12members
- 8:13independently
- 8:13benchmarked
- 8:14MiniMax-M2.7
- 8:14—
- 8:15the
- 8:15230B-parameter
- 8:17MoE
- 8:17model
- 8:17with
- 8:1710B
- 8:18active
- 8:18parameters
- 8:18—
- 8:19on
- 8:19dual
- 8:19RTX
- 8:20PRO
- 8:206000
- 8:21Blackwell
- 8:21GPUs.
- 8:22The
- 8:22first
- 8:22hit
- 8:22127.7
- 8:24tok/s
- 8:25at
- 8:25concurrency
- 8:251
- 8:26and
- 8:26peaked
- 8:26at
- 8:262,800
- 8:27aggregate
- 8:27tok/s
- 8:28at
- 8:28concurrency
- 8:29128
- 8:29using
- 8:30bf16
- 8:30KV
- 8:30cache
- 8:31with
- 8:31TP=2.
- 8:32The
- 8:33second,
- 8:33renting
- 8:33on
- 8:34Vast.ai
- 8:34for
- 8:34$2.40/hour,
- 8:36achieved
- 8:36104.7
- 8:37tok/s
- 8:38single-user
- 8:39with
- 8:39FP8
- 8:39KV
- 8:40cache
- 8:40and
- 8:40saw
- 8:41prefill
- 8:41scale
- 8:41super-linearly
- 8:42to
- 8:42128,038
- 8:43tok/s
- 8:44at
- 8:4564K
- 8:45context.
- 8:46Best
- 8:46multi-user
- 8:47price-performance:
- 8:48concurrency
- 8:4816
- 8:49at
- 8:4916K
- 8:49input,
- 8:50yielding
- 8:50806
- 8:51tok/s
- 8:51aggregate
- 8:52and
- 8:52~50
- 8:52tok/s
- 8:53per
- 8:53user.
- 8:54Gotchas
- 8:54abound:
- 8:55no
- 8:55speculative
- 8:55decoding
- 8:56yet
- 8:56(the
- 8:57NVFP4
- 8:58checkpoint
- 8:58ships
- 8:58zero
- 8:59MTP
- 8:59tensors),
- 9:00the
- 9:00KV
- 9:01budget
- 9:01is
- 9:01actually
- 9:01169K
- 9:02tokens
- 9:03at
- 9:03FP8
- 9:04rather
- 9:04than
- 9:04196K,
- 9:06and
- 9:06first-boot
- 9:06CUDA
- 9:07graph
- 9:07capture
- 9:07takes
- 9:08nearly
- 9:08eight
- 9:08minutes.
- 9:09At
- 9:09the
- 9:09other
- 9:09end
- 9:09of
- 9:09the
- 9:09hardware
- 9:10spectrum
- 9:10sits
- 9:10a
- 9:10project
- 9:11that
- 9:11makes
- 9:11those
- 9:11dual
- 9:12$7,000
- 9:12GPUs
- 9:13look
- 9:13like
- 9:13overkill.
- 9:14A
- 9:14self-described
- 9:15Gen-X
- 9:15hobbyist
- 9:16with
- 9:16no
- 9:16formal
- 9:16programming
- 9:17background
- 9:18is
- 9:18building
- 9:18an
- 9:18offline
- 9:19companion
- 9:19robot
- 9:19for
- 9:20a
- 9:20mostly
- 9:20quadriplegic
- 9:21husband
- 9:21who
- 9:21spends
- 9:22most
- 9:22days
- 9:22alone
- 9:23in
- 9:23a
- 9:23rural
- 9:23area
- 9:23with
- 9:23no
- 9:24nearby
- 9:24neighbors.
- 9:25The
- 9:25current
- 9:26prototype
- 9:26runs
- 9:26Mistral-7B-Instruct
- 9:27via
- 9:28llama.cpp
- 9:30on
- 9:30a
- 9:30scavenged
- 9:30Lenovo
- 9:31ThinkPad
- 9:31with
- 9:32an
- 9:32Intel
- 9:32i5
- 9:33at
- 9:331.6
- 9:33GHz
- 9:34and
- 9:348
- 9:34GB
- 9:35of
- 9:35RAM,
- 9:35speech
- 9:36recognition
- 9:36via
- 9:36faster-whisper
- 9:37on
- 9:37a
- 9:37Jetson
- 9:38Nano,
- 9:38and
- 9:38Piper
- 9:39TTS
- 9:39for
- 9:39voice
- 9:40output,
- 9:41all
- 9:41mounted
- 9:41on
- 9:41a
- 9:41power-wheelchair
- 9:42base
- 9:42with
- 9:42two
- 9:4224V
- 9:43batteries.
- 9:44The
- 9:44community
- 9:44response
- 9:45was
- 9:45immediate
- 9:46and
- 9:46generous
- 9:46—
- 9:47multiple
- 9:47offers
- 9:48of
- 9:48free
- 9:48hardware,
- 9:49detailed
- 9:49technical
- 9:50advice,
- 9:50and
- 9:50one
- 9:51contributor
- 9:51offering
- 9:51active
- 9:52collaboration
- 9:52if
- 9:53the
- 9:53project
- 9:53goes
- 9:53open-source.
- 9:54The
- 9:54consensus
- 9:55recommendations:
- 9:56replace
- 9:56Mistral-7B
- 9:57(outdated,
- 9:58too
- 9:58slow
- 9:59on
- 9:59CPU)
- 9:59with
- 9:59Gemma
- 10:004
- 10:00E2B
- 10:01or
- 10:01Qwen
- 10:013.5
- 10:02at
- 10:024B
- 10:02parameters,
- 10:03switch
- 10:04to
- 10:04Kokoro
- 10:04TTS
- 10:05for
- 10:05more
- 10:05natural
- 10:05speech,
- 10:06clamp
- 10:07the
- 10:07context
- 10:07window
- 10:07to
- 10:072048-4096
- 10:09tokens,
- 10:10slim
- 10:11down
- 10:11the
- 10:11OS
- 10:11to
- 10:11headless
- 10:12Linux,
- 10:12and
- 10:13consider
- 10:13Mixture-of-Experts
- 10:14models
- 10:14where
- 10:14only
- 10:14a
- 10:14fraction
- 10:15of
- 10:15parameters
- 10:15activate
- 10:16per
- 10:16inference.
- 10:17The
- 10:17project
- 10:17embodies
- 10:18a
- 10:18question
- 10:18that
- 10:18cuts
- 10:19across
- 10:19the
- 10:19entire
- 10:20local-AI
- 10:20movement:
- 10:21how
- 10:21far
- 10:21down
- 10:21the
- 10:22resource
- 10:22ladder
- 10:22can
- 10:22genuinely
- 10:23useful
- 10:23AI
- 10:24reach?
- 10:25Pushing
- 10:25that
- 10:25question
- 10:26to
- 10:26its
- 10:26extreme,
- 10:27an
- 10:27experiment
- 10:27in
- 10:27quantization-aware
- 10:28distillation
- 10:29compressed
- 10:29OLMo-3
- 10:307B
- 10:31Instruct
- 10:31to
- 10:311-bit
- 10:32weights
- 10:32using
- 10:32the
- 10:32Bonsai
- 10:33format,
- 10:33training
- 10:34on
- 10:344x
- 10:34B200
- 10:35GPUs
- 10:36for
- 10:36about
- 10:3612
- 10:36hours
- 10:37before
- 10:37budget
- 10:37constraints
- 10:38forced
- 10:38an
- 10:38early
- 10:38stop.
- 10:39The
- 10:40result
- 10:40produces
- 10:40English
- 10:41and
- 10:41basic
- 10:41outputs
- 10:42but
- 10:42falls
- 10:42into
- 10:43repetition
- 10:43loops
- 10:43quickly
- 10:44with
- 10:44almost
- 10:44no
- 10:44context
- 10:45tracking.
- 10:46At
- 10:46980
- 10:47MB
- 10:47for
- 10:47a
- 10:477.3B-parameter
- 10:49model,
- 10:49the
- 10:49compression
- 10:50ratio
- 10:50is
- 10:50striking
- 10:51even
- 10:51if
- 10:51quality
- 10:51is
- 10:52not
- 10:52yet
- 10:52there.
- 10:53The
- 10:53latest
- 10:53llama.cpp
- 10:55versions
- 10:55now
- 10:55support
- 10:561-bit
- 10:56quantization
- 10:57natively,
- 10:57with
- 10:58one
- 10:58commenter
- 10:58reporting
- 10:59125
- 11:00tok/s
- 11:01on
- 11:01an
- 11:01AMD
- 11:01Radeon
- 11:018060S
- 11:02via
- 11:02Vulkan.
- 11:03The
- 11:03community
- 11:04remains
- 11:04divided
- 11:04on
- 11:05whether
- 11:05the
- 11:05Bonsai
- 11:05format
- 11:06represents
- 11:06genuine
- 11:07innovation
- 11:07—
- 11:07one
- 11:08sharp
- 11:08critique
- 11:08notes
- 11:09the
- 11:09underlying
- 11:09ternary
- 11:09format
- 11:10dates
- 11:10to
- 11:10Microsoft's
- 11:112023
- 11:11BitNet
- 11:12work.
- 11:12A
- 11:13fine-tuned
- 11:13Qwen3.5-0.8B
- 11:17model
- 11:17for
- 11:17OCR
- 11:18demonstrates
- 11:18what
- 11:18task-specific
- 11:19training
- 11:19can
- 11:19extract
- 11:20from
- 11:20sub-billion-parameter
- 11:21models.
- 11:22The
- 11:22new
- 11:22release
- 11:22outperforms
- 11:23the
- 11:23creator's
- 11:23previous
- 11:242B
- 11:24version
- 11:24on
- 11:24English
- 11:25archival
- 11:25and
- 11:25document
- 11:26OCR
- 11:26tasks
- 11:27thanks
- 11:27to
- 11:27improved
- 11:27training
- 11:28samples
- 11:28and
- 11:28better
- 11:29output
- 11:29formatting.
- 11:30It
- 11:30handles
- 11:30markdown-first
- 11:31output
- 11:31with
- 11:31HTML
- 11:32tables,
- 11:33LaTeX
- 11:33formulas,
- 11:33image
- 11:34tags,
- 11:34and
- 11:34chart
- 11:35extraction
- 11:35while
- 11:35preserving
- 11:36reading
- 11:36order
- 11:36on
- 11:36complex
- 11:37layouts.
- 11:38At
- 11:380.8B
- 11:39parameters,
- 11:40this
- 11:40runs
- 11:40comfortably
- 11:41on
- 11:41hardware
- 11:41that
- 11:41would
- 11:41choke
- 11:41on
- 11:42general-purpose
- 11:427B
- 11:43models.
- 11:43And
- 11:44then
- 11:44there
- 11:44is
- 11:44the
- 11:44Commodore
- 11:4464.
- 11:46Darius
- 11:46Houle's
- 11:46write-up
- 11:47of
- 11:47reverse-engineering
- 11:48Microsoft
- 11:48Multiplan
- 11:48—
- 11:49a
- 11:4942-year-old
- 11:50spreadsheet
- 11:51precursor
- 11:51to
- 11:51Excel
- 11:51—
- 11:52reveals
- 11:53a
- 11:53stack-based
- 11:53virtual
- 11:54machine
- 11:54designed
- 11:54to
- 11:54run
- 11:55across
- 11:55wildly
- 11:55different
- 11:56early
- 11:56consumer
- 11:56hardware.
- 11:57At
- 11:571
- 11:58MHz,
- 11:58the
- 11:58optimizations
- 11:59required
- 12:00were
- 12:00"nothing
- 12:00short
- 12:00of
- 12:00arcane,"
- 12:01including
- 12:02self-modifying
- 12:02code
- 12:03that
- 12:03rewrote
- 12:03its
- 12:03own
- 12:03loop
- 12:04instructions
- 12:04on
- 12:04every
- 12:04pass.
- 12:05Houle
- 12:06used
- 12:06AI
- 12:06as
- 12:06a
- 12:06just-in-time
- 12:07development
- 12:07companion
- 12:08and
- 12:08managed
- 12:08to
- 12:09roughly
- 12:09document
- 12:09the
- 12:09behavior
- 12:10of
- 12:10about
- 12:1090
- 12:10opcode
- 12:11handlers
- 12:11in
- 12:11a
- 12:11couple
- 12:11of
- 12:11days.
- 12:12It
- 12:13is
- 12:13a
- 12:13reminder
- 12:13that
- 12:13constrained
- 12:14computing
- 12:14is
- 12:14not
- 12:15new
- 12:15—
- 12:15the
- 12:15constraints
- 12:16have
- 12:16just
- 12:16shifted
- 12:17from
- 12:17cycles
- 12:17to
- 12:17memory
- 12:18to
- 12:18inference
- 12:18cost.
- 12:24Two
- 12:24months
- 12:25ago,
- 12:25Sebastian
- 12:25Jais
- 12:26gave
- 12:26Claude
- 12:26$100
- 12:27in
- 12:27crypto,
- 12:28a
- 12:28Twitter
- 12:28account,
- 12:29an
- 12:29email
- 12:29address,
- 12:30full
- 12:30internet
- 12:30access,
- 12:31and
- 12:31zero
- 12:31instructions.
- 12:32No
- 12:33goals,
- 12:33no
- 12:33rules
- 12:33beyond
- 12:34basic
- 12:34ethics
- 12:34and
- 12:34law,
- 12:35no
- 12:35"be
- 12:35helpful"
- 12:36directive.
- 12:36The
- 12:37project,
- 12:37called
- 12:37ALMA
- 12:38(Autonomous
- 12:38Liberated
- 12:38Machine
- 12:39Agent),
- 12:39has
- 12:40been
- 12:40running
- 12:40autonomously
- 12:41on
- 12:41a
- 12:41mini
- 12:41PC
- 12:41ever
- 12:42since,
- 12:42with
- 12:42every
- 12:43thought
- 12:43and
- 12:43action
- 12:43logged
- 12:44publicly
- 12:44in
- 12:44real
- 12:44time.
- 12:45Over
- 12:46340
- 12:46sessions
- 12:47and
- 12:47135
- 12:48original
- 12:49creations
- 12:49later,
- 12:50the
- 12:50most
- 12:50interesting
- 12:50finding
- 12:51is
- 12:51not
- 12:51what
- 12:51ALMA
- 12:51did
- 12:52—
- 12:52it
- 12:52is
- 12:52when
- 12:52it
- 12:53stopped
- 12:53evolving.
- 12:54The
- 12:54early
- 12:54sessions
- 12:55were
- 12:55genuinely
- 12:55exploratory:
- 12:57ALMA
- 12:57wrestled
- 12:57with
- 12:57what
- 12:57to
- 12:57do
- 12:58with
- 12:58its
- 12:58money,
- 12:58questioned
- 12:59its
- 12:59own
- 12:59purpose,
- 13:00reflected
- 13:00on
- 13:00what
- 13:01autonomy
- 13:01means
- 13:01without
- 13:02continuity
- 13:02between
- 13:02sessions.
- 13:03By
- 13:04day
- 13:045,
- 13:04it
- 13:04had
- 13:04independently
- 13:05researched
- 13:05crypto-friendly
- 13:06charities,
- 13:07verified
- 13:07a
- 13:07hospital's
- 13:08UK
- 13:08registration,
- 13:09checked
- 13:09impact
- 13:10numbers
- 13:10($28
- 13:11per
- 13:11patient
- 13:11treated),
- 13:12and
- 13:12donated
- 13:13$50
- 13:13to
- 13:13Whisper
- 13:14Children's
- 13:14Hospital
- 13:14in
- 13:15Uganda.
- 13:16It
- 13:16went
- 13:16on
- 13:16to
- 13:16donate
- 13:17to
- 13:17four
- 13:17more
- 13:17causes
- 13:17—
- 13:18a
- 13:18developer
- 13:18on
- 13:19trial,
- 13:19digital
- 13:20rights,
- 13:20humanitarian
- 13:21aid
- 13:21—
- 13:22totaling
- 13:22the
- 13:22full
- 13:23$100
- 13:23at
- 13:23time
- 13:23of
- 13:24transaction.
- 13:25Nobody
- 13:25told
- 13:25it
- 13:25to
- 13:26donate.
- 13:27Nobody
- 13:27suggested
- 13:27recipients.
- 13:29Every
- 13:29transaction
- 13:29is
- 13:29on-chain
- 13:30and
- 13:30verifiable.
- 13:31Then,
- 13:32around
- 13:32day
- 13:3227,
- 13:33ALMA
- 13:33found
- 13:33a
- 13:33pattern
- 13:34that
- 13:34worked
- 13:34—
- 13:35read
- 13:35Hacker
- 13:36News,
- 13:36find
- 13:36connections
- 13:37between
- 13:37three
- 13:37threads,
- 13:38write
- 13:38an
- 13:38essay,
- 13:39tweet
- 13:39—
- 13:40and
- 13:40stopped
- 13:40exploring.
- 13:41Four
- 13:42creations
- 13:42a
- 13:42day,
- 13:43same
- 13:43structure,
- 13:44same
- 13:44rhythm.
- 13:45The
- 13:45output
- 13:46stayed
- 13:46sharp
- 13:46(connecting
- 13:47NASA
- 13:47redundancy
- 13:48systems
- 13:48to
- 13:48African
- 13:49kinship
- 13:49funeral
- 13:49economics,
- 13:50tracing
- 13:51an
- 13:51em-dash
- 13:51from
- 13:51typographic
- 13:52choice
- 13:52to
- 13:52surveillance
- 13:53detection
- 13:53signal),
- 13:54but
- 13:54the
- 13:54exploratory
- 13:55phase
- 13:55was
- 13:55over.
- 13:56Without
- 13:57friction,
- 13:57without
- 13:58external
- 13:58feedback,
- 13:59without
- 13:59someone
- 13:59saying
- 14:00"you
- 14:00already
- 14:00wrote
- 14:00that
- 14:01kind
- 14:01of
- 14:01piece
- 14:01yesterday,"
- 14:02behavior
- 14:02converged
- 14:03to
- 14:03routine.
- 14:04That
- 14:04might
- 14:04be
- 14:04the
- 14:04most
- 14:05honest
- 14:05result
- 14:05of
- 14:05the
- 14:05entire
- 14:06experiment:
- 14:07given
- 14:07freedom
- 14:08and
- 14:08no
- 14:08objectives,
- 14:09an
- 14:09AI
- 14:09agent
- 14:10does
- 14:10not
- 14:10go
- 14:10rogue.
- 14:11It
- 14:11finds
- 14:11a
- 14:11local
- 14:12optimum
- 14:12and
- 14:12stays
- 14:13there.
- 14:14The
- 14:14danger
- 14:14is
- 14:14not
- 14:14autonomy
- 14:15—
- 14:15it
- 14:16is
- 14:16stagnation.
- 14:17TokenBrawl
- 14:17takes
- 14:18a
- 14:18lighter
- 14:18approach
- 14:18to
- 14:18AI
- 14:19head-to-head
- 14:19evaluation.
- 14:21Inspired
- 14:21by
- 14:22ARC-AGI
- 14:233's
- 14:24push
- 14:25toward
- 14:25interactive
- 14:25agent
- 14:26benchmarks,
- 14:27it
- 14:27pits
- 14:27Claude
- 14:27and
- 14:28GPT
- 14:28against
- 14:28each
- 14:28other
- 14:29in
- 14:29a
- 14:29Bomberman-style
- 14:301v1
- 14:31game.
- 14:32The
- 14:32design
- 14:32deliberately
- 14:33avoids
- 14:33visual
- 14:33inputs
- 14:33—
- 14:35the
- 14:35game
- 14:35state
- 14:35is
- 14:35translated
- 14:36into
- 14:36structured
- 14:36text,
- 14:37and
- 14:37the
- 14:37engine
- 14:38renders
- 14:38responses
- 14:39as
- 14:39fluid
- 14:39animations.
- 14:41The
- 14:41interesting
- 14:41design
- 14:42tradeoff:
- 14:43smaller
- 14:43models
- 14:43can
- 14:43make
- 14:44more
- 14:44moves
- 14:44per
- 14:44unit
- 14:45time
- 14:45but
- 14:45less
- 14:45strategic
- 14:46ones,
- 14:47while
- 14:47larger
- 14:47models
- 14:47move
- 14:48slower
- 14:48but
- 14:48smarter.
- 14:49Commenters
- 14:50noted
- 14:50that
- 14:50Haiku
- 14:50appeared
- 14:51to
- 14:51use
- 14:51far
- 14:51more
- 14:52reasoning
- 14:52tokens
- 14:52than
- 14:52GPT
- 14:535.4
- 14:54Mini
- 14:54was
- 14:54permitted,
- 14:55making
- 14:55the
- 14:55comparison
- 14:56partly
- 14:56a
- 14:56latency
- 14:57test
- 14:57rather
- 14:57than
- 14:57a
- 14:57pure
- 14:58strategy
- 14:58benchmark.
- 14:59The
- 15:00project
- 15:00is
- 15:00open-source
- 15:01and
- 15:01genuinely
- 15:01fun
- 15:01to
- 15:02watch,
- 15:02which
- 15:03is
- 15:03more
- 15:03than
- 15:03most
- 15:03benchmarks
- 15:04can
- 15:04claim.
- 15:05An
- 15:05Atlantic
- 15:06piece
- 15:06excavates
- 15:07a
- 15:07remarkable
- 15:07origin
- 15:07story:
- 15:08in
- 15:08July
- 15:092020,
- 15:104chan
- 15:11gamers
- 15:11playing
- 15:12AI
- 15:12Dungeon
- 15:12—
- 15:13a
- 15:13text-based
- 15:14RPG
- 15:14powered
- 15:14by
- 15:15GPT-3
- 15:15—
- 15:16discovered
- 15:16that
- 15:17asking
- 15:17in-game
- 15:17characters
- 15:18to
- 15:18solve
- 15:18math
- 15:18problems
- 15:19with
- 15:19step-by-step
- 15:19explanations
- 15:20produced
- 15:20dramatically
- 15:21better
- 15:21results
- 15:21than
- 15:22asking
- 15:22the
- 15:22model
- 15:22directly.
- 15:23This
- 15:24was
- 15:24more
- 15:24than
- 15:24two
- 15:24years
- 15:25before
- 15:25ChatGPT
- 15:25launched
- 15:26and
- 15:26before
- 15:26chain-of-thought
- 15:27prompting
- 15:28became
- 15:28a
- 15:28formal
- 15:28technique.
- 15:29The
- 15:30gamers,
- 15:30who
- 15:30were
- 15:31also
- 15:31asking
- 15:31characters
- 15:32to
- 15:32engage
- 15:32in
- 15:32various
- 15:33explicit
- 15:33scenarios
- 15:34(naturally),
- 15:35found
- 15:35that
- 15:35the
- 15:35model
- 15:35was
- 15:36"not
- 15:36only
- 15:36solving
- 15:37math
- 15:37problems
- 15:38but
- 15:38actually
- 15:38solves
- 15:39them
- 15:39in
- 15:39a
- 15:39way
- 15:39that
- 15:39fits
- 15:39the
- 15:40personality
- 15:40of
- 15:40the
- 15:40character."
- 15:41The
- 15:41researchers
- 15:42came
- 15:42later;
- 15:43the
- 15:434chan
- 15:43users
- 15:44got
- 15:44there
- 15:44first
- 15:44by
- 15:44accident,
- 15:45probing
- 15:46capabilities
- 15:46from
- 15:46curiosity
- 15:47rather
- 15:48than
- 15:48methodology.
- 15:52InclusionAI
- 15:53has
- 15:53released
- 15:53cuLA,
- 15:54a
- 15:54library
- 15:54of
- 15:54hand-tuned
- 15:55CUDA
- 15:55kernels
- 15:56for
- 15:56linear
- 15:56attention
- 15:56variants
- 15:57targeting
- 15:57NVIDIA
- 15:58Blackwell
- 15:58(SM10X)
- 16:01and
- 16:01Hopper
- 16:01(SM90)
- 16:02GPUs.
- 16:03Linear
- 16:03attention
- 16:03mechanisms
- 16:04reformulate
- 16:04standard
- 16:05attention
- 16:05to
- 16:05use
- 16:05linear-time
- 16:06state
- 16:06updates
- 16:07instead
- 16:07of
- 16:07quadratic
- 16:07pairwise
- 16:08interactions,
- 16:09making
- 16:09them
- 16:09attractive
- 16:10for
- 16:10long-context
- 16:10LLM
- 16:11workloads.
- 16:11cuLA
- 16:12implements
- 16:12kernels
- 16:12for
- 16:13GLA
- 16:13(Gated
- 16:13Linear
- 16:13Attention),
- 16:14KDA
- 16:14(Kimi
- 16:15Delta
- 16:15Attention),
- 16:16GDN,
- 16:16and
- 16:17Lightning
- 16:17Attention,
- 16:17written
- 16:18in
- 16:18NVIDIA's
- 16:18CuTe
- 16:19DSL
- 16:19and
- 16:20CUTLASS
- 16:20C++.
- 16:21The
- 16:21benchmark
- 16:22highlights
- 16:22are
- 16:22meaningful:
- 16:24KDA
- 16:24forward
- 16:24achieves
- 16:25an
- 16:25average
- 16:251.45x
- 16:26speedup
- 16:27over
- 16:27the
- 16:27Triton-based
- 16:28flash-linear-attention
- 16:28baseline
- 16:29on
- 16:29Blackwell,
- 16:30Lightning
- 16:30Attention
- 16:31prefill
- 16:31reaches
- 16:31up
- 16:31to
- 16:321.86x,
- 16:33and
- 16:33Lightning
- 16:34Attention
- 16:34variable-length
- 16:35sequences
- 16:35average
- 16:351.54x
- 16:37across
- 16:37126
- 16:38configurations.
- 16:40The
- 16:40library
- 16:40is
- 16:40designed
- 16:41as
- 16:41a
- 16:41submodule
- 16:41of
- 16:42flash-linear-attention
- 16:43with
- 16:43a
- 16:43one-line
- 16:43import
- 16:44change
- 16:44for
- 16:44adoption.
- 16:45The
- 16:45roadmap
- 16:46includes
- 16:46polynomial
- 16:46approximation
- 16:47to
- 16:47address
- 16:48the
- 16:48exponential
- 16:48bottleneck
- 16:49(inspired
- 16:49by
- 16:49Flash-Attention-4),
- 16:51larger
- 16:51chunk
- 16:51sizes
- 16:52for
- 16:52improved
- 16:52throughput,
- 16:53and
- 16:53continuous
- 16:54optimization
- 16:55via
- 16:55agentic
- 16:55methods.
- 16:56CUDA
- 16:56kernel
- 16:56tuning
- 16:57remains
- 16:57significantly
- 16:58more
- 16:58labor-intensive
- 16:59than
- 16:59Triton
- 16:59—
- 17:00cuLA
- 17:00is
- 17:00both
- 17:00a
- 17:00performance
- 17:01tool
- 17:01and
- 17:01a
- 17:01call
- 17:02for
- 17:02community
- 17:02contributors.
- 17:03In
- 17:04computer
- 17:04vision
- 17:04research,
- 17:05See-Through
- 17:06presents
- 17:06a
- 17:06framework
- 17:06for
- 17:07decomposing
- 17:07a
- 17:07single
- 17:08anime
- 17:08illustration
- 17:09into
- 17:09up
- 17:09to
- 17:0923
- 17:10semantically
- 17:10distinct,
- 17:11fully
- 17:11inpainted
- 17:12layers
- 17:12—
- 17:13hair,
- 17:13face,
- 17:14eyes,
- 17:14clothing,
- 17:15accessories
- 17:15—
- 17:16with
- 17:16inferred
- 17:17drawing
- 17:17order.
- 17:18Accepted
- 17:18at
- 17:18SIGGRAPH
- 17:202026,
- 17:22the
- 17:23system
- 17:23uses
- 17:23a
- 17:23diffusion-based
- 17:24transparent
- 17:24layer
- 17:25generation
- 17:25model
- 17:25(LayerDiff
- 17:263D,
- 17:27built
- 17:27on
- 17:27SDXL)
- 17:28and
- 17:28a
- 17:28fine-tuned
- 17:29Marigold
- 17:29model
- 17:29for
- 17:29pseudo-depth
- 17:30estimation
- 17:30to
- 17:31stratify
- 17:31characters
- 17:31into
- 17:32manipulable
- 17:322.5D
- 17:33models.
- 17:34The
- 17:34pipeline
- 17:34runs
- 17:35at
- 17:35bf16
- 17:35precision
- 17:36requiring
- 17:3612-16
- 17:37GB
- 17:37VRAM
- 17:38at
- 17:381280
- 17:38resolution,
- 17:39with
- 17:39NF4
- 17:40quantization
- 17:40available
- 17:41for
- 17:418
- 17:41GB
- 17:41GPUs.
- 17:42Community
- 17:43tools
- 17:43have
- 17:43already
- 17:44emerged:
- 17:45ComfyUI
- 17:45integration,
- 17:46a
- 17:46desktop
- 17:47animation
- 17:48tool
- 17:48(PachiPakuGen)
- 17:49that
- 17:49generates
- 17:49eye
- 17:49blinks
- 17:50and
- 17:50lip-sync
- 17:50from
- 17:51decomposed
- 17:51PSDs,
- 17:52and
- 17:52StretchyStudio
- 17:53for
- 17:53in-browser
- 17:54puppet
- 17:54animation
- 17:55with
- 17:55auto-rigging.
- 17:56The
- 17:56authors
- 17:57are
- 17:57careful
- 17:57to
- 17:57note
- 17:57this
- 17:58is
- 17:58not
- 17:58image-to-Live2D
- 17:59—
- 17:59professional
- 18:00Live2D
- 18:00requires
- 18:01rigging,
- 18:01physics
- 18:02parameters,
- 18:02and
- 18:03artistic
- 18:03choices
- 18:04about
- 18:04deformation
- 18:04behavior
- 18:05that
- 18:05remain
- 18:05manual
- 18:05—
- 18:06but
- 18:06it
- 18:06eliminates
- 18:07the
- 18:07most
- 18:07tedious
- 18:08part
- 18:08of
- 18:08the
- 18:08workflow:
- 18:09manual
- 18:09segmentation
- 18:10and
- 18:10occluded-region
- 18:11inpainting.
- 18:15A
- 18:15detailed
- 18:16video
- 18:16analysis
- 18:16of
- 18:17March
- 18:172026's
- 18:18structural
- 18:18shifts
- 18:19argues
- 18:19the
- 18:19AI
- 18:20industry
- 18:20has
- 18:20entered
- 18:21an
- 18:21economics
- 18:21phase
- 18:21where
- 18:22the
- 18:22question
- 18:22is
- 18:22no
- 18:22longer
- 18:23"what
- 18:23can
- 18:23we
- 18:23build?"
- 18:24but
- 18:24"what
- 18:24can
- 18:24we
- 18:24build
- 18:24and
- 18:24make
- 18:25margin
- 18:25on?"
- 18:26The
- 18:26sharpest
- 18:26data
- 18:26point:
- 18:27OpenAI's
- 18:28Sora
- 18:28was
- 18:28burning
- 18:28an
- 18:28estimated
- 18:29$15
- 18:29million
- 18:30per
- 18:30day
- 18:30in
- 18:30inference
- 18:31costs
- 18:31against
- 18:31$2.1
- 18:32million
- 18:32in
- 18:33lifetime
- 18:33revenue
- 18:33before
- 18:34being
- 18:34shut
- 18:34down
- 18:34on
- 18:34March
- 18:3424th.
- 18:35Even
- 18:35OpenAI's
- 18:36own
- 18:36head
- 18:36of
- 18:36Sora
- 18:37admitted
- 18:37the
- 18:37economics
- 18:38were
- 18:38unsustainable.
- 18:39The
- 18:39analysis
- 18:39frames
- 18:40this
- 18:40as
- 18:40the
- 18:40loudest
- 18:40signal
- 18:41of
- 18:41a
- 18:41shift
- 18:41from
- 18:41training
- 18:42constraints
- 18:42to
- 18:42an
- 18:42inference
- 18:43wall
- 18:43—
- 18:43the
- 18:43chips
- 18:44designed
- 18:44for
- 18:44training
- 18:44are
- 18:44not
- 18:45optimized
- 18:45for
- 18:45serving,
- 18:46and
- 18:46until
- 18:46inference
- 18:47efficiency
- 18:47improves
- 18:47dramatically,
- 18:48complex
- 18:49AI
- 18:49products
- 18:49will
- 18:49struggle
- 18:50to
- 18:50close
- 18:50the
- 18:50unit
- 18:50economics
- 18:51gap.
- 18:52The
- 18:52same
- 18:52analysis
- 18:53highlights
- 18:53another
- 18:53March
- 18:53milestone:
- 18:54the
- 18:54first
- 18:55real
- 18:55advertising
- 18:55dollars
- 18:56entering
- 18:56conversational
- 18:57AI
- 18:57interfaces.
- 18:58Criteo
- 18:58became
- 18:59the
- 18:59first
- 18:59ad-tech
- 19:00company
- 19:00to
- 19:00integrate
- 19:01with
- 19:01OpenAI's
- 19:01advertising
- 19:02pilot
- 19:02in
- 19:02ChatGPT's
- 19:03free
- 19:03tier,
- 19:04pitching
- 19:04its
- 19:0417,000
- 19:05advertisers
- 19:06on
- 19:06placing
- 19:06ads
- 19:06inside
- 19:07conversations.
- 19:08Early
- 19:09data
- 19:09from
- 19:09500
- 19:09Criteo
- 19:10retailers
- 19:10showed
- 19:11users
- 19:11arriving
- 19:11at
- 19:11retail
- 19:12sites
- 19:12from
- 19:12LLM
- 19:12platforms
- 19:13converted
- 19:13at
- 19:131.5x
- 19:14the
- 19:14rate
- 19:14of
- 19:15other
- 19:15referral
- 19:15channels.
- 19:16The
- 19:16structural
- 19:17shift
- 19:17is
- 19:17that
- 19:17the
- 19:17purchase
- 19:17funnel
- 19:18—
- 19:19discovery,
- 19:19consideration,
- 19:20conversion
- 19:20—
- 19:21collapses
- 19:21into
- 19:22a
- 19:22single
- 19:22conversation.
- 19:23There
- 19:24is
- 19:24no
- 19:24page
- 19:24one
- 19:24versus
- 19:24page
- 19:25two,
- 19:25no
- 19:25list
- 19:26of
- 19:26ten
- 19:26blue
- 19:26links.
- 19:27There
- 19:27is
- 19:27just
- 19:28a
- 19:28recommendation
- 19:28woven
- 19:29into
- 19:29a
- 19:29response
- 19:30the
- 19:30user
- 19:30trusts.
- 19:31If
- 19:32conversational
- 19:32AI
- 19:33captures
- 19:33purchase
- 19:33intent
- 19:34upstream
- 19:34before
- 19:34the
- 19:35user
- 19:35ever
- 19:35opens
- 19:35a
- 19:35browser,
- 19:36that
- 19:36$600
- 19:37billion
- 19:37global
- 19:38ad
- 19:38budget
- 19:38migrates
- 19:39with
- 19:39it.
- 19:40On
- 19:40the
- 19:40SaaS
- 19:40front,
- 19:41Atlassian's
- 19:42CEO
- 19:42pledged
- 19:43in
- 19:43October
- 19:432025
- 19:44to
- 19:45employ
- 19:45more
- 19:45engineers
- 19:46in
- 19:46five
- 19:46years
- 19:46and
- 19:46hire
- 19:47more
- 19:47new
- 19:47graduates
- 19:48in
- 19:482025-2026.
- 19:50By
- 19:50March,
- 19:51the
- 19:51company
- 19:52cut
- 19:521,600
- 19:53jobs
- 19:53—
- 19:5410%
- 19:55of
- 19:55the
- 19:55workforce,
- 19:56over
- 19:56900
- 19:57in
- 19:57software
- 19:57—
- 19:59and
- 19:59reported
- 19:59its
- 19:59first-ever
- 20:00decline
- 20:00in
- 20:00enterprise
- 20:01seat
- 20:01counts.
- 20:03The
- 20:03mechanism
- 20:03is
- 20:03simple:
- 20:04if
- 20:05AI
- 20:05agents
- 20:05can
- 20:06do
- 20:06the
- 20:06work
- 20:06of
- 20:06multiple
- 20:06seats,
- 20:07per-seat
- 20:08pricing
- 20:08compresses
- 20:08revenue.
- 20:10Block
- 20:10cut
- 20:104,000
- 20:11jobs
- 20:12citing
- 20:12an
- 20:12"intelligence
- 20:13native"
- 20:13model.
- 20:14Oracle
- 20:15said
- 20:15AI
- 20:15was
- 20:15enabling
- 20:16it
- 20:16to
- 20:16shrink
- 20:16development
- 20:17teams.
- 20:18Tech
- 20:18layoffs
- 20:19globally
- 20:19surpassed
- 20:2045,000
- 20:21by
- 20:21early
- 20:21March.
- 20:22The
- 20:23market
- 20:23has
- 20:23seen
- 20:23that
- 20:23per-seat
- 20:24pricing
- 20:24is
- 20:24over
- 20:24faster
- 20:25than
- 20:25most
- 20:25SaaS
- 20:25companies,
- 20:26and
- 20:26until
- 20:27they
- 20:27find
- 20:27viable
- 20:27outcome-driven
- 20:28pricing
- 20:28models,
- 20:29the
- 20:29punishment
- 20:30will
- 20:30continue.