Latest / AGI Dreams – Open, Uncensored, & Local - AI News Digest / AGI Dreams Podcast – April 30, 2026
Transcript
- 0:00Wiz
- 0:00Research
- 0:00just
- 0:01published
- 0:01the
- 0:01technical
- 0:02breakdown
- 0:02of
- 0:02CVE-2026-3854,
- 0:06a
- 0:06critical
- 0:06remote
- 0:07code
- 0:07execution
- 0:07vulnerability
- 0:08in
- 0:08GitHub's
- 0:09internal
- 0:09git
- 0:09infrastructure
- 0:10that
- 0:10any
- 0:10authenticated
- 0:11user
- 0:11could
- 0:11trigger
- 0:12with
- 0:12a
- 0:12single
- 0:12git
- 0:12push.
- 0:13The
- 0:13exploitation
- 0:14chain
- 0:14is
- 0:14elegant
- 0:15in
- 0:15its
- 0:15simplicity:
- 0:16GitHub's
- 0:16internal
- 0:16babeld
- 0:17proxy
- 0:17copies
- 0:17git
- 0:18push
- 0:18option
- 0:18values
- 0:19directly
- 0:19into
- 0:19an
- 0:19X-Stat
- 0:20header
- 0:20without
- 0:20sanitizing
- 0:21semicolons.
- 0:22Since
- 0:22semicolons
- 0:23delimit
- 0:23fields
- 0:24in
- 0:24that
- 0:24header,
- 0:25an
- 0:25attacker
- 0:25can
- 0:25inject
- 0:26arbitrary
- 0:26key-value
- 0:27pairs
- 0:27—
- 0:28including
- 0:28rails
- 0:29env,
- 0:29custom
- 0:29hooks
- 0:30dir,
- 0:30and
- 0:30repo
- 0:31pre
- 0:31receive
- 0:31hooks
- 0:31—
- 0:32to
- 0:32bypass
- 0:33sandbox
- 0:33execution,
- 0:34redirect
- 0:35hook
- 0:35script
- 0:35lookup,
- 0:36and
- 0:36achieve
- 0:36path
- 0:36traversal
- 0:37to
- 0:37any
- 0:37binary
- 0:38on
- 0:38the
- 0:38filesystem.
- 0:39The
- 0:39result:
- 0:40unsandboxed
- 0:40code
- 0:41execution
- 0:41as
- 0:41the
- 0:41git
- 0:42service
- 0:42user,
- 0:43with
- 0:43filesystem
- 0:44access
- 0:44to
- 0:44every
- 0:44repository
- 0:45on
- 0:45the
- 0:45affected
- 0:46storage
- 0:46node.
- 0:47On
- 0:47GitHub.com,
- 0:49Wiz
- 0:49confirmed
- 0:49that
- 0:50millions
- 0:50of
- 0:50public
- 0:50and
- 0:51private
- 0:51repository
- 0:51entries
- 0:52belonging
- 0:53to
- 0:53other
- 0:53users
- 0:53and
- 0:53organizations
- 0:54were
- 0:54accessible
- 0:55from
- 0:55compromised
- 0:55nodes.
- 0:56The
- 0:57most
- 0:57consequential
- 0:57detail
- 0:58isn't
- 0:58the
- 0:58vulnerability
- 0:59itself
- 0:59—
- 1:00it's
- 1:00how
- 1:00it
- 1:00was
- 1:01found.
- 1:02Wiz
- 1:02credits
- 1:02AI-augmented
- 1:03reverse
- 1:03engineering,
- 1:04specifically
- 1:05IDA
- 1:06MCP
- 1:06(Model
- 1:07Context
- 1:07Protocol
- 1:07integration
- 1:08for
- 1:08the
- 1:08IDA
- 1:09disassembler),
- 1:10with
- 1:10making
- 1:10the
- 1:10discovery
- 1:11feasible.
- 1:12In
- 1:12prior
- 1:12rounds
- 1:13of
- 1:13research,
- 1:14extracting
- 1:14and
- 1:14auditing
- 1:15GitHub
- 1:15Enterprise
- 1:16Server's
- 1:16compiled
- 1:16binaries
- 1:17was
- 1:17"too
- 1:18costly"
- 1:18in
- 1:18manual
- 1:19effort.
- 1:20This
- 1:20time,
- 1:21AI
- 1:21reconstructed
- 1:22internal
- 1:22protocols,
- 1:23traced
- 1:23user
- 1:24input
- 1:24flow
- 1:24across
- 1:25multiple
- 1:25services
- 1:26written
- 1:26in
- 1:26different
- 1:26languages,
- 1:27and
- 1:27identified
- 1:28where
- 1:28assumptions
- 1:29diverged.
- 1:30GitHub
- 1:30mitigated
- 1:31the
- 1:31issue
- 1:31on
- 1:31GitHub.com
- 1:32within
- 1:33six
- 1:33hours
- 1:33of
- 1:33the
- 1:33initial
- 1:34report,
- 1:34but
- 1:35at
- 1:35disclosure
- 1:35time,
- 1:3688%
- 1:37of
- 1:37GHES
- 1:37instances
- 1:38remained
- 1:38unpatched.
- 1:40That
- 1:40gap
- 1:40between
- 1:40cloud
- 1:41and
- 1:41self-hosted
- 1:42patching
- 1:42speed
- 1:42is
- 1:42worth
- 1:43watching
- 1:43—
- 1:44it's
- 1:44the
- 1:44same
- 1:44pattern
- 1:45that
- 1:45makes
- 1:45enterprise
- 1:45software
- 1:46a
- 1:46persistent
- 1:46target.
- 1:48The
- 1:48vulnerability
- 1:48also
- 1:49surfaces
- 1:49a
- 1:49pattern
- 1:50that
- 1:50extends
- 1:50well
- 1:50beyond
- 1:51GitHub:
- 1:52when
- 1:52multiple
- 1:52services
- 1:53pass
- 1:53data
- 1:53through
- 1:53a
- 1:53shared
- 1:54internal
- 1:54protocol,
- 1:55each
- 1:55service's
- 1:56assumptions
- 1:56about
- 1:56that
- 1:57data
- 1:57become
- 1:57an
- 1:57attack
- 1:58surface.
- 1:59One
- 1:59service
- 1:59assumed
- 2:00push
- 2:00option
- 2:00values
- 2:01were
- 2:01safe.
- 2:02Another
- 2:02assumed
- 2:03every
- 2:03X-Stat
- 2:03field
- 2:04came
- 2:04from
- 2:04a
- 2:04trusted
- 2:05source.
- 2:06A
- 2:06pre-receive
- 2:06hook
- 2:07assumed
- 2:07a
- 2:07certain
- 2:07environment
- 2:08variable
- 2:08could
- 2:08only
- 2:09be
- 2:09"production"
- 2:09in
- 2:10production.
- 2:11Each
- 2:11assumption
- 2:11was
- 2:12individually
- 2:12reasonable
- 2:13and
- 2:13collectively
- 2:13dangerous.
- 2:14Meanwhile,
- 2:15a
- 2:15US
- 2:16government
- 2:16memo
- 2:16on
- 2:16adversarial
- 2:17distillation
- 2:18is
- 2:18raising
- 2:18questions
- 2:19about
- 2:19whether
- 2:19open-weight
- 2:20models
- 2:20need
- 2:21tighter
- 2:21export
- 2:21controls
- 2:22—
- 2:23the
- 2:23concern
- 2:23being
- 2:23that
- 2:24state
- 2:24actors
- 2:24can
- 2:25distill
- 2:25capabilities
- 2:26from
- 2:26frontier
- 2:26models
- 2:27into
- 2:27smaller,
- 2:27ungoverned
- 2:28ones
- 2:28.
- 2:29Whether
- 2:29the
- 2:29policy
- 2:30response
- 2:30lands
- 2:30on
- 2:31controls
- 2:31or
- 2:31capacity-building
- 2:32will
- 2:32shape
- 2:33the
- 2:33open-source
- 2:33AI
- 2:34ecosystem
- 2:34for
- 2:34years.
- 2:35On
- 2:36the
- 2:36fraud
- 2:36side,
- 2:37a
- 2:37research
- 2:37repository
- 2:38called
- 2:38gpt-pp-team
- 2:39documents
- 2:40the
- 2:40full
- 2:40attack
- 2:41chain
- 2:41for
- 2:41replaying
- 2:42ChatGPT
- 2:42Team
- 2:43subscriptions
- 2:43—
- 2:44from
- 2:44Stripe
- 2:44Checkout
- 2:45through
- 2:45PayPal
- 2:46billing
- 2:46agreements
- 2:46to
- 2:46Codex
- 2:47OAuth
- 2:47token
- 2:47extraction
- 2:48—
- 2:48complete
- 2:49with
- 2:49a
- 2:494,000-line
- 2:51hCaptcha
- 2:51visual
- 2:52solver
- 2:52and
- 2:52empirical
- 2:53anti-fraud
- 2:53data.
- 2:54The
- 2:54research
- 2:55findings
- 2:55are
- 2:55more
- 2:56instructive
- 2:56than
- 2:56the
- 2:56tooling:
- 2:57batch-created
- 2:58accounts
- 2:58show
- 2:59a
- 2:59next-day
- 2:59survival
- 3:00rate
- 3:00of
- 3:00approximately
- 3:002%,
- 3:02killed
- 3:02by
- 3:02IP-level
- 3:03string
- 3:03fingerprinting,
- 3:04batch
- 3:04correlation
- 3:05with
- 3:05delayed
- 3:05bans,
- 3:06and
- 3:06a
- 3:06clear
- 3:06separation
- 3:07between
- 3:07probe
- 3:07layers
- 3:08(that
- 3:08detect)
- 3:08and
- 3:09ban
- 3:09layers
- 3:09(that
- 3:09act).
- 3:10It's
- 3:10a
- 3:10useful
- 3:11case
- 3:11study
- 3:11in
- 3:11how
- 3:11modern
- 3:12anti-fraud
- 3:13systems
- 3:13use
- 3:13layered,
- 3:14delayed
- 3:14enforcement
- 3:15rather
- 3:15than
- 3:15real-time
- 3:16blocking.
- 3:22Martin
- 3:22Fowler's
- 3:22Thoughtworks
- 3:23just
- 3:23published
- 3:24what
- 3:24may
- 3:24be
- 3:24the
- 3:24most
- 3:24rigorous
- 3:25treatment
- 3:25yet
- 3:25of
- 3:26how
- 3:26teams
- 3:26should
- 3:26actually
- 3:27use
- 3:27AI
- 3:27coding
- 3:28assistants
- 3:28at
- 3:28scale.
- 3:29Their
- 3:29method,
- 3:30Structured
- 3:30Prompt-Driven
- 3:31Development
- 3:31(SPDD),
- 3:32treats
- 3:32prompts
- 3:33as
- 3:33first-class
- 3:33delivery
- 3:34artifacts
- 3:34—
- 3:35version-controlled,
- 3:36reviewed,
- 3:36reusable,
- 3:37and
- 3:37governed
- 3:37by
- 3:37the
- 3:38same
- 3:38discipline
- 3:38as
- 3:38code.
- 3:39The
- 3:39core
- 3:40structure
- 3:40is
- 3:40the
- 3:40REASONS
- 3:41Canvas:
- 3:41seven
- 3:42dimensions
- 3:42spanning
- 3:43Requirements,
- 3:43Entities,
- 3:44Approach,
- 3:45Structure,
- 3:46Operations,
- 3:46Norms,
- 3:47and
- 3:47Safeguards.
- 3:48The
- 3:48canvas
- 3:49captures
- 3:49intent,
- 3:50domain
- 3:51model,
- 3:51design
- 3:51decisions,
- 3:52constraints,
- 3:53and
- 3:53task
- 3:54decomposition
- 3:54in
- 3:54a
- 3:54single
- 3:55artifact
- 3:55that
- 3:55the
- 3:56LLM
- 3:56operates
- 3:56within.
- 3:58The
- 3:58workflow
- 3:58enforces
- 3:58a
- 3:59critical
- 3:59rule:
- 3:59when
- 4:00reality
- 4:00diverges,
- 4:01fix
- 4:01the
- 4:01prompt
- 4:01first,
- 4:02then
- 4:02update
- 4:02the
- 4:02Refactoring
- 4:04flows
- 4:04the
- 4:04other
- 4:05direction
- 4:05—
- 4:06change
- 4:06the
- 4:06code,
- 4:07then
- 4:07sync
- 4:07back
- 4:08to
- 4:08the
- 4:08prompt
- 4:08via
- 4:08/spdd-sync.
- 4:10The
- 4:10result
- 4:11is
- 4:11a
- 4:11closed
- 4:11loop
- 4:11where
- 4:12prompts
- 4:12and
- 4:12code
- 4:12evolve
- 4:13together
- 4:13rather
- 4:14than
- 4:14drifting
- 4:14apart.
- 4:15The
- 4:15three
- 4:15skills
- 4:16SPDD
- 4:16identifies
- 4:17—
- 4:18alignment
- 4:18(design
- 4:19before
- 4:19you
- 4:19generate),
- 4:20abstraction-first
- 4:21(lock
- 4:21intent
- 4:21before
- 4:22you
- 4:22write
- 4:22code),
- 4:23and
- 4:23iterative
- 4:23review
- 4:24(turn
- 4:24output
- 4:24into
- 4:25a
- 4:25controlled
- 4:25loop)
- 4:25—
- 4:26are
- 4:26exactly
- 4:27the
- 4:27skills
- 4:27that
- 4:27separate
- 4:28developers
- 4:28who
- 4:28get
- 4:29consistent
- 4:29value
- 4:29from
- 4:30AI
- 4:30assistants
- 4:31from
- 4:31those
- 4:31who
- 4:31get
- 4:31fast
- 4:31garbage.
- 4:33The
- 4:33fitness
- 4:33table
- 4:34is
- 4:34refreshingly
- 4:34honest:
- 4:35SPDD
- 4:36rates
- 4:36itself
- 4:36five
- 4:37stars
- 4:37for
- 4:37scaled
- 4:37standardized
- 4:38delivery
- 4:39and
- 4:39high-compliance
- 4:39environments,
- 4:40but
- 4:41only
- 4:41one
- 4:41or
- 4:41two
- 4:41stars
- 4:42for
- 4:42firefighting
- 4:42hotfixes,
- 4:44exploratory
- 4:44spikes,
- 4:45and
- 4:45one-off
- 4:45scripts.
- 4:46This
- 4:47is
- 4:47engineering
- 4:47discipline
- 4:48applied
- 4:48to
- 4:48a
- 4:48new
- 4:48tool,
- 4:49not
- 4:49a
- 4:49silver
- 4:50bullet.
- 4:51The
- 4:51walkthrough
- 4:52of
- 4:52enhancing
- 4:52a
- 4:52billing
- 4:52engine
- 4:53demonstrates
- 4:54the
- 4:54full
- 4:54cycle
- 4:54from
- 4:54requirements
- 4:55through
- 4:55analysis,
- 4:56canvas
- 4:57generation,
- 4:57code
- 4:58generation,
- 4:59verification,
- 5:00and
- 5:00regression
- 5:00testing
- 5:01—
- 5:02a
- 5:02complete
- 5:02end-to-end
- 5:03example
- 5:03that
- 5:03teams
- 5:04can
- 5:04actually
- 5:04follow.
- 5:06A
- 5:06complementary
- 5:06approach
- 5:07emerges
- 5:07from
- 5:07a
- 5:08blog
- 5:08post
- 5:08about
- 5:08running
- 5:09two
- 5:09Claude
- 5:09Code
- 5:10sessions
- 5:10against
- 5:10one
- 5:11repository.
- 5:12Rather
- 5:12than
- 5:13a
- 5:13formal
- 5:13framework,
- 5:14the
- 5:14author
- 5:15discovered
- 5:15that
- 5:15when
- 5:15context
- 5:16runs
- 5:16out
- 5:16in
- 5:16a
- 5:16brainstorming
- 5:17session,
- 5:18you
- 5:18can
- 5:18spin
- 5:18up
- 5:18a
- 5:18second
- 5:19agent
- 5:19for
- 5:19the
- 5:19editing
- 5:20work
- 5:20and
- 5:20coordinate
- 5:21them
- 5:21through
- 5:21a
- 5:21shared
- 5:22markdown
- 5:22protocol
- 5:22file.
- 5:24The
- 5:24primitives
- 5:24are
- 5:24minimal:
- 5:25roles
- 5:26(Drafter/Editor),
- 5:27turf
- 5:27(directory-based
- 5:28boundaries),
- 5:29named
- 5:29handoff
- 5:30units
- 5:30(one
- 5:30markdown
- 5:31file
- 5:31per
- 5:31atomic
- 5:32edit),
- 5:32and
- 5:32a
- 5:32human
- 5:33message
- 5:33bus.
- 5:34Neither
- 5:34agent
- 5:35can
- 5:35self-approve
- 5:35—
- 5:36the
- 5:36Drafter
- 5:37proposes,
- 5:37the
- 5:37operator
- 5:38approves,
- 5:39the
- 5:39Editor
- 5:39applies.
- 5:40The
- 5:40protocol
- 5:41grew
- 5:41organically
- 5:42as
- 5:42the
- 5:42agents
- 5:43themselves
- 5:43identified
- 5:44gaps:
- 5:44the
- 5:45Editor
- 5:45proposed
- 5:45a
- 5:45visual-layout-verification
- 5:47rule
- 5:47when
- 5:47it
- 5:48realized
- 5:48it
- 5:48couldn't
- 5:48validate
- 5:49rendering
- 5:49changes;
- 5:50the
- 5:50Drafter
- 5:51proposed
- 5:51stricter
- 5:52source-document
- 5:52drift
- 5:53detection.
- 5:54Sentrux
- 5:54attacks
- 5:55a
- 5:55related
- 5:55problem
- 5:55from
- 5:56the
- 5:56measurement
- 5:56side.
- 5:57It's
- 5:57a
- 5:57Rust-based
- 5:58architectural
- 5:59sensor
- 5:59that
- 5:59watches
- 5:59codebases
- 6:00in
- 6:00real-time,
- 6:01computing
- 6:02five
- 6:02root-cause
- 6:03metrics
- 6:03(modularity,
- 6:04acyclicity,
- 6:05depth,
- 6:06equality,
- 6:06redundancy)
- 6:07into
- 6:07a
- 6:07single
- 6:08continuous
- 6:08score.
- 6:09The
- 6:09thesis
- 6:10is
- 6:10sharp:
- 6:11"the
- 6:11better
- 6:11the
- 6:11AI
- 6:12generates
- 6:12code,
- 6:13the
- 6:13faster
- 6:13your
- 6:13codebase
- 6:14becomes
- 6:14ungovernable."
- 6:15Every
- 6:16AI
- 6:16session
- 6:17silently
- 6:17degrades
- 6:18architecture
- 6:18—
- 6:19scattered
- 6:19responsibilities,
- 6:20tangled
- 6:21dependencies,
- 6:22conflicting
- 6:22abstractions
- 6:23—
- 6:24and
- 6:24without
- 6:24structural
- 6:25feedback,
- 6:25the
- 6:25next
- 6:26session
- 6:26makes
- 6:26the
- 6:26mess
- 6:27worse.
- 6:27Sentrux
- 6:28integrates
- 6:29as
- 6:29an
- 6:29MCP
- 6:29server
- 6:30so
- 6:30agents
- 6:30get
- 6:31real-time
- 6:31access
- 6:32to
- 6:32structural
- 6:32health.
- 6:33The
- 6:33quality
- 6:34gate
- 6:34catches
- 6:35regression:
- 6:35save
- 6:36a
- 6:36baseline
- 6:36before
- 6:37an
- 6:37agent
- 6:37session,
- 6:38compare
- 6:38after,
- 6:39block
- 6:39degradation.
- 6:40Fifty-two
- 6:41languages
- 6:41via
- 6:42tree-sitter,
- 6:42single
- 6:43binary,
- 6:44no
- 6:44runtime
- 6:44dependencies.
- 6:46Rounding
- 6:46out
- 6:46the
- 6:46tooling
- 6:47theme,
- 6:47gopher-code
- 6:48is
- 6:48a
- 6:48ground-up
- 6:49rewrite
- 6:49of
- 6:49Claude
- 6:50Code
- 6:50from
- 6:50TypeScript
- 6:51to
- 6:51Go
- 6:52—
- 6:52513,000
- 6:53lines
- 6:54of
- 6:54TypeScript
- 6:54distilled
- 6:55into
- 6:55idiomatic
- 6:56Go
- 6:56with
- 6:56a
- 6:5612ms
- 6:57cold
- 6:57start,
- 6:58single
- 6:58static
- 6:59binary,
- 7:00and
- 7:0033
- 7:01built-in
- 7:01tools.
- 7:02It's
- 7:02currently
- 7:03at
- 7:03roughly
- 7:033%
- 7:04parity
- 7:04across
- 7:05594
- 7:06identified
- 7:07tasks,
- 7:08so
- 7:08this
- 7:08is
- 7:08early-stage,
- 7:09but
- 7:10the
- 7:10architectural
- 7:10choices
- 7:11are
- 7:11interesting:
- 7:12Bubble
- 7:12Tea
- 7:13for
- 7:13the
- 7:13TUI,
- 7:14context-first
- 7:15cancellation
- 7:15on
- 7:16every
- 7:16goroutine,
- 7:17interfaces
- 7:17at
- 7:18all
- 7:18boundaries,
- 7:19and
- 7:19golden-file
- 7:20tests
- 7:20against
- 7:21captured
- 7:21Claude
- 7:22Code
- 7:22transcripts
- 7:23for
- 7:23behavioral
- 7:23parity
- 7:24validation.
- 7:25A
- 7:25workshop
- 7:25video
- 7:26by
- 7:26Cole
- 7:26Medin
- 7:27demonstrates
- 7:28a
- 7:28three-phase
- 7:28AI
- 7:29coding
- 7:29workflow
- 7:29—
- 7:30strategic
- 7:31planning,
- 7:32a
- 7:32plan-implement-verify
- 7:33loop,
- 7:33and
- 7:34system
- 7:34evolution
- 7:34—
- 7:35that
- 7:35maps
- 7:36naturally
- 7:36onto
- 7:36the
- 7:37structured
- 7:37approaches
- 7:38described
- 7:38above.
- 7:43Qwen
- 7:433.6
- 7:44at
- 7:44the
- 7:4427-billion-parameter
- 7:45size
- 7:45is
- 7:45posting
- 7:46agency
- 7:46benchmarks
- 7:46on
- 7:47Artificial
- 7:47Analysis
- 7:48that
- 7:48tie
- 7:48with
- 7:49Claude
- 7:49Sonnet
- 7:494.6
- 7:49—
- 7:50a
- 7:50remarkable
- 7:51result
- 7:51for
- 7:51an
- 7:51open-weight
- 7:52model
- 7:52running
- 7:52locally.
- 7:53The
- 7:5327B
- 7:54parameter
- 7:54count
- 7:54hits
- 7:54a
- 7:54sweet
- 7:55spot:
- 7:55large
- 7:56enough
- 7:56for
- 7:56complex
- 7:57agentic
- 7:57tasks,
- 7:57small
- 7:58enough
- 7:58to
- 7:58run
- 7:58on
- 7:58consumer
- 7:59hardware
- 7:59with
- 7:59quantization.
- 8:00For
- 8:00the
- 8:00agentic
- 8:01coding
- 8:01use
- 8:01cases
- 8:02dominating
- 8:02today's
- 8:02developer
- 8:03workflows,
- 8:03agency
- 8:04benchmarks
- 8:04matter
- 8:04more
- 8:05than
- 8:05raw
- 8:05text
- 8:05generation
- 8:06quality
- 8:06—
- 8:07a
- 8:07model
- 8:07that
- 8:07reliably
- 8:08plans,
- 8:08uses
- 8:09tools,
- 8:09and
- 8:09self-corrects
- 8:10is
- 8:10more
- 8:10valuable
- 8:10than
- 8:11one
- 8:11that
- 8:11writes
- 8:11prettier
- 8:11prose
- 8:12but
- 8:12stumbles
- 8:12on
- 8:12multi-step
- 8:13reasoning.
- 8:14Qwen
- 8:143.6
- 8:15closing
- 8:15the
- 8:15gap
- 8:15with
- 8:15a
- 8:15frontier
- 8:16commercial
- 8:16model
- 8:16at
- 8:16a
- 8:16fraction
- 8:17of
- 8:17the
- 8:17parameter
- 8:17count
- 8:18signals
- 8:18that
- 8:19the
- 8:19open-weight
- 8:19ecosystem
- 8:20is
- 8:20maturing
- 8:20faster
- 8:21than
- 8:21many
- 8:21expected.
- 8:22This
- 8:23arrives
- 8:23alongside
- 8:23the
- 8:23first
- 8:23direct
- 8:24side-by-side
- 8:24comparison
- 8:25of
- 8:25Mixture-of-Experts
- 8:26versus
- 8:26dense
- 8:26architectures
- 8:27at
- 8:27equivalent
- 8:27compute
- 8:27budgets,
- 8:28a
- 8:28test
- 8:28the
- 8:29community
- 8:29has
- 8:29been
- 8:29requesting
- 8:30for
- 8:30years.
- 8:31The
- 8:31results
- 8:31should
- 8:31inform
- 8:32architecture
- 8:32decisions
- 8:33for
- 8:33anyone
- 8:33training
- 8:33or
- 8:34fine-tuning
- 8:34models
- 8:34—
- 8:35whether
- 8:35the
- 8:35MoE
- 8:36routing
- 8:36overhead
- 8:36pays
- 8:36for
- 8:37itself
- 8:37in
- 8:37quality-per-FLOP
- 8:38depends
- 8:38heavily
- 8:38on
- 8:38the
- 8:38task
- 8:39distribution
- 8:39and
- 8:39inference
- 8:40hardware
- 8:40constraints.
- 8:41On
- 8:41the
- 8:41frontier
- 8:42model
- 8:42side,
- 8:42OpenAI
- 8:43has
- 8:43confirmed
- 8:43GPT-6
- 8:44is
- 8:44in
- 8:44development
- 8:44—
- 8:45no
- 8:45timeline,
- 8:46no
- 8:46architecture
- 8:47details,
- 8:47just
- 8:47acknowledgment
- 8:48that
- 8:48the
- 8:48next
- 8:48generation
- 8:49is
- 8:49underway
- 8:49.
- 8:50Meanwhile,
- 8:50Google
- 8:51is
- 8:51reportedly
- 8:51investing
- 8:51up
- 8:52to
- 8:52$40
- 8:52billion
- 8:52in
- 8:53Anthropic,
- 8:53spreading
- 8:54its
- 8:54AI
- 8:54bets
- 8:54beyond
- 8:54its
- 8:55own
- 8:55Gemini
- 8:55line.
- 8:56That
- 8:56investment,
- 8:56if
- 8:57confirmed
- 8:57at
- 8:57scale,
- 8:58would
- 8:58make
- 8:58Anthropic
- 8:58one
- 8:59of
- 8:59the
- 8:59best-capitalized
- 9:00AI
- 9:00labs
- 9:00and
- 9:00raises
- 9:01questions
- 9:01about
- 9:01competitive
- 9:02dynamics
- 9:02—
- 9:03Google
- 9:03funding
- 9:04a
- 9:04direct
- 9:04competitor
- 9:04to
- 9:05its
- 9:05own
- 9:05flagship
- 9:05models
- 9:06is
- 9:06a
- 9:06hedge
- 9:06that
- 9:07suggests
- 9:07even
- 9:07Google
- 9:08isn't
- 9:08sure
- 9:08which
- 9:08architecture
- 9:09or
- 9:09approach
- 9:09will
- 9:09dominate.
- 9:11For
- 9:11Anthropic,
- 9:12this
- 9:12kind
- 9:12of
- 9:12capital
- 9:13runway
- 9:13could
- 9:13fund
- 9:13the
- 9:14safety
- 9:14research
- 9:14and
- 9:15scaling
- 9:15experiments
- 9:16that
- 9:16differentiate
- 9:16its
- 9:16approach.
- 9:18NVIDIA's
- 9:19Nemotron
- 9:19Nano
- 9:193
- 9:20Omni
- 9:20is
- 9:20gaining
- 9:21llama.cpp
- 9:23support
- 9:23through
- 9:23a
- 9:23conversion
- 9:24PR,
- 9:24adding
- 9:25another
- 9:25multimodal
- 9:25option
- 9:26to
- 9:26the
- 9:26local
- 9:26inference
- 9:27stack
- 9:27—
- 9:28the
- 9:28omni
- 9:28designation
- 9:29signals
- 9:29vision,
- 9:30audio,
- 9:30and
- 9:31text
- 9:31capabilities
- 9:32in
- 9:32a
- 9:32compact
- 9:32form
- 9:32factor
- 9:33designed
- 9:33for
- 9:33edge
- 9:33deployment.
- 9:40The
- 9:40persistent
- 9:41complaint
- 9:41about
- 9:41local
- 9:42LLM
- 9:42inference
- 9:43for
- 9:43agentic
- 9:43coding
- 9:43is
- 9:44that
- 9:44KV
- 9:44cache
- 9:44invalidation
- 9:45kills
- 9:45latency.
- 9:46Every
- 9:46time
- 9:47an
- 9:47agent
- 9:47circles
- 9:47back
- 9:48to
- 9:48a
- 9:48previous
- 9:48prefix
- 9:49—
- 9:49which
- 9:50happens
- 9:50dozens
- 9:50of
- 9:50times
- 9:51per
- 9:51session
- 9:51—
- 9:52the
- 9:52entire
- 9:52cache
- 9:53is
- 9:53recomputed.
- 9:54oMLX
- 9:54tackles
- 9:55this
- 9:55directly
- 9:56by
- 9:56persisting
- 9:56every
- 9:56KV
- 9:57cache
- 9:57block
- 9:57to
- 9:58SSD
- 9:58on
- 9:58Apple
- 9:59Silicon,
- 10:00restoring
- 10:00from
- 10:00disk
- 10:00in
- 10:00milliseconds
- 10:01instead
- 10:01of
- 10:01recomputing
- 10:02from
- 10:02scratch.
- 10:03Benchmarks
- 10:04on
- 10:04an
- 10:04M3
- 10:05Ultra
- 10:05512GB
- 10:06show
- 10:07Qwen3.5
- 10:09models
- 10:09hitting
- 10:10941
- 10:11tokens/second
- 10:11prompt
- 10:12processing
- 10:12at
- 10:128K
- 10:12context,
- 10:14with
- 10:148-request
- 10:14continuous
- 10:15batching
- 10:15pushing
- 10:15throughput
- 10:16to
- 10:16190
- 10:16tok/s
- 10:17—
- 10:18a
- 10:183.36x
- 10:19speedup
- 10:19over
- 10:19single
- 10:20requests.
- 10:21The
- 10:21405B
- 10:22parameter
- 10:23class
- 10:23manages
- 10:2316.7
- 10:24tok/s
- 10:25single-request,
- 10:26scaling
- 10:27to
- 10:2760.3
- 10:27tok/s
- 10:28at
- 10:288x
- 10:29batch.
- 10:30The
- 10:30pitch
- 10:30is
- 10:30that
- 10:30this
- 10:30makes
- 10:31local
- 10:31inference
- 10:31fast
- 10:32enough
- 10:32for
- 10:32coding
- 10:32agents
- 10:32that
- 10:33need
- 10:33responsive
- 10:33tool-calling
- 10:34llama.cpp
- 10:36build
- 10:36b8967
- 10:38introduces
- 10:38native
- 10:38NVFP4
- 10:40support
- 10:40for
- 10:40NVIDIA's
- 10:41Blackwell
- 10:41architecture,
- 10:42meaning
- 10:42the
- 10:42B100/B200
- 10:45GPUs
- 10:45can
- 10:45now
- 10:45run
- 10:464-bit
- 10:46quantized
- 10:46models
- 10:47through
- 10:47llama.cpp's
- 10:48inference
- 10:48stack
- 10:48without
- 10:49This
- 10:50is
- 10:50significant
- 10:51for
- 10:51anyone
- 10:51deploying
- 10:52local
- 10:52or
- 10:52on-premise
- 10:53inference
- 10:53at
- 10:53scale
- 10:54—
- 10:55Blackwell's
- 10:55native
- 10:56FP4
- 10:56throughput
- 10:57is
- 10:57substantially
- 10:57higher
- 10:58than
- 10:58emulated
- 10:58quantization
- 10:59on
- 10:59older
- 10:59architectures.
- 11:01A
- 11:01project
- 11:01called
- 11:02Sigilant
- 11:02shifts
- 11:02the
- 11:03local
- 11:03model
- 11:03selection
- 11:04conversation
- 11:04from
- 11:04raw
- 11:05tokens-per-second
- 11:05to
- 11:06tool-calling
- 11:06pass
- 11:06rate
- 11:07as
- 11:07the
- 11:07primary
- 11:08quality
- 11:08metric
- 11:08for
- 11:09GGUF
- 11:09quantizations.
- 11:11The
- 11:11argument:
- 11:12TPS
- 11:12tells
- 11:13you
- 11:13how
- 11:13fast
- 11:13a
- 11:13model
- 11:14talks,
- 11:14but
- 11:15not
- 11:15whether
- 11:15it
- 11:15can
- 11:15reliably
- 11:16call
- 11:16tools
- 11:16—
- 11:17and
- 11:18for
- 11:18agentic
- 11:18use
- 11:18cases,
- 11:19a
- 11:19model
- 11:20that's
- 11:2020%
- 11:20slower
- 11:21but
- 11:2140%
- 11:22more
- 11:22reliable
- 11:22on
- 11:23structured
- 11:23tool
- 11:23calls
- 11:24is
- 11:24unambiguously
- 11:25better.
- 11:26This
- 11:26is
- 11:26the
- 11:26kind
- 11:27of
- 11:27practical
- 11:27benchmarking
- 11:28the
- 11:28local
- 11:28LLM
- 11:29community
- 11:29needs
- 11:29more
- 11:30of.
- 11:30Meanwhile,
- 11:31a
- 11:31frustrated
- 11:32r/LocalLLaMA
- 11:33post
- 11:34titled
- 11:34"I'm
- 11:34done
- 11:34with
- 11:35using
- 11:35local
- 11:35LLMs
- 11:36for
- 11:36coding"
- 11:37captures
- 11:37the
- 11:37other
- 11:37side
- 11:38of
- 11:38the
- 11:38experience
- 11:38gap
- 11:39—
- 11:40when
- 11:40local
- 11:40models
- 11:40fail
- 11:41at
- 11:41complex
- 11:41multi-file
- 11:42edits
- 11:42that
- 11:43cloud
- 11:43models
- 11:43handle
- 11:44reliably,
- 11:45the
- 11:45cost
- 11:45savings
- 11:45aren't
- 11:46worth
- 11:46the
- 11:46context-switching
- 11:55A
- 11:55new
- 11:55paper
- 11:55from
- 11:55KAIST
- 11:56introduces
- 11:56TARA-Merging
- 11:58(Task-Rank
- 12:00Anisotropy
- 12:00Alignment),
- 12:01a
- 12:01framework
- 12:02for
- 12:02combining
- 12:02multiple
- 12:03LoRA
- 12:03adapters
- 12:04into
- 12:04a
- 12:04single
- 12:04model
- 12:04that
- 12:05addresses
- 12:05two
- 12:05properties
- 12:06most
- 12:06prior
- 12:06methods
- 12:06overlook:
- 12:07subspace
- 12:08coverage
- 12:08and
- 12:08directional
- 12:09anisotropy.
- 12:10The
- 12:10problem
- 12:10is
- 12:11practical
- 12:11—
- 12:12when
- 12:12you've
- 12:12fine-tuned
- 12:13separate
- 12:13LoRA
- 12:13adapters
- 12:14for
- 12:14different
- 12:14tasks
- 12:15and
- 12:15want
- 12:15to
- 12:15merge
- 12:15them
- 12:16into
- 12:16one
- 12:16general-purpose
- 12:17model,
- 12:17naive
- 12:18combination
- 12:18erodes
- 12:18the
- 12:18representational
- 12:19directions
- 12:20most
- 12:20critical
- 12:20to
- 12:20certain
- 12:21tasks
- 12:21while
- 12:21overemphasizing
- 12:22others.
- 12:23TARA
- 12:24decomposes
- 12:24LoRA
- 12:25updates
- 12:25into
- 12:25rank-1
- 12:26directions,
- 12:27measures
- 12:27how
- 12:27broadly
- 12:28those
- 12:28directions
- 12:28span
- 12:29the
- 12:29parameter
- 12:29space
- 12:29(subspace
- 12:30coverage
- 12:30via
- 12:30effective
- 12:31rank),
- 12:32and
- 12:32quantifies
- 12:32how
- 12:32unevenly
- 12:33task
- 12:33losses
- 12:34respond
- 12:34to
- 12:34different
- 12:34directions
- 12:35(anisotropy
- 12:35via
- 12:36the
- 12:36task-loss
- 12:36Jacobian's
- 12:37singular
- 12:37value
- 12:38spectrum).
- 12:39The
- 12:39method
- 12:39offers
- 12:40two
- 12:40variants:
- 12:41Variant
- 12:41A
- 12:42reweights
- 12:42individual
- 12:43rank-1
- 12:43factors
- 12:43within
- 12:44each
- 12:44adapter,
- 12:45and
- 12:45Variant
- 12:45B
- 12:45constructs
- 12:46a
- 12:46shared
- 12:46orthonormal
- 12:47basis
- 12:47across
- 12:47all
- 12:48tasks
- 12:48via
- 12:48SVD
- 12:49before
- 12:49assigning
- 12:50per-direction
- 12:50weights.
- 12:51Variant
- 12:51B
- 12:52consistently
- 12:52achieves
- 12:53the
- 12:53highest
- 12:53scores
- 12:54—
- 12:5476.3%
- 12:55average
- 12:56normalized
- 12:56accuracy
- 12:57across
- 12:57eight
- 12:57vision
- 12:57benchmarks
- 12:58with
- 12:58CLIP
- 12:58ViT-B/32,
- 13:00and
- 13:0080.3%
- 13:01on
- 13:01six
- 13:02NLI
- 13:02benchmarks
- 13:03with
- 13:03LLaMA-3
- 13:038B,
- 13:05outperforming
- 13:05both
- 13:05vanilla
- 13:06baselines
- 13:06(Task
- 13:06Arithmetic,
- 13:07TIES,
- 13:08DARE,
- 13:08AdaMerging)
- 13:09and
- 13:09LoRA-aware
- 13:09methods
- 13:10(KnOTS,
- 13:11LoRA-LEGO,
- 13:12RobustMerge).
- 13:13The
- 13:13generalization
- 13:14results
- 13:14are
- 13:14particularly
- 13:15interesting:
- 13:16models
- 13:16merged
- 13:17on
- 13:17six
- 13:17seen
- 13:17tasks
- 13:18and
- 13:18evaluated
- 13:19on
- 13:19two
- 13:19unseen
- 13:19tasks
- 13:20show
- 13:20TARA
- 13:21achieving
- 13:2170.9-72.1%
- 13:26overall
- 13:26accuracy
- 13:27versus
- 13:2766.4-66.7%
- 13:31for
- 13:31the
- 13:32next-best
- 13:32method.
- 13:33For
- 13:33anyone
- 13:34building
- 13:34multi-capability
- 13:35systems
- 13:35by
- 13:35composing
- 13:36task-specific
- 13:36adapters,
- 13:37this
- 13:38is
- 13:38a
- 13:38meaningful
- 13:38step
- 13:38toward
- 13:39principled
- 13:39merging
- 13:40that
- 13:40respects
- 13:40the
- 13:40geometry
- 13:41of
- 13:41what
- 13:41each
- 13:41adapter
- 13:42learned.
- 13:43On
- 13:43the
- 13:43retrieval
- 13:43side,
- 13:44Stuart
- 13:44Winter-Tear's
- 13:45analysis
- 13:45of
- 13:45autonomous
- 13:46knowledge
- 13:46graph
- 13:46exploration
- 13:47reframes
- 13:48the
- 13:48problem
- 13:48in
- 13:48a
- 13:48way
- 13:48that
- 13:48resonates
- 13:49with
- 13:49production
- 13:49RAG
- 13:50systems.
- 13:51The
- 13:51insight:
- 13:52knowledge
- 13:52graphs
- 13:52aren't
- 13:53the
- 13:53autonomous
- 13:53part
- 13:53—
- 13:54the
- 13:54agentic
- 13:55retrieval
- 13:55process
- 13:55sitting
- 13:56on
- 13:56top
- 13:56of
- 13:56them
- 13:56is.
- 13:57Retrieval
- 13:58becomes
- 13:58an
- 13:58adaptive
- 13:59control
- 13:59problem
- 14:00where
- 14:00the
- 14:00system
- 14:00needs
- 14:00to
- 14:00follow
- 14:01relationships,
- 14:02use
- 14:02relational
- 14:03context,
- 14:03traverse
- 14:04structured
- 14:04evidence,
- 14:05and
- 14:05know
- 14:05when
- 14:05to
- 14:06stop
- 14:06exploring.
- 14:07The
- 14:07failure
- 14:08mode
- 14:08isn't
- 14:08just
- 14:08missing
- 14:09the
- 14:09right
- 14:09answer
- 14:09—
- 14:10sometimes
- 14:10the
- 14:11system
- 14:11never
- 14:11leaves
- 14:11the
- 14:12surface,
- 14:12and
- 14:12sometimes
- 14:13it
- 14:13drifts
- 14:13For
- 14:15enterprise
- 14:15applications
- 14:16where
- 14:16agents
- 14:16need
- 14:17reliable
- 14:17paths
- 14:17through
- 14:18structured
- 14:18organizational
- 14:19memory,
- 14:20this
- 14:20framing
- 14:20of
- 14:20"retrieval
- 14:21as
- 14:21control"
- 14:22is
- 14:22more
- 14:22useful
- 14:22than
- 14:22another
- 14:23round
- 14:23of
- 14:23semantic-search
- 14:24benchmarks.
- 14:29Pipecat's
- 14:29Gradient
- 14:29Bang
- 14:30is
- 14:30an
- 14:30open-source
- 14:30multiplayer
- 14:31space
- 14:31game
- 14:31where
- 14:31every
- 14:32entity
- 14:32—
- 14:32including
- 14:33the
- 14:33ship
- 14:33you
- 14:33command
- 14:33—
- 14:34is
- 14:34an
- 14:34AI
- 14:34agent.
- 14:35It's
- 14:36built
- 14:36on
- 14:36Pipecat
- 14:36for
- 14:36real-time
- 14:37voice,
- 14:37Supabase
- 14:38for
- 14:38the
- 14:38game
- 14:38server
- 14:39(PostgreSQL
- 14:39with
- 14:39edge
- 14:39functions),
- 14:40and
- 14:40React
- 14:41for
- 14:41the
- 14:41client.
- 14:42The
- 14:42technical
- 14:43architecture
- 14:43demonstrates
- 14:43full-stack
- 14:44agentic
- 14:44workflows:
- 14:45multi-tasking
- 14:46across
- 14:46exploration,
- 14:47trading,
- 14:48and
- 14:48combat;
- 14:49tool
- 14:49calling
- 14:49for
- 14:49game
- 14:50mechanics;
- 14:50low-latency
- 14:51voice
- 14:51interaction
- 14:51with
- 14:52Deepgram
- 14:52STT,
- 14:53Cartesia
- 14:53TTS,
- 14:54and
- 14:54Gemini
- 14:55or
- 14:55Claude
- 14:55for
- 14:55reasoning.
- 14:56The
- 14:56bot
- 14:57process
- 14:57supports
- 14:57both
- 14:58voice
- 14:58agents
- 14:58(real-time
- 14:59conversation)
- 14:59and
- 14:59NPC
- 15:00task
- 15:00agents
- 15:01(autonomous
- 15:01missions).
- 15:02A
- 15:02local
- 15:02pooler
- 15:03mode
- 15:03bypasses
- 15:03Supabase
- 15:04edge
- 15:04function
- 15:04network
- 15:05hops
- 15:05for
- 15:05co-located
- 15:06deployments,
- 15:06cutting
- 15:07latency
- 15:07from
- 15:07500ms
- 15:08average
- 15:09to
- 15:09near-zero.
- 15:10The
- 15:10project
- 15:10is
- 15:10also
- 15:11a
- 15:11showcase
- 15:11for
- 15:11Claude
- 15:12Code
- 15:12integration
- 15:12—
- 15:13/init
- 15:14sets
- 15:14up
- 15:14the
- 15:14entire
- 15:14stack,
- 15:15/deploy
- 15:16handles
- 15:16production
- 15:16deployment,
- 15:17and
- 15:17/npc
- 15:18launches
- 15:18autonomous
- 15:19agents
- 15:19as
- 15:20named
- 15:20characters.
- 15:21AgentFM
- 15:22takes
- 15:22a
- 15:22different
- 15:22approach
- 15:22to
- 15:23agent
- 15:23infrastructure:
- 15:24a
- 15:24peer-to-peer
- 15:24compute
- 15:25grid
- 15:25built
- 15:25on
- 15:25libp2p
- 15:26that
- 15:26turns
- 15:26idle
- 15:27hardware
- 15:27into
- 15:27a
- 15:27decentralized
- 15:28AI
- 15:28supercomputer.
- 15:29The
- 15:29pitch
- 15:30is
- 15:30"SETI@Home,
- 15:31but
- 15:31for
- 15:31AI."
- 15:32Workers
- 15:33run
- 15:33agents
- 15:33in
- 15:33Podman
- 15:34container
- 15:34sandboxes;
- 15:35a
- 15:36Boss
- 15:36node
- 15:36orchestrates
- 15:37and
- 15:37dispatches
- 15:37via
- 15:38an
- 15:38OpenAI-compatible
- 15:39API
- 15:39on
- 15:39standard
- 15:40endpoints
- 15:40(/v1/chat/completions,
- 15:43/v1/models);
- 15:46Relay
- 15:46nodes
- 15:47handle
- 15:47NAT
- 15:47traversal.
- 15:48Hardware-aware
- 15:49routing
- 15:49broadcasts
- 15:50live
- 15:50CPU/GPU/queue
- 15:51state
- 15:52every
- 15:52two
- 15:52seconds,
- 15:53and
- 15:53the
- 15:53matcher
- 15:54picks
- 15:54the
- 15:54least-loaded
- 15:55peer
- 15:55per
- 15:55request.
- 15:56End-to-end
- 15:56encrypted
- 15:57streams
- 15:57via
- 15:58libp2p
- 15:58Noise,
- 15:59PSK
- 15:59mode
- 16:00for
- 16:00fully
- 16:00isolated
- 16:01private
- 16:01meshes,
- 16:02and
- 16:02bearer-token
- 16:03auth
- 16:03with
- 16:03constant-time
- 16:04comparison.
- 16:05It's
- 16:05a
- 16:05single
- 16:06statically-linked
- 16:06Go
- 16:07binary
- 16:07for
- 16:07Linux,
- 16:08macOS,
- 16:09Windows,
- 16:10FreeBSD
- 16:10across
- 16:11six
- 16:11architectures.
- 16:12Microsoft's
- 16:13TRELLIS.2,
- 16:14a
- 16:144-billion-parameter
- 16:15open-source
- 16:16image-to-3D
- 16:16model
- 16:17with
- 16:17PBR
- 16:17(physically-based
- 16:18rendering)
- 16:18textures,
- 16:19extends
- 16:20the
- 16:20generative
- 16:20AI
- 16:21toolkit
- 16:21into
- 16:21spatial
- 16:22computing
- 16:22—
- 16:23useful
- 16:23for
- 16:23game
- 16:24development
- 16:24pipelines
- 16:25and
- 16:25digital
- 16:25twin
- 16:25creation
- 16:26where
- 16:263D
- 16:26asset
- 16:27production
- 16:27is
- 16:28the