Shows / Deep End Era. Engineering with Sankalp
Deep End Era. Engineering with Sankalp
Long-form engineering, computing and mathematics. Created by Sankalp Thakur. A Transient Labs production. Website: https://transientlabs.ai/the-deep-end GitHub: https://github.com/sankalpsthakur X: https://x.com/sankalpsthakur LinkedIn: https://www.linkedin.com/in/sankalpthakur/ Hugging Face: https://huggingface.co/sankalpsthakur Scripts: Claude Opus. Synthetic narration: Edge TTS (episodes 1–96) and Kokoro, credited per episode. Reviewed, listened to and approved by Sankalp Thakur.
Episodes
Deep End Era. Engineering with SankalpUnusual, Bad and Actionable: Anomaly Detection from Control Charts to Isolation Forests
Monday morning at the Kestrel compressor station: 412 anomaly alerts from one weekend, and buried among them a bearing on compressor four that fails on…
Deep End Era. Engineering with SankalpThe Map Is Not the Territory: PCA, t-SNE, UMAP, Autoencoders and Misleading Embedding Plots
PhD student Mateo finds a perfectly round island of six hundred cells in his single-cell UMAP and thinks it is a new cell type. His supervisor Yuki asks three…
Deep End Era. Engineering with SankalpSlicing the Rainbow: Clustering, k-means, DBSCAN, Mixtures and Segmentation Pitfalls
Noor's seven customer segments became persona posters, until Rafael reran her code with a different random start and got seven different ones. Part five of The…
Deep End Era. Engineering with SankalpTwenty Questions, Asked Greedily: Decision Trees, Random Forests and Gradient Boosting
Hélène, fresh from a deep learning lab, bets a box of pastries that her neural network will beat actuary-turned-data-scientist Kwame at predicting motor…
Deep End Era. Engineering with SankalpAim at the Right Part of the Cloud: Regression, Baselines, Changing Noise and Quantiles
Femi's strawberry forecast is right to within two percent over a quarter, yet the Riverside store runs out every Saturday and bins fruit every Tuesday. His new…
Deep End Era. Engineering with SankalpNinety-Nine Point Eight Percent: Classification, Thresholds, Calibration and Rare Events
A vendor shows a card fraud model that is 99.8 percent accurate, and Amara, Northgate Pay's new head of fraud analytics, points out that a model that never…
Deep End Era. Engineering with SankalpThe Exam in the Bin: Supervised Learning, Loss, Bias-Variance and Leakage
Two months into his first job, Tomasz builds a hospital deterioration model with an area under the curve of 0.991. His manager Priya knows that the first…
Deep End Era. Engineering with SankalpDon't Move the Text: Ropes, Gap Buffers and Piece Tables
In Montréal, a forty-megabyte lab log makes a text editor eat over a gigabyte of memory and crash. In the finale of The Deep End's Data Structures series…
Deep End Era. Engineering with SankalpA Bet About the Future: Caches as Data Structures
In Johannesburg, a nightly archive export quietly empties a news site's cache and knocks over its database. In part twenty of The Deep End's Data Structures…
Deep End Era. Engineering with SankalpLay It Out by the Question: Columnar Layouts and Inverted Indexes
In Dublin, a music-streaming start-up reads two terabytes to add up one number per country. In part nineteen of The Deep End's Data Structures series, data…
Deep End Era. Engineering with SankalpAll Trust Lives in the Root: Merkle Trees and Authenticated Data Structures
In Oslo, an auditor asks a firmware company to prove every wind turbine received the same build, and the archive is four hundred gigabytes. In part eighteen of…
Deep End Era. Engineering with SankalpSixty Four Cores and One Door: Concurrent Data Structures
In Mumbai, a brokerage buys sixty-four-core servers and its market-data system gets slower. In part seventeen of The Deep End's Data Structures series, team…
Deep End Era. Engineering with SankalpFewer Bits, Same Answers: Succinct and Compressed Data Structures
In São Paulo, a customer-segment index is seven times bigger than the data it indexes. In part sixteen of The Deep End's Data Structures series, platform lead…
Deep End Era. Engineering with SankalpNever Mutate What Others Can See: Persistent and Immutable Data Structures
In Edinburgh, a floor-plan editor's undo button summons a staircase nobody drew. In part fifteen of The Deep End's Data Structures series, team lead Priya…
Deep End Era. Engineering with SankalpRemember the Furthest End: Segment Trees, Fenwick Trees and Interval Trees
In Singapore, intern Tomás Ferreira finds a dashboard doing ten billion additions a second and a genome job that takes nine hours. In part fourteen of The Deep…
Deep End Era. Engineering with SankalpCarve the Map or Flatten It: Spatial Indexes
On a rainy Friday in Jakarta, new engineer Daniel Okafor discovers that indexing latitude and longitude separately makes every rider lookup take a second. In…
Deep End Era. Engineering with SankalpWhere the Neighbours Live: How Graphs Are Stored
In Lagos, fraud analyst Tom Fairley tries to find every account within three hops of a suspect, and first builds a grid that would need fifty terabytes, then a…
Deep End Era. Engineering with SankalpThe Club Secretaries: Union-Find and Disjoint Sets
In Leeds, Nadia Okafor and Ben Hartley must work out which of eleven million hospital records belong to the same four million people, and Ben's relabelling job…
Deep End Era. Engineering with SankalpAllowable Errors: Bloom Filters and Their Successors
At a Singapore CDN, Priyanka Rao finds that three quarters of the files her edge servers cache are never requested again, and her colleague Marcus suggests…
Deep End Era. Engineering with SankalpBalanced by a Coin: Skip Lists
At midnight in Lisbon, Rosa Ferreira watches two million players flood a game's live leaderboard, which sits in one Redis sorted set, which is, as her…
Deep End Era. Engineering with SankalpSpelled Out: Tries, Radix Trees and Finite State Transducers
On 12 August 2014, Frankfurt network engineer Yusuf Demir watches chunks of the internet flicker as the global IPv4 routing table passes 512,000 routes, the…
Deep End Era. Engineering with SankalpWho Goes Next: Heaps, Priority Queues, Timer Wheels and Schedulers
In Toulouse, satellite flight-software engineer Siobhán Kelly tells new graduates why a lander on Mars kept rebooting in July 1997: the most important task was…
Deep End Era. Engineering with SankalpA Map Drawn with an Old Alphabet: B-Trees and B+ Trees as Data Structures
On a Sunday in Bristol, database consultant Wren Halloway learns that a veterinary chain's receptionist cannot find Mrs de Souza or Mr O'Brien-Hart, though…
Deep End Era. Engineering with SankalpThe Tree That Became a Line: Binary Search Trees and Balancing
In Accra, Ama Boateng's payment scheduler takes eleven seconds because a payroll customer uploaded salaries sorted by date, and her binary search tree became a…
Deep End Era. Engineering with SankalpEvery Coat on Its Hook: Hash Tables from the Inside
On 28 December 2011, security engineer Arjun Mehta watches two researchers in Berlin take down web servers with a single form submission, by choosing field…
Deep End Era. Engineering with SankalpWaiting in Line: Linked Lists, Stacks, Queues, Deques and Ring Buffers
In a London trading firm, Hana Sato's order gateway takes nine hundred microseconds on the busiest minute of the day, and Marcus says her queue is too big. In…
Deep End Era. Engineering with SankalpShaped for the Machine: Arrays, Dynamic Arrays and Memory Layout
Above a bakery in Kraków, game programmer Priya Nandakumar's forty thousand flocking birds run at nineteen frames a second, until her lead Felix tells her to…
Deep End Era. Engineering with SankalpEleven Writes for One: LSM Trees as a Data Structure
At two in the morning in a Leeds mill, storage engineer Imogen Hart sees eleven bytes hitting disk for every byte her delivery vans send. In part one of The…
Deep End Era. Engineering with SankalpWhere the Numbers Live: Arithmetic Algorithms from Euclid to Kahan, and the Algorithms Series Finale
A fictional ledger engineer finds that her company's books are out by a few cents after a billion transactions, and that adding the same numbers in a different…
Deep End Era. Engineering with SankalpMany Hands, One Answer: Parallel and Concurrent Algorithms, from Work and Span to the ABA Problem
A fictional payments engineer watches a sixty-four-core server finish a nightly settlement job only three times faster than her laptop. A fictional game-engine…
Deep End Era. Engineering with SankalpDeciding Before the Future Arrives: Online and Streaming Algorithms, from Ski Rental to the Secretary Problem
A fictional cloud platform lead must decide, every week, whether to keep paying by the hour for servers or commit to a year-long reservation, without knowing…
Deep End Era. Engineering with SankalpYes or No, Prove It: SAT and Constraint Solving from Davis-Putnam to the Solvers Inside Package Managers and Chip Verification
A fictional package-manager maintainer watches an install hang for forty minutes on a dependency tangle, and a fictional chip verification engineer needs to…
Deep End Era. Engineering with SankalpThe Best Corner: Linear and Integer Programming from Dantzig's Simplex to the Solvers That Clear Power Markets
A fictional market operator's clearing engine misses its five-minute deadline on a heatwave afternoon, and a fictional logistics planner discovers her…
Deep End Era. Engineering with SankalpGood Enough, Provably: Approximation Algorithms and Heuristics for NP-Hard Problems
A fictional airline's crew roster collapses after a sandstorm, and its lone optimisation engineer has six hours to rebuild it. Along the way: Christofides's…
Deep End Era. Engineering with SankalpWhere Am I? Computational Geometry: Convex Hulls, Sweep Lines, Point-in-Polygon, Voronoi and Robust Predicates
A fictional delivery start-up in Nairobi starts charging customers in the wrong zone, and a fictional game studio's character falls through a floor. Both bugs…
Deep End Era. Engineering with SankalpRandomised Algorithms: Las Vegas, Monte Carlo, Random Pivots, Miller-Rabin, Karger and Reservoir Sampling
At 2 a.m. in Lisbon, a fictional ticketing company's servers melt under a few dozen carefully crafted requests. Fixing the hash table leads us through the…
Deep End Era. Engineering with SankalpCompression Algorithms: Huffman to LZ77, DEFLATE, Arithmetic Coding, ANS and Zstandard
A fictional Montreal game studio has to ship a 60 GB update to twelve million players by Friday. Following its build engineer's benchmarks, we take apart how…
Deep End Era. Engineering with SankalpSuffix Arrays, Suffix Trees, the Burrows-Wheeler Transform and the FM Index
A fictional Nairobi genomics lab places 300 million reads to find one changed letter. Worked by ear on "banana": the suffix array, prefix doubling, the longest…
Deep End Era. Engineering with SankalpString Algorithms: KMP, Boyer-Moore, Rabin-Karp, Aho-Corasick and the Regex That Broke the Internet
A fictional malware scanning team watches its cluster choke on one bad signature. Along the way: worked examples of a KMP table and a Horspool search by ear…
Deep End Era. Engineering with SankalpThree Strangers on the Same Morning: Network Flow and Matching
A man wants to give his wife a kidney, and the tests say he can't. But somewhere in the country another couple is stuck the same way, and an algorithm can find…
Deep End Era. Engineering with SankalpThe Cheapest Skeleton: Minimum Spanning Trees and Union-Find
A rural broadband cooperative in Wales must connect forty farms and three villages with fibre for the least money. The mathematics it needs was first worked…
Deep End Era. Engineering with SankalpCounting to Infinity: Shortest Paths, Protocols and Timetables
A brother runs a national internet backbone; his sister builds a city's transit trip planner. Both say their routing problem is harder, and both are solving…
Deep End Era. Engineering with SankalpCycle Detected: Graph Search from Mazes to Build Systems
Two days before a game studio's big release, the build system prints one line, "cycle detected in dependency graph", and stops. Somewhere among 11,000 pieces…
Deep End Era. Engineering with SankalpWhen Greed Is Good: Greedy Algorithms and Matroids
A hospital scheduler must fit as many operations as possible into one theatre tomorrow. Her predecessor booked the shortest first; her colleague books the…
Deep End Era. Engineering with SankalpNot Even a Congressman Could Object: Dynamic Programming
An e-reader's paragraphs look like ransom notes, because the layout code fills each line greedily and never looks back. The fix, published by Donald Knuth and…
Deep End Era. Engineering with SankalpThree Instead of Four: Recursion and Divide and Conquer
A payments app takes two seconds to sign each transaction on a cheap phone, and the intern who profiles it says schoolbook multiplication is "the only way to…
Deep End Era. Engineering with SankalpThe Data Was Already Sorted: Sorting in the Real World
A logistics company's nightly sort of four billion parcel scans suddenly became forty times slower, on the very night its input became more orderly. Part three…
Deep End Era. Engineering with SankalpNobody Drops the Whole Box: Comparison Sorts and the n log n Limit
A box of 4,200 trading cards hits the floor of a Leeds card shop, and a father and daughter argue about how to put them back in order. Their ten-minute…
Deep End Era. Engineering with SankalpHalve It Again: Binary Search and Its Cousins
A release engineer has eleven days of commits, 873 suspects and forty hotel restaurants whose printers just slowed to a crawl. Her colleague says one word…
Deep End Era. Engineering with SankalpGlass in the Sea: The Engineering of the Internet
Baran, Davies and Kleinrock; ARPANET 1969; Cerf and Kahn; the 1983 TCP/IP flag day; Saltzer, Reed and Clark; the 1986 congestion collapse, Jacobson 1988, AIMD…
Deep End Era. Engineering with SankalpFour Hundred Metres Down: The Nuclear Fuel Cycle
Klaproth, Becquerel, Hahn–Strassmann–Meitner–Frisch, Chicago Pile-1; in situ leaching, Cigar Lake, yellowcake and Navajo miners; UF6 conversion bottlenecks…
Deep End Era. Engineering with SankalpThe Curve That Went Back Down: The Mathematics of ML Generalisation
Hume and induction; Hoeffding; bias–variance (Geman, Bienenstock, Doursat 1992), ridge, lasso, AIC; Vapnik–Chervonenkis 1971, shattering, Sauer's lemma, the…
Deep End Era. Engineering with SankalpTell the Robots: Robotics and Motion Planning
Čapek, Unimate, Shakey and A, the DARPA challenges, Kiva and Amazon; forward and inverse kinematics, Jacobians, redundancy and singularities; Kalman filters…
Deep End Era. Engineering with SankalpNinety-Two Percent Water: Enhanced Oil Recovery
Porosity, permeability and Darcy's law; primary recovery and drive mechanisms; waterflooding from Bradford to Buckley–Leverett; displacement times sweep…
Deep End Era. Engineering with SankalpThe Missing Clause: Search Engines and Information Retrieval
From Callimachus, concordances and Vannevar Bush to Luhn, Cleverdon's Cranfield experiments, Salton's vector space model, Spärck Jones's IDF and TREC…
Deep End Era. Engineering with SankalpThe Sun's Weather: Plasma and Space Weather
Matías Ferreira-Holm forecasts; Thandiwe Okonkwo-Lindqvist runs the grid. Sunspots and the solar cycle, flares and CMEs, the solar wind and Parker, Dungey…
Deep End Era. Engineering with SankalpThe Ninety-Ninth Percentile: Operating System Internals
From Atlas, CTSS, Multics and Unix to Linux; system calls and Meltdown mitigations; scheduling from multilevel feedback queues to CFS, EEVDF and schedext; page…
Deep End Era. Engineering with SankalpThe Stain on the Ceiling: Cement, Concrete and Why Structures Fail
A rust stain spreads across a garage ceiling beneath a seaside apartment block, and the residents have read about Surfside. Episode one hundred and ninety two…
Deep End Era. Engineering with SankalpThe Monday Morning Problem: Error-Correcting Codes
In 2003 a Belgian candidate received exactly 4,096 impossible votes: one flipped bit. Episode one hundred and ninety one explains why such errors are rare…
Deep End Era. Engineering with SankalpA Mountain Drawn by a Child: Lithium and the Critical Minerals
The price of lithium rose tenfold and then fell by ninety per cent in four years. Episode one hundred and ninety explains why, and why the real chokepoint for…