Latest / Deep End Era. Engineering with Sankalp
Stream Processing Internals: Chandy-Lamport Distributed Snapshots, Watermarks, RocksDB State Backends, and End-to-End Exactly-Once Semantics
It is three-seventeen in the morning at Qarnain Payments Network in Dubai, and a single slow merchant partition is holding three million payment events per second hostage. Systems engineer Tariq Al-Hashimi is staring at the Apache Flink dashboard for Qarnain's real-time merchant settlement and velocity-fraud pipeline. Normally, every sixty seconds, the sixty-four TaskManagers in the Flink cluster complete a distributed state checkpoint in under eight hundred milliseconds, snapping a consistent view of four terabytes of sliding-window merchant totals and card-velocity counters out to object…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.