Search for a command to run...
Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Leaderless Replication in a leaderless configuration, failover does not exist the client sends the write to all three replicas in parallel, and the two ...
Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Multi-Leader Replication Multi-datacenter operation - we have a database with replicas in several different datacenters. With a normal leader-based repl...
Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Implementation of Replication Logs Statement-based replication In the simplest case, the leader logs every write request (statement) that it executes an...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter IV] Encoding and Evolution Avro To maintain forward and backward compatibility its important to add or remove a field that has some default value. In case of Avro, You can onl...
Spark Structured Streaming Dynamic Dataset Join I have came across a unique problem, I had a list of valid names in some remote configuration which changes often. Now I have a spark structured streaming job which runs always and it is an always on ki...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter IV] Encoding and Evolution Apache Thrift and Protocol Buffers (protobuf) are binary encoding libraries that are based on the same principle Both Thrift and Protocol Buffers re...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter IV] Encoding and Evolution Evolvability: we should aim to build systems that make it easy to adapt to change [Making Change Easy] In order for the system to continue running s...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter III] Storage and Retrieval B-Trees The most widely used indexing structure is the B-tree. B-trees keep key-value pairs sorted by key, which allows efficient keyvalue lookups a...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter III] Storage and Retrieval SSTables and LSM-Trees Sorted String Table, or SSTable for short, requires that each key only appears once within each merged segment file Merging s...
