The Art of Scalable Systems: Designing for Success

Buckle up, intrepid coder! The Art of Scalable Systems is your passport to unraveling the mysteries of services. Explore the hilarious mishaps and ingenious solutions to everyday problems.

📚 NB: This is an attempt at documenting all my system design notes from reading and hands-on experience, starting with explaining the basic components of a service to providing examples of real world systems and discussing tradeoffs of possible solutions.

Basic Concepts

System components	System concepts
Load Balancer	ACID
API Gateway	CAP Theorem
Caching	PACEL Theorem
DNS
Message Queues
Proxies
Databases

System components

System concepts

Design Patterns

Problem	Solution
Check set contains	Bloom Filters
Where to insert data	Consistent Hashing
Ensure strong consistency	Quorum Consensus
Ensure high availability	Leader And Follower
Atomicity in data transfers	Write Ahead Log Segmented Log High Water Mark
Concurrent updates to file	Locking Lease
Concurrent node writes	Vector Clocks
Node liveness	Heartbeat Gossip Protocol Phi Accrual Failure Detection
Deal with dead nodes coming back	Split Brain With Fencing Split Brain With Generation Clock
Update dead nodes with missed data	Hinted Handoff
Update stale nodes	Read Repair Merkle Trees
Check data inconsistency	Checksum

Problem

Solution

Check set contains

Bloom Filters

Where to insert data

Consistent Hashing

Ensure strong consistency

Quorum Consensus

Ensure high availability

Leader And Follower

Atomicity in data transfers

Write Ahead Log Segmented Log High Water Mark