> For the complete documentation index, see [llms.txt](https://dianadarie.gitbook.io/system-design-notes/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://dianadarie.gitbook.io/system-design-notes/readme.md). # The Art of Scalable Systems: Designing for Success Buckle up, intrepid coder! The Art of Scalable Systems is your passport to unraveling the mysteries of services. Explore the hilarious mishaps and ingenious solutions to everyday problems. 📚 NB: This is an attempt at documenting all my system design notes from reading and hands-on experience, starting with explaining the basic components of a service to providing examples of real world systems and discussing tradeoffs of possible solutions. ## Table of contents #### Basic Concepts | System components | System concepts | | --------------------------------------------------------------- | ------------------------------------------------------------- | | [Load Balancer](/system-design-notes/basics/load-balancer.md) | [ACID](/system-design-notes/basics/acid.md) | | [API Gateway](/system-design-notes/basics/api-gateway.md) | [CAP Theorem](/system-design-notes/basics/cap-theorem.md) | | [Caching](/system-design-notes/basics/caching.md) | [PACEL Theorem](/system-design-notes/basics/pacel-theorem.md) | | [DNS](/system-design-notes/basics/dns.md) | | | [Message Queues](/system-design-notes/basics/message-queues.md) | | | [Proxies](/system-design-notes/basics/proxies.md) | | | [Databases](/system-design-notes/basics/databases.md) | | #### Design Patterns | Problem | Solution | | ---------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Check set contains | [Bloom Filters](/system-design-notes/system-design-patterns/bloom-filters.md) | | Where to insert data | [Consistent Hashing](/system-design-notes/system-design-patterns/consistent-hashing.md) | | Ensure strong consistency | [Quorum Consensus](/system-design-notes/system-design-patterns/quorum-consensus.md) | | Ensure high availability | [Leader And Follower](/system-design-notes/system-design-patterns/leader-and-follower.md) | | Atomicity in data transfers |

Write Ahead Log
Segmented Log
High Water Mark

| | Concurrent updates to file | [Locking Lease](/system-design-notes/system-design-patterns/locking-lease.md) | | Concurrent node writes | [Vector Clocks](/system-design-notes/system-design-patterns/vector-clocks.md) | | Node liveness |

Heartbeat
Gossip Protocol
Phi Accrual Failure Detection

| | Deal with dead nodes coming back |

Split Brain With Fencing
Split Brain With Generation Clock

| | Update dead nodes with missed data | [Hinted Handoff](/system-design-notes/system-design-patterns/resyncing-nodes/hinted-handoff.md) | | Update stale nodes |

Read Repair
Merkle Trees

| | Check data inconsistency | [Checksum](/system-design-notes/system-design-patterns/checksum.md) | #### Data Synchronisation Patterns | Chapters | | ---------------------------------------------------------------------------------------------------------- | | [CQRS](/system-design-notes/data-synchronisation-patterns/two-phase-commit.md) | | [Two Phase Commit](/system-design-notes/data-synchronisation-patterns/cqrs.md) | | [Transactional Outbox](/system-design-notes/data-synchronisation-patterns/transactional-outbox.md) | | [Change Data Capture (CDC)](/system-design-notes/data-synchronisation-patterns/change-data-capture-cdc.md) | #### Monolith Decomposition Patterns | Chapters | | ---------------------------------------------------------------------------------------------------------------------------------- | | [Domain Driven Design](/system-design-notes/monolith-decomposition-patterns/domain-driven-design.md) | | [The Strangler Fig Migration Pattern](/system-design-notes/monolith-decomposition-patterns/the-strangler-fig-migration-pattern.md) | #### Real World Scenarios | Chapters | | ------------------------------------------------------------------------------------------------------------- | | [Distributed Message Queue & Event Streaming Platform](/system-design-notes/real-world-scenarios/untitled.md) | **Infrastructure Bits and Bobs** | Chapters | | ------------------------------------------------------------------------------------------------------------------------------- | | [K8S - ClusterIP vs NodePort vs LoadBalancer](/system-design-notes/infrastructure/k8s-clusterip-vs-nodeport-vs-loadbalancer.md) | #### Payments Domain | Chapters | | -------------------------------------------------------------------------------------------------------- | | [Parties: Acquirer, Issuer](/system-design-notes/payments-services/parties-acquirer-issuer.md) | | [Events: Chargebacks, Reversals](/system-design-notes/payments-services/events-chargebacks-reversals.md) |