Designing Distributed Systems Useful Links

Distributed Systems Useful Links

Below are some of the links to the different technologies which are used to build a distributed system. It is necessary to know the different technologies available and how they can be used to build a distributed system.

Topics to Discuss for System Design Interview

Whenever you are Designing a System the following things should be discussed.

1. What is the problem Statement
2. Requirement and Goal of the System?
3. Functional Requirements
4. Non Functional Requirements
5. Some Design Considerations
6. Capacity Estimation and Constraints
• Traffic Estimate
• Storage Estimate
• Bandwidth Estimate
• Memory Estimate
7. High Level Design
8. System API
9. Database Design
10. Load Balancer
11. Caching
12. Disaster Recovery plan

Keep the following things in Mind and call the following things during the interview to show that you have a deep understanding of the concepts

• Load Balancer and usage
• CAP theorem - Will you choose Consistency or Availability ?
• Multiple instances of the service
• Software Architectural pattern for used
• Microservices Architectural pattern used
• Discuss Databases
• Type of database used - NoSQL vs SQL and why ?
• Do we need DB Sharding?
• Do we need Consistent Hashing ?
• Master - slave architecture
• Will Read and Write happen from same DB ?
• Discuss Caching
• Caching strategy - DBs that can be used for Caching
• Cache eviction policy
• Discuss Queueing mechanism
• Kafka, RabbitMQ
• Discuss Disaster Recovery
• How multiple instances could help 
• How DB backups can be made

Service Registry

https://microservices.io/patterns/service-registry.html

Load Balancer:
https://evil-stewie.blogspot.com/2022/07/load-balancers.html

Message Broker 

Rabbit MQ:

https://lostechies.com/derekgreer/2012/03/28/rabbitmq-for-windows-exchange-types/

https://www.rabbitmq.com/tutorials/amqp-concepts.html

https://www.rabbitmq.com/getstarted.html

Video : 

KAFKA vs RabbitMQ

https://stackoverflow.com/questions/42151544/is-there-any-reason-to-use-rabbitmq-over-kafka

https://www.interviewbit.com/blog/rabbitmq-vs-kafka/ 

https://www.linkedin.com/learning/apache-kafka-essential-training-getting-started?u=2126985 

Maintaining Message Ordering and no Duplication
https://developer.confluent.io/tutorials/message-ordering/kafka.html
Video : https://developer.confluent.io/learn-kafka/apache-kafka/topics/

Kafka Streams : https://www.youtube.com/watch?v=gJUTErFyuY4&list=PLa7VYi0yPIH35IrbJ7Y0U2YLrR9u4QO-s

JMS vs RabbitMQ:

https://dzone.com/articles/jms-vs-rabbitmq

IBM MQ:

https://www.ibm.com/support/knowledgecenter/en/SSFKSJ_7.5.0/com.ibm.mq.pro.doc/q001020_.htm

NServiceBus:

https://medium.com/@chrisverwijs/a-simple-explanation-of-nservicebus-and-why-you-need-it-a6c6a885838

Capacity Estimation

https://www.youtube.com/watch?v=VBw703pjC3E
https://dev.to/ievolved/how-i-calculate-capacity-for-systems-design-3477

https://www.codementor.io/@robinpalotai/back-of-the-envelope-calculation-for-system-design-interviews-z4ljbsp5l

https://gist.github.com/jboner/2841832

FlipKart Tech Blog

https://tech.flipkart.com/virtual-private-cloud-solving-sdn-for-flipkart-cloud-25813747de5f

Building Architecture of Scale:

https://lethain.com/introduction-to-architecting-systems-for-scale/

API Rate Limiting
https://nordicapis.com/everything-you-need-to-know-about-api-rate-limiting/