system-design

What can we do when load balancer becomes the bottleneck?

不羁的心 提交于 2021-02-04 14:48:15
问题 I just started learning load balancers. Taking a server side application (http/https) load balancer as an example, I assume it listens a specific ip address, then forward the http requests to available servers based on its algorithm. So is it possible for a load balancer to become a bottleneck? Because it's listening a specific ip address, all requests will first go to the single load balancer. So I think there could be a scenario where the amount of traffic is beyond the limit/capacity of

What can we do when load balancer becomes the bottleneck?

橙三吉。 提交于 2021-02-04 14:48:05
问题 I just started learning load balancers. Taking a server side application (http/https) load balancer as an example, I assume it listens a specific ip address, then forward the http requests to available servers based on its algorithm. So is it possible for a load balancer to become a bottleneck? Because it's listening a specific ip address, all requests will first go to the single load balancer. So I think there could be a scenario where the amount of traffic is beyond the limit/capacity of

How to design a system that can manage configurations in a dynamic way efficiently?

我们两清 提交于 2020-08-10 19:34:30
问题 I am working on designing a system where I need to manage configuration (config files) in a dynamic way across bunch of application servers. I am working with Consul key value store to manage configurations. I created below node in consul kv store for the purpose of managing configurations. {"remoteConfig":"abc-123.tgz", "...."} Here remoteConfig contains the config file that all the app servers will use (atleast this is the design I got). Below is what I am trying to do: All the app servers

Load balancer and API Gateway confusion

为君一笑 提交于 2020-07-09 12:48:05
问题 I have always worked on mobile technologies and now I am stepping into backend systems, more specifically systems design. I keep coming across conflicting statements for the roles of api gateway and load balancer. Googling has only returned the same half a dozen results that mostly focus on the implementations of load balancer or api gateway service provided by some famous service. I will list here all the confusing I am facing, in hope someone can clarify all of them. Sometimes, i come

Clean way to create multiple resources (different types) with an API

£可爱£侵袭症+ 提交于 2020-06-27 04:05:09
问题 For the development of an API we want to create a new organization and a new user for that organization with one form submission (the registration) using a clean RESTful API design. As we don't want to mix different resources (organizations and users) and create the them with one call (the response of that call is it an organization or an user?) we need to split the registration into two calls: create organization first and directly after create user. But if the user and organization creation

Keeping services in sync in a kafka event driven backbone

断了今生、忘了曾经 提交于 2020-06-17 02:31:11
问题 Say I am using Kafka as the event-driven backbone for all my microservices in my system design. Many microservices use the events data to populate their internal databases. Now there is a requirement where I need to create a new service and it uses some events data. The service will only be able to consume events after the time it comes live and hence, won't have a lot of data that it missed. I want a strategy such that I don't have to backfill my internal databases by writing out scripts.

Keeping services in sync in a kafka event driven backbone

社会主义新天地 提交于 2020-06-17 02:30:08
问题 Say I am using Kafka as the event-driven backbone for all my microservices in my system design. Many microservices use the events data to populate their internal databases. Now there is a requirement where I need to create a new service and it uses some events data. The service will only be able to consume events after the time it comes live and hence, won't have a lot of data that it missed. I want a strategy such that I don't have to backfill my internal databases by writing out scripts.

How to implement undo functionality?

半世苍凉 提交于 2020-05-24 23:01:26
问题 In my application I want to provide the user with a small undo functionality. There aren't many actions than can be undone by the user. Particularly the actions are: Add notes to an object Color an object Tag a objcet with a string Now I thought about how to implement this. I first thought of a Action Class that is the abstract base class for the 3 different actions that can be taken by the user. Every time the user takes on of these actions, a new appropriate instance of a subclass of this

How to design a distributed job scheduler? [closed]

╄→尐↘猪︶ㄣ 提交于 2020-01-01 09:04:12
问题 Closed . This question needs to be more focused. It is not currently accepting answers. Want to improve this question? Update the question so it focuses on one problem only by editing this post. Closed last year . I want to design a job scheduler cluster, which contains several hosts to do cron job scheduling. For example, a job which needs run every 5 minutes is submitted to the cluster, the cluster should point out which host to fire next run, making sure: Disaster tolerance: if not all of