Definition
A system that distributes incoming network traffic across multiple servers to ensure no single server becomes overwhelmed.
In Depth
Load balancers (like Nginx, HAProxy, or AWS ALB) route requests using algorithms like round-robin, least connections, or weighted distribution. They provide high availability by detecting and routing around failed servers.
Example Usage
Using Nginx as a reverse proxy to distribute API requests across multiple Gunicorn worker processes.
Business Context
Load balancing is essential for reliability and scalability — it ensures your application stays responsive during traffic spikes and survives individual server failures.
Related Terms
API Gateway
Single entry point that manages, secures, and routes API requests.
API Rate Limiting
Restricting the number of API requests a client can make in a given timeframe.
Blue-Green Deployment
A deployment strategy that maintains two identical production environments, routing traffic to the n...
Container
A lightweight, standalone package that includes everything needed to run a piece of software — code,...
Content Delivery Network
A distributed network of servers that delivers web content from locations geographically closest to ...
Also Known As
Tags
Quick Info
Need help implementing this in your business?
Get Started