Token bucket algorithm

Showing posts with the label Token bucket algorithm

API Gateway Rate Limiting with Token Bucket and Redis

29 Mar 2026 Post a Comment

Unexpected traffic spikes can cripple your backend infrastructure in seconds. Whether it is a legitimate viral surge, a misconfigured client retry …

API Gateway Rate Limiting with Token Bucket and Redis

Older HomeNewest

Labels

DevOps
Cloud Security
Distributed Systems
GitHub Actions
AWS Lambda
Event-driven Architecture
Kubernetes
Terraform
Backend
DevSecOps

Infrastructure as Code
Kubernetes Networking
Memory management
Microservices
SRE
nodejs
API security
AWS EKS
CI/CD Pipeline
Cloud Native
Container Security
Data Consistency
Distributed Transactions
Eventual Consistency
FinOps
Garbage collection
Karpenter
Kubernetes Security
Microservices Architecture
Node.js
Performance Tuning
PostgreSQL
Python
Semantic Search
Spring Boot
Spring Boot 3
terraform force-unlock
API Gateway Rate Limiting
API Performance
AWS Lambda Cold Start
AWS S3 Backend
AWS Security
Apache Kafka
Asynchronous programming
Backend Performance
Blue-Green Deployment
CI/CD
CI/CD Performance
CI/CD Security
CUDA OOM
Calico
Change Data Capture
Cloud Cost Optimization
Cloud Posture Management
Containerization
Data engineering
DataLoader
Database Architecture
Database Version Control
Debezium
DevOps Security
DevOps Troubleshooting
DevOps automation
DevSecOps Pipeline
Distributed tracing
Distroless Images
Docker
Domain-Driven Design
Exit Code 137
FastAPI
Frontend Architecture
GraphQL N+1 problem
Hugging Face
IaC
JWT Security
Jailbreak Attacks
Java Spring Boot
K8s security
K8s troubleshooting
Kafka
Kubernetes OOMKilled
LLM Inference Optimization
LLM Security
Multi-tenancy
Node.js performance
OIDC
OWASP Top 10 LLM
OWASP ZAP
Observability FinOps
OpenTelemetry
PagedAttention
Prometheus Custom Metrics
QLoRA
React
Saga Pattern
Scalability
Schema Evolution
Semantic Caching
Strangler Fig Pattern
System design
Terraform State Lock
Vector Search
Vector database
Web Application Firewall
Zero-downtime deployment
enterprise container security
memory leak
state management
.NET Core memory leak
.NET backend
.NET best practices
.NET diagnostics
2PC
2dsphere index
429 Too Many Requests
60fps scrolling
ACID vs BASE
AI Cost Reduction
AI Cyber Security
AI FinOps
AI Hallucination Mitigation
AI Infrastructure
AI deployment
AI guardrails
AI model training
AI workloads
AOT compilation
API Gateway
API Gateway 504
API Management
API Quota
API Resiliency
API Routing
API optimization
APM
APM configuration
ARM64 vs AMD64
ASP.NET Core DI
AWS
AWS ALB
AWS API Gateway
AWS ASG runners
AWS Bot Control
AWS CloudFront invalidation
AWS Compute Optimizer
AWS DynamoDB
AWS EC2
AWS EC2 IMDSv2
AWS ECS Fargate
AWS EKS upgrade
AWS FinOps
AWS Glacier
AWS Graviton deployment
AWS IAM Least Privilege
AWS IAM cross-account
AWS IRSA
AWS Lambda VPC
AWS Lambda optimization
AWS Macie
AWS NAT Gateway Costs
AWS OIDC authentication
AWS Organizations
AWS RDS performance tuning
AWS Release Engineering
AWS Route 53 Tutorial
AWS S3 Security
AWS STS
AWS SnapStart
AWS SnapStart tutorial
AWS Transit Gateway
AWS VPC Peering
AWS WAF Configuration
AWS WAF rate limiting
AWS cost management
AWS database scaling
AWS lifecycle policies
AWS policies
Access control architecture
Access-Control-Allow-Origin
Active defragmentation
Adaptive Query Execution
Airflow Datasets
Airflow TaskGroups
Alert grouping
Alpine Linux
Amazon DynamoDB
Amazon EKS
Amazon Route 53
Amazon S3 cost optimization
Angular
Apache Airflow DAGs
Apache Avro
Apache Cassandra
Apache Spark OOM
App Router errors
Apple Silicon Docker
Application Monitoring
ApplicationSet
ArgoCD
ArgoCD GitOps
ArgoCD OutOfSync
ArgoCD sync loop
AsSplitQuery
AsyncDatabase
Asynchronous Java
Asynchronous ML Inference
Asynchronous Rust
Audit Logs
Authentication architecture
Authorization
Authorization Code Flow
Auto-scaling
Automated Vulnerability Scanning
Automerge
Axon Framework
B2B SaaS
BM25
Backend Engineering
Backend security
Batching queries
BeanCurrentlyInCreationException
Big data processing
Bot Management
Bot mitigation
Build speed
Build speed optimization
BuildKit
Bundle size optimization
C# architecture
C# async await tutorial
C# async void vs Task
C# memory management
CAP_SYS_ADMIN
CDN caching strategy
CI pipeline speed
CI/CD Failure
CI/CD Optimization
CI/CD database
CI/CD pipeline optimization
CI/CD pipelines
CI/CD security testing
CI/CD standardization
CNI Security
CORS preflight error
CPU LLM
CPU profiling
CPU-bound tasks
CPython
CQRS architecture
CRDTs
CVE-2021-44228
Cache-Control headers
Caching layer optimization
Captive dependency
Cargo Lambda tutorial
Cartesian explosion
Cascading failures
Cassandra tombstones
Celery Workers
Choreography
Chrome DevTools profiling
Cilium
Circuit breaker pattern
Cloud
Cloud Autoscaling
Cloud Performance
Cloud analytics
Cloud logging costs
Cloud metadata protection
Cloud native observability
Cloud networking architecture
Cloud storage architecture
Cloud-Native DR
CloudTrail Security
Cluster API
Cluster Autoscaler
Cluster Autoscaler vs Karpenter
Cluster consensus
ClusterRole
CockroachDB
Code Coverage
CodeDeploy
CodeQL
Compaction strategy
Compute credits
Concurrency tuning
Confluent Schema Registry
Confused Deputy Problem
Connection Pool
Connection Pooling
Container Escape
Container Image Signing
Container Orchestration
Container memory limits
Context Injection
Context splitting
Continuous Batching
Core Web Vitals
CrashLoopBackOff
Cross-Origin Resource Sharing
Custom LLM
Custom Metrics API
Cyclic Dependency
DAST integration
DDP
DNS Failover
DNS Timeout
DNS management
DNS rebinding
DRY code
Data Drift Detection
Data Governance
Data Isolation
Data Leak Prevention
Data ingestion
Data modeling
Data pipeline orchestration
Database Buffer Usage
Database Credential Rotation
Database Optimization
Database Sharding
Database bloat
Database concurrency
Database indexes
Database maintenance
Database schema evolution
Database transaction
Database troubleshooting
Datadog APM costs
DbContext scope
Dead Letter Exchange
Declarative pipeline
Deep Learning
Dependency Injection
Dependency Management
Dependency injection lifetimes
DevOps best practices
Developer experience DX
Disk Space
Distributed SQL
Distributed messaging
Distributed rate limiting
Django Debug Toolbar
Django ORM
Docker BuildKit
Docker Desktop alternative
Docker Optimization
Docker System Prune
Docker Troubleshooting
Docker buildx
Docker hardening
Docker layer caching
Docker manifest
Docker rootless mode
Docker security best practices
Docker security compliance
Dockerfile Best Practices
Document Chunking
Dynamic Analysis
Dynamic Routing
Dynamic Secrets
DynamoDB
DynamoDB backend
DynamoDB hot partition
DynamoDB idempotency
EC2 Fleet
EF Core 8
EKS Multi-AZ
EKS Pod Identity
EKS Security
EKS migration
ESR rule
Edge AI Inference
Elasticsearch
Elasticsearch 7.x
Elasticsearch 8.x
Elasticsearch Sync
Elasticsearch kNN
Elasticsearch split-brain
Enterprise RAG
Enterprise SSO
Enterprise security policies
Entity Framework Core
Entity Framework Core optimization
EntityGraph
Envoy configuration
Envoy proxy optimization
Event Orchestration
Event Sourcing
Event loop already running
Event streaming
EventStoreDB
Evergreen
Evidently AI
Exactly-once semantics
Exception handling
ExecutorLostFailure
Expand and contract pattern
Exponential Backoff
ExternalTaskSensor
FAISS
FSDP
Fail-fast
Fault tolerance
FinOps data warehouse
FinTech Engineering
Flamegraphs
Flyway
Flyway migrations
ForkJoinPool
Frontend Engineering
Frontend SEO
Frontend backend integration
Frontend build tools
Frontend performance
GGUF format
GKE upgrade
GOGC tuning
GOMEMLIMIT
GPTCache
GPU Memory Optimization
GPU memory management
Generative AI Engineering
Generative AI Performance
Generative AI safety
Geospatial queries
GitHub Actions OIDC
GitHub Actions Security
GitHub Actions cache
GitHub Actions caching
GitHub Actions paths
GitHub Actions self-hosted
GitLab CI/CD optimization
GitLab Runner
GitOps
GitOps troubleshooting
Global availability
Go garbage collection
Go memory leak
Go runtime
Golang latency
Golang performance
Goroutine leak
GraalVM Native Image
GraalVM native image Lambda
GraalVM optimization
Graceful shutdown
Gradient Checkpointing
Grafana Dashboards
Grafana Loki storage
GraphQL Resolver Optimization
GraphQL resolvers
Groovy scripting
HNSW
HNSW Index
HTTP 429
HTTP OPTIONS
HTTP/2
Hardening Kubernetes
HashiCorp Sentinel
HashiCorp Vault
HashiCorp license change
Heap Snapshot
Heap analysis
Heap dump analysis
Helm atomic flag
Helm rollback
Hibernate 6
Hibernate LazyInitializationException
High Availability
High CPU utilization
High Volume Data
High availability architecture
HikariCP configuration
HttpOnly cookies
Hugging Face PEFT
Hybrid Search
IAM
IAM Access Analyzer
IAM Roles
IAM Roles for Service Accounts
IAM Trust Policy
IAM role GitHub Actions
IAM roles GitHub Actions
IServiceScopeFactory
IVF
IaC alternatives
Idempotency Key
Idempotent API
Idempotent consumer
Identity Access Management
Identity and access management
Identity management
Image preloading
Incident management
Ingestion rules
InnoDB locking
Istio 1.24
Istio Service Mesh
Istio latency
Istio mTLS
Istio performance tuning
JDBC Source Connector
JOIN FETCH example
JPA N+1 problem
JPA fetch join
JSON vs Protobuf
JTI validation
JVM performance debugging
JVM tuning
JWKS endpoint
JWT Routing
JWT sliding expiration
JWT validation Spring
Jaeger
Jaeger Tracing
Jakarta EE migration
Java
Java 17 Spring
Java CompletableFuture
Java Concurrency
Java Enterprise Security
Java JVM Tuning
Java heap size
Java heap space
Java serverless
Java serverless performance
Java thread dump
JavaScript memory
JavaScript memory profiling
Jenkins Shared Libraries
Jenkinsfile refactoring
Jupyter Notebook async fix
Just-in-Time Provisioning
K8s Cost Optimization
K8s finalizers
K8s production
K8s scheduler
K8s storage
KV cache
Kafka Connect
Kafka Connect latency
Kafka Streaming
Kafka best practices
Kafka consumer rebalance
Kafka performance
Kafka tuning
Kubectl patch
Kubernetes 502 Bad Gateway
Kubernetes Autoscaling
Kubernetes CoreDNS
Kubernetes CrashLoopBackOff
Kubernetes Disaster Recovery
Kubernetes Draining
Kubernetes HPA
Kubernetes Jobs
Kubernetes Least Privilege
Kubernetes Network Policies
Kubernetes PVC stuck terminating
Kubernetes RBAC
Kubernetes Security Best Practices
Kubernetes cluster upgrade
Kubernetes configuration management
Kubernetes deployment
Kubernetes diff
Kubernetes node affinity
Kubernetes self-healing
Kubernetes service mesh
Kubernetes tutorial
Kubernetes zero trust
LINQ performance
LLM API costs
LLM Deployment
LLM Embeddings
LLM Integration
LLM Latency
LLM chunking strategy
LLM fine-tuning
LLM infrastructure
Lambda NAT Gateway
Lambda Power Tuning
Lambda SQS integration
Lambda cold start
Lambda timeout fix
LangChain
Largest Contentful Paint LCP
Latency
Latency-based routing
Lateral Movement
Layer 7 DDoS
Layer 7 DDoS protection
Least privilege
Legacy Java Security
Legacy Migration
Lifetime errors
Linux Capabilities
Linux top
Linux user namespace
Liveness Probes
Llama 3
Llama 3 Fine-tuning
LlamaIndex
LoRA
Log retention policy
Log4Shell Remediation
Log4j Patching
Loki compactor
ML Model Monitoring
MLOps
MLOps Architecture
MLflow
MTTR improvement
Machine Learning Lifecycle
Machine Learning Production
Master node election
Matrix builds
Memory leaks
Message Buildup
Message Queue
Message duplication
Metadata Service
Metrics API
Micro-frontends
Microservices communication
Microservices connectivity
Microservices consistency
Microservices data patterns
Microservices observability
Microservices resilience
Milvus
Mobile performance optimization
Model Decay
Model Quantization
Modernization
ModuleFederationPlugin
MongoDB indexing
MongoDB performance
Monitoring architecture
Monolith to Microservices
Monorepo CI/CD
Move Docker Directory
Multi-architecture images
Multi-cluster management
Multi-region architecture
Multi-stage Builds
Multi-tenant EKS
Multi-tenant SaaS
Multiprocessing
Mutating admission webhook
Mutual TLS
MySQL
MySQL deadlock
N+1 problem
N+1 queries
NGINX Ingress
NIST 800-162
NVIDIA GPU Serving
Namespace Isolation
NeMo Guardrails
NetworkPolicies
Next.js hydration mismatch
Next.js optimization
NoSQL database design
NoSQL optimization
NoSQL performance
Node Provisioning
Node Termination Handler
Node group migration
Node.js GraphQL
Node.js OpenAI
Node.js WebSockets
Node.js event loop
Node.js memory leak
Node.js security
NodeLocal DNSCache
OAuth 2.0
OAuth 2.0 PKCE
OAuth 2.1
OAuth2 implementation
OAuth2 security
OIDC Integration
OOMKilled fix
OTLP
Observability
Observability metrics
Observable
Okta Integration
On-call optimization
Open Session In View
OpenAI API Rate Limits
OpenAI performance
OpenID Connect
OpenID Connect OIDC
OpenTelemetry Collector
OpenTofu
OpenTofu migration
OpenTofu registry
Operational Transformation
OrbStack vs Docker Desktop
Orchestration
Outbox pattern
Ownership
PCI-DSS Compliance
PEFT
PII Discovery
PKCE Flow
PageSpeed Insights
PagerDuty alert fatigue
Parallel Programming
Parameter-Efficient Fine-Tuning
Payment Processing
Penetration Testing
Penetration testing automation
Performance Insights
Performance optimization
Persistent volumes troubleshooting
PgBouncer
Pinecone
Pinecone Vector DB
Pinecone vs Milvus
Platform Engineering
Pod CrashLoopBackOff
Pod Restart Troubleshooting
Pod Security Admission
Pod anti-affinity
Pod lifecycle
PodDisruptionBudget
Poison Pill
Policy Generation
Policy as Code
PostgreSQL EXPLAIN ANALYZE
PostgreSQL Performance
PostgreSQL Security
PostgreSQL VACUUM FULL
Postgres locking
Postgres vacuum
Prometheus Adapter
Prometheus cardinality explosion
Prompt Engineering Security
Prompt Injection
Prompt injection prevention
Promtail configuration
Protocol Buffers
ProvisionedThroughputExceededException
PyTorch Distributed Training
Python GIL
Python OpenAI SDK
Python asyncio error
Python concurrency
Python debugging
QEMU
QoS Prefetch
Quality Gate
Quantization Tutorial
Query execution plan
Query optimization
QueuePool
RAG
RAG Accuracy
RAG Optimization
RAG architecture
RBAC vs ABAC
RCE Vulnerability
RDS PostgreSQL high CPU
RESTful API Design
RFC 7636
RLS
RabbitMQ
Race Conditions
Rate Based Rules
Rate-based rules
Rc
React 18
React Context API performance
React Native FlatList
React Native rendering
React Profiler
React deployment
React hooks
React hydration
React state libraries
React state management
React.memo
ReadTimeoutException
Readiness Probes
Real-time Collaboration
Real-time Data Pipeline
Real-time architecture
Reciprocal Rank Fusion
Redis
Redis Broker
Redis Lua script
Redis Pub/Sub
Redis blocklist
Redis caching
Redis deduplication
Redis memory fragmentation
Redis performance
Redis rate limit
RedisVL
Redux Toolkit vs Zustand
Refactoring
Refresh Token Rotation
Refresh token
Replay Attacks
Resilience4j
Resource Server implementation
Resource allocation
Retention filters
Retrieval-Augmented Generation
RoleBinding
Row-Level Security
Rust
Rust async traits
Rust borrow checker
Rust debugging
Rust macros
Rust memory safety
Rust native binary
RxJS
S3 Block Public Access
S3 Intelligent-Tiering
S3 backend
S3 log storage
S3 static hosting
S3 storage classes
SAST vs DAST
SFTTrainer
SHOW ENGINE INNODB STATUS
SLSA
SOS debugging
SPA authentication
SPA deployment
SPA memory management
SPA performance
SQL
SQL IN clause
SQL Server performance
SQL optimization
SQL tuning
SQLAlchemy
SQS worker pattern
SRE best practices
SSRF Vulnerability
SSRF prevention
STS AssumeRole
SaaS Logging
SaaS Scaling
Scalable Architecture
Scaling
Schema Compatibility
Search engine architecture
Secrets Management
Security Automation
SecurityContext
Sentinel rules example
Serialization
Server-Side Request Forgery
Server-side rendering SSR
Serverless Optimization
Service Control Policies
Service Mesh
Service Mesh performance
Service-to-Service Encryption
Session Hijacking
Session management
Shift-Left Security
Sidecar resource
Sigstore Cosign
Sigstore container signing
Similarity search
Singleton scoped errors
Slow query optimization
Smart pointers Arc
Snowflake clustering
Snowflake cost optimization
Software Composition Analysis
Software Supply Chain Security
SonarQube
SonarScanner
Spark 3.5.0
Spark shuffle optimization
Spot Instances
Spring Boot Hibernate
Spring Boot Kubernetes
Spring Boot Memory Management
Spring Boot Microservices
Spring Boot Native Image
Spring Boot RBAC
Spring Boot connection pool
Spring Boot serverless optimization
Spring Cloud
Spring Cloud Gateway
Spring Data
Spring Data JPA
Spring Framework
Spring Native
Spring Security JWT
Spring Security OAuth2
State Transition
State management optimization
Static Analysis
Static membership
Storage backend
Streaming pipelines
Structs
Supply chain attacks
System Architecture
TTFB
Tail-based sampling
Task Parallel Library
Task dependencies
Tenant Isolation
Terraform Cloud setup
Terraform governance
Terraform mono-repo
Terraform refactoring
Terraform workspaces
Terragrunt
Thread contention
Thread pool exhaustion
ThreadPoolExecutor
Throttling Algorithms
Throttling fix
Time-series database
Token Bucket
Token bucket algorithm
Token revocation
Token rotation
Tokio
Traffic management
Traits implementation
Transaction Pooling
Transaction isolation
Transactional Outbox Pattern
Trivy CI pipeline
Two-Phase Commit
Unacked Messages
Unnecessary re-renders
V8
V8 Profiler
V8 engine
VPC Endpoints
VPC Peering vs Transit Gateway cost
Vault Tutorial
Vector Database Caching
Vector Database Optimization
Vector Databases
Vector search caching
Vector search scaling
Virtual warehouse sizing
Vite configuration guide
Vite vs Webpack
Vue
Vue 3 Composition API
Vue.js performance
Weaviate
Web Application Security
Web application vulnerabilities
Web security
WebSocket scaling
WebSockets
Webpack Module Federation
Webpack to Vite migration
Worker threads
Workflow Optimization
Workflow Triggers
Workflow management
Write sharding
YAML configuration
YAML optimization
Yjs
Zero Downtime
Zero Trust
Zero Trust Network
Zero Trust Security
Zero downtime deployment
Zero-downtime Migration
Zustand vs Redux
actions/cache
actions/cache example
angular best practices
api design
architecture
async-trait crate
asynchronous Lambda
autovacuum tuning
aws kms
backend-optimization
bare-metal k8s
bitsandbytes
blast radius
cache node_modules
code_challenge
code_verifier
compound index
container breakout prevention
database connection exhaustion
database indexing
database performance
database tuning
dependency array
deployment matrix
discovery.zen.minimum_master_nodes
dotnet-dump analysis
drain node WebSockets
dumpheap
duplicate SQS messages
eBPF security
encryption
enterprise CI/CD security
enterprise IaC
enterprise Kubernetes
enterprise backend architecture
enterprise compliance
enterprise serverless security
ephemeral runners
error-handling
esbuild performance
exactly-once processing
expressjs
fastify
frontend debugging
fuse-overlayfs
gRPC vs REST
gc_grace_seconds
gcroot
getItemLayout
graceful shutdown Kubernetes
high-throughput backend
hipaa compliance
hono
horizontal scaling
idempotent Lambda
ignoreDifferences
image optimization
image-processing
impl Future
incremental polling
inference throughput
infinite loop
infinite scroll
initialDelaySeconds
internal network security
iptables race condition
javax to jakarta
jemalloc
jstack analysis
k8s micro-segmentation
k8s zero downtime deployment
kNN Search Performance
kubectl debug
llama.cpp
lock contention
mTLS Microservices
macOS container performance
maximumPoolSize tuning
mem_fragmentation_ratio
modular Terraform
monolith migration
multi-cloud Terraform
multi-stage Dockerfile
multi-tenant k8s
nest_asyncio
network policies
nf_conntrack
ngOnDestroy
nid mapping
npm install optimization
onUnmounted lifecycle
optimize database queries
overlay2
passwordless CI/CD
paths-ignore
performance
pg_repack
pg_squeeze
pod memory limits
poly-repo
pprof profiling
preStop hook
preStop hook example
prefetch_related
reachability metadata
reduce AWS bill
reduce Lambda costs
reference equality
relabel_configs
remote state backend
reusable workflows
secure AWS deployment
secure AWS runners
secure egress traffic
secure state file
security
select_related
self-hosted Kubernetes
serverless architecture
serverless performance
serverless pricing
slirp4netns
socket.io redis adapter
speed up CI/CD
split state file
startupProbe
state lock
static IP Lambda
suppressHydrationWarning
takeUntil
terminationGracePeriodSeconds
terraform state mv
troubleshooting
unprivileged containers
unsubscribe
useEffect
useMemo
vLLM
vLLM Serving
vulnerability scanning
web development
web performance
window is not defined
worker-threads
workflow performance
workflow_call

Show more (+1115)

Show less