PgBouncer: From 45K to 210K Queries per Second
A benchmark-driven look at how one PgBouncer process became a CPU bottleneck, how multiple processes scaled it, and where the next limit appeared.
man karan
Name
karanbackend engineer
Backend engineer with 5+ years building production Python services, distributed geospatial data platforms, and high-performance APIs on AWS.
Navi Mumbai, India 🇮🇳
Synopsis
karan --build backend-systems --with python,postgres,aws --optimize-for scale,reliability
Links
Description
I build Python backend systems for geospatial data, climate risk analytics, distributed processing, and high-performance APIs.
From March 2021 to May 2026, I worked at Intensel Ltd as a Software Engineer focused on backend and data infrastructure. I owned architecture, delivery, distributed processing, and production support for a climate risk platform used by enterprise customers across 10+ countries.
Feel free to reach out and say hi on X or LinkedIn. I'm always happy to connect, collaborate, and share knowledge.
Selected impact
2.3B+building records- Designed ingestion and query systems across 1.8 TB of PostGIS data.
50K+jobs/day- Operated AWS SQS and Dask workflows with scheduling, retries, worker orchestration, and failure recovery.
- Minutes → single-digit milliseconds
- Reduced critical query latency through PostGIS indexing and query optimization.
p99under 200ms- Built FastAPI and Django APIs with caching strategies for production load.
- Half-hourly NASA precipitation data
- Built a near-real-time pipeline for GPM IMERG GeoTIFFs with a 10-minute availability buffer and Amazon S3 delivery for risk monitoring and alerts.
60%faster deployments- Built Docker-based CI/CD and deployed services to Kubernetes on Amazon EKS with CloudWatch observability.
Writing
Experience
Software Engineer (Backend & Data Infrastructure) — Intensel Ltd
Owned backend architecture and data infrastructure for a climate risk platform serving enterprise customers across 10+ countries. Took changes from ambiguous requirements through technical design, automated testing, deployment, and production support; reviewed code, mentored engineers, and investigated incidents across APIs, workers, queues, databases, and deployments.
Skills
Backend / APIs, validation & testing
Django FastAPI Axum REST APIs Validation Automated testing
Languages / Application & data systems
Python SQL Rust
AI & analytics / Natural-language data access
LLM agents Natural-language queries Geospatial analytics
Engineering / Delivery & production support
System design Code review Mentoring Production debugging Monitoring
Data & processing / Databases, queues & workers
PostgreSQL PostGIS Redis DuckDB AWS SQS Dask
Cloud & infrastructure / Deployment & operations
AWS Docker Kubernetes Amazon EKS EC2 S3 RDS Linux CI/CD CloudWatch
Projects
Climate Risk Platform
Owned backend architecture and delivery for an enterprise climate risk platform serving customers across 10+ countries, from requirements and technical design through rollout and production support.
NASA GPM IMERG Precipitation Pipeline
Built and operated near-real-time ingestion of half-hourly precipitation GeoTIFFs with a 10-minute availability buffer and Amazon S3 storage for insurance and financial-services risk monitoring and alerts.
Natural-Language Geospatial Analytics
Built an LLM-powered agent that converted natural-language requests into structured geospatial and analytics queries, using DuckDB for vector-data analysis and integrating with backend APIs and PostgreSQL/PostGIS.
Global Building Footprints
Built ingestion, validation, indexing, and query workflows for 2.3B+ building records across 1.8 TB of PostGIS data, balancing batch throughput with low-latency access.
Map Tile Service
Designed authenticated backend delivery for 5.3 TB of geospatial raster data, with tuned storage access, caching, logging, and monitoring for reliable production delivery.
RediServe
Built an asynchronous HTTP API for Redis in Rust with Axum and Tokio, using connection pooling and explicit backend resource management.
Education
Bachelor of Computer ScienceUniversity of Mumbai · 2020
See also
Open to high-impact collaborations, consulting, and OSS. Drop me a line at karan@jadhav.dev.