PgBouncer: From 45K to 210K Queries per Second
A benchmark-driven look at how one PgBouncer process became a CPU bottleneck, how multiple processes scaled it, and where the next limit appeared.
hey, I'm Karan Jadhav 👋
Backend engineer with 5+ years building production Python services, distributed geospatial data platforms, and high-performance APIs on AWS.
Navi Mumbai, India 🇮🇳
I build Python backend systems for geospatial data, climate risk analytics, distributed processing, and high-performance APIs.
From March 2021 to May 2026, I worked at Intensel Ltd as a Software Engineer focused on backend and data infrastructure. I owned architecture, delivery, distributed processing, and production support for a climate risk platform used by enterprise customers across 10+ countries.
Feel free to reach out and say hi on X or LinkedIn . I'm always happy to connect, collaborate, and share knowledge.
Selected impact
2.3B+ building records
Designed ingestion and query systems across 1.8 TB of PostGIS data.
50K+ jobs/day
Operated AWS SQS and Dask workflows with scheduling, retries, worker orchestration, and failure recovery.
Minutes to single-digit milliseconds
Reduced critical query latency through PostGIS indexing and query optimization.
p99 under 200ms
Built FastAPI and Django APIs with caching strategies for production load.
Half-hourly NASA precipitation data
Built a near-real-time pipeline for GPM IMERG GeoTIFFs with a 10-minute availability buffer and Amazon S3 delivery for risk monitoring and alerts.
60% faster deployments
Built Docker-based CI/CD and deployed services to Kubernetes on Amazon EKS with CloudWatch observability.
Latest writing
View all postsExperience
Software Engineer (Backend & Data Infrastructure) at Intensel Ltd
March 2021 - May 2026 · 5+ years
Owned backend architecture and data infrastructure for a climate risk platform serving enterprise customers across 10+ countries. Took changes from ambiguous requirements through technical design, automated testing, deployment, and production support; reviewed code, mentored engineers, and investigated incidents across APIs, workers, queues, databases, and deployments.
Skills
Core Expertise= primary skills across sectionsAlso work with= other skills I use regularly
Backend Core
APIs, validation & testing
DjangoFastAPIAxumREST APIsValidationAutomated testing
Languages
Application & data systems
PythonSQLRust
AI & Analytics
Natural-language data access
LLM agentsNatural-language queriesGeospatial analytics
Engineering
Delivery & production support
System designCode reviewMentoringProduction debuggingMonitoring
Data & Processing
Databases, queues & workers
PostgreSQLPostGISRedisDuckDBAWS SQSDask
Cloud & Infrastructure
Deployment & operations
AWSDockerKubernetesAmazon EKSEC2S3RDSLinuxCI/CDCloudWatch
Projects
Climate Risk Platform
Owned backend architecture and delivery for an enterprise climate risk platform serving customers across 10+ countries, from requirements and technical design through rollout and production support.
NASA GPM IMERG Precipitation Pipeline
Built and operated near-real-time ingestion of half-hourly precipitation GeoTIFFs with a 10-minute availability buffer and Amazon S3 storage for insurance and financial-services risk monitoring and alerts.
Natural-Language Geospatial Analytics
Built an LLM-powered agent that converted natural-language requests into structured geospatial and analytics queries, using DuckDB for vector-data analysis and integrating with backend APIs and PostgreSQL/PostGIS.
Global Building Footprints
Built ingestion, validation, indexing, and query workflows for 2.3B+ building records across 1.8 TB of PostGIS data, balancing batch throughput with low-latency access.
Map Tile Service
Designed authenticated backend delivery for 5.3 TB of geospatial raster data, with tuned storage access, caching, logging, and monitoring for reliable production delivery.
RediServe
Built an asynchronous HTTP API for Redis in Rust with Axum and Tokio, using connection pooling and explicit backend resource management.
Education
Bachelor of Computer Science
University of Mumbai · 2020
Open to high-impact collaborations, consulting, and OSS, drop me a line karan@jadhav.dev