What I'm up to now.

A September update from Navi Mumbai.

Updated

Starting at Morningstar

I've joined Morningstar as a Senior Software Engineer on the Index Technology team. After five years at Intensel, I'm getting to know a new team and a new set of systems.

Recent experiments

I've been testing PostgreSQL performance and working with large datasets in Python. The results left me with a few things to think about.

  • When does adding more processes help, and when does it just move the bottleneck?
  • How much memory does a program need before it can do anything useful?
  • What happens to search latency when a vector index grows from 10 million records to 100 million?

I've written about the results in the notebook or find the code in the workshop.

Working on this site

I'm changing this site to feel more personal. Dark backgrounds, my writing, and a few things to play with.

The homepage drawing generates a new set of lines each time you change it. If you like one, you can download it as an SVG.

Back to the drawing ↗