Writing
Architecture notes and technical deep dives on data systems, performance, machine learning, and developer tools.
-
Jobman: A Practical Job Manager for Research Computing
A practical guide to running reliable research pipelines with Jobman using dependencies, retries, timeouts, concurrency limits, durable logs, and notifications.
-
Inside Jobman, Part 2: Transferring Job Ownership to a Detached Supervisor
How Jobman durably transfers a submitted job to a detached supervisor and resolves failures during the handoff.
-
Inside Jobman, Part 1: Reliable Background Jobs Without a Daemon
A technical introduction to Jobman's architecture through a real workflow with dependencies, retries, durable state, and logs.