Selby JenningsChicago, IL, USA

Software Developer - Data Infrastructure | Chicago, IL, USA | In-Office

Description

About the Role We are partnered with a leading global technology‑driven trading firm built on engineering excellence, real time decision making, and a culture of constant improvement. Their teams solve complex, high stakes problems where their infrastructure must be both extraordinarily reliable and endlessly scalable. Engineers here work shoulder to shoulder with traders and researchers, owning systems end‑to‑end and shipping solutions that have immediate, measurable impact. If you want to build at the intersection of distributed systems, low latency technology, and high performance data infrastructure, this is the place. • They are hiring Software Developers to design and operate the core data infrastructure that powers their analytics and product systems. • You'll architect and own cross‑cutting data components by streaming pipelines, table formats, metadata/control planes, orchestration, and platform reliability. What You'll Do • Build and operate scalable streaming, ingestion, batch, and storage systems. • Define patterns for schema governance, table formats, replication, and data quality. • Lead migrations, backfills, and major data‑platform transformations. • Design metadata and lineage systems to improve discoverability and trust. • Develop resilient orchestration, CI/CD for data workloads, and generic backfill frameworks. • Establish SLAs, create runbooks, and improve operational reliability. • Contribute to platform architecture, documentation, and technical direction. What We're Looking For • Built or owned production-grade streaming/ingestion platforms. • Implemented schema governance and safe evolution workflows. • Designed cross-region replication or DR patterns. • Led migrations to modern table-format data lakes (Iceberg/Delta/Hudi). • Developed robust batch pipelines with idempotency, replay, and backfill support. • Built metadata/control-plane systems (catalogs, lineage, certification). • Operated large-scale orchestration systems with dependency management. • Delivered hybrid on-prem/cloud systems using infrastructure-as-code. • Provided architectural leadership, documentation, and mentorship.

Skills

SAFeCI/CD

Want AI to find more roles like this?

Upload your CV once. Get matched to relevant assignments automatically.

Try personalized matching