Systems & Data Infrastructure Engineer

Functional Focus: Data Engineering, Real-Time Streaming, and HPC Job Orchestration

• Scientific Data Architecture: Design crash-safe, binary data formats capable of handling high-speed incremental writes from compute jobs and concurrent reads for query-time calculations.
• Operational Data Modeling: Design and maintain a relational database schema via an async ORM, backend-agnostic across database engines.
• HPC Workload Management: Manage the lifecycle of batch and interactivecompute jobs, handling subprocess monitoring, status polling, and cluster filesystem coherency.
• Real-Time API & Streaming: Build async backend services and long-lived, server-pushed event channels with backpressure handling, and enforce role-based access control on all APIs.
• AI Service Integration: Integrate and orchestrate calls to an AI/analytics service from the backend, coordinating with application state.