Golang Data Engineer

Golang Data Engineer #2613 Position Summary:

Our partner is a quantitative trading organization where live market data, low-latency systems, and proprietary models directly drive capital allocation decisions. As the platform continues to scale, the team is adding a senior engineer to own the real-time streaming ingestion systems that power live trading. You’ll build production-grade Go services that consume live WebSocket feeds, process and time-slice high-throughput market data, and deliver reliable inputs to a C-based trading engine running on AWS. The focus is demanding and meaningful: streaming reliability, automated failover, observability, and production debugging in a latency-sensitive environment where performance and correctness directly impact outcomes. If you enjoy building systems where milliseconds matter and your work influences real capital in motion, this is engineering at its sharpest.

Experience and Education:

BS in Computer Science, Computer Engineering, Software Engineering or equivalent hands-on experience/field Hands-on experience building production-grade distributed system for real-time or streaming environments Strong production experience developing backend or systems services in Go Experience implementing WebSocket-based live data ingestion Experience deploying and operating services on AWS, specifically EC2 and S3 Experience building and deploying containerized services, ideally in Kubernetes environments Experience supporting low-latency, high-availability systems where downtime or delay had direct business impact

Skills and Strengths:

Go Real-time streaming systems WebSockets Low-latency architecture Production service development AWS EC2 AWS S3 Kubernetes Containerization Monitoring Observability Prometheus High-throughput data processing Failover design Distributed systems Debugging live production systems Time-series data handling Data pipeline development Concurrency patterns Systems reliability engineering

Primary Job Responsibilities:

Rebuild and own the production-grade, real-time market data ingestion system end-to-end Develop high-performance Go services that consume live market data over WebSockets Process and manage high-throughput streaming data across approximately 1,500 equities Aggregate and time-slice streaming data for accurate downstream model consumption Deliver structured, low-latency data feeds to a C-based trading engine running on AWS EC2 Design and implement automatic failover from live market feeds to delayed backup streams Ensure data integrity and correctness during feed transitions and recovery scenarios Maintain and validate the historical data ingestion pipeline sourcing from AWS S3 Instrument services with monitoring and observability to detect latency spikes, data gaps, and system degradation Debug and resolve live production streaming failures with minimal business disruption Optimize ingestion services for latency, throughput, and fault tolerance Deploy and operate containerized services within cloud-native environments Collaborate directly with technical leadership on architectural decisions and performance tradeoffs Operate independently without daily direction, taking full ownership of reliability and delivery Continuously improve system resilience to support live trading without manual intervention