Software / Platform / Data Engineer – Agent Trace Collection

Job Description

Turing is hiring an experienced Software / Platform / Data Engineer to build an end-to-end system for capturing and processing GitHub Copilot CLI agent traces across developer machines.

You’ll own the technical pipeline from endpoint trace capture through Azure ingestion, privacy filtering, sanitized storage, and a read-only trace viewer.

This role is suited to an experienced engineer who can take a written technical design and independently turn it into a production-ready system while treating data privacy and security as core requirements.

What You’ll Do

• Build the OpenTelemetry capture pipeline for developer endpoints.
• Configure OTLP exports and collector pipelines involving receivers, processors, and exporters.
• Develop centralized ingestion infrastructure in Azure.
• Implement privacy filtering to detect and redact sensitive or personally identifiable information before data reaches reviewers.
• Configure sanitized data stores for processed trace information.
• Build or configure a read-only trace viewer.
• Implement task, session, and trace correlation.
• Maintain appropriate cloud security, access controls, and auditing throughout the pipeline.

Requirements

• Bachelor’s degree in Computer Science, Engineering, a related field, or equivalent practical experience.
• 5+ years of experience in software, platform, or data engineering.
• 3+ years of hands-on Azure experience, or comparable major-cloud experience that transfers to Azure PaaS.
• 2+ years building observability or telemetry pipelines.
• Direct experience with OpenTelemetry, including OTLP, collectors, spans/traces, and semantic conventions.
• Experience with Azure PaaS technologies such as Container Apps/AKS, API Management, ADX/Kusto or Application Insights, ADLS Gen2/Blob, Key Vault, and Entra ID.
• Strong proficiency in Python or Node.js.
• Bash scripting experience.
• Practical experience with data privacy, PII detection, secret detection, redaction, or tokenization.
• Understanding of data pipelines and cloud-security fundamentals, including RBAC, private networking, and auditing.

Nice to Have

• Grafana or other telemetry-backend experience.
• LLM-agent or generative AI observability experience.
• Cross-cloud identity federation experience, particularly Azure AD/Entra ID and GCP IAM.

Evaluation Process

Candidates complete one approximately 30-minute interview covering technical and cultural topics.

Contract & Compensation

This is a fully remote contractor assignment paying $100 per hour.

The engagement is expected to last 3 months, with a minimum commitment of 20 hours per week and at least 4 hours per day. Candidates must also provide 4 hours of PST overlap.

The expected project start date is next week.