AI Systems Engineer - DevOps& Observability - Senior
RemoteSan Diego · RemoteLast seen today
Summary
Senior AI Systems Engineer responsible for designing and operating CI/CD/CV pipelines, MLOps infrastructure, and observability stacks for production AI workloads at scale. Must build governance frameworks for AI assets (model registries, experiment tracking, CVE scanning), implement cost attribution and FinOps controls (OpenCost/Kubecost), and own the full observability layer (metrics, logs, traces, OpenTelemetry). Requires 8+ years of hands-on DevOps/MLOps/platform engineering with production experience operating inference systems (Ray Serve, vLLM, Triton, NIM) on GPUs, GitOps tooling, and observability platforms, with ability to bridge engineering, architecture, and leadership on runtime and cost tradeoffs.
Data ScienceDevOps / InfrastructureAIApache KafkaApptioArgocdArtifactoryAutomated RollbackCI CDCost AttributionCve ScanningDcgmDockerEnvoyFinopsGitHub ActionsGitLab CIGitopsGpuGrafanaHarborHelmHugging FaceInference OptimizationJaegerKubecostKubernetesLangfuseLangsmithLokiMlflowMlopsMulti Tenant ArchitectureNexusNvidia NimObservabilityOpencostOpenlineageOpentelemetryProgressive DeploymentPrometheusRay ServeSbomTempoTritonTrivyVllm