: Experience developing, debugging, and integrating enterprise APIs (REST, gRPC, WebSockets) and API gateways (e.g., Envoy, Kong...
(Envoy or equivalent), including streaming responses. Experience with cost management / FinOps tooling (OpenCost, Kubecost...
gateways and request routing (Envoy or equivalent), including streaming responses. Experience with cost management / FinOps...
for hosted, NVIDIA OpenShell/vNode for on-prem) for isolated, safe model execution. Own cognitive and routing: Envoy AI Gateway...
Platform team builds and operates core compute orchestration infrastructure based on CNCF technologies including Istio, Envoy... infrastructure that directs application traffic to Kubernetes backends at scale Build capabilities on top of Envoy-based reverse...
Gateway solutions (e.g., Kong, Azure APIM, Envoy, or equivalent) to route, manage, and secure AI services and microservices... with API Gateway solutions (such as Kong, Azure APIM, Envoy, or equivalent) 2+ years demonstrated experience building...
gaps. Possess deep hands-on proficiency with Go-based services, production Kubernetes (including Envoy and GPU-aware...
gaps. Possess deep hands-on proficiency with Go-based services, production Kubernetes (including Envoy and GPU-aware...
and reliability. Design, build, and operate EKS clusters with technologies such as Karpenter, Cilium, Istio/Envoy, and IRSA/Pod... deployment patterns. Experience with service mesh (Istio / Envoy), Cilium, and API gateways (Envoy Gateway, Kong...
and reliability. Design, build, and operate EKS clusters with technologies such as Karpenter, Cilium, Istio/Envoy, and IRSA/Pod... deployment patterns. Experience with service mesh (Istio / Envoy), Cilium, and API gateways (Envoy Gateway, Kong...