capabilities with proficiency in tools such as Excel, VBA, Access, Python, R, and actuarial software (e.g., MG-Triton, MG-ALFA...
serving (Triton, TensorRT, vLLM), experiment tracking (W&B, MLflow), and CI/CD for ML Infrastructure as Code experience..., HarmBench), human behavior simulation Infrastructure: Kubernetes, Docker, Terraform, AWS/GCP, Ray, Spark MLOps: Triton...
) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton...
-specific tuning Exposure to ONNX Runtime, TensorRT, Triton, TVM, or similar systems Exposure to neural networks, tree-based...
) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton...
(e.g., vLLM, SGLang, Triton, or similar systems). - Implement and evaluate inference optimization techniques..., KV-cache optimization, batching). - Hands-on experience with inference/serving frameworks such as vLLM, SGLang, Triton...
, TorchServe, ONNX, or NVIDIA Triton. Integrate AI systems into engineering tools and environments (e.g., CAD/CAE software...
. Experience working with high-performance inference engines (e.g., vLLM, NVIDIA Triton, TorchServe) for efficient LLM serving...
, capabilities, and skills Foundational understanding of NVIDIA GPU infrastructure software (e.g., DCGM, BCM, Triton Inference...
with Ray, Kubernetes, Triton, TensorRT, Docker, W&B, or large-scale training and deployment infrastructure. · Background..., Isaac Lab, MuJoCo, OpenUSD, Omniverse, Open3D Systems: Python, Ray, FastAPI, Docker, Kubernetes, Triton, TensorRT...