synchronous and asynchronous web services. Develop real-time online inferencing for highly complex models using Triton, TensorRT... or equivalent experience in ML. Experience working with ML technologies (PyTorch, Sagemaker, Triton, TensorRT, etc.). Experience...
models. Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services. Skilled in Unix/Shell...
models. Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services. Skilled in Unix/Shell...
(Triton, TensorRT, VLLM, TGI, etc.). Familiarity with MLOps practices for CI/CD, continuous training, observability...
/Triton). Prior contributions to major LLM inference frameworks (e.g. vLLM) or prior experience with graph compilers in deep...
and optimizations using TensorRT LLM, VLLM, SGLang, Triton and CUDA kernels. Work and collaborate with a diverse set of teams involving.../OSS LLM frameworks, inference benchmarking frameworks, TensorRT, and Triton. Work with cross-collaborative teams...
). Familiarity with serving models using Triton Inference Server and PyTriton via Docker. Ways to stand out from the crowd...
) on large GPU clusters. Expertise in kernel development (CUTLASS, cuteDSL, tilelang, OpenAI Triton) or compiler/runtime paths...
Certification. Hands-on experience with NVIDIA GPUs and SDKs (e.g. CUDA, RAPIDS, Triton etc.) System-level experience...
with relevant libraries, compilers, and languages - CUDNN, CUBLAS, CUTLASS, MLIR, Triton, CUDA, OpenCL Experience with the...