, and efficient serving techniques (vLLM, TensorRT-LLM, Triton) - Help Go-To-Market Specialist define and drive strategy on assets... frameworks (vLLM, llm-d, Triton, SGlang, etc), and optimization techniques (quantization, speculative decoding, KV-cache...
high-performance inference engines such as vLLM, NVIDIA Triton, or TorchServe, and working with cloud-native deployment...
with modern inference platforms and frameworks (vLLM, TensorRT-LLM, SGLang, Triton Inference Server) and the architectural trade...
Triton, or TorchServe, and working with cloud-native deployment, Docker, Kubernetes, MLOps pipelines, and major cloud...
with LLM inference engines and serving frameworks (e.g., SGLang, vLLM, Triton, TensorRT-LLM) Deep low-level systems...
Experience with audio or podcast programmatic preferred (AudioMax, Adrise, Megaphone, Triton) Proficient in Excel, Salesforce...
using CUDA, Triton, and related tools - Explore AI-driven infrastructure for inference systems, including AI Agents...-level optimization using CUDA, Triton, Cutlass, or related tools - Experience with LLM inference optimization, such as PTQ...
using CUDA, Triton, and related tools - Explore AI-driven infrastructure for inference systems, including AI Agents...-level optimization using CUDA, Triton, Cutlass, or related tools - Experience with LLM inference optimization, such as PTQ...
(e.g. Triton, kserve, etc.) Experience with production ML and High Performance Compute development systems Strong problem...
servers such as vLLM, Triton. Experience with low-level GPU kernel development and writing custom kernels (e.g., CUDA, ROCm...