, e.g., writing Triton kernels, inserting quantize/dequantize nodes into prefill and decode paths, and ensuring per-expert...: Experience contributing to inference serving frameworks (vLLM, TRT-LLM, SGLang) or Triton kernel development Track record...
and OpenAI Triton. Designing user facing features in JAX and related libraries and other general software engineering work... but not required. Experience with the following technologies is a huge plus: XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models...
, Triton, etc.). Excellent C/C++ and Python programming and software design skills, including debugging, performance analysis...
in production (Ray Serve, vLLM, Ollama, TorchServe, Triton, etc.) Understanding of RAG (Retrieval-Augmented Generation...
in production (Ray Serve, vLLM, Ollama, TorchServe, Triton, etc.) Understanding of RAG (Retrieval-Augmented Generation...
learning model serving technologies (e.g. NVIDIA Triton, RayServe, etc.), multi-phase ranking infrastructure, and Elasticsearch...
Systems sector is seeking a Systems Engineer for the Triton program in Rancho Bernardo, San Diego CA at the Autonomous Design... to a wide range of difficult problems within the Core Systems Engineering team on the Triton Enterprise. This includes scope...
, Triton, etc.). Excellent C/C++ and Python programming and software design skills, including debugging, performance analysis...
in production (Ray Serve, vLLM, Ollama, TorchServe, Triton, etc.) Understanding of RAG (Retrieval-Augmented Generation...
in production (Ray Serve, vLLM, Ollama, TorchServe, Triton, etc.) Understanding of RAG (Retrieval-Augmented Generation...