, Dagger, Spring. Infra & tooling: Linux, FreeBSD, illumos/Triton, containers, PostgreSQL, MQTT/HiveMQ, Grafana, Prometheus...
-serving systems such as vLLM, Triton, TGI, SageMaker, Vertex AI, or custom inference services to improve batching, concurrency... of smaller models where appropriate. Experience working with model-serving systems such as vLLM, Triton, TGI, SageMaker, Vertex...
regression gates. About you Deep GPU systems experience, with kernel-level CUDA / Triton work and comfort with CUTLASS...
, with kernel-level CUDA / Triton work and comfort with CUTLASS, Flash Attention, Pytorch and Nsight profiling. Production...
, Keenfinity operates as an independent company within the portfolio of European investment firm Triton. The Group comprises four...