-Augmented Generation (RAG), Azure AI Foundry, Copilot technologies, Ollama, vLLM, and modern LLM orchestration frameworks...
with using inference serving engines (e.g. vLLM, Ollama) is a plus Experience with AI clusters using job schedulers (e.g., PBS...
). Knowledge of AI infrastructure tools and frameworks (LiteLLM, Bifrost, Ray, Ollama). Knowledge of service mesh technologies...
-Augmented Generation (RAG), Azure AI Foundry, Copilot technologies, Ollama, vLLM, and modern LLM orchestration frameworks...
). Knowledge of AI infrastructure tools and frameworks (LiteLLM, Bifrost, Ray, Ollama). Knowledge of service mesh technologies...
, including locally hosted models, inference servers, or platforms such as Ollama and Open WebUI. Preferred: Experience...
, Gemma, Qwen).Proven expertise with self-hosted local serving frameworks such as vLLM, Ollama, TensorRT-LLM, or Triton.Strong...
technologies, and system-level security architecture. Proven understanding of LLM inference pipelines (Ollama, Llama.cpp, vLLM...
of the public. Strong time management skills and the ability to manage tasks independently. Experience with Ollama...
and OpenAI, and experience configuring tools like Obsidian and Ollama is a plus for supporting other workflows. Working...