, sandboxing technologies, and system-level security architecture. Proven understanding of LLM inference pipelines (Ollama, Llama...
on feature and performance enhancements of OSS software, including but not limited to projects like GGML, Llama.cpp, Ollama, vLLM...
Kernel) and model APIs (OpenAI, Anthropic, Bedrock, Ollama, Hugging Face). +2 year experience in building agentic AI systems...
learning or systems engineering.Hands-on experience deploying open-weight models using vLLM, TGI, or Ollama, and optimizing...
computing LLM inference engines such as llama.cpp, vLLM, Ollama, TensorRT-LLM or similar technologies Kubernetes...
-weight inference: Ollama, llama.cpp, or MLX, quantization tradeoffs, context and KV-cache sizing, and OpenAI-compatible shims...
(vLLM, Ollama, Hugging Face). Data exploration techniques and tools. Agile / Atlassian;advanced IDEs (Cursor, IntelliJ...
for specific domains and optimize them for edge device performance, including ONNX, GGML, or Ollama. Develop evaluation frameworks...
, LlamaIndex, Semantic Kernel) and model APIs (OpenAI, Anthropic, Bedrock, Ollama, Hugging Face). +2 year experience in building...
, Agno, or the NVIDIA NeMo Agent ToolkitExperience with model inference/serving platforms (NVIDIA NIM, vLLM, Ollama, LiteLLM...