, sandboxing technologies, and system-level security architecture. Proven understanding of LLM inference pipelines (Ollama, Llama...
, Ollama, or similar frameworks using vector databases for local LLMs and agentic AI systems. OR An associate degree... development in a team environment and one year working with LangChain, Ollama, or similar frameworks using vector databases...
Kernel) and model APIs (OpenAI, Anthropic, Bedrock, Ollama, Hugging Face). +2 year experience in building agentic AI systems...
learning or systems engineering.Hands-on experience deploying open-weight models using vLLM, TGI, or Ollama, and optimizing...
computing LLM inference engines such as llama.cpp, vLLM, Ollama, TensorRT-LLM or similar technologies Kubernetes...
-weight inference: Ollama, llama.cpp, or MLX, quantization tradeoffs, context and KV-cache sizing, and OpenAI-compatible shims...
(vLLM, Ollama, Hugging Face). Data exploration techniques and tools. Agile / Atlassian;advanced IDEs (Cursor, IntelliJ...
similarity search (ANN), and RAG pipelines. Experience with providers such as OpenAI, Anthropic, Hugging Face, and Ollama...
for specific domains and optimize them for edge device performance, including ONNX, GGML, or Ollama. Develop evaluation frameworks...
, LlamaIndex, Semantic Kernel) and model APIs (OpenAI, Anthropic, Bedrock, Ollama, Hugging Face). +2 year experience in building...