Senior LLMOps Engineer
such as HuggingFace Transformers, vLLM, TensorRT-LLM, or similar. Proficiency in Python and operational tooling such as FastAPI...
such as HuggingFace Transformers, vLLM, TensorRT-LLM, or similar. Proficiency in Python and operational tooling such as FastAPI...
with generative AI, including hands-on work with LLMs and frameworks like LangChain, LlamaIndex, or the HuggingFace ecosystem...
orchestration. Model Lifecycle Management: Oversee the complete HuggingFace model lifecycle, including model onboarding... with modern inference frameworks, specifically vLLM and TensorRT-LLM. Proven track record managing the HuggingFace deployment...
, RoBERTa, LLaMA). Expertise in natural language processing (NLP) and sequence-to-sequence models. Familiarity with Hugging... Face libraries and OpenAI APIs. Experience with MLOps tools like Docker, Kubernetes, and CI/CD pipelines. Strong...
;AWS Gateway API;AWS SDK and AWS CDK;LLM APIs including OpenAI, Azure OpenAI, and HuggingFace;Prompt engineering...
frameworks - TensorFlow, PyTorch, Scikit-learn, HuggingFace, LangChain or equivalent ⦁ Experience in AWS core services...
, HuggingFace Transformers, LangChain, LlamaIndex, or similar. Demonstrated ability to design and develop production-grade...
AI/ML: OpenAI API, Anthropic API, AWS Bedrock, LangChain, HuggingFace Safety: Content moderation APIs, custom guardrail...
with ML frameworks (scikit-learn, XGBoost, LightGBM, HuggingFace) - Thorough understanding of model evaluation metrics...
and execute a comprehensive alliance strategy across hyperscalers (AWS, Azure, GCP), AI platforms (Anthropic, OpenAI, HuggingFace...