Senior AI Evaluation Scientist
such as PyTorch, HuggingFace, LangChain, scikit-learn, and evaluation tooling (LLM-as-a-judge, rubric-based evaluators, or custom...
such as PyTorch, HuggingFace, LangChain, scikit-learn, and evaluation tooling (LLM-as-a-judge, rubric-based evaluators, or custom...
embeddings, and orchestration frameworks (e.g., LangChain, LlamaIndex, Ray, or HuggingFace). Experience with AI compliance...
· Experience with additional AI frameworks and tools (e.g., HuggingFace, OpenAI API, Anthropic Claude API) · Knowledge of vector...
with deep learning frameworks (PyTorch, TensorFlow) and NLP/Speech-focused libraries (e.g., HuggingFace Transformers...
Fine-tune or prompt-tune foundation models (OpenAI, HuggingFace, LLaMA, Mistral, Claude, etc.) for domain-specific tasks...
frameworks (OpenAI, HuggingFace, Instructor, etc.). Diagnose and iterate on challenges like chunk size trade-offs, retrieval...
, AutoGen, OpenAI APIs, TensorFlow/PyTorch, LangChain, HuggingFace). Demonstrable experience or deep theoretical understanding...
GenAI frameworks (e.g., LangChain, HuggingFace) and agentic design patterns to enhance model capabilities and reliability...;familiar with frameworks such as LangChain and HuggingFace. Strong understanding of GenAI evaluation methodologies...
and understanding Experience in NLP/ML platforms such as Tensorflow/Keras, PyTorch, AWS, HuggingFace, etc. Proficiency with rapid...
visualization. Familiarity with generative AI tools (e.g., OpenAI, HuggingFace, or Google Vertex AI) for automating insights...