for DoD Agency spaces at multiple Government locations. You will provide all Agency SIPR token administration, CAC resets... of personnel, visit requests, etc. to inform the collection of robust performance metrics. Ensure personnel are completing...
a coherent narrative from partial signals. Investigate attacker tradecraft such as: Credential theft and replay (token theft... Workflow: Case management, runbooks/playbooks, SOAR tooling, structured reporting, and metrics The salary range is indicative...
to improve completion metrics. Set and enforce per-task token budgets and track cost per completed workflow to ensure...
summarization patterns, and semantic search configurations. FinOps & Compliance: Optimize token usage, manage cloud costs, ensure... stacks, and metrics achieved within your most recent project history. Avoid generic filler descriptions or company-level...
: safe auth flows, token handling guidance, secure storage, and protection against common web vulnerabilities. Collaborate... patterns (OIDC awareness a plus). Observability for the front end: client-side logging/metrics, error reporting, and debugging...
. Implements and governs authentication/authorization using OIDC/OAuth2, token validation, scopes/claims, and service-to-service... security patterns. Establishes robust observability practices (structured logging, metrics, tracing), incident response...
, experiment troubleshooting, latency, token usage, cost, and failure analysis. Production Support Incident triage, root-cause... latency, tool-call latency, token usage, error rate, trace ingestion health, cost trends, and failed user journeys. Incident...
, dashboards, prompt/version visibility, datasets support, experiment troubleshooting, latency, token usage, cost, and failure... and alerting for p50/p95 response latency, LLM latency, search latency, tool-call latency, token usage, error rate, trace ingestion...
: ReAct Self-Reflection Hierarchical Delegation Strong understanding of: Token Utilization Cost Optimization State Management... AI Tracing LLM Performance Metrics For applications and inquiries, contact: [email protected]...
. Design and maintain LLM evaluation harnesses — golden sets, regression suites, and online quality metrics. Engineer high... harnesses — golden sets, regression suites, and quality/cost metrics. Client-facing skills: Demonstrated ability to engage...