Senior Principal Engineer, API Hub
of building and shipping custom, customer-facing API-driven software. Strong technical expertise in OAuth 2.0 / OIDC, token...
of building and shipping custom, customer-facing API-driven software. Strong technical expertise in OAuth 2.0 / OIDC, token...
that analyze and compress token contexts before they reach the underlying model — delivering roughly 50% inference cost reduction...
in production - Own LLMOps for the toolchain: deployment, monitoring, cost management, latency optimization, token budget management...
sparse-vector indices, embedding-based semantic indices, and emerging semantic-ID indexing driven by next-token prediction...
governance, quality standards, and scalable AI delivery. Manage AI operational costs, including cloud consumption and LLM/token...
custom machine learning models that analyze and compress token contexts before they reach the underlying model, cutting...
manager callbacks, process/thread notification callbacks, load image callbacks, access token and impersonation APIs...
one Build and maintain the inventory capacity model that determines token caps at the market level, calibrated... a-la-carte vs. pack economics, guest checkout funnel conversion, and token-utilization patterns that predict renewal risk...
: student ratio and positive token motivation system - we make your job easy and fun. No busy work - we want...
Experience implementing inference request flows, including handling latency, token limits, and batching strategies Experience...