layiq
worthy; deserving; fitting; suitable.
A role, opportunity, or path that merits attention, time, and pursuit.
Loading LAYIQ…Job opportunity
Amazon
Seattle, WA
Source: Amazon careers · View original posting
From Amazon's posting. “We” and “our” refer to the employer.
Amazon is seeking a Senior Product Manager – Technical to own the vision and roadmap for MARS (Model Accelerator and Recommender Service), our hardware-agnostic platform for optimizing, benchmarking, and containerizing large language models across heterogeneous compute (Inferentia2, Trainium, and GPU).
MARS automatically tunes and recommends optimal hosting configurations, delivering substantial inference cost reduction, throughput gains, and accelerator-utilization improvements for teams across the organization—from model hosting and catalog enrichment to search ranking.
In this role, you will work backwards from internal customers to define a multi-year product strategy that scales MARS into a shared, self-service optimization platform. You will partner closely with science and engineering to expand the platform's capabilities—new hardware backends, quantization and distillation techniques, and automated benchmarking—while establishing the operating model, intake, and prioritization framework needed to grow adoption.
You will own key business metrics such as cost per million tokens, accelerator utilization, and realized IMR savings, and communicate progress and trade-offs to senior leadership.
The ideal candidate is a technical product leader who thrives at the intersection of ML infrastructure, cost optimization, and cross-org influence, and who can turn ambiguous, high-leverage problems into measurable outcomes.
Key job responsibilities
As a Senior Product Manager – Technical for MARS (Model Accelerator and Recommender Service), you will own the product vision, strategy, and roadmap for Amazon's hardware-agnostic model optimization and benchmarking platform. MARS automatically optimizes, containerizes, and recommends optimal hosting configurations for LLMs across heterogeneous compute (Inferentia2, Trainium, and GPU), driving significant inference cost reduction and throughput gains for teams across the organization.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.
Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually
LAYIQ is an independent job-discovery service. This listing does not imply a partnership with or endorsement by the employer. Review the original posting for current details and availability.
Employer posted: