Principal Technical Program Manager

Overview

The Azure HPC & AI Infrastructure team defines and delivers the systems that power some of the world’s largest AI training and inference workloads. As Microsoft continues to expand the scale and sophistication of its AI infrastructure, networking is a key defining technology determining system performance, reliability, efficiency, and speed of deployment.

We are seeking a Principal Technical Lead for AI Infrastructure Networking to provide technical leadership for the networking architectures that connect GPU and accelerated computing infrastructure. This role will help deliver the next generation of networking capabilities behind Microsoft’s AI infrastructure, spanning technologies including InfiniBand, RDMA, high-performance Ethernet, network interface devices, switches, optics, and emerging AI interconnect architectures.

This is a highly cross-functional technical leadership role operating at the intersection of AI systems architecture, networking, GPU platforms, datacenter infrastructure, software, operations, and silicon and networking suppliers. The successful candidate will define technical strategy, shape architecture and roadmap decisions, and drive complex infrastructure programs from early technology evaluation through qualification, deployment, and operation at hyperscale.

The role requires both deep technical expertise and the ability to operate effectively in highly ambiguous environments where technology, business requirements, and customer demand are evolving rapidly. You will work with senior engineering and product leaders across Microsoft as well as strategic technology partners to make decisions that influence the performance, reliability, scalability, and economics of Microsoft’s AI infrastructure.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure. Use fleet telemetry, performance analysis, customer signals, and operational incidents to identify systemic improvements and influence future architecture and product investments.
• Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
• Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
• Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
• Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
• Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
• Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
• Lead complex infrastructure initiatives from early technology exploration and proof of concept through architecture definition, engineering qualification, production readiness, fleet deployment, and lifecycle improvement.
• Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.
• Identify architectural, execution, and operational risks early and drive cross-organizational resolution of issues that can affect infrastructure readiness, capacity delivery, workload performance, or customer commitments.

Qualifications

• Required Qualifications: Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development
• OR equivalent experience.
• 3+ years of experience managing cross-functional and/or cross-team projects.
• Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
• These requirements include, but are not limited to the following specialized security screenings:
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Bachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development
• OR equivalent experience.
• 8+ years of experience managing cross-functional and/or cross-team projects.
• 1+ year(s) of experience reading and/or writing code (e.g., sample documentation, product demos).
• 1+ year(s) experience designing, developing, deploying, or operating large-scale datacenter, cloud, HPC, accelerated computing, or AI infrastructure.
• 1+ year(s) deep technical experience with high-performance networking technologies such as InfiniBand, Ethernet, RDMA/RoCE, network interface devices, switches, routing and switching architectures, congestion management, optics, or high-speed interconnects.
• 1+ year(s) experience evaluating complex system architectures and translating workload requirements into technical requirements, architecture decisions, and executable engineering plans.
• 1+ year(s) experience influencing technical decisions without relying solely on direct organizational authority, including the ability to build alignment among engineering, architecture, operations, product, and business stakeholders.
• #azurecorejobs

Technical Program Management IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.