Massachusetts Jobs

MassHire JobQuest Logo

Job Information

Microsoft Corporation Principal Technical Program Manager, AI HW Architecture in Cambridge, Massachusetts

The Cloud Accelerated Systems and Technologies team is building the next generation AI hardware and systems for large scale datacenter deployments. Our team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. We are a cross-discipline team of highly capable and motivated people with a collaborative and inclusive culture.

We are seeking a Principal Technical Program Manager to help shape and execute the next generation of AI hardware innovations that will power Azure Deep Learning services. We are looking for someone who is motivated and able to motivate others, proactive with a demonstrated history of problem solving and persistent in the face of challenges. An entrepreneurial approach and ability to take initiative and operate autonomously are essential.

In this role you will be responsible for the AI hardware and architectural roadmaps, taking new innovations into systems, driving planning, program approval, execution, and cross-company alignment. You will work with silicon and hardware system solutions, software toolchain, new data science, on-line services, and AI models, ensuring that the hardware roadmap and associated toolchain delivers leading capabilities to Azure cloud.



  • Drive technical projects and deliverables from early technology development through NPI, including managing complex project schedules, aligning executives and technical experts on program direction, managing team and project through business and technical challenges, ambiguity and competing priorities.

  • Work with hardware architects, engineering, and business teams to develop and drive end-to-end program development.

  • Partner closely with cross-functional teams to define, prioritize, and implement features, infrastructure, processes, and workflows.

  • Create and operationalize processes to transform the effectiveness of the organizationwith respect to meeting business goals.

  • Responsible for effective communication and escalation of risks and dependencies while ensuring timely decisions are being made.

  • Scopes technical and business problems and processes by identifying key issues, inputs, stakeholders, and outcomes.

  • Executive engagement, communication, and stakeholder management - highlighting risks across functional teams and providing recommendations to support product level decisions.

  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate.



  • B.S. or higher preferably in Electrical Engineering, Computer Science, or related fields OR equivalent work experience in lieu of education.

  • 10+ years of hardware/system engineering and/or technical product/program management experience.

  • 7+ years of experience driving program strategy and direction and leading end-to-end program execution.

  • 5+ years of experience driving exec-level communication and stakeholder management.

  • Familiarity with hardware products/ technologies relevant to datacenter/cloud infrastructure.

  • Experience in program management fundamentals including presentation skills and written communication; ability to build relationships and influence in a matrix organization; manager cross team deliverables including program costs, schedules, risks and issues mitigation.


  • Experience with program management across complex systems with teams driving silicon, HW systems & SW ecosystem setup within technical contexts.

  • Exposure to deep learning concepts and AI/ML toolchains.

  • Experience with distributed ML (Data and Model Parallelism).

  • Ability to handle high ambiguity, drive clarity, and identify/prioritize issues and opportunities.

  • Knowledge of data center infrastructure, server technology and associated commodities.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form ( .

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.