Vice President, AI Infrastructure Support Engineer
Sign up free to see how well your resume matches this role.
What you'll do
- Provide operational support and issue resolution for AI infrastructure and platform services.
- Manage AI deployments and monitor workloads on distributed systems using Kubernetes and Docker.
- Develop and maintain scripts and automation using Python and Shell scripting.
- Extensively use infrastructure ticketing systems such as JIRA and ServiceNow.
- Collaborate with cross-functional teams and be well versed in DevOps practices including CI/CD (GitLab), containerization (Docker), and secure access control (Azure AD).
- Assist with documenting infrastructure processes, runbooks, and architectural components.
- Troubleshoot networking and storage-related issues across AI workloads.
- Participate in periodic on-call rotations, including occasional weekend coverage.
What they're looking for
- Bachelor's degree in computer science or a related discipline or equivalent work experience required. 6 - 8 years of application or infrastructure related experience required; experience in the securities or financial services industry is a plus
- 4+ years of experience in infrastructure engineering, DevOps, or site reliability roles.
- Hands-on experience with Kubernetes, Docker, HELM, and GitLab CI/CD.
- Proficiency in Python and Bash/Shell scripting for automation and operational tooling.
- Familiarity with enterprise tools such as JIRA, ServiceNow, and Azure AD.
- Working knowledge of networking fundamentals and storage systems, especially as they apply to distributed AI systems.
- Strong documentation and collaboration skills in a cross-functional, fast-paced environment.
- Willingness to participate in weekend or after-hours support rotations as needed.
Nice to have
- experience in the securities or financial services industry is a plus
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.
Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.
We’re seeking a future team member for the role of Vice President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA Location.
In this role, you'll make an impact in the following ways:
- Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
- Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
- Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
- Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
- Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
- Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
- Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
- Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
- Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.
To be successful in this role, we’re seeking the following:
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
- Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
- Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
- Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
- Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
- Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
- Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
- Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
- Understanding of identity and access management, including secure access controls such as Azure AD.
- Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
- Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
- Willingness to participate in on-call rotations and provide occasional weekend support as needed.
At BNY, our culture speaks for itself, check out the latest BNY news at:
Here’s a few of our recent awards:
- America’s Most Innovative Companies, Fortune, 2025
- World’s Most Admired Companies, Fortune 2025
- “Most Just Companies”, Just Capital and CNBC, 2025
Our Benefits and Rewards:
BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.
BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.