Senior QA Automation Engineer

• Design and implement testing strategies, including agentic AI, to provide automated validation of quality metrics and gates within the system. Identify appropriate testing strategies to apply for differing scenarios and processes. Provide expert guidance on functional and data-oriented risks. 

• Help ensure that system components are built with security as a high priority. 

• Maintain the highest engineering standards in collaboration with product owners, architects, and stakeholders, in support of our systems and services  

• Understand new product capabilities and decompose the implementation into specific functional changes for verification 

• Create appropriate mock services to ensure zero dependency, where possible, with other teams 

• Provide entry and exit points for automated services that other engineers may use to ensure their own quality before it reaches the team level. 

• Build solutions using the best practices of Agile, CI/CD, and DevOps. 

Team Operations & Success (20%) 

• Participate in and possibly lead Agile ceremonies. Contribute to development of new processes for agentic-centered development. 

• Participate and lead peer reviews of software engineering artifacts for both design and code 

• Assist in the resolution of production issues 

• Be a fierce advocate for development standards and security policies and procedures  

• Adopt the continuous integration and continuous delivery (CI/CD) practice of rapidly implementing, testing, and delivering high-quality code based on the team’s DevOps model 

• Continuously develop the skills required to work as part of the Agile team in a poly-skilled development environment 

• Contribute to SDLC process design when appropriate 

Systems Analysis and Development (20%) 

• Develop and maintain a thorough understanding of the customer’s business processes and operations 

• Work closely with Architects and Engineers to evaluate feature requests, provide level-of-effort estimates, and contribute to planning. 

• Analyze and conduct testing to determine the most efficient approaches for our systems and benchmark current approaches 

About you, you have: 

• ~7+ years of experience in software systems, testing, quality assurance and scripting/development 

• Working experience with quality tools, such as Cucumber, Jest, Postman, etc. 

• Familiarity with advanced testing strategies such as using test doubles (stubs, fakes, shims, mocks) 

• Basic understanding of performance testing and the mechanics of operating one 

• Experience applying AI for both development and testing purposes 

• Experience testing code and scripting within an Amazon Web Services environment (Lambda, Step Functions, S3, Dynamo, etc.) 

• Experience with CI/CD and DevOps, infrastructure and how role access works 

• Experience working in Agile methodologies 

• Proven ability to pitch new ideas and implement improved systems and processes 

• Strong oral and written communication skills and analytical ability 

• Able to function independently and in a collaborative environment 

• Ability to travel 3-5 times a year to our NYC or Reston, VA office 

All roles at College Board require: 

• A passion for expanding educational and career opportunities and mission-driven work 

• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively. 

• Clear and concise communication skills, written and verbal 

• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input. 

• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking. 

• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success 

• Authorization to work in the United States 

About Our Process 

• Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. · While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks. 

What We Offer 

At College Board, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market. 

A Thoughtful Approach to Compensation 

• The hiring range for this role is $153,000–$166,000. 

• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board. 

• We aim to make our best offer upfront, rooted in fairness, transparency, and market data. 

• We adjust salaries by location to ensure fairness, no matter where you live. 

• You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more. 

#LI-REMOTE

#LI-AP1