Agentic Reliability Engineer at Service Management Processes & Solutions

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

What you`ll do:

Summary:

We are looking for an Agentic Reliability Engineer who designs and optimizes prompting strategies and reasoning workflows for the Agentic AI system. You will implement prompting-related development tasks and evaluate AI performance to ensure reliable and high-quality outputs. You will also contribute to data engineering activities, incl. the creation of golden datasets for evaluation.

The Role:

In this role, you will support the AI product lifecycle, from delivery, operations and continuous improvement. You will collaborate closely with the Product Owner and engineers to shape AI use cases that create measurable business impact. This role is highly responsible for building output evaluation automation strategy measuring the quality of the different Agentic AI solutions.

Responsibilities:

• Ensure high and reliable AI performance by analyzing and evaluating prompt outputs
• Design and optimize prompting strategies and reasoning workflows
• Collaborate with developers and product owners to ensure clear, testable requirements and robust acceptance criteria
• Define and implement test strategies with a strong focus on automation
• Build and maintain automated test suites and integrate them into the deployment pipeline
• High confidence level on the understanding of delivered solutions and related processes: a go to person together with the Product Owner in case of question on expected outcome
• Implement and maintain observability (logging, metrics, alerting, dashboards) to monitor system health and quality
• Analyze defects, incidents, and production issues, driving root-cause analysis and continuous improvement

What you bring:

• Degree in computer science, (business) economics or a similar field
• Experience in roles such as Prompt Engineer, AI Engineer, ML Engineer, LLM Engineer, AI Solution Engineer, or similar
• Advanced AI and prompt engineering skills (prompt design & optimization, understanding of LLM behaviour, agentic workflows)
• Experience with Evaluation and Performance Measurements (model evaluation techniques, benchmarking, error analysis)
• Experience with Data Engineering & Dataset skills (Golden Dataset creation, data preprocessing, basic data pipelines)
• Strong analytical & problem solving skills
• Strong communication skills and a collaborative mindset, comfortable working in agile, cross-functional team
• Fluent English 

Nice to have but not a must

• Good programming/scripting skills (e.g., Python, or a modern programming language)

These skills are a plus. If you don’t have experience in all these areas, we’ll provide the resources and training you need to become a leader in cutting-edge AI technologies.

Meet your team:

Service Management Processes & Solutions holds global responsibility for all products and tools that empower SAP's customer-facing and employee-facing service management processes. We are dedicated to delivering innovative solutions that drive efficiency and excellence across our service ecosystem.

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.  

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity,  gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 452091  | Work Area: Software-Design and Development  | Expected Travel: 0 - 10%  | Career Status: Professional  | Employment Type: Regular Full Time   | Additional Locations:  #LI-Hybrid