Data Engineer (Databricks)

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

We are looking for a Data Engineer to join our Data Engineering Center of Excellence (CoE), responsible for designing, building, and scaling robust data pipelines and data products on Databricks using PySpark and Python.

In this role, you will contribute to a modern data platform that enables analytics and machine learning use cases across SAP internal stakeholders. You will work with large-scale datasets in a cloud-native environment, ensuring data is reliable, high-quality, and optimized for downstream consumption by ML and analytics teams.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines in Databricks using PySpark
• Build data products that support machine learning, MLOps, and analytics use cases
• Work with data stored in ADLS Gen2 and SAP HANA Data Lake (Delta/Parquet formats)
• Implement and maintain data quality checks (schema validation, deduplication, enrichment, tagging).
• Collaborate with ML engineers, data scientists, and business stakeholders to translate requirements into data solutions
• Contribute to engineering best practices, including version control, CI/CD, testing, and monitoring

What you bring:

• Proficiency in Python
• Hands-on experience with Databricks (PySpark, Delta Lake)
• Experience with version control systems (e.g. GitHub)
• Experience with CI/CD frameworks (e.g. Github Actions)
• Performance tuning for large-scale datasets
• Knowledge of Datalake technologies
• Strong English communication skills (written and spoken), required for collaboration with international teams

Nice to have:

• At least one other programming/scripting language (e.g. Java, SQL, Scala)
• Experience with data governance and cataloging in Azure ecosystem (Unity Catalog)

Technology stack:

• Python
• PySpark
• Databricks
• MS Azure

About us:

CPIT is SAP’s technology backbone and most compelling reference customer, and as such, we influence SAP product development and strategy, with our customer experience at heart. Our Enterprise AI Center of Excellence is leading the charge in embedding AI into business processes, powered by high-quality data and next-gen search architecture.  We build and run AI platforms, custom solutions, and AI agents informed by reusable data products that simplify work across SAP. We work in agile, autonomous teams with a culture of trust, creativity, and continuous learning. If you're passionate about AI and want to help shape the future of enterprise technology - this is the place to be!

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.  

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity,  gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 451483  | Work Area: Software-Design and Development  | Expected Travel: 0 - 10%  | Career Status: Professional  | Employment Type: Regular Full Time   | Additional Locations:  #LI-Hybrid