AI Senior Software Engineer

We Help the World Run Better 

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.  

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world. Apply now and be part of shaping the future. 

What You’ll Do 

Do you thrive in collaborative environments and enjoy building tools that empower others? Are you passionate about data, AI and new technologies? 

Join us as a Senior Phython Developer/ AI Engineer in the Customer Engagement Tools (CET) organization. 

We are looking for a highly skilled Senior Python Developer with strong experience in Generative AI to design, develop, and deploy AI-powered applications and intelligent systems. You will play a key role in building scalable backend services, integrating large language models (LLMs), and translating business use cases into production-ready AI solutions. 

This role combines deep Python engineering expertise with hands-on experience in modern AI frameworks and GenAI technologies. 

Key responsibilities are 

• Design and develop scalable backend systems and APIs using Python 

• Build and deploy Generative AI solutions leveraging LLMs and related tooling 

• Agentic framework 

• Integrate foundation models (OpenAI, open-source LLMs, etc.) into enterprise applications 

• Implement prompt engineering, RAG (Retrieval-Augmented Generation), and fine-tuning workflows 

• Develop data pipelines for AI model training and inference 

• Optimize model performance, latency, and cost efficiency 

• Collaborate with product managers, data scientists, and DevOps teams 

• Ensure production-grade reliability, monitoring, and security of AI services 

• Stay current with advancements in AI, ML, and LLM ecosystems 

• Continuously develop AI engineering expertise by learning new skills and applying them to improve solutions, tooling, and operational practices 

• Security 

• Documentation 

What You Bring 

• Bachelor's or master's degree in machine learning, computer science, engineering, or related technical fields  

• 3-5 years of professional Python development experience 

• 1-2 years working with AI/ML systems, preferably including Generative AI 

• Strong experience with Python frameworks (FastAPI, Flask, Django) 

• Hands-on experience with LLMs and APIs (e.g., OpenAI, Anthropic, open-source models) 

• Experience with LangChain, LlamaIndex, or similar orchestration frameworks 

• Solid understanding of embeddings, vector databases (e.g., Pinecone, Weaviate, FAISS) 

• Experience with cloud platforms (AWS, Azure, or GCP) 

• Knowledge of containerization (Docker) and CI/CD pipelines 

• Vast general software engineering best-practices (e.g. Object-Oriented Programming) and experience working in a scrum-like software engineering unit.  

• Fluent English and Ability to operate in fast-moving environments 

• Collaborative, problem-solving and innovation mindset 

• Understanding of Agile/SAFe methodologies 

Nice to have but not a must: 

• Knowledge of Distributed Computing Systems for Big Data Engineering such as Databricks (PySpark/Scala) 

• Hands-on experience with genAI / agenticAI frameworks such as crewAI, langgraph, etc. 

• Expertise in code-based LLM consumption from platforms like OpenAI or Huggingface 

• Curiosity to explore different AI applications and emerging technologies 

• Experience with SAP AI offerings such as AI Core, AI Business Services, Joule 

Meet Your Team 

The team is part of CPIT (Corporate Processes & IT) and focuses primarily on internal solutions that support customer-facing roles across the company. We combine a strong technical foundation with a passion for building reliable and intelligent applications, including solutions powered by AI. 
 
We’re a highly diverse and cross-functional team that actively embraces new technologies to bring real improvements to the end-user experience. At the same time, we aim for rock-solid operations, which is why we invest heavily in automated tests to ensure smooth and reliable releases to production. 
 
We work in an Agile/Scrum setup, collaborating closely across locations.