Duties and Responsibilities

Build and optimize scalable data pipelines using Databricks, PySpark, Spark, and Azure Data Factory.

• Analyse, clean, and organize raw data from multiple structured and unstructured sources.

• Develop and maintain ETL/ELT workflows following best engineering and DevOps practices.

• Implement CI/CD pipelines using GitHub and Azure DevOps.

• Deploy and orchestrate workloads using Docker and Kubernetes.

• Develop solutions aligned to enterprise data models, DataVault methods, and architectural standards.

• Ensure data quality, data governance, GDPR compliance, and metadata management.

• Use tools like QuerySurge for data testing and validation.

• Collaborate with teams using Agile/Scrum frameworks and tools like JIRA, Confluence, and SharePoint.

• Support production deployments, troubleshooting, and operational excellence for cloud data services.

Qualification, Experience and Skills

Experience/Qualifications/skills required:

Bachelor’s or Master’s degree in Engineering, Computer Applications, or equivalent.
6+ years’ experience in IT, with 4+ years specifically in Data Engineering.
Hands-on expertise in Azure, Databricks, Synapse, Python, SQL, Spark, PySpark, and CI/CD frameworks.
Good understanding of data warehousing, modelling, cloud infrastructure, and data architecture.
Strong problem-solving, communication, and stakeholder management skills.
Experience with data quality, governance, and GDPR compliance.
Exposure to AI tools is an add-on advantage.

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us.

At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating for equal opportunities for all. And the foundation for this is our inclusive workplace, where people and performance both matter, and nurtures a culture grounded in integrity, fairness, inclusion and trust.

We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.

Join us. Let's care for tomorrow.

Note: Having different strengths, experiences, perspectives and approaches is an integral part of Allianz‘ company culture. One means to achieve this is a regular rotation of Allianz Executive employees across functions, Allianz entities and geographies. Therefore, the company expects from its employees a general openness and a high motivation to regularly change positions and collect experiences across Allianz Group.

1 Job im Bereich GDPR compliance in Indien

Azure Databricks Systems Specialist_2567