Overall Objectives of Job: (If multiple sections, accord weightage to each section)

Project Name : GAFS (Global Antifraud Solution )

This role offers opportunities to work as Data engineer in one of the Prestigious Fraud detection solution of Allianz Group

Objective :

Support in the development of the GAFS velocity layer (end Q1, Q2)
Support in the development of the Machine Learning Data Layer (AIccelerate) – Databricks to enable predictive models on demand(Q3,Q4)

100%

PART 3

Duties and Responsibilities

List in order of importance and state approximate weightage accorded to each.

As a Data engineer He/She will be responsible for developing robust solution as per requirement in Agile landscape.
Tech Stack we look forward is –
Azure Data engineer ( Preferred Databricks or Fabrics)
- python / pyspark programming
- strong ETL/ELT and Data warehousing knowledge.

8

PART 4

Authorities Held

Experience technology stack

Experience in data integration (batch, Kafka events, etc.), processing (ETL/ELT), and migration on-premises/cloud (Azure)
Knowledge of Azure Synapse, DataBricks, Data Lake Gen 2, API Azure, Azure Functions, Triggers, Events, SHIR, etc.
Strong Python programming skills (core Python, PySpark), and containers development (K8s)
Strong SQL skills (T-SQL and PL-SQL), with hands-on experience in building complex SQL queries and creating ETL loads
Strong knowledge of different RDBMS (Oracle, PostgreSQL, etc.)
Strong knowledge of DWH concepts and architecture, Logical & Physical design, Data modeling (3NF, Star schema, etc.)
Strong knowledge of Lakehouse concepts (DeltaLake)
Knowledge of Agile concepts and hands-on experience with Confluence & Jira
Experience with Data modeling tools (knowledge of Erwin and FET)
Experience working in a multi-cultural team

PART 5

Qualification, Experience and Skills

BE, Btech , Computer Science , MCA

Systematic and logical approach

Reasoning and analytic ability.

Excellent communication skills.

Good inter personal skills.

Adaptable and flexible

PART 6

Key Competencies

- Azure Data engineer ( Preferred Databricks or Fabrics)
- python / pyspark programming
- strong ETL/ELT and Data warehousing knowledge.

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us.

At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating for equal opportunities for all. And the foundation for this is our inclusive workplace, where people and performance both matter, and nurtures a culture grounded in integrity, fairness, inclusion and trust.

We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.

Join us. Let's care for tomorrow.

Note: Having different strengths, experiences, perspectives and approaches is an integral part of Allianz‘ company culture. One means to achieve this is a regular rotation of Allianz Executive employees across functions, Allianz entities and geographies. Therefore, the company expects from its employees a general openness and a high motivation to regularly change positions and collect experiences across Allianz Group.

2 Jobs for Pyspark in India

Systems Specialist_2481

Azure Databricks Systems Specialist_2567