Data Engineer

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and cloud-native data solutions on Azure.
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
• Implement data governance, security, and lineage using Unity Catalog.
• Collaborate with business stakeholders, analysts, and engineering teams to deliver data products.
• Support CI/CD implementation, code deployment, and DevOps best practices.
• Ensure data quality, performance optimization, and adherence to engineering standards.

Required Experience

• Experience in Data Engineering with Azure technologies.
• Experience delivering end-to-end data solutions in enterprise environments.
• Banking or Financial Services domain experience preferred.
• Exposure to Data Products and modern data platform implementations.

Technical Skills

• Azure: Databricks, Unity Catalog, ADLS, Azure SQL Database, Synapse Analytics, Blob Storage.
• Programming: Advanced Python (PySpark, Pandas, NumPy) and SQL.
• Data Integration: Informatica IDMC (CDI mappings, task flows, mapplets, parameterization, Secure Agent configuration).
• DevOps: Git, Azure DevOps, GitHub Actions, CI/CD pipeline implementation.
• Data Architecture: Cloud-native solution design, data governance, and large-scale data processing.

Soft Skills

• Strong communication and presentation skills across technical and business audiences.
• Ability to work effectively with cross-functional and distributed teams.
• Excellent analytical, problem-solving, and decision-making capabilities.
• Self-motivated, adaptable, and capable of working independently with minimal supervision.

Preferred Qualifications

• Experience in Banking and Financial Services.
• Knowledge of data governance and enterprise data management frameworks.
• Understanding of Agile delivery methodologies and DataOps practices.