Azure Databricks Engineer

Your Role

• Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics and ADLS.I
• Implementing data validation and quality frameworks to ensure data reliability. Writing efficient PySpark and SQL code for complex transformations, aggregations, and performance tuning 
• Managing secure access using Azure Key Vault, role-based permissions, and compliance best practices
• Working in an Agile/Scrum environment, delivering solutions aligned with business needs.

Your Profile

• Should have 4 to 12 years of experience in Azure Databricks with strong pyspark experience
• Experience with Azure Data Bricks, Data Factory
• Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics
• Experience in Python/Pyspark/Scala/Hive Programming.
• Experience with Azure Databricks/ADB
• Experience with building CI/CD pipelines in Data environments

What you’ll love about working here

• You can shape your career with us. We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.
• You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.
• You will have the opportunity to learn on one of the industry’s largest digital learning platforms, with access to 250,000+ courses and numerous certifications.