Lead Azure Data Engineer

Job Title: Lead Azure Data Engineer

Needed 12+ years resume H1b/H4 need to share passport number GC DOB<1989

About Veltris

• Where Innovation, Acceleration and Transformation meet to deliver high-ROI technology and business solutions.

• Our design thinking approach to agile software development coupled with premium full-stack capabilities, and a cutting-edge innovation mindset accelerates time-tomarket. This results in long-term strategic and competitive advantages for our clients and partners.

• Veltris – Innovate, Accelerate, Transform to enable technology-driven Enterprise, Business, and Industry transformations.

 Job Description:

 As discussed, they must possess the following skills:

• Good communication skills both written and verbal in English.

• Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.

• Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.

• Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources (Kafka).

• Knowledge on change data capture.

 • Good experience in ADB.

• Azure Data Factory –

o Parametrization and reusable linked services, datasets, and pipelines

o Self-hosted IRs

• Databricks –

o DELTA LIVE Tables with time travel experience

o Structured LIVE streaming with DELTA LIVE Tables

o Knowledge of Optimization and partition best practices.

o Knowledge of how to use the Unity Catalog and its benefitso Mounting Technique.

• Streaming Data o KAFKA, KAFKA Connectors (Debezium MYSQL)

o Ideally knowledge of Confluent Kafka.

o Event hubs, service bus, Azure Function.