Role : Tech Lead, Big Data (Azure, Databricks)
Location : Remote
Exp : 12-15 YRS of exp.,
Databricks Certified Data Engineer Associate/Professional Certification
Your role:
-You will be the Big Data Analytics expert, architecting and designing solutions with hands-on spark programming.
-Lead a large-scale data migration & modernization project, managing a team of data engineers.
Your expertise:
-7+ years’ Experience in distributed data processing using Databricks (preferred) or Apache Spark in a customer-facing technical or consulting role.
-Expertise in writing code in Python / Scala and optimizing spark jobs.
-Expert in creating data structures optimized for storage and various query patterns for example Parquet and Delta Lake.
-Supported platform migration to azure cloud & data bricks in areas of data modelling and data extraction.
-Meaningful experience in at least one database technology such as:
-Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL)
-NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin)
-Experience in traditional data warehousing / ETL tools (Azure Data factory, Informatica)
– must have – Databricks Certified Data Engineer Associate/Professional Certification.