Principal Data Engineer – Databricks

Principal Data Engineer Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure Job Description Location: Toronto Work Model: Onsite (4 days/week) Key Requirements 1218 years of overall Data Engineering experience. 8+ years of experience with Enterprise Data Warehouse and Data Lake platforms. 5+ years of hands-on experience with Databricks and Apache Spark at scale. Strong experience modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse. Experience redesigning ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake. Experience refactoring legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines. Experience ensuring data reconciliation, audit integrity, and consistency during migration. Experience designing and governing Enterprise Data Warehouse and Data Lake/Lakehouse architectures. Experience implementing layered architectures including: Raw...

Ready to Apply?

Submit your application today and join our talented team at Astra North Infoteck Inc..

Submit Application