Principal Data Solutions Engineer

JD & Role Overview:

As a Senior Data Engineer, you will be the backbone of our Martech data ecosystem. You will design, build, and optimize the data pipelines that power real-time promotions and personalized marketing journeys. We need someone who can take a business requirement from a whiteboard and turn it into a production-ready, end-to-end deliverable within our Databricks and AWS S3 environment.

Key Responsibilities:

Data Lakehouse Architecture: Design and implement robust Data Lake patterns on AWS S3 using Databricks/Delta Lake to ensure data is scalable, searchable, and secure.

ETL/ELT Development: Build end-to-end data pipelines to ingest, transform, and load data from various Martech sources, ensuring high quality and low latency.

Streaming Integration: Collaborate on the integration of Apache Flink event streams into the data lake to support real-time promotional analytics and historical auditing.