Databricks Consultant

Key Responsibilities

• Design, implement, and optimize scalable data solutions using Snowflake and Databricks platforms to meet evolving business needs.
• Develop and maintain complex ETL/ELT pipelines integrating structured and semi-structured data from diverse sources, ensuring reliability and performance.
• Create and manage Snowflake objects including databases, schemas, tables, views, stored procedures, streams, and tasks to support robust data management and accessibility.
• Construct and optimize Databricks notebooks and Spark jobs leveraging PySpark and Spark SQL for advanced data transformation and analytics.
• Collaborate with cloud infrastructure teams to integrate data pipelines with cloud storage solutions and enterprise applications using APIs and connectors.
• Apply data modeling best practices including dimensional modeling, partitioning, and data partition strategies to enhance query performance and system scalabi...

Ready to Apply?

Submit your application today and join our talented team at LumenData.