Engineer (Spark, SparkSQL)

• 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform
• Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
• Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
• Unix Shell Scripting and setting up CRON
• Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
• Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).
• Prior Experience in Consumer Banking Domain is an advantage.
• Prior Experience in the agile delivery method is an advantage.
• Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
• Core Java skillset is an added advantage. Airflow is an added advantage.
• Good K...

Ready to Apply?

Submit your application today and join our talented team at Anicalls (Pty) Ltd.

Submit Application