Big Data Engineer
|Job Title:||Big Data Engineer|
|Contact Name:||Rueben Schreur|
|Job Published:||about 1 month ago|
Setting up batch & real-time data flows in order to build data marts for diverse Use Cases in marketing, sales and content recommendation.
Aggregating data from different source systems in a Hadoop data lake
Developing data transformation tasks in Python
Programming test driven Spark jobs in Scala
Converting business stories to technical specifications.
Bachelor's or Master's degree in computer science or software engineering
Proficient in designing efficient and robust ETL workflows and able to work with cloud computing environments
Good knowledge of SQL, ideally Hive / Impala
Expertise in Python, Scala and Spark
Nice to have knowledge: Kafka, Kinesis, Streamsets, Flume, Jenkins, Airflow, AWS Cloud, Cloudera, Tableau, DevOps, Linux, Java and micro services…
Agile & Lean mindset; experience with Scrum is an added value
Test Driven Development, Domain Driven Design, clean code practices are sounding familiar to deliver quality
You have a curious and open mind
Teamplayer with passion for development and big data.
Interviews Available immediately
Rate depending on experience
Please apply below
Parallel Consulting is acting as an Employment Business in relation to this vacancy.
Sorry, this job post it's no longer available