Big Data Engineer (Azure/Spark/Scala)

Location: Utrecht

As a Big Data Engineer you are responsible for the development of scalable and performant solutions based on open-source technologies in the Cloud (Azure) and, although being phased out, on-premise (Cloudera). Development and maintenance of data pipelines mainly using Spark on Databricks or an on-premise environment and setting up and maintaining CI/CD pipelines in Azure DevOps.Streaming flow development with HDF (Hortonworks) NiFi and Spark Structured Streaming.

 

What are we looking for?

  • 2 year Spark experience
  • Azure 
  • Databricks
  • Python
  • CI/CD
  • Willingness to learn and being open to new techniques
  • Willingness and capability to teach and share knowledge
  • Team oriented
  • Hands-on attitude
  • Being agile
  • Knowledge of financial products and business processes
  • Able to contribute and communicate on new solutions

Function properties

  • Azure
  • Spark
  • CI/CD
  • Data Science application deployment

What you will get?

  • Above market salary 
  • Pension

Geïnteresseerd? Neem contact op met Tom van Dijk.

Arrow TERUG NAAR HET OVERZICHT