Big Data Engineer (Azure/Spark/Scala)

As a Big Data Engineer you are responsible for the development of scalable and performant solutions based on open-source technologies in the Cloud (Azure) and, although being phased out, on-premise (Cloudera). Development and maintenance of data pipelines mainly using Spark on Databricks or an on-premise environment and setting up and maintaining CI/CD pipelines in Azure DevOps.Streaming flow development with HDF (Hortonworks) NiFi and Spark Structured Streaming.

What are we looking for?

• 2 year Spark experience
• Azure 
• Databricks
• Python
• CI/CD

• Willingness to learn and being open to new techniques
• Willingness and capability to teach and share knowledge
• Team oriented
• Hands-on attitude
• Being agile
• Knowledge of financial products and business processes
• Able to contribute and communicate on new solutions

Function properties

• Azure
• Spark
• CI/CD
• Data Science application deployment

What you will get?

• Above market salary 
• Pension