Big Data Engineer (Azure/Spark/Scala)

Development of scalable and performant solutions based on open-source technologies in the Cloud (Azure) and, although being phased out, on-premise (Cloudera). Development and maintenance of data pipelines mainly using Spark on Databricks or on-premise environment. Setting up and maintain CI/CD pipelines in Azure DevOps.Streaming flow development with HDF (Hortonworks) NiFi and Spark Structured streaming.

What are we looking for?

• 2 year Spark experience
• Azure 
• Databricks
• Python
• CI/CD

• Willingness to learn and being open to new techniques
• Willingness and capability to teach and share knowledge
• Team oriented
• Hands-on attitude
• Being agile
• Knowledge on financial products and business processes
• Able to contribute and communicate on new solutions

Function properties

• Azure
• Spark
• CI/CD
• Data Science application deployment

What you will get?

• Above market salary 
• Pension