Development of scalable and performant solutions based on open-source technologies in the Cloud (Azure) and, although being phased out, on-premise (Cloudera). Development and maintenance of data pipelines mainly using Spark on Databricks or on-premise environment. Setting up and maintain CI/CD pipelines in Azure DevOps.Streaming flow development with HDF (Hortonworks) NiFi and Spark Structured streaming.
What are we looking for?
Function properties
What you will get?