Job Description
About the team: As a Data Engineer in the Data Warehouse team you will be relied on to
independently develop and deliver high-quality features and finish tasks to a high standard.
You’ll be part of an emerging team, focussing on building and improving our innovative BNL Data
Warehouse offerings applying marketing suites.
What we are looking for
For this position the ideal candidate has 8 years of experience in software development, and
with data structures/algorithms with a focus on backend and data engineering.
Level of skills and experience:
● 5 years of hands-on experience in using Python, JVM and Shell Scripting with production
experience.
● 3 years of proven experience on building cloud native data intensive applications, Amazon
Web Service experience is a must and good to have experience in GCP.
● Experience on Data Warehouse design and development per the business nature using any of
the modern data warehouses. Having experience in Databricks and dbt experience is required.
● Highly proficient in architecting and implementing workflow management systems, Airflow is
a must.
● Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
● Hands-on experience of building and maintaining Spark applications.
● Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.
● Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.
● Experience with observability systems (such as Datadog or Prometheus/Grafana)
● Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or
Jenkins is good to have.
● Experience with unit testing and test automation frameworks.
● Comfortable providing, receiving constructive feedback, particularly while participating in
code reviews and ability to not only code, but also provide good quality readable business
documentation.
● Focus on business value vs engineering interest and focus on business value vs engineering
interest.
● Pro-active / service-oriented towards our internal customers
● Strong written and verbal English communication skill and proficient in communication with
non-technical stakeholders.
