Job Description:
7+ years of relevant and progressive data engineering experience
Deep Technical knowledge and experience in Databricks, Python, Scala, and Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored procedures
Hands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, Synapse, Data Lake, file-based, SQL database)
Experience in engineering practices such as development, code refactoring, leveraging design patterns, CI/CD, and building highly scalable data applications and processes
Experience developing batch ETL pipelines; real-time pipelines are a plus
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience working with Teradata is a plus