Azure Data Engineer
We are seeking experienced Data Engineer proficient in Azure to join our dynamic team. As a Data Engineer, you will be responsible for data ingestion using ADF pipelines, working with Databricks, and communicating effectively with various stakeholders within the business.
Requirements
- Strong technical background with experience in data engineering
- Proficiency in Azure services, particularly Azure Data Factory and Azure Data Lake
- Experience with SQL, Python, Scala, and Spark
- Familiarity with data integration tools and techniques
- Excellent communication skills with the ability to work collaboratively in a team environment
Responsibilities
- Utilize Azure Data Factory (ADF) pipelines for data ingestion
- Demonstrate proficiency in Databricks for data processing
- Collaborate with business stakeholders to understand requirements and deliver solutions accordingly
- Work with SQL, Python, Scala, and Spark for data processing tasks
- Integrate data from various sources using Azure Data Lake and other data integration tools
- Knowledge of APIs and Kafka topics for data collection and ingestion