Data Engineer
Original Advert
Our client is a global jewelry manufacturer that is transforming the retail experience with cutting-edge technology. The mission is to provide an exceptional shopping experience to our customers by leveraging data-driven insights and innovative solutions. We are looking for a talented Data Engineer to join our dynamic team and help us shape the future of retail, where you will play a critical role in developing and maintaining robust data pipelines in both Azure Synapse and Databricks.
Joining our team, you will contribute to building a solid foundation for the data infrastructure, supporting our marketing analytics organization's goal of becoming more data-driven and customer-centric. You will collaborate closely with cross-functional teams, helping to drive impactful data product deliveries and optimizing our analytical framework for scalable insights globally.
Develop and maintain data products and pipelines in Databricks, Azure Data Factory and Azure
Synapse AnalyticsCommunicate with stakeholders and users of our data products by understanding their problems and supporting them in their needs
Optimize data pipelines for performance and scalability, automating repetitive tasks to improve
efficiency and reduce the time from data ingestion to actionable insightsImplement and maintain data quality processes, including data validation, cleansing, and error
handling, to ensure high data integrity across all systemsImprove existing data integration processes to provide better reliability and robustness
Partner with product managers, analysts, and business stakeholders to understand data
requirements, provide data engineering support, and ensure data is accessible and usable foranalysis and reportingStay up-to-date with the latest trends and best practices in data engineering, bringing innovative
ideas and solutions to improve our data infrastructure and capabilities
4+ years of experience as a Data Engineer, ETL Developer, or similar role
Experience with Azure Synapse Analytics
Strong knowledge of SQL and Spark SQ
Understanding of dimensional data modelling concepts
Understanding of streaming data ingestion processes
Ability to develop & manage Apache Spark data processing applications using PySpark on Databricks
Experience with version control (e.g., Git), DevOps, and CI/CD
Experience with Python
Experience with Microsoft data platform, Microsoft Azure stack, and Databricks
Experience in Marketing, Retail, and Ecom will be a plus.
Soft Skills:
• Strong problem-solving skills and the ability to work independently as well as part of a team.• Excellent communication skills, with the ability to translate technical concepts into business-friendly language.• Detail-oriented with a commitment to delivering high-quality, reliable data solutions.Application managed by ZooLATECH