Data Engineer

Responsibilities

• Design and implement scalable data pipelines for ingesting, transforming, and loading data from various tools and sources.
• Design data models to support data analysis and reporting.
• Collaborate with engineers, process managers, data scientists to understand their needs and design solutions.
• Act as a bridge between the engineering and the business team in all areas related to Data.
• Automate monitoring and alerting mechanism on data pipelines, products and Dashboards and troubleshoot any issues. On call requirements.
• SQL creation and optimization – including modularization and optimization which might need views, table creation in the sources etc.
• Defining best practices for data validation and automating as much as possible; aligning with the enterprise standards.
• QA environment data management – e.g Test Data Management etc