Project Lead

Responsibilities

• Design and Develop Data Processing Pipelines: Design, develop, and maintain large-scale data processing pipelines on GCP, using tools such as DataFlow, BigQuery, and Cloud Storage.
• Data Warehousing and Data Lake Management: Design, build, and maintain data warehouses and data lakes on GCP, using tools such as BigQuery and Cloud Storage.
• Data Engineering and Architecture: Collaborate with cross-functional teams to design and implement data engineering solutions that meet business requirements, ensuring scalability, reliability, and performance.
• Data Quality and Governance: Develop and implement data quality and governance processes to ensure data accuracy, completeness, and consistency
• Big Data Processing: Process and analyze large datasets using tools such as BigQuery, DataFlow, and Cloud Storage
• Cloud Storage and Data Lake Management: Design, build, and maintain cloud storage solutions on GCP, using tools such as Cloud Storage and Data Lake.
• Collaboration and Communication: Collaborate with data scientists, data analysts, and other stakeholders to understand business requirements and develop data solutions.
• Troubleshooting and Optimization: Troubleshoot and optimize data processing pipelines and data storage solutions to ensure high performance and reliability.
• Cloud Security and Compliance: Ensure that all data processing and storage solutions meet cloud security and compliance requirements.