Job Description
Data Bricks Architect
| Job Code | : | 12272 |
| Experience | : | 12-20 Years |
| Location | : | Hyderabad |
We are looking for candidate with strong knowledge on • Databricks Solution Architect, Delta Lake, Delta Live Tables and Databricks SQL (Primary) - High, • ETL, SSRS, Data Lake houses and data integration (Databricks) (Primary) - High
Responsibilities
• 10+ years of experience in Databricks, data engineering, and architecture.
• Expertise in Delta Lake, Delta Live Tables, Databricks SQL, ETL, SSRS, and data integration.
• Strong understanding of data governance, security, and compliance.
• Experience with cloud-based data platforms and services.
• Strong communication and collaboration skills.
• Bachelor’s degree in Computer Science or related field.
Requirements
• Design and implement a low latency data hub using Databricks, based on a pre-defined data architecture.
• Collaborate with data engineers, data architects, and other stakeholders to understand data requirements and ensure seamless integration.
• Optimize data pipelines for performance, scalability, and reliability.
• Develop and maintain ETL processes to ingest, transform, and load data into the data hub.
• Develop and maintain business rules engine ETL using Databricks notebooks and Databricks/ANSI SQL
• Ensure data quality and integrity throughout the data lifecycle. Provide technical leadership and best practices for using Databricks and related technologies.
• Monitor and troubleshoot data hub performance and resolve any issues.
• Stay updated with the latest advancements in Databricks and big data technologies.