Job Title: Data Architect - Azure Databricks

Location: Bangalore, India

Position Overview:

We are looking for a Data Architect with 10 to 12 years of experience specializing in Azure Databricks and Azure native services. The ideal candidate will have a proven track record of designing and implementing scalable, high-performance data solutions in cloud environments, with a focus on optimizing data pipelines and driving strategic initiatives. The Data Architect is responsible for designing & developing the data models & design the various layers of the architecture (Medalian architecture) to support data integration, storage & access needs of the engagement. 

Key Responsibilities:

• Lead the design and implementation of our cloud-based data architecture using Azure Databricks and Azure native services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
• Collaborate with cross-functional teams to define data requirements, develop data models, and establish data governance policies and standards.
• Architect scalable and efficient data pipelines to support real-time and batch processing, ensuring data quality, reliability, and consistency.
• Design and implement security and compliance measures to protect sensitive data and ensure regulatory compliance.
• Optimize data architecture for performance, scalability, and cost-effectiveness, leveraging cloud-native technologies and best practices.
• Provide technical leadership and mentorship to data engineering teams, guiding them in the implementation of data solutions and adoption of best practices.
• Evaluate emerging technologies and trends in data engineering and cloud computing and recommend strategic investments and initiatives.
• Collaborate with infrastructure and operations teams to define and implement cloud infrastructure requirements and configurations.
• Establish and maintain documentation for data architecture, including data models, data lineage, and system configurations.

Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 10 to 12 years of experience working as a Data Architect, with a focus on cloud-based data platforms and services, particularly Azure Databricks and Azure native services.
• Extensive hands-on experience designing and implementing data solutions using Azure cloud services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
• Strong proficiency in SQL, Python, and Spark, with advanced knowledge of data modelling techniques, dimensional modelling, and data warehousing concepts.
• In-depth understanding of data governance, security, and compliance frameworks, with experience implementing security controls and encryption mechanisms in cloud environments.
• Excellent leadership and communication skills, with the ability to effectively communicate technical concepts and strategies to stakeholders at all levels.
• Proven ability to lead cross-functional teams, drive consensus, and achieve project goals in a dynamic and fast-paced environment.

Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert or Microsoft Certified: Azure Data Engineer Associate are highly desirable.