Databricks Data Architect

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today's most complex challenges.

Join one of the Fortune 500 leaders in the pharmaceutical industry that is looking innovate and expand our technological capabilities. The person would join a product team working on their self-service company-wide platform that enables all the teams and business units to deploy their AI solutions, making them accessible across the entire company.

We are seeking a Data Architect to lead the architectural design and strategy for a large-scale lakehouse migration. This role involves defining the technical roadmap, data governance, and best practices for leveraging Databricks and cloud-native tooling. You will play a key role in shaping the future data platform, ensuring scalability, security, and performance across data domains.

• Design end-to-end architecture for the lakehouse migration, aligning with business and technical goals
• Establish data governance frameworks using Unity Catalog and support lineage, access, and compliance
• Guide engineering teams on scalable data modeling and processing strategies using PySpark and SQL
• Define standards for workflow orchestration, code quality, and CI/CD using Git-based tools
• Evaluate and optimize system architecture for performance, cost, and maintainability
• Collaborate with cloud architects and platform teams to integrate with AWS/Azure services as needed
• Document architectural decisions, patterns, and migration plans

Requirements

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• 11+ years of experience in data architecture or senior data engineering roles
• Proven expertise in Databricks platform, especially Unity Catalog, workflows, and notebooks
• Deep understanding of lakehouse architecture concepts and implementation
• Strong hands-on experience with PySpark, Python, and SQL
• Familiarity with Git (Bitbucket or GitHub) and CI/CD processes
• Excellent communication and stakeholder management skills

Nice to Have:

• Experience with Snowflake or other modern data platforms
• Cloud architecture knowledge in AWS or Azure
• Exposure to Jenkins or other orchestration/automation frameworks