Databricks Architect

Job description

Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals.

If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk.

Take your skills to a new level and launch a career where you can truly do what matters.


Come join us:
The Databricks Solution Architect is a senior technical leadership role responsible for defining, designing, and overseeing the implementation of scalable, secure, and high-performance data platforms using the Databricks Lakehouse Platform.

This individual will translate business strategy into technical architecture, guide development teams, and ensure all data solutions align with enterprise standards for governance, security, and cost optimization.
What you'll do:
* Architectural Leadership: Define and own the end-to-end technical architecture and roadmap for the enterprise data platform on Databricks, including data ingestion, transformation, storage, and consumption layers.
* Lakehouse Design: Design and champion the implementation of the Lakehouse architecture utilizing Delta Lake, Databricks Unity Catalog, and Databricks SQL Warehouse to support all data, analytics, and AI/ML initiatives.
* Data Governance & Security: Architect and enforce enterprise-level data governance, security, and access control policies using Unity Catalog (e.g., fine-grained access, lineage tracking, auditing).
* Technical Guidance & Mentorship: Provide technical leadership, guidance, and mentorship to a team of Databricks Engineers.

Conduct architectural reviews, code audits, and ensure adherence to best practices and standards.
* Performance and Cost Optimization: Define strategies for, and lead, major performance tuning and cost optimization initiatives across all Databricks workloads, clusters, and Delta Lake storage.
* Cloud Integration: Lead the integration of Databricks with core cloud services (AWS, Azure, or GCP) and other enterprise systems (e.g., data catalogs, BI tools, ML platforms).
* Stakeholder Collaboration: Engage with executive stakeholders, data scientists, and business leaders to understand complex requirements and translate them into robust, scalable technical designs and solution blueprints.
* DataOps and Automation Strategy: Define the DevOps/DataOps strategy for the Databricks environment, including continuous integration/continuous delivery (CI/CD) pipelines and Infrastructure-as-Code (IaC) using tools like Terraform or Databricks Asset Bundles.
* Innovation: Evaluate new Databricks features, open-source technologies (e.g., MLflow), and industry trends to drive continuous platform improvement and competitive advantage.
Required Skills & Experience:
* [10]+ years of experience in data architecture, data engineering, or a related senior technical role.
* [5]+ years of deep, hands-on experience designing and implementing large-scale data solutions on the Databricks Platform.
* Expertise in Lakehouse Architecture, Delta Lake, Apache Spark, and performance tuning techniques.
* Proven experience implementing Databricks Unity Catalog for centralized governance.
* Deep proficiency in Python/PySpark or Scala and advanced SQL.
* Extensive experience with one major cloud platform and its security and data services.
* Strong experience with data modeling (dimensional, data vault) and data warehouse concepts.
* Demonstrated ability to lead technical discussions, document architectural designs, and communicate complex concepts to both technical and non-technical audiences.
Preferred Skills & Certifications:
* Experience with real-time/streaming data architectures (Structured Streaming).
* Experience with MLOps practices, including MLflow for model lifecycle management.
* Expertise in Infrastructure-as-Code tools (e.g., Terraform) and automated CI/CD for Databricks.
* Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional or equivalent cloud architecture certification.
About you
Characteristics that can spell success for this role
· Consultative, collaborative, curious
· Resilient, adaptable, flexible
· Humble leader, strong negotiator, relationship builder
· Passionate about tech and engaging with and advising clients
Enjoy your career
Some of the best things about working at Avanade
· People-first culture that supports innovation and encourages people to move forward
· Turn your ideas to human impact by cultivating a team that will help clients unlock what’s next​
· Opportunities to innovate in the Microsoft platform while charting your own career path
· On-the-job growth through hackathons, innovation contests, and other expressions of our passion for innovating with purpose
· Real-time access to technical and skilled resources globally
Find out more about some of our benefits [1] here.
A great place to work
As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return.

As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities.

You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, but to also lean on your expertise.

You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live.

It’s all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees.

Visit our [2] Inclusion & Diversity page.
Create a future for our people that focuses on
• Expanding your thinking • Experimenting courageously • Learning and pivoting
Inspire greatness in our people by
• Empowering every voice • Encouraging boldness • Celebrating progress
Accelerate the impact of our people by
• Amazing the client • Prioritizing what matters • Acting as one
Learn more
To learn more about the types of projects our Data & AI team works on check out these case studies:
· [3] thyssenkrupp Materials Services uses data to help strike a delicate operational balance
· [4] What matters to SSE Renewables is innovating for a sustainable future
· [5] Hachette UK enables employees with machine learning-driven contract searches
· [6] Marston Holdings identifies significant cloud savings
Interested in knowing what’s going on inside Avanade?

Check out our blogs:
· [7] Avanade Insights - exchange ideas that drive tomorrow’s innovation
· [8] Inside Avanade - explore what life is like working at Avanade
References
Visible links
1.

https://www.avanade.com/en-gb/career/benefits
2.

https://www.avanade.com/en-us/about-avanade/inclusion-and-diversity
3.

https://www.avanade.com/en-gb/clients/thyssenkrupp
4.

https://www.avanade.com/en-gb/clients/sse-renewables-ai
5.

https://www.avanade.com/en-gb/clients/hachette-automated-identification
6.

https://www.avanade.com/en-gb/clients/marston-holdings
7.

https://www.avanade.com/en/blogs/avanade-insights
8.

https://www.avanade.com/en/blogs/inside-avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees.

Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.

Required Skill Profession

Other General