Databricks Machine Learning Lead

Job description

Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals.

If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk.

Take your skills to a new level and launch a career where you can truly do what matters.



Come join us:

The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform.

It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

What you'll do:

* Lead the Design: Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.

* Hands-on Development: Serve as the most senior developer, writing high-quality, production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.

* Performance Optimization: Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management

* Standards & Best Practices: Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps/CI/CD pipelines for the engineering team.

Required Skills & Experience:

· 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform.

· Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.

· Deep understanding and practical experience with Delta Lake architecture and optimization techniques.

· Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).

Preferred Skills & Certifications:

* Experience with Databricks features like Databricks Workflows, and Unity Catalog.

* Experience with streaming technologies (e.g., Kafka, Spark Streaming).

* Familiarity with CI/CD tools and Infrastructure-as-Code (e.g., Terraform, Databricks Asset Bundles).

* Databricks Certified Machine Learning Professional certified.

About you

Characteristics that can spell success for this role

· Consultative, collaborative, curious

· Resilient, adaptable, flexible

· Humble leader, strong negotiator, relationship builder

· Passionate about tech and engaging with and advising clients

Enjoy your career

Some of the best things about working at Avanade

· People-first culture that supports innovation and encourages people to move forward

· Turn your ideas to human impact by cultivating a team that will help clients unlock what’s next​

· Opportunities to innovate in the Microsoft platform while charting your own career path

· On-the-job growth through hackathons, innovation contests, and other expressions of our passion for innovating with purpose

· Real-time access to technical and skilled resources globally

Find out more about some of our benefits [1] here.

A great place to work

As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return.

As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities.

You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, but to also lean on your expertise.

You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live.

It’s all here, so take a closer look!

We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees.

Visit our [2] Inclusion & Diversity page.

Create a future for our people that focuses on

• Expanding your thinking • Experimenting courageously • Learning and pivoting

Inspire greatness in our people by

• Empowering every voice • Encouraging boldness • Celebrating progress

Accelerate the impact of our people by

• Amazing the client • Prioritizing what matters • Acting as one

Learn more

To learn more about the types of projects our Data & AI team works on check out these case studies:

· [3] thyssenkrupp Materials Services uses data to help strike a delicate operational balance

· [4] What matters to SSE Renewables is innovating for a sustainable future

· [5] Hachette UK enables employees with machine learning-driven contract searches

· [6] Marston Holdings identifies significant cloud savings

Interested in knowing what’s going on inside Avanade?

Check out our blogs:

· [7] Avanade Insights - exchange ideas that drive tomorrow’s innovation

· [8] Inside Avanade - explore what life is like working at Avanade

References

Visible links

1.

https://www.avanade.com/en-gb/career/benefits

2.

https://www.avanade.com/en-us/about-avanade/inclusion-and-diversity

3.

https://www.avanade.com/en-gb/clients/thyssenkrupp

4.

https://www.avanade.com/en-gb/clients/sse-renewables-ai

5.

https://www.avanade.com/en-gb/clients/hachette-automated-identification

6.

https://www.avanade.com/en-gb/clients/marston-holdings

7.

https://www.avanade.com/en/blogs/avanade-insights

8.

https://www.avanade.com/en/blogs/inside-avanade

We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees.

Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.

Required Skill Profession

Other General