Senior Software Engineer - Model Service Runtimes

Our client, a leader in the open-source AI industry, is seeking a Senior Software Engineer - Model Service Runtimes to join their team. As a Senior Software Engineer, you will be part of the engineering team supporting innovative AI solutions. The ideal candidate will have strong problem-solving skills, a collaborative mindset, and a passion for continuous learning, which will align successfully in the organization.

Job Title: Senior Software Engineer - Model Service Runtimes

Location: Raleigh, North Carolina or Boston, Massachutese

Pay Range:

Competitive salary based on experience

What's the Job?

Contribute as a model serving and runtimes subject matter expert for the model serving features of the open-source Open Data Hub project.

Participate actively in KServe, vLLM, PyTorch, Kubeflow, HuggingFace, and other open-source communities.

Design, secure, build, test, and release model serving, trustworthy AI, and model registry capabilities.

Collaborate closely with internal cross-functional development teams to drive innovation.

Be a key contributor to MLOps upstream communities, influencing the evolution of hybrid cloud platforms.

What's Needed?

Experience with Kubernetes and MLOps (Machine Learning Operations).

Strong programming skills in relevant languages and frameworks.

Ability to work independently and as part of a dynamic team.

Familiarity with open-source projects and community engagement.

Excellent communication skills to collaborate across teams.

What's in it for me?

Opportunity to work on cutting-edge AI technologies and hybrid cloud solutions.

Engagement in a culture that fosters continuous learning and professional development.

Chance to contribute to impactful open-source projects.

Collaborative work environment with a diverse team of experts.

Potential for career growth within a rapidly evolving industry.

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!

About ManpowerGroup, Parent Company of:

Manpower, Experis, Talent Solutions, and Jefferson Wells

ManpowerGroup (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands

Manpower, Experis, Talent Solutions, and Jefferson Wells


creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.

ManpowerGroup is committed to providing equal employment opportunities in a professional, high quality work environment. It is the policy of ManpowerGroup and all of its subsidiaries to recruit, train, promote, transfer, pay and take all employment actions without regard to an employee's race, color, national origin, ancestry, sex, sexual orientation, gender identity, genetic information, religion, age, disability, protected veteran status, or any other basis protected by applicable law.