Quality Engineer- AI Platform Testing

Job Title: Quality Engineer- AI Platform Testing

Location: Bangalore?

Experience: 5-7 years'

Education: Bachelor's or Associate's Degree in Computer Science, Engineering, or a related field

Job Summary:

We are looking for an experienced Quality Engineer with a strong background in software testing processes, automation, test framework development and application testing. The ideal candidate will have expertise in AI based application/platform testing, Model [LLM's] evaluation testing, RESTful API testing and technical proficiency in python, JavaScript, TypeScript, and related tools.

Key Responsibilities:

Create and maintain comprehensive test cases for web applications.

Develop and execute smoke, functional, regression, and integration testing processes for software applications.

Design, create, and maintain automated test frameworks using tools like RAGA'S/ DeepEval/Lang chain, Postman, VS Code, Cucumber and node.js.

Collaborate closely with development and product teams to ensure testing coverage across all stages of development.

Identify, record, document thoroughly and track bugs.

Perform load and performance testing using tools like JMeter.

Manage testing processes using GitHub, JIRA, and other DevOps tools.

Contribute to continuous integration/continuous deployment (CI/CD) practices to enhance test automation pipelines.

Work with cloud technologies, particularly AWS, to manage testing environments.

Required Skills & Qualifications:

6+ years of relevant work experience in software testing, particularly in automation and test framework development.

Proficiency in python, JavaScript, TypeScript, Postman, VS Code, Cucumber, and Node.js.

Must have experience in Model [LLM's] evaluation testing, analysing model performance

Strong experience in backend testing with exposure to LLM's using Swagger, postman tools.

Must have experience in tools like Kubernetes to check the logs.

Must have experience in model evaluation frameworks [for ex: RAGA'S, DeepEval, Lang chain]

Familiarity with various testing techniques. Knowledge of quality standards and regulations.

Strong understanding of version control systems (GitHub) and project management tools (JIRA).

Experience in Agile/Scrum development environments.

A detail-oriented approach with excellent problem-solving skills.

Preferred Qualifications:

Familiarity with continuous integration and delivery (CI/CD) pipelines using Github actions.

Experience or knowledge of machine learning and open-source AI models, Test automation using pytest.

Experience testing applications hosted in multiple geographical locations.

Familiarity with cloud technologies, especially AWS.

Qualification

Bachelor's Degree