As a QA Engineer you will be responsible for designing, implementing, and executing test cases for AI/ML applications. You will also be working on creating automated test scripts and frameworks for AI/LLM applications. You will work closely with cross-functional teams to construct test scenarios, develop systematic test cases, and ensure that all components meet the required standards. Your role will also involve performance testing, LLM prompt testing etc. and ensuring comprehensive test coverage.
Job Responsibilities include:
- Creating testing methodologies specific to conversational interfaces, scenario-based testing, intent testing, and regression testing.
- Designing and executing tests specifically for evaluating the performance, accuracy, and relevance of LLM outputs. Conducting LLM prompt testing and response-time testing to ensure high-quality outputs.
- Constructing test scenarios based on User Stories or requirements to validate the functionality and performance of AI/ML applications.
- Developing systematic test cases from scenarios for AI/ML applications based on User Stories or requirements.
- Liaise with internal teams and client representatives to identify and verify software requirements
- Developing and executing manual tests to validate software functionality before automating it.
- Executing systematic test cases to ensure that new or revised components or systems perform as per the expectations.
- Ensuring that applications meet standards for usability, performance, reliability, and compatibility.
- Performing thorough regression testing when bugs are resolved
- Developing and maintaining automated testing frameworks and scripts to streamline the testing process and improve coverage.
- Documenting test results, reporting defects, and tracking them through resolution. Provide detailed reports and feedback to development teams.
- Implementation support and user training of the applications.