This is a remote position.

The SENIOR QA ENGINEER – AUTOMATION TESTING role is a full-time remote position focused on ensuring product quality, test automation, and release readiness across web applications. The role involves developing automation frameworks, performing API, performance, security, and regression testing, and validating AI/LLM-powered features and MCP server functionality. It also requires working closely with development teams to improve testing processes, mentor junior testers, and ensure reliable product releases.

Edit job description

Requirements

Skills and Qualifications

8+ years in software testing, including 4+ years in test automation.
Experience setting up automation frameworks and QA processes from scratch.

Automation & Testing Tools

UI Automation: Selenium WebDriver (Java), Playwright or Cypress.
API Testing: REST Assured, Postman/Newman.
Test Frameworks: JUnit 5, TestNG; Spock (Groovy) and Cucumber (BDD) are a plus.
Performance Testing: Apache JMeter.
Security Testing: OWASP ZAP and knowledge of OWASP Top 10.
CI/CD & Reporting: Jenkins or GitHub Actions, Git, Allure.

Technology Stack

Java (OpenJDK), Groovy/Grails and Vue.js.
Database testing: MariaDB (SQL) and Neo4j (Cypher).
REST APIs, Apache Tomcat and TLS.
Authentication: Keycloak, SSO (OIDC/SAML), MFA; familiarity with Okta, Microsoft Entra ID or Auth0.
Windows Server and Linux (Ubuntu) installation and upgrade testing.

Additional Requirements

Strong Java programming skills for test automation.
Ability to write clear bug reports and test documentation.
Degree in Computer Science or a related field, or equivalent practical experience.

AI, LLM and MCP Testing

Ability to test AI/LLM-powered features, including non-deterministic outputs.
Experience evaluating AI responses, identifying hallucinations, and performing prompt injection and regression testing.
Understanding of MCP server testing, tool execution and access-control validation.

Competências necessárias

Test Automation Framework Design and QA Process SetupJava Programming for Test AutomationUI Test Automation with Selenium WebDriver, Playwright, or CypressREST API Testing with REST Assured or Postman/NewmanRegression TestingPerformance Testing with Apache JMeterSecurity Testing with OWASP ZAP and OWASP Top 10CI/CD Test Integration and Reporting with Jenkins or GitHub ActionsDatabase Testing with SQL and CypherAuthentication and SSO Testing (OIDC, SAML, MFA)Windows Server and Linux Installation and Upgrade TestingAI/LLM Response Evaluation, Including Hallucination DetectionPrompt Injection TestingMCP Server Testing, Tool Execution, and Access-Control ValidationMentoring Junior Testers

Vagas similares