QA Engineer

Hace 2 días

municipio de rincón de los sauces, neuquén, Argentina Solvd, Inc. Jornada completa

We are looking for a Senior QA Engineer to join a team building and validating AI-powered and traditional features for a leading personal finance platform. You’ll own quality across web, mobile, and API — with a particular focus on testing AI/LLM-integrated components where standard deterministic methods don’t apply.

This role requires someone who understands the fundamental difference between testing software that has a right answer and evaluating AI outputs that have a probability distribution — and who has done both in production.

What you’ll do

  • Plan, design, and execute test cases for AI-powered components and traditional features, applying the appropriate methodology — eval-based or deterministic — based on the target behavior.
  • Analyze traditional functional requirements as well as AI model behavior specifications, prompt outputs, and edge-case scenarios.
  • Turn business requirements, user flows, and business process procedures into comprehensive test plans, test cases, and test scripts.
  • Perform manual feature testing across platforms and verify bug fixes.
  • Create clear, detailed defect reports and document unexpected AI model responses, hallucinations, and performance regressions.
  • Assist in developing QA practices for emerging technologies including AI frameworks, and disseminate best practices across the team.
  • Become a subject matter expert in core systems, interfaces, business processes, and reporting tools.
  • Partner closely with functional teams, engineers, and IT in a global environment with aligned LATAM working hours.

Required skills & experience

  • 5–7 years of experience in software testing across web, mobile, and API.
  • Hands-on experience with Playwright in a production testing environment — this is a primary requirement for this role.
  • Hands‑on AI feature testing experience — validating AI/LLM-integrated products for accuracy, relevance, robustness against adversarial prompts, edge cases, and safety/toxicity.
  • Clear understanding of eval vs. deterministic testing — the difference between pass/fail based on exact input/output and evaluating probabilistic AI outputs using human-in-the-loop evaluations, score metrics, benchmark datasets, and semantic evaluation.
  • Strong understanding of web and mobile application development lifecycles including iOS and Android specifics.
  • Proven experience in integration, regression, performance/load, and UAT.
  • Advanced proficiency in Jira and Confluence.
  • Experience with test management systems.

Preferred qualifications

  • Experience with HTML proxy tools such as Charles Proxy or Fiddler.
  • Hands‑on knowledge of Xcode logs and ADB logs.
  • Experience in the financial services or fintech domain.
  • Bachelor’s degree in Computer Science or equivalent.