Senior Engineer – GenAI Quality Assurance

Senior Engineer – GenAI Quality Assurance

Full Time Presencial
C

Responsibilities

  • Design and implement automated and manual QA strategies for GenAI systems
  • Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy
  • Validate prompt logic, model behavior and evaluation metrics
  • Execute tests and debug pipelines
  • Support deployment of GenAI products
  • Lead system design reviews
  • Collaborate closely with data scientists and developers
  • Establish testing standards and workflows for continuous integration and deployment
  • Conduct code reviews and document system design decisions

Requirements

  • 3+ years of experience as a software engineer
  • Familiarity with RAG & Graph frameworks
  • 5+ years of experience in production systems
  • 1+ year experience in GenAI systems
  • Advanced Python skills
  • Experience with LLM-based systems
  • Hands‑on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCP
  • Proven ability to implement test frameworks
  • Knowledge of API testing, data validation, data pipeline testing
  • Experience with version control (Git)

Core Competencies

Demonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. Proficient in establishing testing standards, conducting code reviews, and collaborating with cross‑functional teams to ensure product quality.

Senior Engineer – GenAI Quality Assurance empresa: College Recruiter

Capitole es una de las mejores empresas de consultoría IT, donde la gente es el centro de todo. Ofrecemos un ambiente de trabajo flexible y humano, con oportunidades de crecimiento profesional a través de un presupuesto anual de formación de 1200 € y un camino de carrera adaptado a tus necesidades. Además, disfrutarás de un equipo diverso y dinámico, acceso a comunidades tecnológicas y eventos emocionantes, todo mientras trabajas en proyectos interesantes desde la comodidad de tu hogar en España.

C

Datos de contacto:

Equipo de selección de College Recruiter