Unlimited Job Postings Subscription - $99/yr!

Job Details

AI QA Engineer

  2026-03-31     Ova Technologies     all cities,AK  
Description:

About the Role

We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.

Key Responsibilities

  • Design, develop, and execute test plans and test cases for AI/ML-based products.
  • Validate AI models for accuracy, fairness, robustness, and performance.
  • Test data pipelines, feature engineering processes, and model integration with production systems.
  • Develop automated test scripts for model APIs, training pipelines, and inference workflows.
  • Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues.
  • Implement monitoring and alerting mechanisms for deployed AI systems.
  • Conduct regression testing to ensure changes do not degrade model performance.
  • Ensure compliance with data privacy, security, and responsible AI standards.
Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing.
  • Strong knowledge of QA methodologies, tools, and processes.
  • Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework).
  • Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn).
  • Experience testing RESTful APIs and microservices.
  • Proficiency in Python (preferred), Java, or other programming languages.
  • Strong problem-solving skills and attention to detail.
Preferred Qualifications
  • Experience with ML model validation, monitoring, and drift detection.
  • Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML).
  • Understanding of bias, fairness, and explainability in AI systems.
  • Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment.
  • ISTQB or equivalent certification in QA.
What We Offer
  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge AI products.
  • Collaborative, innovative, and growth-focused work environment.
  • Professional development and learning opportunities.


Apply for this Job

Please use the APPLY HERE link below to view additional details and application instructions.

Apply Here

Back to Search