Senior Quality Engineer

About Client:
The client is a global technology, consulting, and digital solutions company with problem-solving abilities and an emphasis on developing ingenious solutions that allow its clients to remain competitive, profitable, and secure in an evolving business environment.
Client anticipates and leads change to remain in the leader s quadrant for profitable growth, driven by partnerships with globally leading hyperscales like AWS, Google Cloud, and Microsoft. It has built strong capabilities in new as well as existing technologies such as cloud, data, and digital, pioneering new frontiers.



Salary Range: CAD $90K-$95K/Month



Job Description:

• We are seeking an experienced Big Data QA Engineer with strong expertise in data quality assurance, ETL/ELT validation, cloud data platforms, and analytics testing.
• The ideal candidate will have hands-on experience validating large-scale data pipelines, ensuring data integrity across cloud environments, and leveraging Generative AI to automate and enhance data quality processes.
• This role requires a strong understanding of Google BigQuery, SQL, ETL validation, Big Data technologies, and cloud-based analytics platforms. Experience with Claude, Agentic AI, RAG, and Docker is essential to support AI-driven data validation and intelligent quality assurance.

Key Responsibilities
Data Quality Assurance

• Design, develop, and execute comprehensive test plans for Big Data and analytics platforms.

• Validate data quality, completeness, consistency, and accuracy across large-scale datasets.

• Perform data reconciliation, schema validation, and data integrity checks throughout ETL/ELT pipelines.

• Identify, investigate, and resolve data discrepancies across multiple data sources.

• Validate business rules and ensure accurate reporting for downstream analytics and business intelligence.

Big Data & ETL Testing

• Validate ETL/ELT processes to ensure accurate extraction, transformation, and loading of enterprise data.

• Perform end-to-end testing of data ingestion, transformation, and reporting workflows.

• Validate high-volume data pipelines and monitor data quality across cloud platforms.

• Execute data reconciliation and schema validation between source and target systems.

• Support testing of distributed data processing frameworks.

Cloud & Data Platforms

• Validate data pipelines hosted on Google Cloud Platform (GCP) and Amazon Web Services (AWS).

• Perform data validation using Google BigQuery and SQL.

• Support testing of cloud-native data ingestion and transformation processes.

• Ensure reliable and scalable data quality across enterprise cloud environments.

Automation & Scripting

• Develop automated data validation scripts using Python, Shell Scripting, or similar technologies.

• Build reusable automation utilities for regression and reconciliation testing.

• Enhance automation coverage to reduce manual validation efforts.

GenAI & AI-Driven Data Quality

• Utilize Claude (mandatory) to create, optimize, and maintain SQL queries, reconciliation logic, validation rules, and analytical summaries.

• Implement AI-driven automation to replace manual data validation processes.

• Apply Generative AI for anomaly detection, trend analysis, intelligent reconciliation, and root cause analysis.

• Develop RAG (Retrieval-Augmented Generation) solutions using data dictionaries, metadata, pipeline documentation, and historical defects to improve AI accuracy.

• Build Agentic AI workflows that automate metadata validation, pipeline analysis, issue summarization, and recommended next actions.

• Containerize validation utilities and AI solutions using Docker for consistent execution across environments.

Collaboration

• Work closely with Data Engineers, Analytics Engineers, BI Developers, QA teams, and Product Owners.

• Participate in Agile ceremonies, sprint planning, backlog grooming, and release activities.

• Communicate data quality findings to both technical and business stakeholders.

Required Qualifications

• Minimum 5 years of experience in Software Quality Assurance with a strong focus on Big Data Testing and Analytics Quality Assurance.

• Strong hands-on experience with Google BigQuery.

• Advanced SQL skills for data validation and reconciliation.

• Experience validating ETL/ELT processes.

• Strong understanding of data quality principles and data integrity validation.

• Experience working with cloud platforms:

  • Google Cloud Platform (GCP)

  • Amazon Web Services (AWS)

• Excellent analytical, debugging, and problem-solving skills.

• Strong communication skills with the ability to explain technical findings to business stakeholders.

Required Technical Skills
Big Data

• Google BigQuery

• SQL

• Big Data Testing

• Data Validation

• Data Reconciliation

• Data Integrity

• Data Quality

ETL / ELT

• ETL Testing

• ELT Validation

• Data Pipelines

• Schema Validation

• Source-to-Target Validation

Data Processing

• Apache Beam

• Google Dataflow

• Apache Spark

Cloud

• Google Cloud Platform (GCP)

• Amazon Web Services (AWS)

Automation

• Python

• Shell Scripting

• Automation Frameworks

• Data Quality Automation

AI & GenAI

• Claude (Mandatory)

• Generative AI

• Agentic AI

• RAG (Retrieval-Augmented Generation)

• AI-Assisted Data Validation

• Intelligent Anomaly Detection

• Root Cause Analysis (RCA)

DevOps

• Docker

• CI/CD Pipelines

BI & Reporting

• Tableau

• Looker

Agile

• JIRA

• Confluence

• Agile/Scrum

Preferred Skills

• Experience testing enterprise data warehouses and analytics platforms.

• Experience validating streaming analytics and media data.

• Knowledge of enterprise metadata management and data governance.

• Familiarity with business intelligence reporting validation.

• Experience working with large-scale cloud-native data platforms.

Domain Experience

• Media & Entertainment (Preferred)

• Streaming Analytics

• Digital Analytics

• Business Intelligence

• Enterprise Data Platforms

Soft Skills

• Strong analytical and critical thinking abilities.

• Excellent troubleshooting and problem-solving skills.

• Strong written and verbal communication.

• Ability to collaborate with cross-functional teams.

• Self-driven with a continuous improvement mindset.

Primary Technologies

• Google BigQuery SQL ETL ELT GCP AWS Apache Spark Apache Beam Google Dataflow Python Shell Scripting Tableau Looker Data Quality Data Validation Claude Generative AI Agentic AI RAG Docker JIRA Confluence Agile

About ApTask:
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.

If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com

Applicant Consent:
By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy , and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or help@aptask.com. Message frequency may vary. Msg & data rates may apply.