Quality Analysts

Quality Analyst

The Quality Analyst (QA) supports the Case Management Modernization (CMM) Program for the Administrative Office of the U.S. Courts (AO) by performing test analysis, planning, execution, and defect management within Agile development teams. The QA ensures that modernized application components—developed using React, NodeJS, and AWS—meet functional, performance, and compliance standards. Working closely with developers, automation engineers, and business analysts, this role contributes to the overall quality and reliability of the cloud-based case management solution delivered under the CMM Dev modernization initiative.

Key Responsibilities:

• Analyze requirements, user stories, and acceptance criteria to develop comprehensive test plans and test cases.
• Execute manual and automated tests to validate functionality, integration, and performance.
• Work closely with developers to identify, reproduce, and document defects and issues in Jira or equivalent Agile tools.
• Participate in Agile ceremonies (daily standups, sprint planning, backlog grooming, and retrospectives) to ensure quality integration across all phases.
• Verify API, UI, and data layer functionality across multiple environments in cloud-hosted systems.
• Support the Quality Assurance & Compliance Lead in ensuring all releases meet federal quality, accessibility, and documentation standards.
• Validate Section 508 accessibility compliance and ensure alignment with FedRAMP and NIST controls where applicable.
• Perform regression, smoke, and end-to-end testing to confirm system stability following each sprint or release.
• Collaborate with Automation Testers to enhance coverage and optimize test reusability.
• Track and report test results, coverage, and defect metrics to stakeholders and leadership.

Deliverable Alignment & Performance Outcomes:

• Test Plans and Test Cases: Developed and executed per sprint, mapped to SOW and functional requirements.
• Defect and Test Reports: Logged, triaged, and tracked in Jira with resolution status.
• Compliance Verification Artifacts: Accessibility validation and traceability documentation for audit readiness.
• Sprint Quality Metrics: Reports on test pass rates, defect closure, and code quality.
• Performance Outcomes:
• o ≥95% test case execution coverage per sprint.
• o ≥90% on-time defect resolution rate.
• o ≤5% reopened defects across cycles.
• o Zero release rollbacks due to undetected functional defects.

Required Skills & Experience:

• 6+ years of experience in software testing and quality analysis, preferably in Agile or SAFe environments.
• Experience creating and executing test plans, test scripts, and validation procedures for web-based applications.
• Proficiency in functional, regression, and integration testing methodologies.
• Working knowledge of Agile lifecycle tools (Jira, Azure DevOps, Rally) for tracking user stories, tests, and defects.
• Familiarity with cloud-hosted application testing and understanding of DevSecOps principles.
• Basic understanding of automation testing frameworks (Selenium, Playwright, Cypress).
• Strong analytical and problem-solving skills with attention to detail.
• Experience testing in federal or enterprise modernization programs.
• Familiarity with API testing tools such as Postman or ReadyAPI.
• Understanding of Section 508, FedRAMP, and NIST compliance testing requirements.
• Exposure to performance testing using tools like JMeter or LoadRunner.
• Knowledge of SQL and basic data validation queries.

Certifications:

• · ISTQB Certified Tester – Foundation Level (CTFL) – required.
• · Certified Agile Tester (CAT) or SAFe Practitioner – preferred.
• · AWS Cloud Practitioner or DevOps Foundations certification – beneficial.

Tools & Technologies:

• · Test management: Jira, Zephyr, TestRail.
• · Testing tools: Selenium, Playwright, Cypress, Postman.
• · CI/CD: Jenkins, GitLab CI/CD, GitHub Actions.
• · Reporting: Power BI, Jira dashboards, Confluence documentation.

QUALIFICATIONS:

• · 6+ years of experience testing software applications.
• · Bachelor's degree in computer science, Information Systems, or related discipline.
• · Sound understanding of unit testing, system testing, functional, regression, and integration testing methodologies.
• · Experience in developing test plans/procedures, expected outcomes, and verification statements.
• · Comprehensive understanding of Agile & DevOps methodology and culture.

COMMUNICATION & ORGANIZATIONAL

• · Excellent presentation and communication (oral and written) skills.
• · Consultant mindset with the ability to work with high level customer stakeholders and build excellent customer relationship.
• · Experience identifying and applying industry tools, solutions, methods best practices, and emerging technologies.
• · Strong analytical skills and problem-solving skills with the ability to formulate and communicate recommendations for improvement.
• · Demonstrated ability to work effectively, independently, and as part of a team.