Rule catalog
Every rule in the registry. Each page shows why the pattern fails in production, real detector output, the fix, and confirmation of the clean pattern it correctly leaves alone.
79rules
73measured FP rate
10families
Showing 79 of 79
| Rule | Family | Severity | Tier | FP rate |
|---|---|---|---|---|
| QA-CI-001continue-on-error masks a failing verification gate | CI integrity | error | quarantine | 11% (n=19) |
| QA-CI-002Ignored exit code (|| true) | CI integrity | error | extended | 11% (n=18) |
| QA-CI-005Report consumed but never generated | CI integrity | error | quarantine | 8% (n=13) |
| QA-CI-007Retry masks test failures | CI integrity | warning | extended | 0% (n=11) |
| QA-CI-008Always-success step masks failures | CI integrity | error | quarantine | 10% (n=10) |
| QA-CI-009Test command does not propagate exit code | CI integrity | error | extended | 0% (n=10) |
| QA-CI-010Tests skipped where they must block | CI integrity | error | quarantine | 10% (n=10) |
| QA-CI-013Verification gate conditioned so it can never fail the pipeline | CI integrity | error | quarantine | on assumption |
| QA-CI-014try/catch swallows a verification-stage failure | CI integrity | error | quarantine | on assumption |
| QA-CS-101Skipped test | C# / .NET | warning | extended | 0% (n=20) |
| QA-CS-102Hard sleep in test | C# / .NET | warning | extended | 8% (n=24) |
| QA-CS-103Test without assertions | C# / .NET | error | extended | 0% (n=11) |
| QA-CS-104Browser state shared across tests | C# / .NET | warning | extended | 0% (n=10) |
| QA-CS-105WaitForTimeoutAsync hard sleep | C# / .NET | warning | extended | 25% (n=16) |
| QA-CS-106Brittle selector instead of role-based locator | C# / .NET | warning | quarantine | 33% (n=12) |
| QA-CS-107waitForLoadState(networkidle) used | C# / .NET | warning | extended | 8% (n=12) |
| QA-CS-109Retry masks test failures | C# / .NET | warning | extended | 0% (n=10) |
| QA-CYP-001Fixed cy.wait(n) hard-coded wait | Cypress | warning | extended | 20% (n=15) |
| QA-CYP-002Focused test (.only) | Cypress | error | quarantine | 0% (n=10) |
| QA-CYP-003Cypress config disables chromeWebSecurity | Cypress | error | quarantine | 0% (n=10) |
| QA-ENV-001Environment coupling in test | Environment | warning | quarantine | 100% (n=20) |
| QA-JV-101Disabled test | Java / JUnit · TestNG | warning | core | 0% (n=35) |
| QA-JV-102Hard sleep in test | Java / JUnit · TestNG | warning | extended | 26% (n=23) |
| QA-JV-103Test without assertions | Java / JUnit · TestNG | error | extended | 26% (n=58) |
| QA-JV-104Browser state shared across tests | Java / JUnit · TestNG | warning | extended | 20% (n=10) |
| QA-JV-105waitForTimeout hard sleep | Java / JUnit · TestNG | warning | extended | 10% (n=20) |
| QA-JV-106Brittle selector instead of role-based locator | Java / JUnit · TestNG | warning | quarantine | 33% (n=12) |
| QA-JV-107waitForLoadState(networkidle) used | Java / JUnit · TestNG | warning | extended | 0% (n=10) |
| QA-JV-109Retry masks test failures | Java / JUnit · TestNG | warning | extended | 0% (n=18) |
| QA-PW-002Unawaited Playwright assertion | Playwright | error | extended | 0% (n=20) |
| QA-PW-003Debug artifact committed to e2e spec | Playwright | error | extended | 10% (n=10) |
| QA-PW-004Brittle selector instead of role-based locator | Playwright | warning | quarantine | 43% (n=14) |
| QA-PW-101Hard sleep via waitForTimeout | Playwright | error | extended | 0% (n=20) |
| QA-PW-102Load-event wait instead of web-first assertion | Playwright | warning | quarantine | 10% (n=10) |
| QA-PW-104trial:true click without follow-up assertion | Playwright | warning | extended | 0% (n=10) |
| QA-PW-113frameLocator chain deeper than 2 | Playwright | warning | extended | 0% (n=11) |
| QA-PW-115Shared page object across tests | Playwright | warning | quarantine | 56% (n=16) |
| QA-PW-116storageState without expiry strategy | Playwright | warning | extended | 0% (n=10) |
| QA-PW-117describe.serial without justification | Playwright | warning | core | 0% (n=35) |
| QA-PW-121Config retry/worker abuse | Playwright | warning | extended | 0% (n=12) |
| QA-PW-122No trace capture on retry | Playwright | warning | extended | 6% (n=80) |
| QA-PW-123Hardcoded environment URL in spec | Playwright | warning | quarantine | 46% (n=11) |
| QA-PW-124No smoke/regression project split | Playwright | info | extended | 7% (n=15) |
| QA-PW-125Global setup mutating shared state | Playwright | warning | extended | 0% (n=10) |
| QA-PW-140Screenshot without maxDiffPixelRatio | Playwright | warning | extended | 0% (n=10) |
| QA-PW-141Retries configured without a flake-triage loop | Playwright | warning | extended | 9% (n=33) |
| QA-PW-142Blanket route mock | Playwright | warning | extended | 18% (n=11) |
| QA-PW-143No screenshot/video capture on failure | Playwright | info | extended | 6% (n=80) |
| QA-PW-144Single-browser project matrix | Playwright | info | extended | 14% (n=21) |
| QA-PW-146CSS/XPath string selector instead of a normalized locator | Playwright | warning | quarantine | 12% (n=17) |
| QA-PW-147Playwright codegen default test title (recording artifact) | Playwright | info | quarantine | on assumption |
| QA-PY-001Focused test committed | Python / pytest | error | extended | 0% (n=12) |
| QA-PY-002Skipped test | Python / pytest | warning | extended | 12% (n=25) |
| QA-PY-003Test function with no assertions | Python / pytest | error | quarantine | 52% (n=33) |
| QA-PY-004Bare truthiness assert on complex object | Python / pytest | warning | quarantine | on assumption |
| QA-PY-005time.sleep() in test | Python / pytest | warning | extended | 13% (n=23) |
| QA-PY-007pytest.raises without match | Python / pytest | warning | quarantine | on assumption |
| QA-PY-009Commented-out test | Python / pytest | warning | extended | 6% (n=18) |
| QA-PY-011Mutable fixture shared across tests | Python / pytest | warning | extended | 10% (n=10) |
| QA-PY-012Tautological assertion | Python / pytest | error | quarantine | 40% (n=30) |
| QA-PY-101Sync/async Playwright API mix | Python / pytest | warning | extended | 0% (n=10) |
| QA-PY-103wait_for_timeout() as sync | Python / pytest | warning | extended | 8% (n=25) |
| QA-PY-104Brittle selector instead of role-based locator | Python / pytest | warning | quarantine | 0% (n=10) |
| QA-PY-105Playwright test without assertions | Python / pytest | error | quarantine | 0% (n=12) |
| QA-PY-106Browser state shared across tests | Python / pytest | warning | extended | 0% (n=14) |
| QA-PY-107waitForLoadState(networkidle) used | Python / pytest | warning | extended | 0% (n=10) |
| QA-PY-108Hardcoded URL in test | Python / pytest | warning | quarantine | 0% (n=16) |
| QA-SE-001Hard sleep before element lookup (Java, missing WebDriverWait) | Selenium (cross-language) | warning | quarantine | 0% (n=10) |
| QA-SE-002Hard sleep before element lookup (C#, missing WebDriverWait) | Selenium (cross-language) | warning | quarantine | 8% (n=13) |
| QA-SE-003Hard sleep before element lookup (Python, missing WebDriverWait) | Selenium (cross-language) | warning | quarantine | 0% (n=11) |
| QA-TEST-001Focused test committed | Test hygiene | error | quarantine | 60% (n=20) |
| QA-TEST-002Skipped test | Test hygiene | warning | quarantine | 62% (n=21) |
| QA-TEST-003Test with no assertions | Test hygiene | error | quarantine | 22% (n=78) |
| QA-TEST-004Hard sleep in test | Test hygiene | warning | extended | 30% (n=20) |
| QA-TEST-006Retry abuse hiding flakiness | Test hygiene | warning | quarantine | 36% (n=11) |
| QA-TEST-010Empty test body | Test hygiene | error | quarantine | 58% (n=31) |
| QA-TQUAL-002Tautological assertion | Test quality | error | quarantine | 53% (n=32) |
| QA-TQUAL-009Assertion in promise chain that is never awaited | Test quality | error | quarantine | on assumption |
| QA-TQUAL-011Commented-out test | Test quality | warning | extended | 24% (n=25) |
Generated, not written
This catalog is generated from the live rule registry — it cannot drift. Get the same data locally with mjolnir explain --list --md, or one rule at a time with mjolnir explain <RULE-ID>.