Skip to content

Rule catalog ​

Every rule in the registry. Each page shows why the pattern fails in production, real detector output, the fix, and confirmation of the clean pattern it correctly leaves alone.

79rules
73measured FP rate
10families

Showing 79 of 79

RuleFamilySeverityTierFP rate
QA-CI-001continue-on-error masks a failing verification gateCI integrityerrorquarantine11% (n=19)
QA-CI-002Ignored exit code (|| true)CI integrityerrorextended11% (n=18)
QA-CI-005Report consumed but never generatedCI integrityerrorquarantine8% (n=13)
QA-CI-007Retry masks test failuresCI integritywarningextended0% (n=11)
QA-CI-008Always-success step masks failuresCI integrityerrorquarantine10% (n=10)
QA-CI-009Test command does not propagate exit codeCI integrityerrorextended0% (n=10)
QA-CI-010Tests skipped where they must blockCI integrityerrorquarantine10% (n=10)
QA-CI-013Verification gate conditioned so it can never fail the pipelineCI integrityerrorquarantineon assumption
QA-CI-014try/catch swallows a verification-stage failureCI integrityerrorquarantineon assumption
QA-CS-101Skipped testC# / .NETwarningextended0% (n=20)
QA-CS-102Hard sleep in testC# / .NETwarningextended8% (n=24)
QA-CS-103Test without assertionsC# / .NETerrorextended0% (n=11)
QA-CS-104Browser state shared across testsC# / .NETwarningextended0% (n=10)
QA-CS-105WaitForTimeoutAsync hard sleepC# / .NETwarningextended25% (n=16)
QA-CS-106Brittle selector instead of role-based locatorC# / .NETwarningquarantine33% (n=12)
QA-CS-107waitForLoadState(networkidle) usedC# / .NETwarningextended8% (n=12)
QA-CS-109Retry masks test failuresC# / .NETwarningextended0% (n=10)
QA-CYP-001Fixed cy.wait(n) hard-coded waitCypresswarningextended20% (n=15)
QA-CYP-002Focused test (.only)Cypresserrorquarantine0% (n=10)
QA-CYP-003Cypress config disables chromeWebSecurityCypresserrorquarantine0% (n=10)
QA-ENV-001Environment coupling in testEnvironmentwarningquarantine100% (n=20)
QA-JV-101Disabled testJava / JUnit · TestNGwarningcore0% (n=35)
QA-JV-102Hard sleep in testJava / JUnit · TestNGwarningextended26% (n=23)
QA-JV-103Test without assertionsJava / JUnit · TestNGerrorextended26% (n=58)
QA-JV-104Browser state shared across testsJava / JUnit · TestNGwarningextended20% (n=10)
QA-JV-105waitForTimeout hard sleepJava / JUnit · TestNGwarningextended10% (n=20)
QA-JV-106Brittle selector instead of role-based locatorJava / JUnit · TestNGwarningquarantine33% (n=12)
QA-JV-107waitForLoadState(networkidle) usedJava / JUnit · TestNGwarningextended0% (n=10)
QA-JV-109Retry masks test failuresJava / JUnit · TestNGwarningextended0% (n=18)
QA-PW-002Unawaited Playwright assertionPlaywrighterrorextended0% (n=20)
QA-PW-003Debug artifact committed to e2e specPlaywrighterrorextended10% (n=10)
QA-PW-004Brittle selector instead of role-based locatorPlaywrightwarningquarantine43% (n=14)
QA-PW-101Hard sleep via waitForTimeoutPlaywrighterrorextended0% (n=20)
QA-PW-102Load-event wait instead of web-first assertionPlaywrightwarningquarantine10% (n=10)
QA-PW-104trial:true click without follow-up assertionPlaywrightwarningextended0% (n=10)
QA-PW-113frameLocator chain deeper than 2Playwrightwarningextended0% (n=11)
QA-PW-115Shared page object across testsPlaywrightwarningquarantine56% (n=16)
QA-PW-116storageState without expiry strategyPlaywrightwarningextended0% (n=10)
QA-PW-117describe.serial without justificationPlaywrightwarningcore0% (n=35)
QA-PW-121Config retry/worker abusePlaywrightwarningextended0% (n=12)
QA-PW-122No trace capture on retryPlaywrightwarningextended6% (n=80)
QA-PW-123Hardcoded environment URL in specPlaywrightwarningquarantine46% (n=11)
QA-PW-124No smoke/regression project splitPlaywrightinfoextended7% (n=15)
QA-PW-125Global setup mutating shared statePlaywrightwarningextended0% (n=10)
QA-PW-140Screenshot without maxDiffPixelRatioPlaywrightwarningextended0% (n=10)
QA-PW-141Retries configured without a flake-triage loopPlaywrightwarningextended9% (n=33)
QA-PW-142Blanket route mockPlaywrightwarningextended18% (n=11)
QA-PW-143No screenshot/video capture on failurePlaywrightinfoextended6% (n=80)
QA-PW-144Single-browser project matrixPlaywrightinfoextended14% (n=21)
QA-PW-146CSS/XPath string selector instead of a normalized locatorPlaywrightwarningquarantine12% (n=17)
QA-PW-147Playwright codegen default test title (recording artifact)Playwrightinfoquarantineon assumption
QA-PY-001Focused test committedPython / pytesterrorextended0% (n=12)
QA-PY-002Skipped testPython / pytestwarningextended12% (n=25)
QA-PY-003Test function with no assertionsPython / pytesterrorquarantine52% (n=33)
QA-PY-004Bare truthiness assert on complex objectPython / pytestwarningquarantineon assumption
QA-PY-005time.sleep() in testPython / pytestwarningextended13% (n=23)
QA-PY-007pytest.raises without matchPython / pytestwarningquarantineon assumption
QA-PY-009Commented-out testPython / pytestwarningextended6% (n=18)
QA-PY-011Mutable fixture shared across testsPython / pytestwarningextended10% (n=10)
QA-PY-012Tautological assertionPython / pytesterrorquarantine40% (n=30)
QA-PY-101Sync/async Playwright API mixPython / pytestwarningextended0% (n=10)
QA-PY-103wait_for_timeout() as syncPython / pytestwarningextended8% (n=25)
QA-PY-104Brittle selector instead of role-based locatorPython / pytestwarningquarantine0% (n=10)
QA-PY-105Playwright test without assertionsPython / pytesterrorquarantine0% (n=12)
QA-PY-106Browser state shared across testsPython / pytestwarningextended0% (n=14)
QA-PY-107waitForLoadState(networkidle) usedPython / pytestwarningextended0% (n=10)
QA-PY-108Hardcoded URL in testPython / pytestwarningquarantine0% (n=16)
QA-SE-001Hard sleep before element lookup (Java, missing WebDriverWait)Selenium (cross-language)warningquarantine0% (n=10)
QA-SE-002Hard sleep before element lookup (C#, missing WebDriverWait)Selenium (cross-language)warningquarantine8% (n=13)
QA-SE-003Hard sleep before element lookup (Python, missing WebDriverWait)Selenium (cross-language)warningquarantine0% (n=11)
QA-TEST-001Focused test committedTest hygieneerrorquarantine60% (n=20)
QA-TEST-002Skipped testTest hygienewarningquarantine62% (n=21)
QA-TEST-003Test with no assertionsTest hygieneerrorquarantine22% (n=78)
QA-TEST-004Hard sleep in testTest hygienewarningextended30% (n=20)
QA-TEST-006Retry abuse hiding flakinessTest hygienewarningquarantine36% (n=11)
QA-TEST-010Empty test bodyTest hygieneerrorquarantine58% (n=31)
QA-TQUAL-002Tautological assertionTest qualityerrorquarantine53% (n=32)
QA-TQUAL-009Assertion in promise chain that is never awaitedTest qualityerrorquarantineon assumption
QA-TQUAL-011Commented-out testTest qualitywarningextended24% (n=25)

Generated, not written

This catalog is generated from the live rule registry — it cannot drift. Get the same data locally with mjolnir explain --list --md, or one rule at a time with mjolnir explain <RULE-ID>.

Released under the MIT License.