Skip to content

Full Editing Manual Matrix

Use this matrix immediately before major merges/releases. It complements automated coverage and explicitly covers flows that are currently skipped in Playwright.

Execution metadata

FieldValue
Build/commit under test
Store under test
Tester
Start timestamp (ET)
End timestamp (ET)

Status legend

  • PASS: behavior matches expected result.
  • FAIL: behavior diverges; capture logs/screenshots and block merge.
  • N/A: not applicable for this release; explain why.

Matrix

IDAreaScenarioExpected resultAutomated coverageManual status
E-001Task setupCreate task with product-level filter onlyTask creates and appears in history with correct filter summaryYes (tests/bulk-tasks/filter-and-controls.pw.spec.ts)
E-002TagsTags addMatching products gain tag; non-matching products unchangedYes (tests/bulk-tasks/basic-actions.pw.spec.ts)
E-003TagsTags removeTag removed only from matching products where presentPartial
E-004TitleReplace titleTitle updates to expected value/pattern outputYes (tests/textFields-flow.pw.spec.ts)
E-005DescriptionAppend descriptionDescription appends once, preserves existing contentYes (tests/textFields-flow.pw.spec.ts)
E-006SEOReplace SEO titleSEO title updates and rollback restores prior valueYes (tests/textFields-flow.pw.spec.ts)
E-007SEOReplace SEO descriptionSEO description updates and rollback restores prior valueYes (tests/textFields-flow.pw.spec.ts)
E-008SEOReplace handleHandle updates to valid slug and rollback succeedsYes (tests/textFields-flow.pw.spec.ts)
E-009VendorReplace vendorVendor updates on all matching productsPartial
E-010Product typeReplace product typeProduct type updates on all matching productsPartial
E-011StatusSet status to draft/activeStatus transitions to selected target without user errorsPartial
E-012MetafieldSet metafield valueNamespace/key/type/value stored exactly; preview and logs reflect set actionYes (tests/bulk-tasks/basic-actions.pw.spec.ts)
E-013MetafieldRemove metafieldTarget metafield removed; unrelated metafields untouchedPartial
E-014CollectionsAdd to manual collectionProduct added to selected manual collection(s)Yes (tests/bulk-tasks/basic-actions.pw.spec.ts)
E-015CollectionsRemove from collectionProduct removed from selected collection(s) onlyPartial
E-016PriceSet price on all variantsVariant prices updated; compare-at behavior matches configured togglesYes (tests/bulk-tasks/basic-actions.pw.spec.ts)
E-017PriceIncrease/decrease percent and roundComputed values and rounding target match expectationsPartial
E-018SKUReplace SKU with variant filterOnly targeted variants update SKUYes (tests/bulk-tasks/sku-and-barcode.pw.spec.ts)
E-019BarcodeAppend barcode suffix with variant filterOnly targeted variants update barcodeYes (tests/bulk-tasks/sku-and-barcode.pw.spec.ts)
E-020Variant targetingBy numberOnly Nth matching variant is edited per productYes (tests/bulk-variants/variant-actions.pw.spec.ts)
E-021Variant targetingBy option valueOnly variants matching option rule are editedYes (tests/bulk-variants/variant-actions.pw.spec.ts)
E-022Variant addAdd new variant rowNew variant created with configured option/price/SKU/barcode fieldsPartial
E-023Variant editEdit existing variant fieldsTargeted variant fields update correctlyYes (tests/bulk-variants/variant-actions.pw.spec.ts)
E-024Variant deleteDelete targeted variantsTargeted variants removed; guardrails prevent invalid product stateYes (tests/bulk-variants/variant-actions.pw.spec.ts)
E-025Variant cloneClone variants/options from source productTarget product variants/options mirror source configurationSkipped (VA-3)
E-026Variants & optionsOption renameOption name changes across targeted products and remains consistent in AdminPartial
E-027Variants & optionsOptions reorderOption order changes persist and variant data remains validPartial
E-028Variants & optionsOption values reorderValue order updates for chosen option and variants remain editablePartial
E-029FilteringVariant SKU rule in filter builderVariant SKU field rule works as expected in preview/task targetingSkipped
E-030CSVImport CSV creates jobs (file upload path)Valid CSV creates queued jobs and surfaces completion statusSkipped
E-031CSVImport CSV creates jobs (paste flow)Pasted CSV path creates queued jobs successfullySkipped
E-032CSVCSV validation errorsInvalid CSV rows return clear validation errors, no jobs createdPartial
E-033PreviewPreview count and sample rowsPreview reflects filters/actions and gracefully handles transient count errorsYes (tests/preview.test.ts, tests/previewTable.action.test.ts)
E-034Task historyRollback completed taskRollback creates inverse job and restores prior valuesYes (tests/rollback-route.test.ts, tests/rollback.server.test.ts)
E-035Billing gateUsage cap redirect and recoveryOver-cap routes to billing/usage, upgrade returns app to editable statePartial
E-036Billing lifecycleInstall -> subscribe -> uninstall auto-cancel -> reinstall -> re-subscribeLifecycle succeeds with correct subscription state transitionsManual-only

Required pass criteria before merge

  • All rows marked PASS or N/A with rationale.
  • Any FAIL row blocks merge until fixed and re-tested.
  • Row E-036 must be PASS on the final pre-merge run.