Skip to content

docs(qa): manual-test inventory + freenet-mail-qa skill#110

Merged
iduartgomez merged 2 commits intomainfrom
debug/next
May 4, 2026
Merged

docs(qa): manual-test inventory + freenet-mail-qa skill#110
iduartgomez merged 2 commits intomainfrom
debug/next

Conversation

@iduartgomez
Copy link
Copy Markdown
Contributor

Summary

  • New `docs/qa/manual-test-inventory.md` — coverage matrix across 9 feature areas with `auto` / `manual` / `automatable` / `blocked` per behavior. Auto rows link to the covering Playwright/Rust test; manual rows include a recipe.
  • New `.claude/skills/freenet-mail-qa/SKILL.md` — instructs agents on when to consult and update the matrix (pre-merge, post-bug-fix, pre-release).
  • AGENTS.md pointer in the End-to-end testing section so the inventory is discoverable.

Why

After #105/#106/#107/#108/#109 closed, automated suites are green but several behaviors (multi-recipient, search filter, auto-sign idempotency, backup round-trip, 3+ identities, reply-from-archive, Sent failure transition) are still manual-only or untested. The matrix surfaces them so the next contributor / agent can pick them off the backlog.

Test plan

  • Inventory file builds — pure markdown
  • Skill discoverable from `AGENTS.md`
  • Next agent that adds a UI test flips the matching row to `auto`

Cross-node send fails on iso harness because both contact imports
left `verified: false`, and `verify_on_send` defaults to true. The
send_msg path silently rejects (toast: "Recipient is not verified")
so bob never receives — root cause of the harness-only failure
tracked in #105.

The repro spec added in #104 already had this fix; live-node.spec.ts
just hadn't been updated. Tick `fm-verify-check` after filling the
local label so the import lands verified.
`docs/qa/manual-test-inventory.md` catalogs every behavior across
9 feature areas (Identity, Contacts, Inbox, Compose, Drafts, Sent,
Archive, Settings, Layout, Network) with a status of `auto` /
`manual` / `automatable` / `blocked` and either a link to the
covering test or a manual repro recipe.

`.claude/skills/freenet-mail-qa/SKILL.md` instructs agents on when
to consult the matrix (pre-merge, post-bug-fix, pre-release) and
how to update it when tests are added.

AGENTS.md gains a pointer at the top of the End-to-end testing
section so this is discoverable without explicit invocation.

Surfaced gaps for future automation:
- multi-recipient send
- verify_on_send toast on unverified contact
- search filter
- auto-sign idempotent on Resend
- settings round-trip across reload
- backup → restore round-trip
- 3+ identity switching
- reply from Archive folder
- Sent Pending → Failed on send error (needs failure-injection harness)
@iduartgomez iduartgomez merged commit c978666 into main May 4, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant