Skip to content

test(e2e): add CLI conformance baseline - #2871

Draft
elezar wants to merge 3 commits into
mainfrom
codex/2183-cli-conformance-minimal
Draft

test(e2e): add CLI conformance baseline#2871
elezar wants to merge 3 commits into
mainfrom
codex/2183-cli-conformance-minimal

Conversation

@elezar

@elezar elezar commented Aug 21, 2026

Copy link
Copy Markdown
Member

Summary

Establish a portable CLI conformance baseline by selecting existing E2E workflows rather than duplicating their implementations. Driver lanes enable the same profile where those workflows already run, while VM-only filesystem assertions remain driver-specific.

This is stack 1/2. PR #2873 adds the direct API conformance framework on top.

Related Issue

Changes

  • add the e2e-cli-conformance profile and focused mise run e2e:cli-conformance task
  • classify smoke, sandbox_lifecycle, and sandbox_labels as portable CLI conformance targets
  • enable the profile in Docker, Podman, Kubernetes, and VM wrappers where those targets already run
  • keep the canonical Docker E2E task running the promoted targets
  • extract VM overlay and TLS-key permission assertions into the VM-specific vm_overlay target
  • document the portable and driver-specific test boundary

Testing

  • locked compilation of smoke, lifecycle, labels, and VM overlay targets
  • Rust formatting checks
  • shell syntax checks for modified E2E wrappers
  • git diff --check
  • live driver-backed CLI conformance runs
  • mise run pre-commit (mise is unavailable in the current environment)

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)
  • Portable test implementations are reused rather than duplicated
  • Driver-specific VM assertions remain outside conformance
  • Documentation updated

elezar added 3 commits August 21, 2026 13:22
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
@elezar elezar added the test:e2e Requires end-to-end coverage label Aug 21, 2026
@copy-pr-bot

copy-pr-bot Bot commented Aug 21, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions

Copy link
Copy Markdown

Label test:e2e applied, but pull-request/2871 does not exist yet. A maintainer needs to comment /ok to test 4180d62b99b1e3d9891f8281cd0a1adb2e10ac3b to mirror this PR. Once the mirror exists, re-apply the label or re-run Branch E2E Checks from the Actions tab.

@elezar elezar changed the title test(e2e): add minimal CLI conformance profile test(e2e): add CLI conformance baseline Aug 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test:e2e Requires end-to-end coverage

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant