[ExecuTorch][WebGPU] Add certified scoped output suppression#21127
[ExecuTorch][WebGPU] Add certified scoped output suppression#21127JCNTH wants to merge 3 commits into
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21127
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ⏳ No Failures, 1 PendingAs of commit aaf3084 with merge base 86c3470 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
Stack from ghstack (oldest at bottom):
When a caller discards a model's terminal output tensor, the backend still
dispatches the final quantized-linear range and reads it back, wasting a
dispatch and a device-to-host copy on every execution. This adds a default-off,
certificate-bound execution option that suppresses exactly one explicitly
certified terminal output dispatch range and its readback. The certificate must
bind the exact PTE and method and prove a single delegate, no portable nodes,
and a unique leaf output resolving to the caller's host buffer; anything
ambiguous, aliased, portable, or uncertified fails closed and executes
normally. No Vulkan analogue (WebGPU runtime output-contract change).
Key changes:
ScopedWebGPUExecutionOptions, and plan_webgpu_execution suppression planner.
dispatch range and readback when suppression is active.
@exported-using-ghexport
Differential Revision: D113171751
Differential Revision: D113171751