Skip to content

Add stable Next.js eager and lazy test coverage#1747

Open
ijjk wants to merge 2 commits intomainfrom
ijjk/eager-testing
Open

Add stable Next.js eager and lazy test coverage#1747
ijjk wants to merge 2 commits intomainfrom
ijjk/eager-testing

Conversation

@ijjk
Copy link
Copy Markdown
Member

@ijjk ijjk commented Apr 15, 2026 •
edited
Loading

Summary

  • run stable nextjs-turbopack and nextjs-webpack in both lazyDiscovery enabled and disabled modes
  • keep @workflow/next and the e2e helpers aligned with env-driven eager/deferred detection
  • update result parsing for the new artifact names

Alternative to #1713

Testing

  • pnpm vitest run packages/next/src/index.test.ts packages/next/src/builder.test.ts
  • APP_NAME=nextjs-turbopack WORKFLOW_NEXT_LAZY_DISCOVERY=0 pnpm vitest run packages/core/e2e/local-build.test.ts
  • APP_NAME=nextjs-turbopack WORKFLOW_NEXT_LAZY_DISCOVERY=1 pnpm vitest run packages/core/e2e/local-build.test.ts
  • APP_NAME=nextjs-webpack WORKFLOW_NEXT_LAZY_DISCOVERY=0 pnpm vitest run packages/core/e2e/local-build.test.ts
  • APP_NAME=nextjs-webpack WORKFLOW_NEXT_LAZY_DISCOVERY=1 pnpm vitest run packages/core/e2e/local-build.test.ts

@ijjk ijjk requested a review from a team as a code owner April 15, 2026 19:04
@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 15, 2026 •
edited
Loading

🦋 Changeset detected

Latest commit: ec052a0

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
Name Type
@workflow/next Patch
workflow Patch
@workflow/ai Patch
@workflow/world-testing Patch
@workflow/core Patch
@workflow/builders Patch
@workflow/cli Patch
@workflow/nitro Patch
@workflow/vitest Patch
@workflow/web-shared Patch
@workflow/web Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 15, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Building Building Preview, Comment Apr 15, 2026 7:39pm
example-nextjs-workflow-webpack Building Building Preview, Comment Apr 15, 2026 7:39pm
example-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-astro-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-express-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-fastify-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-hono-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-nitro-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-nuxt-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-sveltekit-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workbench-vite-workflow Building Building Preview, Comment Apr 15, 2026 7:39pm
workflow-docs Building Building Preview, Comment, Open in v0 Apr 15, 2026 7:39pm
workflow-swc-playground Building Building Preview, Comment Apr 15, 2026 7:39pm
workflow-web Ready Ready Preview, Comment Apr 15, 2026 7:39pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 15, 2026 •
edited
Loading

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.041s (+3.2%) 1.005s (~) 0.963s 10 1.00x
💻 Local Express 0.044s (+24.2% 🔺) 1.005s (~) 0.962s 10 1.05x
💻 Local Next.js (Turbopack) 0.047s 1.005s 0.958s 10 1.14x
🐘 Postgres Next.js (Turbopack) 0.056s 1.010s 0.954s 10 1.35x
🐘 Postgres Nitro 0.059s (-0.8%) 1.011s (~) 0.952s 10 1.42x
🐘 Postgres Express 0.060s (-5.6% 🟢) 1.011s (~) 0.950s 10 1.46x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 0.318s (+19.1% 🔺) 2.129s (-21.3% 🟢) 1.811s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.120s 2.006s 0.886s 10 1.00x
💻 Local Express 1.129s (+2.8%) 2.006s (~) 0.877s 10 1.01x
💻 Local Nitro 1.130s (+2.9%) 2.006s (~) 0.877s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.139s 2.011s 0.872s 10 1.02x
🐘 Postgres Nitro 1.147s (~) 2.011s (~) 0.864s 10 1.02x
🐘 Postgres Express 1.149s (~) 2.012s (~) 0.862s 10 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.946s (-20.4% 🟢) 3.255s (-23.4% 🟢) 1.309s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 10.807s 11.023s 0.216s 3 1.00x
🐘 Postgres Next.js (Turbopack) 10.824s 11.021s 0.197s 3 1.00x
💻 Local Express 10.923s (+2.7%) 11.024s (~) 0.101s 3 1.01x
💻 Local Nitro 10.926s (+2.5%) 11.023s (~) 0.097s 3 1.01x
🐘 Postgres Express 10.966s (+1.2%) 11.021s (~) 0.055s 3 1.01x
🐘 Postgres Nitro 10.972s (~) 11.027s (~) 0.055s 3 1.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 19.595s (+12.1% 🔺) 20.720s (+6.5% 🔺) 1.125s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 14.487s 15.023s 0.536s 4 1.00x
🐘 Postgres Express 14.598s (+0.9%) 15.024s (~) 0.426s 4 1.01x
💻 Local Next.js (Turbopack) 14.620s 15.029s 0.409s 4 1.01x
🐘 Postgres Nitro 14.632s (~) 15.026s (~) 0.394s 4 1.01x
💻 Local Nitro 14.926s (+4.5%) 15.028s (~) 0.102s 4 1.03x
💻 Local Express 14.976s (+5.4% 🔺) 15.030s (~) 0.053s 4 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 35.315s (-3.0%) 36.681s (-4.5%) 1.366s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 13.986s 14.307s 0.322s 7 1.00x
🐘 Postgres Express 14.162s (+2.0%) 15.024s (+7.1% 🔺) 0.863s 6 1.01x
🐘 Postgres Nitro 14.175s (~) 15.022s (+0.9%) 0.847s 6 1.01x
💻 Local Next.js (Turbopack) 16.004s 16.363s 0.360s 6 1.14x
💻 Local Nitro 16.578s (+10.1% 🔺) 17.029s (+8.5% 🔺) 0.451s 6 1.19x
💻 Local Express 16.674s (+12.1% 🔺) 17.031s (+13.3% 🔺) 0.357s 6 1.19x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 57.996s (+1.9%) 59.570s (+1.3%) 1.574s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.243s 2.010s 0.767s 15 1.00x
🐘 Postgres Nitro 1.268s (-3.1%) 2.009s (~) 0.741s 15 1.02x
🐘 Postgres Express 1.269s (-0.8%) 2.009s (~) 0.740s 15 1.02x
💻 Local Nitro 1.484s (+1.1%) 2.005s (~) 0.521s 15 1.19x
💻 Local Next.js (Turbopack) 1.511s 2.005s 0.494s 15 1.22x
💻 Local Express 1.516s (+3.4%) 2.006s (~) 0.490s 15 1.22x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 53.007s (+2185.8% 🔺) 54.356s (+1255.0% 🔺) 1.349s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.345s (+0.6%) 3.010s (~) 0.665s 10 1.00x
🐘 Postgres Nitro 2.355s (-0.5%) 3.009s (~) 0.654s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.399s 3.009s 0.611s 10 1.02x
💻 Local Next.js (Turbopack) 2.783s 3.453s 0.671s 9 1.19x
💻 Local Express 2.909s (+5.4% 🔺) 3.008s (-3.2%) 0.099s 10 1.24x
💻 Local Nitro 2.940s (+3.1%) 3.453s (+11.1% 🔺) 0.513s 9 1.25x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.048s (-5.7% 🟢) 4.441s (-5.7% 🟢) 1.393s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.485s (~) 4.011s (~) 0.526s 8 1.00x
🐘 Postgres Express 3.486s (+0.6%) 4.011s (~) 0.525s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.681s 4.012s 0.332s 8 1.06x
💻 Local Nitro 8.092s (+12.1% 🔺) 8.768s (+9.4% 🔺) 0.676s 4 2.32x
💻 Local Express 8.101s (+16.2% 🔺) 8.772s (+18.2% 🔺) 0.671s 4 2.32x
💻 Local Next.js (Turbopack) 8.383s 8.770s 0.388s 4 2.41x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.758s (-2.7%) 5.193s (-7.3% 🟢) 1.435s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.232s 2.009s 0.777s 15 1.00x
🐘 Postgres Nitro 1.249s (~) 2.008s (~) 0.759s 15 1.01x
🐘 Postgres Express 1.266s (+0.6%) 2.010s (~) 0.744s 15 1.03x
💻 Local Next.js (Turbopack) 1.497s 2.006s 0.509s 15 1.22x
💻 Local Nitro 1.512s (+2.3%) 2.005s (~) 0.494s 15 1.23x
💻 Local Express 1.585s (+6.3% 🔺) 2.005s (~) 0.420s 15 1.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.841s (+21.8% 🔺) 3.961s (-2.2%) 1.120s 8 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.329s (-0.5%) 3.010s (~) 0.681s 10 1.00x
🐘 Postgres Nitro 2.329s (~) 3.012s (~) 0.683s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.399s 3.009s 0.610s 10 1.03x
💻 Local Next.js (Turbopack) 2.847s 3.566s 0.718s 9 1.22x
💻 Local Nitro 2.960s (+9.1% 🔺) 3.760s (+25.0% 🔺) 0.800s 8 1.27x
💻 Local Express 3.174s (+20.0% 🔺) 3.885s (+29.1% 🔺) 0.711s 8 1.36x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.077s (-41.0% 🟢) 4.802s (-32.2% 🟢) 1.724s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.464s (~) 4.010s (~) 0.546s 8 1.00x
🐘 Postgres Nitro 3.506s (+2.0%) 4.010s (~) 0.504s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.663s 4.010s 0.347s 8 1.06x
💻 Local Next.js (Turbopack) 7.941s 8.519s 0.578s 4 2.29x
💻 Local Nitro 8.673s (+10.1% 🔺) 9.022s (+9.1% 🔺) 0.349s 4 2.50x
💻 Local Express 9.709s (+32.5% 🔺) 10.357s (+29.2% 🔺) 0.648s 3 2.80x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 4.432s (-45.2% 🟢) 6.079s (-44.3% 🟢) 1.647s 5 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.789s 1.006s 0.217s 60 1.00x
🐘 Postgres Express 0.847s (+1.0%) 1.007s (-1.6%) 0.160s 60 1.07x
🐘 Postgres Nitro 0.849s (+4.6%) 1.006s (~) 0.157s 60 1.08x
💻 Local Next.js (Turbopack) 0.857s 1.022s 0.164s 59 1.09x
💻 Local Nitro 0.979s (+36.0% 🔺) 1.116s (+11.1% 🔺) 0.137s 54 1.24x
💻 Local Express 0.990s (+43.5% 🔺) 1.255s (+24.9% 🔺) 0.265s 48 1.25x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 9.728s (-9.6% 🟢) 11.261s (-11.6% 🟢) 1.533s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.890s 2.053s 0.163s 44 1.00x
🐘 Postgres Nitro 2.012s (+4.2%) 2.608s (+22.8% 🔺) 0.596s 35 1.06x
🐘 Postgres Express 2.132s (+9.3% 🔺) 2.913s (+35.5% 🔺) 0.781s 31 1.13x
💻 Local Next.js (Turbopack) 2.662s 3.008s 0.346s 30 1.41x
💻 Local Nitro 3.006s (+32.5% 🔺) 3.378s (+12.3% 🔺) 0.372s 27 1.59x
💻 Local Express 3.025s (+35.6% 🔺) 3.689s (+22.7% 🔺) 0.663s 25 1.60x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 338.939s (+894.2% 🔺) 340.593s (+844.7% 🔺) 1.654s 1 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 3.804s 4.077s 0.273s 30 1.00x
🐘 Postgres Nitro 4.004s (+1.3%) 4.455s (+4.8%) 0.451s 27 1.05x
🐘 Postgres Express 4.149s (+5.6% 🔺) 4.931s (+16.9% 🔺) 0.783s 25 1.09x
💻 Local Next.js (Turbopack) 8.646s 9.088s 0.442s 14 2.27x
💻 Local Express 9.108s (+24.8% 🔺) 9.710s (+21.1% 🔺) 0.602s 13 2.39x
💻 Local Nitro 9.152s (+24.1% 🔺) 9.864s (+23.1% 🔺) 0.713s 13 2.41x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 82.706s (-5.0% 🟢) 83.695s (-5.7% 🟢) 0.989s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.258s 1.007s 0.749s 60 1.00x
🐘 Postgres Nitro 0.283s (+1.5%) 1.007s (~) 0.725s 60 1.10x
🐘 Postgres Express 0.284s (+2.1%) 1.007s (~) 0.723s 60 1.10x
💻 Local Nitro 0.568s (-6.7% 🟢) 1.004s (-1.6%) 0.436s 60 2.20x
💻 Local Express 0.579s (+5.2% 🔺) 1.005s (~) 0.425s 60 2.25x
💻 Local Next.js (Turbopack) 0.602s 1.005s 0.403s 60 2.34x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 78.167s (+4663.2% 🔺) 79.520s (+2231.7% 🔺) 1.352s 4 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.487s (-1.1%) 1.006s (~) 0.519s 90 1.00x
🐘 Postgres Nitro 0.499s (+3.5%) 1.007s (~) 0.508s 90 1.02x
🐘 Postgres Next.js (Turbopack) 0.506s 1.007s 0.501s 90 1.04x
💻 Local Nitro 2.473s (+2.1%) 3.008s (~) 0.536s 30 5.07x
💻 Local Express 2.592s (+8.8% 🔺) 3.009s (~) 0.416s 30 5.32x
💻 Local Next.js (Turbopack) 2.600s 3.009s 0.409s 30 5.34x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.995s (+21.2% 🔺) 5.345s (+5.9% 🔺) 1.350s 18 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.803s (+2.9%) 1.008s (~) 0.206s 119 1.00x
🐘 Postgres Nitro 0.805s (~) 1.009s (~) 0.203s 119 1.00x
🐘 Postgres Next.js (Turbopack) 0.828s 1.016s 0.188s 119 1.03x
💻 Local Next.js (Turbopack) 10.640s 11.207s 0.567s 11 13.25x
💻 Local Express 11.079s (+8.8% 🔺) 11.666s (+9.1% 🔺) 0.587s 11 13.80x
💻 Local Nitro 11.110s (+7.7% 🔺) 11.756s (+8.3% 🔺) 0.646s 11 13.84x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 28.766s (+76.0% 🔺) 30.359s (+66.7% 🔺) 1.592s 11 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 0.170s 1.002s 0.012s 1.018s 0.848s 10 1.00x
🐘 Postgres Next.js (Turbopack) 0.197s 1.001s 0.001s 1.010s 0.813s 10 1.16x
💻 Local Nitro 0.200s (+38.2% 🔺) 1.004s (~) 0.011s (+16.3% 🔺) 1.018s (~) 0.818s 10 1.18x
💻 Local Express 0.208s (+50.7% 🔺) 1.004s (~) 0.012s (+20.4% 🔺) 1.018s (~) 0.809s 10 1.23x
🐘 Postgres Express 0.211s (-1.1%) 0.997s (+0.5%) 0.001s (-20.0% 🟢) 1.011s (~) 0.799s 10 1.24x
🐘 Postgres Nitro 0.223s (+7.6% 🔺) 0.998s (~) 0.002s (+100.0% 🔺) 1.011s (~) 0.787s 10 1.31x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.679s (+8.5% 🔺) 2.851s (-6.6% 🟢) 1.184s (+33.6% 🔺) 4.365s (-1.2%) 2.686s 10 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.617s (~) 1.005s (~) 0.004s (+4.9%) 1.024s (~) 0.406s 59 1.00x
🐘 Postgres Express 0.628s (+2.4%) 1.005s (-1.4%) 0.005s (+65.5% 🔺) 1.023s (-1.3%) 0.396s 59 1.02x
🐘 Postgres Next.js (Turbopack) 0.636s 1.009s 0.006s 1.024s 0.389s 59 1.03x
💻 Local Next.js (Turbopack) 0.660s 1.011s 0.010s 1.024s 0.364s 59 1.07x
💻 Local Nitro 0.725s (-7.1% 🟢) 1.012s (~) 0.009s (~) 1.023s (-16.6% 🟢) 0.297s 59 1.18x
💻 Local Express 0.732s (-5.8% 🟢) 1.012s (~) 0.009s (-1.0%) 1.024s (-16.6% 🟢) 0.292s 59 1.19x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 4.730s (~) 5.642s (-6.1% 🟢) 0.257s (-12.6% 🟢) 6.359s (-5.8% 🟢) 1.628s 10 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.941s (-1.1%) 1.170s (+4.4%) 0.000s (+Infinity% 🔺) 1.197s (+5.4% 🔺) 0.257s 51 1.00x
🐘 Postgres Express 0.959s (+1.2%) 1.194s (+6.4% 🔺) 0.000s (+6.0% 🔺) 1.208s (+5.2% 🔺) 0.249s 50 1.02x
🐘 Postgres Next.js (Turbopack) 0.974s 1.278s 0.000s 1.287s 0.312s 47 1.04x
💻 Local Nitro 1.216s (+2.8%) 2.020s (~) 0.000s (+85.7% 🔺) 2.022s (~) 0.805s 30 1.29x
💻 Local Express 1.230s (+7.7% 🔺) 2.021s (~) 0.000s (+62.5% 🔺) 2.023s (~) 0.794s 30 1.31x
💻 Local Next.js (Turbopack) 1.268s 2.021s 0.000s 2.024s 0.755s 30 1.35x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.450s (-16.5% 🟢) 4.454s (-19.8% 🟢) 0.000s (+Infinity% 🔺) 4.812s (-20.2% 🟢) 1.362s 13 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.730s (-1.1%) 2.104s (~) 0.000s (-50.0% 🟢) 2.123s (~) 0.392s 29 1.00x
🐘 Postgres Nitro 1.761s (+2.9%) 2.140s (+3.4%) 0.000s (-100.0% 🟢) 2.164s (+1.8%) 0.404s 28 1.02x
🐘 Postgres Next.js (Turbopack) 1.833s 2.106s 0.000s 2.112s 0.279s 29 1.06x
💻 Local Express 3.440s (~) 4.035s (+3.3%) 0.001s (+67.6% 🔺) 4.038s (+3.3%) 0.597s 15 1.99x
💻 Local Nitro 3.524s (+1.8%) 4.034s (-1.6%) 0.001s (+37.5% 🔺) 4.036s (-1.6%) 0.512s 15 2.04x
💻 Local Next.js (Turbopack) 3.816s 4.233s 0.000s 4.238s 0.422s 15 2.21x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 4.388s (-10.9% 🟢) 5.430s (-12.8% 🟢) 0.000s (-92.6% 🟢) 5.779s (-13.7% 🟢) 1.391s 11 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Next.js (Turbopack) 14/21
🐘 Postgres Next.js (Turbopack) 12/21
▲ Vercel Next.js (Turbopack) 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 17/21
Next.js (Turbopack) 🐘 Postgres 17/21
Nitro 🐘 Postgres 17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

❌ Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 15, 2026 •
edited
Loading

🧪 E2E Test Results

❌ Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 919 4 67 990
✅ 💻 Local Development 898 0 182 1080
✅ 📦 Local Production 898 0 182 1080
✅ 🐘 Local Postgres 898 0 182 1080
✅ 🪟 Windows 82 0 8 90
❌ 🌍 Community Worlds 133 74 24 231
✅ 📋 Other 228 0 42 270
Total 4056 78 687 4821

❌ Failed Tests

▲ Vercel Production (4 failed)

hono (1 failed):

nextjs-webpack (2 failed):

  • webhookWorkflow | wrun_01KP9AJTZG74K0K87X21FV72KJ | 🔍 observability
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KP9AXZV2JA18VTVJ0RATCQP1 | 🔍 observability

vite (1 failed):

🌍 Community Worlds (74 failed)

mongodb (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP9AJHWPCF5WJS00ZQ6MR4BW
  • webhookWorkflow | wrun_01KP9AJTZG74K0K87X21FV72KJ
  • fetchWorkflow | wrun_01KP9APCEGVTEF2G8X43Y4EWDB
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP9ATP000SXNSBQ2EH200200
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP9B1GVPV0NVW6A7VDZMZBZP

redis (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP9AJHWPCF5WJS00ZQ6MR4BW
  • webhookWorkflow | wrun_01KP9AJTZG74K0K87X21FV72KJ
  • fetchWorkflow | wrun_01KP9APCEGVTEF2G8X43Y4EWDB
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP9ATP000SXNSBQ2EH200200
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP9B1GVPV0NVW6A7VDZMZBZP

turso (60 failed):

  • addTenWorkflow | wrun_01KP9AH9QXW2GHDX700FMR8F1R
  • addTenWorkflow | wrun_01KP9AH9QXW2GHDX700FMR8F1R
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KP9AKG2VB6P27WG9WKEGH1GD
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KP9AHJM7F591B7VNEYYY40BJ
  • promiseRaceWorkflow | wrun_01KP9AHQ3W6MRBBEDQFSRAKQAY
  • promiseAnyWorkflow | wrun_01KP9AHSQ4PYJW79VZMPWGDR88
  • importedStepOnlyWorkflow | wrun_01KP9AKYR09G60D7NWVXT5E4DR
  • hookWorkflow | wrun_01KP9AJ5RGCM3NZAQEARQWJPZ7
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KP9AJHWPCF5WJS00ZQ6MR4BW
  • webhookWorkflow | wrun_01KP9AJTZG74K0K87X21FV72KJ
  • sleepingWorkflow | wrun_01KP9AK16XD3TSDY8VE77F9B0P
  • parallelSleepWorkflow | wrun_01KP9AKDZQ0WWT8R1PD6PJMYXK
  • nullByteWorkflow | wrun_01KP9AKJFRJG9TZQAWDRMFFYXN
  • workflowAndStepMetadataWorkflow | wrun_01KP9AKMMX94YG3HP0E7ZT90Y4
  • fetchWorkflow | wrun_01KP9APCEGVTEF2G8X43Y4EWDB
  • promiseRaceStressTestWorkflow | wrun_01KP9APG25BG2N713XMVRVH8QC
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KP9AT1D2T0GZH6G7WTEV0Y8E
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KP9ATP000SXNSBQ2EH200200
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KP9AVBAPRWTXSSG4JNHHYGV7
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KP9AVZWQQM8XDFM5NZV1AE0V
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KP9AW8WGC757YHRPK46GD6AT
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KP9AWEGRA9PYZ25CCFBJANAS
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KP9AWGSN81RFHN7473RTXMTF
  • runClassSerializationWorkflow - Run instances serialize across workflow/step boundaries | wrun_01KP9AWWMD4N2S7NVPEENNT9S7
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KP9AXC7ASMG0BYNSHB3H5DJ2
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KP9AXJ9ME1RGK38RDABJPMG2
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KP9AXRZZPE4A09HAGP2VQ9TD
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KP9AXZV2JA18VTVJ0RATCQP1
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KP9AY6EVH75R2AVC603Z1XVW
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KP9AYDAD87EWF3Y4BYVCCRW4
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KP9AYM3JPXT08J2CYVD06FHX
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KP9AYYWA4FDA4EZD8XTR6YY6
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KP9AZ9NJPCSYFFEXTB1M4TX7
  • cancelRun - cancelling a running workflow | wrun_01KP9AZGJQCVK646RBEFXR881H
  • cancelRun via CLI - cancelling a running workflow | wrun_01KP9AZSXCV967VFM26PCX1F3M
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KP9B05XN86WYWEVM0YVPWXGG
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KP9B0TY62K9ZEGPQ8S6T7284
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KP9B156W162PTPERY3KE9A6Q
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KP9B1BW08TB8VE88FSC2BG6J
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KP9B1ESE6WKX1KNF7ZNFCHM8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KP9B1GVPV0NVW6A7VDZMZBZP
  • getterStepWorkflow - getter functions with "use step" directive | wrun_01KP9B1MEX16776DM5HJMTTPXC

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
✅ express 83 0 7
✅ fastify 83 0 7
❌ hono 82 1 7
✅ nextjs-turbopack 88 0 2
❌ nextjs-webpack 86 2 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
✅ sveltekit 83 0 7
❌ vite 82 1 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable-lazy-discovery-enabled 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable-lazy-discovery-enabled 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable-lazy-discovery-enabled 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable-lazy-discovery-enabled 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable-lazy-discovery-enabled 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable-lazy-discovery-enabled 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 82 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 6 0 0
❌ mongodb 56 7 8
✅ redis-dev 6 0 0
❌ redis 56 7 8
✅ turso-dev 6 0 0
❌ turso 3 60 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 76 0 14
✅ e2e-local-postgres-nest-stable 76 0 14
✅ e2e-local-prod-nest-stable 76 0 14

📋 View full workflow run

❌ Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: cancelled
  • Local Prod: failure
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@ijjk ijjk requested a review from VaguelySerious April 15, 2026 19:05
VaguelySerious
VaguelySerious reviewed Apr 15, 2026
View reviewed changes
Copy link
Copy Markdown
Member

@VaguelySerious VaguelySerious left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AI review: no blocking issues

Comment thread packages/core/e2e/utils.ts Outdated
Comment thread packages/next/src/index.test.ts Outdated
Comment thread packages/next/src/loader.ts Outdated
Comment thread packages/next/src/builder.ts Outdated
@ijjk ijjk mentioned this pull request Apr 15, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@VaguelySerious VaguelySerious VaguelySerious left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@ijjk @VaguelySerious