feat: add hub command to browse and deploy from the runpod hub#262
Open
TimPietruskyRunPod wants to merge 3 commits intomainfrom
Open
feat: add hub command to browse and deploy from the runpod hub#262TimPietruskyRunPod wants to merge 3 commits intomainfrom
TimPietruskyRunPod wants to merge 3 commits intomainfrom
Conversation
2 tasks
|
📝 Documentation updates detected! Updated existing suggestion: Update runpodctl documentation for v2.0 Tip: Create additional Docs Collections to keep multiple repositories in sync 📚 |
adds `runpodctl hub` command group to browse, search, and get details from the runpod hub marketplace. also adds `--hub-id` flag to `serverless create` to deploy endpoints directly from hub listings without needing to create a template first. new commands: - hub list (with --type, --category, --order-by, --owner filters) - hub search <term> - hub get <id-or-owner/name> serverless create --hub-id resolves the listing, extracts the build image and config, creates an inline template via graphql, and deploys the endpoint — matching the web ui flow.
adds two eval scenarios to test whether an agent can discover and deploy serverless endpoints from the runpod hub using the new hub commands and --hub-id flag.
…hub release - serverless template creation via REST fails because the api rejects volumeInGb on serverless templates even when set to 0; skip sending volume fields when --serverless is set - include tests field in hub release get response so agents can use the pre-built test payloads to call deployed endpoints
TimPietruskyRunPod
force-pushed
the
feat/hub-command
branch
from
6c73c06 to
a41be3c
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
runpodctl hubcommand group (list, search, get) to browse the RunPod Hub marketplace via the existing GraphQLlistingsAPI--hub-idflag toserverless createas an alternative to--template-id, enabling one-command deployment from hub repos--hub-idis used, the CLI resolves the listing, extracts the build image and config from the latest release, creates an inline template via the GraphQLsaveEndpointmutation (matching the web UI flow), and deploys the endpointNew commands
Serverless create from hub
runpodctl hub search vllm runpodctl serverless create --hub-id cm8h09d9n000008jvh2rqdsmb --name "my-vllm"GPU IDs and container disk size are automatically pulled from the hub release config. Users can override with
--gpu-id.Test plan
go test ./...)