Repository navigation
docs(intelligent-compute): document the On-Demand fallback cost limit - #1913
Open
pditommaso wants to merge 7 commits into
Open
pditommaso wants to merge 7 commits into
pditommaso wants to merge 7 commits into
Conversation
spotFirst falls back to On-Demand only while On-Demand costs at most a Seqera-set multiple of the Spot price; otherwise the task is retried on Spot and eventually fails with "on-demand fallback refused". Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
✅ Deploy Preview for seqera-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
…ack cost limits Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
…tflow config The limit can't be changed on the compute environment; a pipeline run can override it with seqera.executor.machineRequirement.onDemandCostRatio (Nextflow 26.10+). Unset keeps the default, 0 removes the limit. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
1 of 2 tasks
…per process with a hint Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
…way to change the limit Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The Intelligent Compute page says the
spotFirstprovisioning model "falls back to On-Demand if Spot capacity is unavailable". That's no longer the whole story. The scheduler now falls back only while On-Demand costs at most a set multiple of the Spot price. When On-Demand is dearer than that, the task is retried on Spot and can end up failing, which the page doesn't mention. This limit already refuses fallbacks in production (seqeralabs/sched#1291).What changes for readers
spotFirstnow says it falls back unless On-Demand is too expensive, and links to the new section.how the limit is measured: the highest On-Demand hourly price compared with the highest Spot hourly price, across the instance types the scheduler selected for the task;
the current default for each cloud provider, with a note that Seqera can change them:
what happens when the limit is exceeded: the task is retried on new Spot capacity, then fails with an error message starting
on-demand fallback refused;how to change the limit: currently only in the pipeline's Nextflow configuration. The compute environment has no setting for it:
seqera.executor.machineRequirement.onDemandCostRatiosets it for all the tasks of a run;seqera/machineRequirement.onDemandCostRatioprocess hint overrides it for one process, the same way asprovisioning;0means no limit (always fall back, not "never");> 0is the limit used;what to do if a pipeline must complete when Spot is scarce: use the
ondemandprovisioning model. Thespotmodel never falls back.The default values match the scheduler defaults shipped in sched 0.96.0 (
sched.scheduling.on-demand-fallback-cost-ratio-{aws,gcp,azure}), with no deployment override.Before merging
Checks
markdownlint-cli2reports the same 48 errors before and after this change, all in existing tables. The new text adds none.🤖 Generated with Claude Code