feat(influxdb3-enterprise): Update chart for InfluxDB 3.11 with PachaTree support - #818
Open
dburton-influxdata wants to merge 4 commits into
Open
Conversation
…onfiguration - Update Chart version 0.8.0 → 0.9.0, appVersion 3.9.3 → 3.11.0 - Rename 12 environment variables (INFLUXDB3_ENTERPRISE_* → INFLUXDB3_*) - Rename WAL environment variables (WAL_SNAPSHOT_SIZE → WAL_FILES_PER_SNAPSHOT, etc.) - Rename memory environment variables (EXEC_MEM_POOL_BYTES → EXEC_MEM_POOL_SIZE) - Remove deleted configuration options (hardDeleteDefaultDuration, cacheEndpoint) - Add breaking change warnings for memory flag validation - Add cache configuration aliases (file* names alongside parquet* names) Breaking changes: - INFLUXDB3_ENTERPRISE_CLUSTER_ID → INFLUXDB3_CLUSTER_ID - INFLUXDB3_START_WITHOUT_AUTH → INFLUXDB3_WITHOUT_AUTH - INFLUXDB3_DB_DIR → INFLUXDB3_DATA_DIR - INFLUXDB3_TELEMETRY_DISABLE_UPLOAD → INFLUXDB3_DISABLE_TELEMETRY_UPLOAD - All resource limit variables lose ENTERPRISE prefix - Memory flags now require unit suffixes (bare numbers rejected) Ref: InfluxDB 3.11 Release Notes
…rocessing Engine PachaTree Support: - Add engine configuration section to values.yaml - Add upgradePachaTree migration flag for existing Parquet clusters - Add PachaTree-specific configuration (shardCount, maxTotalColumns, snapshotSize, etc.) - Add --upgrade-pacha-tree arg to all StatefulSets when migration flag set - Create pachaTreeEnv helper template for PachaTree environment variables - Apply PachaTree env vars to ingester, querier, compactor StatefulSets Graceful Shutdown (3.11+): - Add shutdown.timeout configuration to values.yaml - Add INFLUXDB3_SHUTDOWN_TIMEOUT to configmap.yaml - Default 30s connection drain before forcibly closing Processing Engine Updates (3.11+): - Add disablePackageManagement flag (replaces packageManager: disabled) - Add asyncTriggerConcurrencyLimit configuration - Add INFLUXDB3_DISABLE_PACKAGE_MANAGEMENT env var to processor StatefulSet - Add INFLUXDB3_ASYNC_TRIGGER_CONCURRENCY_LIMIT env var to processor StatefulSet New configuration sections: - engine.upgradePachaTree: Migration flag for Parquet→PachaTree - engine.pachaTree.*: PachaTree-specific tuning options - shutdown.timeout: Graceful shutdown connection drain timeout - processingEngine.disablePackageManagement: Reject package installs - processingEngine.asyncTriggerConcurrencyLimit: Async trigger concurrency Ref: InfluxDB 3.11 Release Notes
Added comprehensive documentation for InfluxDB 3.11 upgrade: MIGRATION-3.11.md (25KB): - Complete upgrade guide with 4 scenarios (fresh install, existing cluster, PachaTree migration, removed options) - Breaking changes summary (12 env var renames, 3 WAL renames, 1 memory format change) - Step-by-step migration procedures with validation steps - PachaTree migration guide (one-way, one-time process) - Post-upgrade validation checklist - Rollback procedures and troubleshooting - Container image references (Quay.io, Docker Hub, direct downloads) CHANGELOG.md (10KB): - Detailed v0.9.0 changelog following Keep a Changelog format - Added: PachaTree support, graceful shutdown, Processing Engine updates - Changed: 12 env vars, 3 WAL vars, 1 memory var (all backward compatible) - Removed: 2 deprecated options (objectStorage.cacheEndpoint, dataLifecycle.hardDeleteDefaultDuration) - Container image links (Quay.io commit SHAs, Docker Hub tags, RPM/DEB downloads) - Files changed summary (7 templates, 2 docs, 97 insertions) README.md updates: - Added 'What's New in 0.9.0' section highlighting major changes - Added 'Storage Engine (PachaTree)' configuration section: - New clusters (automatic PachaTree) - Existing Parquet clusters (stay on Parquet or opt-in migration) - PachaTree benefits and tuning options - Added 'Graceful Shutdown' configuration section - Updated 'Processing Engine' section with 3.11 security/performance options - Enhanced 'Upgrading' section with migration guide link and quick upgrade steps - Added container image references in header (Quay.io, Docker Hub, RPM/DEB) Container Images Documented: - Quay.io Enterprise: quay.io/influxdb/influxdb3-enterprise:e5242f505d23039a340d21693a994b1a053b0f15 - Quay.io Core: quay.io/influxdb/influxdb3-core:139bab4c54b54db01d67539b6dc9f1e1a81dd1b7 - Docker Hub Enterprise: docker.io/influxdb/influxdb3-enterprise:3.11.0-enterprise - Direct downloads: 8 links for Enterprise and Core (RPM/DEB, x86_64/aarch64/amd64/arm64) Documentation highlights backward compatibility and seamless upgrade path for existing clusters. Ref: InfluxDB 3.11 Release Notes
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pull Request: InfluxDB 3.11 Helm Chart Update
Summary
Updates the InfluxDB 3 Enterprise Helm chart to support version 3.11.0, introducing PachaTree storage engine, graceful shutdown, and Processing Engine enhancements.
Chart Version: 0.8.0 → 0.9.0
App Version: 3.9.3 → 3.11.0
Closes: #817
Static validation completed:
Live infrastructure testing needed:
Test guidance: See
charts/influxdb3-enterprise/MIGRATION-3.11.mdfor detailed test scenarios.Changes
Breaking Changes (Fully Backward Compatible)
Environment Variables (12 renames):
INFLUXDB3_ENTERPRISE_*→INFLUXDB3_*prefixWAL Configuration (3 renames):
WAL_SNAPSHOT_SIZE→WAL_FILES_PER_SNAPSHOTWAL_MAX_WRITE_BUFFER_SIZE→WAL_MAX_BUFFERED_WRITESNUM_WAL_FILES_TO_KEEP→SNAPSHOTTED_WAL_FILES_TO_KEEPMemory Configuration (1 rename + format change):
EXEC_MEM_POOL_BYTES→EXEC_MEM_POOL_SIZE"2GB")Removed Options (2 deprecated flags):
objectStorage.cacheEndpoint(now automatic)dataLifecycle.hardDeleteDefaultDuration(cluster-level only)New Features
PachaTree Storage Engine Support
engine.upgradePachaTree: trueConfiguration example:
Graceful Shutdown
shutdown.timeoutconfiguration optionConfiguration example:
Processing Engine Updates
disablePackageManagement: Lock down package installationsasyncTriggerConcurrencyLimit: Control async trigger concurrencyConfiguration example:
Documentation
MIGRATION-3.11.md (25KB)
Comprehensive upgrade guide with 4 scenarios:
Includes:
CHANGELOG.md (10KB)
Detailed v0.9.0 release notes following Keep a Changelog format:
README.md Updates
Container Images
Quay.io (Recommended)
Enterprise:
Core:
Docker Hub
docker.io/influxdb/influxdb3-enterprise:3.11.0-enterprisedocker.io/influxdb/influxdb3-core:3.11.0-coreDirect Downloads (8 packages)
See CHANGELOG.md for full download links.
Backward Compatibility
✅ Fully Backward Compatible
Existing clusters upgrade seamlessly:
Breaking Only For Users With:
objectStorage.cacheEndpointin values → Remove (now automatic)dataLifecycle.hardDeleteDefaultDurationin values → Remove (cluster-level only)memory.execMemPoolBytesoverride → Update to size format with unitsMitigation: Clear error messages + detailed troubleshooting in MIGRATION-3.11.md
Testing Performed
Static Validation ✅
Live Infrastructure Testing ⏳ (Maintainer Action Required)
Test Guidance: See
MIGRATION-3.11.mdfor step-by-step test procedures.Files Changed
Implementation (8 files)
Chart.yamlvalues.yamltemplates/configmap.yamltemplates/_helpers.tpltemplates/ingester-statefulset.yamltemplates/querier-statefulset.yamltemplates/compactor-statefulset.yamltemplates/processor-statefulset.yamlDocumentation (3 files)
MIGRATION-3.11.mdCHANGELOG.mdREADME.mdTotal: 11 files, +1,393 insertions, -5 deletions
Commit History
Review Checklist
References
charts/influxdb3-enterprise/MIGRATION-3.11.mdcharts/influxdb3-enterprise/CHANGELOG.mdcharts/influxdb3-enterprise/README.md