---
id: vl-202601
title: Detailed Version Log Deephaven 1.202601
---
[//]: # (Except for the certified versions section, this file is auto-generated from the iris repository. Do not edit it directly. See `format-vl-markdown.py` in the iris repo for further details.)
> [!NOTE]
> For information on changes to Deephaven Community, see [the Github release page](https://github.com/deephaven/deephaven-core/releases).
## Certified versions
| Certified Version | Notes |
| ----------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| 2026.01.038 | The following caveats apply to this release:- The status dashboard does not work with Envoy.
|
| 2026.01.034 | The following caveats apply to this release:- Kubernetes is not certified in this version.
- Do not use Core+ merge for tables with grouping columns or data indexes if you use any Legacy workers.
- The status dashboard does not work with Envoy.
|
| 2026.01.030 | The following caveats apply to this release:- Kubernetes is not certified in this version.
- Do not use Core+ merge for tables with grouping columns or data indexes if you use any Legacy workers.
- The Schema Editor UI will not build schemas correctly.
- In-worker construction of Python clients using the zero-argument `SessionManager()` constructor does not work when an internal trust store is required.
- The status dashboard does not work with Envoy.
|
| 2026.01.025 | The following caveats apply to this release:- Kubernetes is not certified in this version.
- The status dashboard does not work with Envoy.
- JDBC schema editor preview for the import-sources pane does not give real results.
- The LogFormat XML specification is not in its final state yet. Customers who choose to deploy schemas using the new LogFormat element before the caveat is resolved will need to do a simple migration after the format is finalized.
- The `PersistentQueryStateLog` table gets null values in the `Status` field when the persistent query controller restarts. This will cause schema-based validation to fail if it's run on this table.
|
## Detailed Release Version Log: Deephaven v2026.01
| Patch | Details |
| ----- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| 038 | DH-22065: Revert Fixes to ACL Editor for Playwright
DH-22065: Fix Auto Focus for table backed inputs in ACL Editor
DH-19351, DH-21813: Handle grouping columns declared as indices |
| 037 | Merge updates from 1.20240517.565 - DH-22716: Controller subscription filtering based on PQ name and owner
- DH-20217: Restrict User NamespaceSet for DerivedTableWriter
- DH-22691: Create gradle publish and republish tasks for k8s cherry-pick
- DH-22517: /etc/deephaven permissions should be 775 everywhere
- DH-22629: Add certification-related scripts
- DH-22686: Include examples in installation when --include-tests-and-examples is specified
- DH-22681: Update web version to v0.85.46
- DH-22674: Add plaintext paste key handling
- DH-20294: Show current DB Server even if unavailable
- DH-22578: Follow up panel changes for name-based userColumnWidths
- DH-22587: Update web version in Grizzly to v0.85.45
- DH-22577: Persist user column widths by name in IrisGrid (#2670) (#2674) (c5354c1)
- DH-22578: Un-hide group-by columns, keep other hidden columns hidden when applying rollup
- DH-22560: correct date format in podman deployment's dhinit_log and dhinit_warn
- DH-22023, DH-22315: Follower controllers fixes.
|
| 036 | DH-22633: Document Jira field usage and description formatting in AGENTS.md
DH-22072: Disable InputTable python tests, more debugging for groovy
DH-22065: Fix ACL Editor Playwright test
DH-21938: Do not mark Partition Columns as Partitioning in LocationsTable
DH-22393: validate routing and dises on input and allow for --ignore-error behavior and retries
DH-22711: Update Core to 41.7.
DH-22695: Proactively Create Contexts for Formula Views
DH-22430: Enable Growing Barrage Subscriptions by Default.
DH-22657: Use array instead of chunks for Jackson repeated processors
DH-22671: Add QueryCompilerImpl trace logging.
DH-22640: Symbol Table joins with contiguous or hash redirection used wrong null key.
DH-22701: Allow nullable value for cpu shares
DH-22606: Safe Mode Exception Copy Button E2E test
DH-22703: npm audit fix vulnerabilities
DH-22171: add Gradle dependency submission workflow
DH-22606: Safe Mode Exception Copy Button
DH-22682, DH-22685: Update web version to v1.20.0, deephaven.ui to v0.37.0
DH-21757: Allow widget plugins to register types as dashboard types
DH-17831: Fix partition table losing quick filters
DH-22040: Open Dashboard List global shortcut conflicts
DH-22547: ESC cancels background row position
DH-22548: Command Selection Overrides Select File Button
DH-21898: Local routing
DH-21757: WidgetPlugin support in deephaven.ui
DH-16501: filter indicator
DH-22266, DH-22267: bump logback 1.4.5 → 1.5.25 via global resolutionStrat…
DH-22557: use UniversalSet.safeEquals in ServerGroup.equals to prevent UOE
DH-22072: Further attempt to troubleshoot flaky input-table tests
DH-22438: Improve lease revocation to prevent blocking process shutdown
DH-22673: Pandas 3.0 doesn't work on Python 3.10
DH-22645: make ControllerLoggerCreator service config manual
DH-22069: correct dhconfig dis import help and improve error message,…
DH-22390: Allow Legacy ParquetReader to use grouping Index from Core
DH-20494: Add unit test for core+ StringSet
DH-22391: Add information on binary loggers and timezones
DH-22646: Update version support matrix. |
| 035 | DH-22655: Fix PersistentQueryTablesContext.statusAsString throwing Unrecognized enum.
DH-22646: Update Core+ to 41.6.
DH-20422: bump JPY to 2.0.0
DH-22590, DH-22554: ShiftedColumnOperations needs to handle concurrent instantiation.
DH-22406: allow override of clearColumnLocations
DH-22265: increment Kafka column index for complex spec
DH-21978: WorkerHeapSize column is Incorrect.
DH-22374, DH-22370: NPE and deadlock in BarrageSubscriptionRequestHandl
DH-20507: Remove UnshadowHelpers
DH-22651: set GOOGLE_IMAGE when creating previous-release VMs
DH-22622: Remove message size from LAS_DATA payload
DH-22506: Fix git ssh secret mounting when certmgr is enabled
DH-22623: Fix Log Panel broken due to incorrect session type
DH-22544: Fix Gradle sync in non-IntelliJ IDEs
DH-22634: Fix stale waitForEventCount in PersistentQueryControll…
DH-22631: Guard against BLF reentrancy
DH-22637: Update web UI to v1.19.0
DH-21843: Fix unexpected code studio unmount
DH-22638: Update deephaven.ui to v0.36.1
DH-22174: ui.table works with rollup and tree tables
DH-21938: Move LocationsTable shared logic out of hive package
DH-22515: Make sure label values on stateful set volume claim templates do not change upon release
DH-22143, DH-22027: Create gradle publish and republish tasks for k8s images and cache improvement
DH-22605: Fix Query Monitor Confirmation Dialogs
DH-22543: Use correct server key for kubernetes deployment config
DH-22614: Fix Query Editor Tabs for Helper Queries
DH-22262: commons net remove unneeded usages
DH-22132: bump jackson-core versions to avoid vulnerabilities.
DH-22580: Fix Schema Logger updating with stale data
DH-22065: Fix ACL Editor Playwright Test
DH-22602: Fix QM Fails to Save Draft Query
DH-22469: Fix k8s tests
DH-22541: Improved logging for getObject timing
DH-20905: Convert all Javascript into Typescript
DH-22573: Add AGENTS.md contribution guidelines (spotless, docs format, commit conventions)
DH-22552: Update web version to v1.18.2
DH-19210: Add plaintext paste key handling
DH-20403: Persist user column widths by name in IrisGrid
DH-22054: GridMetrics type update
DH-22326: Un-hide group-by columns, keep other hidden columns hidden when applying rollup
DH-22442: Panels list should not include dashboards in search
DH-15197: Use queryScheduler defaults from iris-defaults.prop in web UI |
| 034 | DH-22566: Fix broken task dependencies for sourcesJar and related tasks
DH-22530: status_dashboard leaks etcd/jetcd/Netty file descriptors, dies with Too many open files
DH-22563: make generateJavaFlatbuf register as sourcesJar dependency
DH-22562: fix bad option in main build jenkinsfile |
| 033 | Merge updates from 1.20240517.564 - DH-22537: PQWorkerService must use sorted TicketTransformers.
- DH-21701: correct integration tests
- DH-22155: Enable GC Logs does not log GC in PEL for PQs
- DH-22308: fix write queue overflow calculation
- DH-22505: Fix gradle build of cpp-client
- DH-21701: provide warnings on questionable DIS filters
- DH-21441: Re-add support for literal Worker pod tolerations for Kubernetes
- DH-22013: Gradle sync fails in IDEs besides IntelliJ
- DH-21202, DH-22334, DH-22301: Turn off automatic updates, fix etcd_wait_for_auth.sh, test timeouts
- DH-22371: Exclude trove from shadow jars.
- DH-20675: fix coreplus artifactId (move core+ segment to version)
- DH-22394: remove deleted diagnostics subproject from plugin settings
- DH-22145: Add source jar publishing for coreplus artifacts
- DH-22145: Revert sourcesJar publishing for core+
- DH-22145: Add sourcesJar publishing for core+
- DH-22344: Stop running CI build after docs only merges
- DH-22349: Fix controller client compatibility
- DH-21810: enhance dhconfig acl inputtable
- DH-22345: disable sourceJar publication when sourceJar task is excluded
- DH-22341: Add Core+ C++ and R Build Stage to Jenkins
- DH-22234: Fix Export Logs Fails with Large Number of Queries
- DH-22203: Dispatcher deadlock due to inconsistent lock ordering
- DH-22177: Fix Safe Mode Logout crashes; fix lint test error
- DH-22177: Fix Safe Mode Logout Crashes with 20k Queries
- DH-21615: Fix query monitor performance with lots of queries
- DH-21745: Fix big audit event log entry (bigAelEntry) integration test
- DH-21819: Pin setuptools to 81.0 for py < 3.10
- DH-21277: Query dispatcher should truncate excessively long AuditEventLog messages
- DH-21381: Change location of monit config files to avoid cross-device link error
- DH-20749: Fix scrolling behavior in dashboard tab navigation
- DH-21425: Fix shifted column where combined with backticks
- DH-20268: Backport improved child-process-killer in installer, and more robust etcd package handling
- DH-21409: Fix sourceJar in gradle build
- DH-21293: Update USNYSE calendar through 2028
- DH-18936: Add publishing for source jars to dh-ent-source
- DH-21005: Fix republishing to include rpm and correctly copy tar+installer jar
- DH-22080: Don't try to restart an schema etcd watcher on error if the watcher is already closed
- DH-22042: Fix scrolling behavior in dashboard tab navigation
- DH-22083, DH-22340: NPE on java client from Missing PQ serial, missing WorkspaceDataSnapshot locking.
- DH-20991: Gradle spotlessCheck should also run Core+ spotless
- DH-21968: dhconfig breaks after importing an invalid binaryLogTimeZone
- DH-22300: allow jenkins to read test failures
- DH-22299: add new state to testcase
- DH-20151: Always import acls in the k8s install/upgrade script
- DH-22297, DH-22254: remove deephaven-engine-test-utils from the classpath
- DH-21539: Prevent browser back navigation on horizontal overscroll
- DH-22209: Build Deephaven C++ and R clients with gradle
- DH-22254: bump assertj
- DH-22253: bump aircompressor
- DH-22245: Update Grizzly Core+ to 41.5.
- DH-22012: implement barrage bug fixes
- DH-22090: Added tests for UnionChunkWriter, corrected bug
- DH-18781: handle SocketException with retry
- DH-22170: Fix update-dh-packages not updating to latest patch
- DH-22156: correct a test
- DH-22230: Remove prefer-offline flag - Grizzly
- DH-22043: Update pip before trying to install dependencies for Core+
- DH-22094: Back port C++ fix (DH-22094) from G+ to Grizzly
- DH-20963: Update legacy wheel vulnerability from SBOM
- DH-22200: Make proto generated files private
- DH-22207: Back port C++ fixes (DH-21989, DH-21877, DH-21816) from G+ to Grizzly
- DH-22210: Kubernetes workers should listen on all addresses to avoid DNS dependency
- DH-22170: Add npm update to the update-dh-packages script
- DH-22208: Modify docker files to support gradle integration, fix bugs
- DH-22214: Add deephaven_enterprise.input_tables to sphinx build
- DH-19741: WorkspaceDataSnapshot isn't applying filters to snapshot
- DH-22156: correct dhconfig dis import help and improve error message
- DH-22197: C++ client docker build script needs to be updated to support the new community version pattern
- DH-22193, DH-22001: Use the correct CRAN repository URL
- DH-21388: Use Java 17 for pre-built podman images
- DH-20938: UTC+07:00 TimeZone Support
- DH-21515: Ensure Kubernetes labels have valid values
- DH-21591: Make Kubernetes prerelease hook pod resources configurable
- DH-22176: Controller unit test fix for new query state
- DH-22169: Update Web UI to v0.85.44 for Grizzly
- DH-22093: Resolved a web UI freezing problem originating from grid-block-events functionality
- DH-19368: AutoQuery PQs retry when no dispatcher is found
- DH-21617: Restore access to Envoy logs in Kubernetes
|
| 032 | DH-22553, DH-22178: Update deephaven.ui in G+ to v0.36.0
DH-22538: fix disappearing deephaven.ui dashboard tab
DH-22085: Check for deleted queries
DH-22546: Update web version to v1.18.1
DH-21869: Fix Timezone for Conditional Date Formatting
DH-22431: preserve focus indicator on nested dashboard tab
DH-22542: Revert previous fix for DH-21373 from PR 4143.
DH-22533: npm audit fix PostCSS vulnerability
DH-20069: port Checkpoint driven FileDataBufferStore to Core+
DH-22464: Enable GC Logs does not log GC in PEL for consoles
DH-20366: Add a github action using gcloud auth via workload identity |
| 031 | DH-22501: Republishing resolutions should not happen at configuration time
DH-22383: Bump brace-expansion from 2.0.1 to 2.1.0 in /DhcInDhe/js-client/src/main/docker
DH-22383: address npm security vulnerabilities
DH-22425: include per-server consoleGroups check in console_permitted gRPC…
DH-22336: Replace urllib with httpx for all http access (both http/1.1, http/2)
DH-22382: Fixed Sphinx Java Home which Fixes CorePlusBenchmark
DH-22421: fix broken shellcheck test
DH-21981: avoid sed in remote client tests (BSD vs gnu sed)
DH-22327: duplicate Test Ids
DH-22362: Improve semantics of JobScheduler.close and related methods
DH-22354: Update DhcInDhe readme with steps to use local deephaven-core
DH-22333: Bump kafka-clients to 3.9.2
DH-22382: CorePlusBenchmark Force DH_PYTHON to false
DH-22304: Fix SessionManager In-Worker Constructor on K8s and Internal PKI
[DH-19956](#disable-temporary-virtual-environments-per-worker-kind): Ability to disable temporary venvs
DH-22263: update xmlsec to avoid vulnerability
DH-22091: Update Schema editor for LogFormat changes
DH-21373: Code Studio query persists after logout (Controller Stop Race) |
| 030 | DH-22364: Update deephaven.ui to v0.35.0
DH-21654: Routing hooks
DH-21376: Add heatmap support to ui.TableFormat
DH-21616: Databar overrides text color when using format prop
DH-22325: add sanity checking to MAX_PEL_ENTRY_SIZE (Core+)
DH-22228: Maintain URL params
DH-22311: correct LAS row limit calculation and improve responsiveness
DH-21789, DH-20902: correct closed() synchronization
DH-22329: Specify ServerStateLog IntervalStartTime precision.
DH-20008: Don't log null values in PersistentQueryStateLog Status field
DH-22248: Fix various republishing issues
DH-22056: correct Encoding columnName attribute
DH-21930: Server-side support for snapshots of PivotTableView.
DH-21826: Prevent mac-only bugs when INTERNAL_PKI=true
DH-22283: introduce ControllerLoggers project
DH-22258: Preserve customer settings for WCD during updates
DH-22225: Generic PyObject ACLs.
DH-22282: Fix client listener in test
DH-22275: PivotTable snapshot chunk bounds fix.
DH-22056: Update LogFormat specification to ensure version uniqueness
DH-22003: Various gplus k8s fixes
DH-22076: Add debugging to groovy InputTables int-test
DH-22230: Remove prefer-offline flag - Grizzly
DH-22261: update the list of all vulnerabilities
DH-22270: Update js pivot plugin to v0.4.0
DH-21744: Advanced Filter support in pivot ColumnBy sources
DH-21183: Context menu for Pivot columnBy source headers and column groups
DH-22250: Update deephaven-plugin-plotly-express to v0.19.2
DH-22224: Context menu for Pivot columnBy source headers and column groups
DH-22251: Update web version to v1.18.0
[DH-21709](#default-limit-on-user-table-appends): set LAS transaction limits by default
DH-22235: add sanity checking to MAX_PEL_ENTRY_SIZE
DH-22227: upgrade transitive dependencies to resolve CVE vulnerabilities
DH-22245: Update Grizzly Core+ to 41.5.
DH-22012: implement barrage bug fixes
DH-22090: Added tests for UnionChunkWriter, corrected bug
DH-21761: add more connection info to TDS timeouts
DH-22243: relax ImportStatePartitionIndex check to DH packages
DH-22236: Remove trailing `--` from npm package versions
DH-22180: Add hard references to Index logger classes
DH-21979: Handle MultiPlugin in loadWorkerPlugins
DH-22142: Convert Eggplant Add and Delete PQ Tests
DH-22032: retarget dependabot original
DH-22195: Integration test for Core+ default properties
DH-22190: Update Web version v1.17.1
DH-20036: Skip totalsConfig updates during model transitions to prevent stale column errors
DH-21696: Fixed broken frozen columns
DH-22093: Fix web UI freezing bug from grid-block-events
DH-22065: Port Eggplant ACL Editor test to Playwright
DH-22179: Add ACL records for LogoutEvents and LogoutSchedules
DH-22189: revert unintended changes to stateless-by-default
DH-22167: Fix Schema Editor for V2Logger xml changes |
| 029 | Merge updates from 1.20240517.558 - DH-22124: Update Grizzly Core+ to 41.4.
- [DH-21785](#changes-for-instant-handling-in-schema-generation): Update unit test to handle Instant becoming DateTime in Schema
- DH-20144: Allow envoy deployment Kubernetes resource configurations
- DH-22100: Update web version to v0.85.43
- DH-22099: stop loading when input filter change has no effect on grid filters
- DH-21420: improve clean disk space for qa systems
- DH-22078: fix org.lz4 groupId rename for republications
- DH-22070: Add @Ignore to Legacy fuzzer test.
- DH-21137: Support SAML with multiple authentication servers
- DH-19923: Core+ continuous PQs not respecting scheduling config
- [DH-21785](#changes-for-instant-handling-in-schema-generation): Improved handling of Instant for parquet merge
- DH-22001: Improve test script and docker builds to make testing easier
- DH-22000: Benchmark Bucket Mime Type
|
| 028 | DH-22181: Update KafkaTeardown.sh path to kafka/support subdirectory
DH-20380: Race conditions during Controller client subscription
DH-22188: Fix npm run start-community error
DH-21417: Update upgrade docs and release notes for certificate/envoy changes
DH-22148: Add trace on failure to Playwright config
DH-22118: tweak monitor PQ testcase
DH-22140: Auto-configure spotless for deephavenBinaryLogger plugin
DH-22150: Create support-factory project
DH-22018: workaround for CVE-2025-67721
DH-22110: Add workflow to detect stale package-lock.json
DH-21992: Update UOE message
DH-21923: ManagedChannel created from WCD2 WebClientTableFactory garbage collected without shutdown
DH-22058: don't scan the directory on every new file
DH-22088: Migrate gradle plugins and conventions to build-logic
DH-21992: Add flag to disable reading V1 binlogs
DH-21329: More detail error message from Schema API Service
DH-22126: Update Grizzly+ Core+ to 41.4.
DH-21930: Expose some of the SnapshotView methods to extenders.
DH-21806: Quiet logging for canceled requests
DH-21548: Permit switching partition-ordering for Iceberg
DH-20532: ConcurrentModificationException from Groovy Script Session Change Observer
DH-21717: Specialize TailInitializationFilter for regioned column sources.
DH-20318: Fix bug in UnionSourceManager pushdown estimation that caused AIOOBE in UnionRedirection
DH-21914: ComposedFilters and Delegating filters should manage all liveness artifacts.
DH-22098: Update web version to v1.17.0
DH-21869: Fix Conditional Formatting on Timestamp
DH-22063: stop loading when input filter change has no effect on grid filters
DH-22108: Update deephaven.ui to v0.34.0
DH-21375: Integrate databars with UI table format
DH-21601, DH-21604: Performance improvements on data routing changes
DH-17041: Use a distinct update graph for PEL in deephaven_jupyter_logging.
DH-22024: Fix Playwright for moving Query Utils to package
DH-22056: use xmllint formatting for all schemas
DH-22107: Update deephaven-plugin-plotly-express to v0.19.1
DH-21423: xaxis_titles and yaxis_titles now apply to OHLC
DH-22094: Make SessionManager close faster by waking up the HeartBeat thread immediately.
DH-21989, DH-21877: upgrade Core+ CPP client deps on Windows
DH-22056: fix non-standard schema XML
DH-21981: docs and tests for remote python clients
DH-21991: Moved more query utils to @deephaven-enterprise/query-utils package
DH-21098: JDBC schema editor preview table
DH-21961: Code Studio Disconnect Prompt Changes
DH-21964: Only generate frozen server requirements on Linux.
DH-22026: fix test schemas location |
| 027 | DH-22041, DH-22039: Update web version to v1.16.1
DH-22024: Backport Playwright e2e to G+
DH-22045: fix org.lz4 groupId rename for republications
DH-21961: Code Studio prompt and log on disconnect
DH-22026: Ensure LogFormat attribute ignore works |
| 026 | DH-22038: apply python version normalization to customer republication |
| 025 | DH-22020: Update web version to v1.16.0
DH-21722: Fix Goto Value for Timestamps
DH-21807: Update envoy and certificates documentation |
| 024 | Merge updates from 1.20240517.556 - DH-21735: handle unresolved addresses
- DH-21986: Update plotly-express to v0.19.0
- DH-20808: Add subplot_titles param to make_subplots
- DH-21383: Switch dx map center to TypedDict
- DH-20716: WebClientData should share etcd client for query monitors.
- DH-21912: Update deephaven.ui to v0.31.4
- DH-21449: Fix dh.ui memoized table flashing when using frozen or hidden columns
- DH-21909: Controller Election Observer can wait forever for an update after recreating a watcher
- DH-21825: Build and push deephaven_qa image
- DH-21976: RegionedColumnSourceManager should specify locations whose removal was illegally attempted
- DH-21900: Example ImportColumn using transform
- DH-21842: Allow user-defined classpaths for coreplus workers in k8s
- DH-21416: DHE Combo Benchmarks
- DH-21907: Bump Grizzly to Core+ 41.3
- DH-21900: Case insensitive matching for transformPrecision
- DH-21856: update configuration service config for Core+
- DH-21746: Fix Pivot ClassCastException on Expand/Collapse All
|
| 023 | DH-22005: Fix CODEOWNERS entry for WebClientData2
DH-21516: Add template for feature planning document
DH-20052: add documentation for BLF LogFormat
DH-21931: implement simpler FileWriters
DH-21995: Remove jdom from CUS directory.
DH-21990: Move the cache directories used by mypy and ruff to the Main/build
DH-21972: update BLF release notes after renaming
DH-21754: Make hadoop-common dependency transitive
DH-21972: regenerate BLF loggers
DH-21959: CorePlusBenchmark Use New JVM Max Build Properties |
| 022 | DH-21960: ForceLogoutProvider test fixes
DH-21972: BLF renaming
DH-21960: recent activity rework
DH-21960: Switch from int array to byte for days array
DH-21915: Switch to AggSortedLast
DH-21958: migrate ForceLogoutProvider to BLF loggers
DH-21752: remove extra characters from error message
DH-21939: Fix merge server config for various integration tests
DH-21882: Make Java client more resilient to missing JSON fields.
DH-21889: Add Python version specifiers for numpy, pandas, pyarrow, matplotlib
DH-21835: Construct LAS writer in BinaryRowUtils
DH-21780: add precision to time parameter javadoc in loggers |
| 021 | DH-21932: memoize viewport subscription options
DH-21921: WebClientData2Objects.historicalAndLiveMerged should avoid get(0)
[DH-20504](#added-support-for-java-21-and-25): Add Java 21 and 25 support for G+
DH-21867: Importer transformation integration test and documentation updates
DH-21916: Create a CODEOWNERS entry for WebClientData2 |
| 020 | DH-21911: switch to maxBy on activeUsers
DH-21913, DH-19818: Update deephaven.ui to v0.33.0
DH-21714: Correctly create dynamic partition BLF loggers |
| 019 | DH-21906: Bump G+ to Core 41.3
DH-21891: Remove numba from install-required of Core Py API
DH-21305: Downgrade jetty to 12.0.33
DH-21814: Reuse callsite for updateBy listener creation.
DH-21873: Schema Editor allow partitioning columns for extended storage type
DH-21875: Fix File Name from Schema Editor Export
DH-21860: Disable All Schema Fields on Parser Error
DH-21893: Avoid NPE due to stale/missing auth token
DH-21752: CorePlus CSV import error handling improvements
DH-21872: Schema Editor Data Index should wrap
DH-21895, DH-21449: Update deephaven.ui to v0.32.3
DH-21894, DH-21658: Update web version to 1.15.1
DH-21553: Clear Stale Validation Errors in Query Editor
DH-21874: Fix Schema Editor Formatting in Firefox
DH-21865, DH-21866: Exclude deephaven-csv-fast-double-parser from EnterpriseShadowed
DH-16844: Custom parsers in CorePlus
DH-21546: add missing sort for stale data
DH-21889: Remove numba and llvmlite from the requirements.txt of Core+ Py
DH-21816: Core+ CPP client needs to handle the null truststore-url case
DH-21864: HTTP Resolvers must use truststore when configured
DH-21568: Schema Editor column revert button
DH-21850: Don't Leave 'Zombie' Workers Running for Successful Tests.
DH-21214: Scheduled Force Logout
DH-21743: switch to definite time mocking
DH-21325: Drop Legacy Python 3.9 in G+
DH-21837: TestOrchestrator can start more tests than intended.
DH-21838: Suppress ClosedChannelException in LogHelper |
| 018 | Merge updates from 1.20240517.555 - DH-21434: Add integration test for ReplayDatabase filter prioritization.
- DH-21705: Authentication close timeout kills dispatcher.
- DH-21782: Update Grizzly to Core+ 41.2
- DH-21772: C++ Client: Fix Base64Encode
- DH-21732: Compromise for stateful partition filter reordering.
- DH-21652: remove Core logger row flags
- DH-21759: Migrate Util annotations to util-annotations
- DH-21100: Allow formulas in rollups.
- DH-21531: DeferredViewTable.TableReference forces coalesce too early
- DH-21655: whereIn ClassCastException for single column partial data index.
- DH-19765: Allow uncoalesced tables to display in Enterprise dashboards
- DH-21783: Backport Use Historical Data for Query Logs to Correlate Serial to Id
- DH-21117: Fix Swing Removing Attachment Type on Update
- DH-20862: Add SAML auth support for C++ client
- DH-21652: prepare for Core logger flag removal
- DH-21707: Adjust dark mode running vs initializing query monitor…
- [DH-19662](#timeseriesfiltergenerator): TimeSeriesFilterGenerator
|
| 017 | DH-21733: Fix missing timeouts in Python Core+ client.
DH-21822: Remove requireNonNull check in LogAggregatorWriterMultiPartition
DH-21792: add loggerClass to LoggerInfo
DH-20052: remove IOException from Logger 'of' method
[DH-19534](#add-core-csv-import-job): Corrections to CSV import documentation
DH-21731: Fix envoy config in K8s to allow wss connections to legacy workers
DH-20052: Binary Logger Factory improvements |
| 016 | DH-21686: Make WCD2's WorkspaceDataWriter service plugin requests async
DH-21769: throttle activity write to localStorage
DH-21760: fix qa results for new release numbering format
DH-21215: Move user refresh outside of cache
DH-20707: Enforce a size limit on WorkspaceData writes on WCD2
DH-21562: Be clearer and consistent with which truststore is used
DH-20987: fix REPLACE mode concurrent modification error by syncing config version
DH-21750: Change the Keepalive Time to 20s for Authentication and Controller Connections.
DH-21636: Default to SHA-256 for public key md/mgf params
DH-21730: Update deephaven.ui to v0.32.2
DH-21670: Fix unbounded memory leak in deephaven.ui / python workers
DH-19973: Aggregations do not persist in deephaven UI tables
DH-19310: Add deleteQueries to EnterpriseClient definition |
| 015 | Merge updates from 1.20240517.555 (in-progress) - DH-21699: Pin setuptools to 81.0 for py < 3.10
- DH-21689: Update default swing merge-storage-type from DEFAULT to Default
- DH-21704: Update Pivot plugin to v0.3.1
- DH-21595: use alternatives --install and --set for jar and jps
|
| 014 | DH-21652: prepare for Core logger flag removal
DH-20361: Cleanup on window "unload" |
| 013 | DH-21541: Swing Should not Edit Core+ Queries
DH-21729: Make sure client connection address is populated correctly
DH-21666: Use Historical Data for Query Logs to Correlate Serial to Id
DH-21540: Make sure launcher system socket factory is initialized
DH-21640: Rename WCD2 to WCD |
| 012 | Merge updates from 1.20240517.554 - DH-21684: Dockerized R Core+ client build is missing proto gen R files
- DH-21711: dhconfig acl users remove from a csv file should allow a file without passwords
- DH-21698: Better thread handling in worker cert readiness check
- DH-21635: Defer table definition creation for ExportedObjectInfo to avoid Swing crash.
- DH-21688: Do more CSV validations for dhconfig user add from CSV file
- DH-21649: Jupyter logging package should specify the pydeephaven version
- [DH-21394](#input-table-specification-updates): Small docs update
- DH-21606: Support batch addition and removal of users via dhconfig
- DH-21659: Fix helm template newline handling with qa shared volumes
- DH-19492: allow ACL import after error
- DH-21645: Update CODEOWNERS for python system test exclusions, and gradle/plugins/ and /Automation/ ownership.
- DH-21140: Fire disconnect events from js pivot table
- DH-21584: GrpcAuthenticationClientManager.verifyToken should only throw AuthException
- DH-20363: Update Web UI, update Pivot js plugin
- DH-21381: Change location of monit config files to avoid cross-device link error
- DH-21510: Update Grizzly to Core+ 0.40.9
- DH-21451: make Python packages: pytz and zoneinfo soft deps
- DH-21486: Allow the clock filter to execute in parallel
- DH-21462: Dictionaries would skip the last region if it had only one value
- DH-21434: Update unit test expectations.
- DH-21594: Update release script to ignore DOC tickets
- DH-21585: Fix Web UI-breaking WCD catalog ACL issue
- DH-21262: Make IServerSelectionProvider implementable outside of iris
- DH-21276,DH-21275: Remove old dh-config files and monit processes when marking a node etcd-only
- DH-21532: Use alternatives --install before --set
- DH-21434: Do not check for empty tables in replay.
- DH-21458: Use bcrypt-cost: 4 etcd config for k8s.
- DH-21483: use poll instead of peek to drain queue
- DH-21436: Support adding commonName to cert-manager certificate objects
- DH-21518: Fix dependency name change for testcontainers dependency
- DH-21426: CI image - add helm, skaffold to CI image
- DH-21446: Fix Dispatcher startup notification ordering.
|
| 011 | DH-21674: Make nightly tests report correctly report results
DH-21211: Add inactivity timeout logoff
DH-21215: Refresh snap table
DH-21683: Update Core+ C++ and R client dockerized build for lib.core.toml
DH-21174: Don't shadow deephaven Core
DH-21419: Add shared filter list for Panel Dropdown and PQ Explorer
[DH-15846](#core-input-table-validation): Fix InputTableEnums test bad merge.
DH-21695: Update Pivot plugin to v0.3.0
DH-21669: Pivot plugin should re-fetch on disconnect/reconnect
DH-21702: Pivot filtering UI
DH-21673: Update web version on G+ to v1.14.0
DH-21625: investigate podman tests
DH-21315: Adjust dark mode running vs initializing query monitor colors
DH-21506: Sort PQ object array by name
DH-21663: correct Expiration rolling logic |
| 010 | DH-21609: WCD2 startup and initial usage memory concerns
DH-21661: update docker version in jenkinsfiles
DH-21316: Convert controller and config from deployments to statefulsets in Kubernetes
[DH-15846](#core-input-table-validation): Validate Core+ Input Table Enums
DH-21551: Fix Dashboard Export Converting Arrays to Strings
DH-19985: Ensure Netty bom is used when we load gRPC
DH-21197: Remove "defaults" for PQs created from JS
DH-21339: ConsolePanel Variable Table Replacement Creating Duplicates
DH-21568: Improve Schema Editor Field Editing
DH-21595: use alternatives --install and --set for jar and jps
DH-21215: Force logout a user that has been deleted
DH-21645: fix codeowners to use exclusion pattern
DH-21099: Js API samples should check for the correct type string
DH-21527: Database name in JDBC import settings should be required
DH-21598: sort out mv file issue on nightlies
DH-20262: Safe Mode Query Editor
DH-21665: Change location of monit config files to avoid cross-device link error
DH-21595: Update images for java alternates (G+) |
| 009 | DH-21607, DH-21234, DH-21610: Update web version in G+ to v1.13.0
DH-21566: Handle "DEFAULT" storage-format in Core+ Merge
DH-21422: Update build-to-version script to work with new build numbers
DH-21600: Added embedDashboardsAndWidgets feature flag
DH-21597: check-deephaven-cluster used wrong argument name.
DH-20724: Add .copy() and .getSourceTable() functions to JsPivotTable
DH-18554: Test Orchestrator - remove unhelpfully noisy grpc logging from output
DH-21502: vulnerability tracker
DH-21514: Update web version to 1.12.1
DH-21552: Add AclService and WebClientUtilsService to Enterprise Auth Module
DH-21574: Wrong ACL filter definition in WCD2 for UserAssignments table
DH-21249: Add Envoy route for SchemaApi service
DH-21530: fix dh-config install error, python test and use signed launcher
DH-21521: SessionMonitor does not wait for enough sessions
DH-21523: Update Grizzly+ Core+ to 41.1.
DH-20446: JS API should close session on disconnect
DH-21486: Allow the clock filter to execute in parallel.
DH-21462: Dictionaries would skip the last region if it had only one value.
DH-21480: Use protobuf instead of JSON for input table restrictions.
DH-20884: Update protobuf-java-util to expected protobuf-java ve…
DH-19985: Use Netty's BOM for consistent netty, boringssl
DH-21451: make Python packages: pytz and zoneinfo soft deps
DH-19489, DH-20658: structured filter support in Core Python client and server API
DH-21400: Implement findPositionForKey for StaticSymbolTableChunkedOperatorAggregationStateManager
DH-21297: correct shift handling for TreeTableFilter
DH-21319: Anonymous classes don't work in the query language |
| 008 | [DH-21265](#deephaven-managed-envoy-installation): Generate per-node certificates for envoy; fix legacy workers after envoy upgrade
DH-21511: fix csv import tests
[DH-21394](#input-table-specification-updates): fix failing test
DH-21478: add disabled test to demonstrate failure
DH-21490: Consistent use of Core+ Schema in all Core+ projects
[DH-21394](#input-table-specification-updates): properly check ColumnSpec invariants
DH-20000: backport test orchestrator
DH-21212: Rework backend API with system tables
DH-21475: Bump the others group across 2 directories with 41 updates
DH-15642: Web Bulk Data Ingestion
DH-21467: Bump deephaven-csv reference to 0.19.0 |
| 007 | Merge updates from 1.20240517.551 - DH-21459: Disable crosscluster tests to G+
- DH-21393: Improve help output for some dhconfig options
- DH-21374: Docs CI and tooling
- DH-21064: JS PivotTable support for filter/sort before subscription
|
| 006 | DH-21008: Fix failing tests
[DH-21173](#objectcodec-deprecations): Remove Legacy and Core+ usage of deprecated codecs
DH-21459: Disable G+ Crosscluster test (G+)
DH-19846: empty password should fail differently
DH-21440: Integration Test for Core+ Schema
[DH-21173](#objectcodec-deprecations): add ObjectCodec binary unit tests
DH-17050: Fix trim defaults for null and 1-character formatting |
| 005 | DH-21444, DH-21259, DH-21027, DH-21367, DH-21407: Update web version v1.12.0
[DH-21173](#objectcodec-deprecations): add ObjectCodec binary unit tests
DH-21343: Move IngesterPersistentQueryConstants
[DH-21173](#objectcodec-deprecations): add ObjectCodec binary unit tests
DH-21306: Refresh token did not update deadline
DH-21008, DH-21249: Fix missing JS API configs after JS API refactor
[DH-21097](#schema-interface-in-core): revert exposing SchemaXmlParser.getColumnTypes
[DH-21097](#schema-interface-in-core): Fix javadoc |
| 004 | Merge updates from 1.20240517.550 - DH-21430: Update Core+ to 0.40.8.
- [DH-19309](#changes-to-data-routing-filtering): Corrections to data routing filtering
- DH-21366: Upgrade fabric8 lib and worker pod logging robustness
- DH-21399: Avoid setting a timeout that applies to all RPC methods in controller_service_config.json
|
| 003 | [DH-21097](#schema-interface-in-core), DH-21110: Schema interface in Core+
DH-21356: Compute the correct image version
DH-21421: Update Java style guide for record formatting
DH-20247: corrections to data routing filters and code enhancements
DH-21415, DH-21259: Upgrade deephaven-plugin-plotly-express to 0.18.3
DH-21158: DH-21295: Correctly map between TS/JS and Proto concerning nulls
DH-20987: Dependent queries not handled correctly when importing queries
DH-21348: Clean up target import-directory on failed BinlogImport job
DH-21411: Fix G+ wheel name normalization.
[DH-19506](#simplify-of-default-tailer-config-file-tailerconfigdbinternalxml): simplify tailerConfigDbInternal.xml
DH-21410: Updates to officially release gplus |
| 002 | Merge updates from 1.20240517.549 - DH-21396: Fix potential NPE when building worker ResourceRequirements
- DH-21341: Fix typo for controller service in controller_service_config.json
- DH-21358: Fix Helm lint failure
- DH-21336: fix bad link in grizzly pydoc
- DH-21324: Give the configuration server more memory in default Helm values
- DH-21285: Allow setting default CPU requests/limits for Kubernetes workers
|
| 001 | DH-19828: no PQ restart triggered when adding/removing replicas or spares
DH-21330: Fix glob CSV import preview
DH-21271: migrate lz4 dependency for enterprise
DH-21352: Fix Schema JDBC API for Import Source
DH-21356: Make sure the build supports the new version scheme
DH-21380: remove extraneous ImporterBase wrapping
DH-21143: More responsively terminate closed Code Studios.
DH-21157: Blue checkmark should be set to indicate the currently selected DataType
DH-21027: Adjust setting menu header for proper contrast
DH-18617: Filter interactive consoles and schema editors from PQ explorer |
## Detailed Release Candidate Version Log: Deephaven v1.20250219beta
| Patch | Details |
| ----- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| 138 | DH-19548: Fix ImportJobs javadoc
DH-21337: bump podman to rocky9 and python312
DH-21334: Add QueryDisplayType enum and complete QueryType enum
DH-20762: Convert auth and acl procs to stateful sets that can have multiple replicas
DH-21187: Remove WCD legacy from gplus
DH-19548: Fix issues with delimiter and trim using CSV import builder
DH-21129: Persist Schema Connection State to Workspace
DH-21115: Use new theme variables for diff colors
DH-20305, DH-20295, DH-19435: Various updates to default property files
DH-21172: Fix Layout for Schema Editor Import Source |
| 137 | Merge updates from 1.20240517.547 - DH-21328: Allow access to k8s resource 'pod/logs'
- DH-21288: Workaround for Groovy Anonymous classes not reporting themselves as anonymous.
- DH-19620: Kubernetes default storage class should be null, not "default"
- DH-21283: Add resource requests/limits for containers that were missing them
- DH-21278: Bump kafka-clients to 3.9.1
- DH-21250: Remove critEmail and smtp.mx.domain from default property files
- DH-13699: gRPC timeout for client auth invalidate cookie should be short
- DH-21233: Add param 'channel_options' in the ControllerClient initializer
- DH-21044: Ignore pre/post install scripts
- DH-21165: Change coreplus py version required to 3.9
|
| 136 | DH-20627: Make WorkspaceDataTool work with WCD2
DH-21317, DH-21093, DH-20243, DH-21048, DH-21144, DH-21258: Update web version to v1.11.0
DH-21322: Update G+ to Core 41.0
DH-18056: Null and NaN Core engine Consistency
DH-10139: Introduce structured errors for input table updates.
DH-18811: Core+ input tables can't be edited after other columns joined on
DH-19047: Selectables with Barriers and Serial Marking
DH-19279: Use ColumnExpressionValidator for HierarchicalTableFilters.
DH-19382: add server side timing to JsCommandResult
DH-19461: Apply linting/type-checking on Core Py APIs
DH-19475: predicate pushdown - parquet dictionary support
DH-19563: JsTreeTable copy throwing breaking advanced filters on tree tables
DH-19929: support Avro String[] types
DH-20248: Update server base images to Ubuntu LTS 24.04
DH-20307: Throw errors when worker connection has been Disconnected
DH-20408: Allow column renames to properly mask collisions.
DH-20448, DH-20449: Better schema information for complex types
DH-20464: support table level data indexing for all filters
DH-20465: Fixes for MethodListValidator dependencies.
DH-20516: Add implicit barriers to serial Selectables.
DH-20517: Add ConcurrencyControl and Selectable wrappers in Py Server API
DH-20523: Include update graph name in log messages.
DH-20533: Catch/ignore warnings in _wrapper.py
DH-20540: Ensure DataIndex pushdown is not short-circuited
DH-20563: Improve juli log level translation
DH-20568: Refactor DHProcess Module for use outside EngineMetrics.
DH-20590: Add Add ColumnExpressionValidator to TicketResolverOptions.
DH-20607: Bump kafka version to 7.9.2
DH-20611: Add dependency constraint on json-smart
DH-20614: correct PartitionAwareSourceTable partition column filter handling
DH-20616: better URI parsing
DH-20625: SelectAndViewAnalyzer track barriers for real and aliased columns
DH-20638: selectDistinct on SourceTable throws an Exception while notifying
DH-20652: retain column definitions when columns retained
DH-20682: Update deephaven-csv to 0.18.0 for shutdown fix
DH-20685: Make Resolver and InferenceInstructions equals better
DH-20720: Add PluginOptions for service loaded plugins to get the ColumnExpressionValidator.
DH-20736: Add more column validation.
DH-20714: Convert Filters and Selectables to Stateless by Default
DH-20783: Update sort operations to put NULL first, NaN last
DH-20784: Mathematical agg ops should ignore NULLs, and poison with NaN
DH-20785: nan/null comparison in filter and query language
DH-20809: Fix Core+ WorkerConnection goes back into Reconnecting state after Disconnected
DH-20816: Refactor WhereFilter.Visitor pattern
DH-20854: TailInitializationFilter that uses rows not timestamps.
DH-20884: Update Jetty to 12.1.5, gRPC to 1.76.2
DH-20990: Fix predicate pushdown for renamed columns in a merged table.
DH-20994: Corrected sort(float), sort(double) to fix chunk sorting issue.
DH-20997: Allow prevFlusher for Distinct operators to run when not exposeInternal
DH-20998: ClassCastException when subscribing to BarrageTable with a ZonedDateTime.
DH-21004: include char in Numeric code generation
DH-21056: Use the value attribute of Pandas Timedelta to avoid type-checking error
DH-21091: Restore QueryLanguageFunction auto-generation
DH-21105: Remove hard-coded stateful ViewColumnSource constructors
DH-21109: Add Configuration constructor parameter for PropertyInputStreamLoader.
DH-21112: Prevent Python formula parallelism in non-free-threaded Python.
DH-21116: Make _to_sequence public to not break DH enterprise Py APIs (Grizzly, G+, SanLuis)
DH-21128: Always call Java Consumer's accept method regardless of whether partition value is provided
DH-21156: IncrementalReleaseFilter support for add-only tables.
DH-21231: WhereIn / WhereNotIn (DynamicWhereFilter) to handle NaN and +/-0 properly
DH-21266: migrate lz4 dependency
DH-19544: remove deprecated IrisLogCreator constructors
DH-13683, DH-21264: fixed remote logout users and groups
DH-21304: Update G+ to Core 41.0-SNAPSHOT
DH-20797: Hide settings tabs for Code Studio and Schema Editor queries
DH-13683: Revert remote logout users and groups |
| 135 | DH-21271: Gradle workaround for lz4 relocation
DH-21237: Update G+ to gRPC 1.76.2 and Jetty 12.1
DH-21256: io.deephaven.importers.csv.CsvSinkFactory used Legacy ColumnSources.
DH-21247: Fix MatchFilter constructor signatures.
DH-13683: remote logout users and groups
DH-20526: Upgrade envoy; fix envoy cert handling
DH-21087, DH-21069: Schema XML preview diff view, fix XML preview button bar
DH-21196: Back button for login screen doesn't work
DH-20409: Fix multi-partition imports
DH-21176: Use AEL instead of PQSL for integration test
DH-20409: Core+ CSV schema editor preview |
| 134 | Merge updates from 1.20240517.545 - DH-21195: Update launcher to address vulnerabilities from SBOM scan
- DH-21188: Allow setting Kubernetes CPU limit to requested value
- DH-20981: Safe Mode reset workspace is resetting all user workspaces
- DH-20654, DH-20435: Update Web UI to v0.85.39, update js-plugin-pivot to v0.2.0
- DH-21147: Revert fabric8 vulnerability update.
- DH-21182: Exclude JDOM1
- DH-21182: Exclude transitive jdom1 dependency from IJ form designer library.
- DH-21178: Update commons-beanutils in Core+
- DH-21169: Resolve all high vulnerability reported in web packages
- DH-21171: Update grpc to 1.76.2 for shadow-proto
- DH-21177: Swing ACL Editor is broken in Grizzly
- DH-21164: Update to Jetty 11.0.26 for Core+
- DH-21107, DH-21108: Runtime security enhancements to Kubernetes containers
- DH-21167: Relocate netty, bouncycastle, vertx in k8s shadow jar
- DH-20962: Bump commons-lang3 and logback to address vulnerabilities
- DH-21047: All Pivot column and row sources reported as not sortable.
- DH-21151: update protobuf-java, commons compress, and jackson core to address vulnerabilities
- DH-21147: Update k8sclient
- DH-21133: Using envoy on default https port results in errors in python and java client
- DH-21154: Update avro for shadow
- DH-21151: Address protobuf-java vulnerabilities
- DH-21148: Bump commons-io in shadow-resteasy
- DH-20949: Update parquet-hadoop, parquet-jackson and dependencies to address vulnerabilities
- DH-21125: PersistentQueryClient token factory retries should include retries for fishlib command failure.
- DH-19967: Fix ResolverReader.getServers() API for getting updates
- DH-20787: update WebClientData default heap
|
| 133 | DH-20375: Schema JDBC API Query
DH-21131: Placeholder for Schema Draft empty table name
DH-21170: Improve Schema Config Tab Behavior
DH-21039: Revert query monaco diff editor fixes
DH-21176: Fix integration-test for cases where there are no PQSL binlogs
DH-21210: Exclude Automation dir from CODEOWNERS
DH-20477, [DH-19534](#add-core-csv-import-job), DH-20340: CSV format tests, CSV/JDBC javadocs and fixes
DH-21208: Remove DH_DEFAULT_CERTIFICATE
DH-20306: A solution to the TableDefinition serialization issue
[DH-19587](#breaking-changes-in-tls-certificate-policy), [DH-19586](#client-truststores-are-optional): one cert per machine, truststore optional
DH-21204: Cover new enum cases in PqDerivedTables.
DH-20945: Update launcher to address vulnerabilities from SBOM scan
DH-20513: Import - Deephaven Binary Logs Web UI fixes
DH-21163: Save as PQ button crashes and loses notebook data
DH-21172: Fix bottom margin for Schema Import Source panel
DH-21065: Add missing proto enum values
DH-21095: Improve Schema Search
DH-21055: Fix layout for Enterprise tooltip worker name
DH-21071: [DH-21009](#custom-grpc-web-transport-for-deephaven-js-api): JS gRPC transport impl and buffer fix
DH-21058: Query monitor errors out when inputting Owner/Name OR filter
DH-21065: Handle legacy object types first in JS API
DH-21122: Fix JDBC codec shadowing
DH-20745: Can't stop code studio or schema editor query |
| 132 | DH-21015: Replace all usages of deprecated QueryInfo methods and IrisClient events
DH-21141: Web Schema Editor UI Fixes for CSV Import Source Preview
DH-20968: Bump the others group across 2 directories with 83 updates
DH-21039: Revert query improvements
DH-21113: GetPropertyRequest reads from classpath not etcd
DH-21081: Log when JettyServerBuilder doesn't enable CORS
DH-21120: Update CODEOWNER for web/client-ui folder to web team
DH-16956: update font loading to re-use fontbootstrap
DH-21044: Ignore pre/post install scripts
DH-21030: Handle formatting multiple jvm args in connection info
DH-20980: Add back missing validation when reverting draft query
DH-20745: Disable restart for Schema API and Code Studio queries
DH-20739: More Schema Editor UI fixes
DH-20776: Add python bindings for EnterpriseTableTools.readBin(...)
DH-20979: Use snapshots for shadowed build.
DH-21051: JS QueryInfo should return null for unset dates
DH-21073: Add missing IP addr for JS public key auth
DH-21060: JS dispatcher list should show correct summary for groups
DH-21084, DH-21085: JS should correctly handle nulls in query configs
DH-21082: Use schema file extension in Web Schema Editor
DH-21052: ConsoleCreator kills workers when used in an iframe
DH-20631: Add methods to retrieve PQ scripts
DH-20257: workspace snapshot schedule daily
DH-20152: Better error message when error creating a console
DH-20743: Reconnect plots correctly after wifi disconnect |
| 131 | Merge updates from 1.20240517.541 - DH-20917: Use same auth service with and without saml
- DH-21043: envoy installs with the internal installer fail when envoy is not setup yet
- DH-21016: Improve jetcd client retry schedule for increased resiliency
|
| 130 | DH-20391: CorePlus imports - remove append flag and clean CSV import exception
DH-15406: Table not refetching after being closed
DH-21042: request JDBC driver keys for JS API
DH-20999: New Tab screen's Shortcuts section is broken
DH-21032: JS API must actually pass saml key to auth server
DH-21032: SAML configs/templates accessible by config server
DH-15407: Alignment for Show Groups Without ACLs
DH-15407: Don't throw if user doesn't exist
DH-20979: Update Grizzly+ to Core 0.41.0-SNAPSHOT
DH-21030: Remove ConsoleConfig to fix code studio creation
DH-21029: Refresh token was not getting stored properly
DH-20980: Query settings flashes validation errors when changing namespace
DH-21018: Add back format document button
DH-20986: Wrap some console creator typing tests in `act`
DH-17975: Replace web_api_service endpoints with gRPC-web calls |
| 129 | Merge updates from 1.20240517.539 - DH-21011: Update to Core 0.40.7
- DH-18811: Core+ input tables can't be edited after other columns joined on
- DH-20997: Allow prevFlusher for Distinct operators to run when not expose Internal.
- DH-20998: ClassCastException when subscribing to BarrageTable with a ZonedDateTime.
- DH-20990: Fix predicate pushdown for renamed columns in a merged table.
- DH-20996, DH-20934: Update Web UI to v0.85.38
- DH-20936: coreplus py client timeout isn't passed to auth/controller clients
|
| 128 | DH-15407: Add showGroupsWithoutAcls flag, error if user does not exist
DH-21014: remove duplicate heap label in console status bar
DH-20414: Update scripted csv import to use specific merge server
DH-21006: Better handling when 20k queries are removed/updated
DH-20513: Enable Import - Deephaven Binary Logs in web
[DH-19534](#add-core-csv-import-job): Make CsvImportOptions immutable
DH-20414: Release CSV integration tests
DH-20992: Update packages to resolve critical vulnerabilities
DH-20855: Use tls crt for all certificates in installer
DH-20485: Make connection json optional
DH-20984: Exclude core JDBC tests from nightlies
DH-19998: Revert Query
DH-20972, DH-19382: Update web version in G+ to v1.10.0
DH-20795: Update QM Custom Filtering
DH-20828: add 'ruffFixAndFormat' gradle task and improve static analysis of Py code |
| 127 | Merge updates from 1.20240517.538 - DH-20909: Disable Legacy Web Column Name Completion Preload
- DH-20346: Replace nightly test jdk17 with jdk8 as we already run jdk17 tests
- [DH-19055](#one-artifact-supports-all-java-versions): Add release notes for the removal of -jdk segments from installation media filenames
- DH-20881: Git script dropdown doesn't show enough of script paths
- DH-20947: Update shadow-mssql to latest version
- DH-20525: error count reset on dependency restart
- DH-19177: correct a syntax error
- DH-17403: Dashboard with Deleted Query has Maximum Call Stack Exceeded
- DH-20838: Update commons-io and commons-lang dependencies in Enterprise build.
- DH-19497: add more diagnostics
- DH-20838: Update avro version in Enterprise to 1.11.5
- DH-20929: Change iriscat default so that its timestamp inference works after 2025/09/23
- DH-20839: Provide explicit supplemental groups on the installer pod in K8s deployments
|
| 126 | DH-20769: Use new useViewportData props to request data where necessary
DH-20970: Bump the patch-only group across 1 directory with 2 updates
DH-19535, DH-20418: CorePlus JDBC import and schema discovery
DH-20744: Use url encoded-comma separated lists for JDBC virtual properties.
DH-20952: Upgrade deephaven-plugin-plotly-express to 0.18.2
DH-15406: Permission analyzer UI
DH-20942, DH-18780, DH-20734, DH-18960, DH-18779, DH-20594: Update Web Version v1.9.0
DH-20944: Fix failing test
DH-20340: Make CsvSchemaCreator builder package visible
DH-20659: Query logs table recovering correctly on request restart
DH-20712: Fix failing console creator unit test
DH-20935: Cleanup subscription leaks after switching to createViewportSubscription
DH-15407: Fix broken javadoc
DH-20829: Use TLS for worker comms in Kubernetes
DH-15407: JS API for ACL Permission Analyzer
DH-20712, DH-20255, DH-20319, DH-20500, DH-19413, DH-20229, DH-19098, DH-20410: Update web version v1.8.0 and React v18 |
| 125 | Merge updates from 1.20240517.536 - DH-20920, DH-18779, DH-18780: Update Web UI to v0.85.37
- DH-20700: Legacy worker Web UI presents incorrect data in oneClick
- DH-20898: Fix JobScheduler close race condition
- DH-20887: Fix Check for Spares with Unlimited Restart Error Count
- DH-19497: Add troubleshooting info to flaky input-table test
|
| 124 | DH-20561: heap usage indicator
DH-20916: TabNavigation not focusing the correct element on click
[DH-19055](#one-artifact-supports-all-java-versions): remove extraneous generate projects
DH-20901: Core+ python client SessionManager.create_auth_client takes optional string argument but if given fails
DH-20344: Remove dead code incorrectly merged
DH-20867: use correct precondition when deciding to create envoy certs
DH-19538: Core+ Binary log import
DH-20187: Schema Editor Bulk Import and Export |
| 123 | Merge updates from 1.20240517.535 - DH-19786: Confirm pod is gone before confirming worker is deleted [Kubernetes]
- DH-20861: Add imagePullPolicy to containers that are missing it
- DH-20831: Add supplementalGroups to pre-release hook
- DH-20850: Remove unnecessary files from the Core C++ client tar bundle created by docker-build.sh
- DH-20853: correct expected error messages
- DH-20412: Close Core+ clients / connections when services / queries restart
- DH-19177: add retries and more diagnostics
- DH-20593: Linker broken on grid widgets when switching between dashboards
- DH-20822: Disable Minikube test
|
| 122 | DH-20427: Web UI Should Close WCD2 Widgets
DH-19951: Fix web publish action in G+
DH-19957: Fix Check for Spares with Unlimited Restart Error Count
DH-20518: Iris Java Client Connection JSON Default
[DH-18577](#rename-core-artifacts-to-use-iodeephavencoreplus-maven-groupid): Rename io.deephaven.dnd to io.deephaven.coreplus
DH-20863: Fix installer handling of core+ -SNAPSHOT version
DH-20832: Fix jetcd 0.8.5 shadow build
DH-20759: Controller Configuration to Include WorkerKind, Protobuf Comments
DH-20834: http/1.1 is required by vscode
DH-19943: clear SchemaService for tests before using |
| 121 | Merge updates from 1.20240517.534 - DH-20806: Fix saveContainerImages gradle task
- DH-20794: Configurable Core+ python client's SessionManager rpc timeouts
- DH-20750: Run deephaven_management container (and install hook) as irisadmin instead of root
- DH-20804: service account role update
- DH-20805: Update Grizzly Core+ to 0.40.5
- DH-20307: Throw errors when worker connection has been Disconnected
- DH-20682: Update deephaven-csv to 0.18.0 for shutdown fix
- DH-20464: cherry-pick filter barrier support for ParquetTableLocation data indexes
- DH-20688: Kubernetes deploy from Jenkins and run automation tests
- DH-20737: Helm values for cert-manager's IssuerKind are called "issuerType"
- DH-20546, DH-20703: Use namespaced roles with limited permissions for Kubernetes service accounts
- DH-20761: Make Envoy service's type configurable in Kubernetes
- DH-20780: Backport to grizzly DH-20234 Controller believes Core+ worker is still running when actually down
- DH-20790: Move dependencies out of task configuration block
|
| 120 | DH-19943: move readBin options into builder
DH-20374: Schema Editor CSV API
DH-20833: Set corePlusManager in useIframeContentLogin
DH-20739: Schema Editor UI enhancements
DH-20414: Add delay for int-test CSV import
DH-20818: Upgrade deephaven-plugin-plotly-express to 0.18.1
DH-20827: Modify CODEOWNERS for web directory ownership
DH-20604: PQs on merge server automatically become a Draft
DH-20473: Provide truststore directly to Jetty h2 client
DH-20781: Update jetcd version to 0.8.5
DH-20748: Web UI crashing when reordering dashboard tabs with a new dashboard open
DH-19948: Allow longer dashboard names in top tabs
DH-20708: Notebook classloading should be disabled for Core+ system PQs |
| 119 | Merge updates from 1.20240517.533 - DH-19994, DH-18788, DH-20010: automate system upgrades, support vmUp/vmDown on systems without local scripts, restart envoy internally (fixed)
- DH-20767: CART requires tracking rowset for InverseWrappedRowSetRowRedirection
- [DH-20740](#fix-core-mis-decoding-of-certain-string-and-stringset-values): Use correct decoder for Core+ String and StringSet columns
|
| 118 | DH-20481: Create Import Source as Valid
DH-20344: Console creator now uses CorePlusManager
DH-20298: Core+ Run Local Query Script
DH-18918,[DH-19076](#rename-dh_dnd_versions-to-dh_coreplus_versions),DH-17469: Extract remotely scripts into .sh files, rename DH_DND_VERSIONS to DH_COREPLUS_VERSIONS, more diskspace installer validation
DH-20782: Disable SNI checks
DH-20234: Controller believes Core+ worker is still running when actually down |
| 117 | DH-19943: Port readBin to Core+
DH-20659: CorePlusManager caching and logging
DH-20538: Use new createViewportSubscrtipion for ItemUpdateListener causing false sharing changes
DH-20472: DH Services should use hostname as authority
DH-20765: Small fixes for Core+ MergeJob |
| 116 | Merge updates from 1.20240517.532 - DH-20706: Fix Iceberg test resources
- DH-19805: Upload Core+ client to testpypi (for now) as part of republication job.
- DH-20620: Fix listener generation for dbSetter="none"
- DH-20620: Support instrumentation columns in readBin
- DH-20500, DH-19973: Update web version v0.85.36 and dh.ui v0.31.3
|
| 115 | DH-20730: rebuild images with expect
DH-20744: Add virtual properties for jsapi. |
| 114 | DH-20687: Publish Enterprise JS API type for RefreshToken
DH-20040: optimize selectDistinct for partitioning columns in DeferredACLTable
DH-20562: Make the test more specific to avoid false positives
DH-20212: repair the checkpoint record after changing table files or definition
DH-20729: Update plotly to v0.18.0
DH-20545: Expose JS VariableDefinition objects without GWT type info |
| 113 | Merge updates from 1.20240517.531 - DH-19994, DH-18788, DH-18855, DH-18872: Revert original change
- DH-20598: Fix broken links in release notes
- DH-19994, DH-18788, DH-18855, DH-18872: automate system upgrades, fix pull_cnf, support vmUp/vmDown on systems without local scripts, restart envoy internally
- DH-20623: Publish kuberenetes images in JDK17 only
- DH-20534: Fix kubernetes legacy python workers issue
- DH-20553: Fix kubernetes swing login issues
- DH-19284: Update podman internal readme to build from local branches
- DH-19851: fix internal config for qa-results box
- DH-20341: Update CART to reduce unnecessary data copying
|
| 112 | DH-20695: Support PQ import/export via gRPC.
DH-20697: gRPC endpoints for config property access
DH-19595: add hostname SAN and remove static authorities from system certs
DH-20095: Right chevron icon doesn't disable when scrolled to end of dashboard tabs
DH-20699: Schema API Query Should Run on Merge
DH-20586: Use new JS API when loading workspace storage data
DH-20693: Fix UnifiedServiceTest, correctly expose Jetty gRPC port
DH-20691: Schema Editor should preserve CDATA
DH-20577: Allow user to call containsAnyWithSplit |
| 111 | Merge updates from 1.20240517.528 - DH-20469: Use deleteRecursivelyOnNFS(...) in HiveLocationsTableKeyFinder
- DH-20639: correct TestDatabase buildExpectedHistTable
- DH-20639: Use LinkedHashMap to ensure proper partition order
|
| 110 | [DH-20690](#column-expression-validation): G+ Should use Parsed ColumnExpressionValidator
DH-20689: Properly Apply WorkspaceData Filters to Latest Snapshot
DH-20340: CSV schema inference infrastructure
DH-20677: Stop Schema API Query on Unload
DH-19899: Use Jetty instead of Netty for our gRPC services
DH-20481: Update Schema Editor Validation for Backwards Compatibility
DH-20661: generate up-to-date loggers / listeners |
| 109 | Merge updates from 1.20240517.527 - DH-20643: Update Grizzly Core+ to 0.40.4
- DH-20638: selectDistinct on SourceTable throws an Exception while notifying
- DH-20626: Update Grizzly Core+ to 0.40.3
- DH-20614: correct PartitionAwareSourceTable partition column filter handling
- DH-20611: Add dependency constraint on json-smart
- DH-19929: support Avro String[] types
- DH-20607: Bump kafka version to 7.9.2
- DH-20621: Acl Filter Barriers should Ignore non-Simple Filters only Partition Columns
- DH-20585: GrpcAuthenticationService should validate the cookie provided in the refreshCookie call
|
| 108 | DH-20531: Discover schema from JDBC screen
DH-20635: Replace call to client.getQuerySelectionPermission
DH-20637: Fix Schema API query disconnect while active
DH-20443: Schema Editor No Compile Option
DH-20510: Fix array-column based validation tests |
| 107 | Merge updates from 1.20240517.525 - DH-20555: Add resource preset for etcd install, set nfs version to non-deprecated image version
- DH-20595: Fix minikube test
- DH-20390: Upgrade DHE Benchmark to Community Benchmark 0.40.0
- DH-20584: Change CsvImportProcessorTest setup to reduce execution time.
- DH-20321: Merge to Parquet fails when source table has array columns with column codecs
- DH-20554: Increase webapi memory from 1Gi to 2Gi in Kubernetes
- DH-20553: Swing launch issue in Kubernetes
- DH-13515: Basic UI support for Pivot tables
- DH-19413: Web UI Grid expand/collapse column groups functionality
|
| 106 | DH-19722: Better handling for large numbers of open dashboards
DH-20439: Convert Schema Explorer ListView to use a TreeTable
DH-20562: Exclude grpc-servlet classes from producing <warning logs
DH-20505: Create new JDBC import source screen
DH-20123: Schema API Query |
| 105 | Merge updates from 1.20240517.524 - DH-20541: Update Grizzly Core+ to 0.40.2
- DH-20533: Catch/ignore warnings in _wrapper.py
- DH-20516: Add implicit barriers to serial Selectables.
- DH-20527: Use pyarrow 20 instead of 21 for ubuntu20 support.
- DH-19719: Revert getdown changes
- DH-20092: Always use pre-built binaries during pip install
- DH-20509: Rename pivot projects instead of output jars.
|
| 104 | DH-20545: Fetching tables from PQs was not working
DH-20529: Use new JS subscription API to fetch viewport data
DH-20360: WCD2 fails to track properly lifetimes of table objects returned to the client
DH-20303: A regular user's default PQ filtering in the QM is incorrect
DH-19889: Added some unit tests specific to gplus |
| 103 | DH-20506: Unshadow gRPC for DHE/Core+ usage
DH-20502: MessageUtilTest.testWebServerParameters failure
DH-19272: Bump GWT/jsinterop/elemental2 versions |
| 102 | Merge updates from 1.20240517.523 - DH-20497: Update Core+ to 0.40.1
- DH-20448, DH-20449: Better schema information for complex types
- DH-19047: Selectables with Barriers and Serial Marking
- DH-20465: Shadow openrewrite for MethodListValidator
- DH-20479: add retries for installation upload
- DH-18080: Use old method name validator, fix properties and property sync.
- DH-20460: Require lock for PivotTable creation and apply method.
- DH-17519: Installer must pass --direct to dhconfig
- DH-19889: ParquetShadowHelper should preserve all fields when copying metadata
- DH-20432: Update Grizzly to Core+ 0.40.0
- DH-20493: VS Code extension - Deephaven UI is broken on Envoy servers
- DH-20385: migrate to ZoneId
- DH-19895: New JS API for requesting data
- fail-fast when SimpleSourceTable has non-simple TableDefinition
- DH-19905: Port LeaderTableFilter to Core
- DH-20383: Add inputTable.isValue to table attributes.
- DH-18080: Make column expression validation more configurable.
- DH-19410: Add multiple row-group write support
- DH-18062: Make IcebergCatalogAdapter Closeable
- DH-18062: Added custom AWS Client factory for Iceberg
- DH-16341: Keyed transpose
- DH-20171: Allow Comparators for Object Sorts
- DH-20148: Make Vector Comparable.
- DH-18857: Allow Vector and Array columns to be handled by quick filter backend.
- DH-20059: Predicate pushdown through merged tables (UnionSourceManager)
- DH-20077: Simplify client builds and prepare for CI automation
- Update web version 1.6.0
- DH-19961: Add RowKeyAgnostic sources to pushdown
- DH-19978: Add assertBlink, assertAddOnly and assertAppendOnly to Table.
- use JobScheduler for pushdown estimate
- DH-19045: FilterBarriers and FilterRespectsBarriers
- DH-18316: throw error if FileHandle key changes
- DH-19859: WindowCheck should not force a table to be refreshing if nothing will ever change.
- DH-18998, DH-18999: Enable etags
- DH-19798: Unsortable Columns Should not have Delayed Error in Rollups.
- Make newTable and mergeTables available from IdeConnection
- DH-19501: Expose Aggregated Columns in JSTreeTable
- add AWS SessionCredentials to S3 module
- DH-19448: Use S3 client for Iceberg from S3FileIO
- implement pushdown predicate filtering for where() calls
- Add Iceberg BuildCatalogOptions
- DH-18260: Added support to read/write list types to Iceberg
- DH-19044: implement serial Filter API
- DH-18145: Write timeout configuration with S3
- DH-20419: Ensure no leading/trailing spaces in auth headers
- DH-20413: Expand UpdateBy timestamp column types
- DH-19644: JS Rollup constituents can appear multiple times
- DH-20379: Python scope does not work in format_columns
- DH-20103: Improve error message for unsupported Timestamp column data types
- DH-20139: Remove CLASSNAME Substitution
- DH-20166: Log all export errors.
- DH-20146: make codec-api and implementations Java 8 compatible
- DH-20132: Lazy MergedDataIndex must include key columns.
- DH-20129: Return delegated AwsCredentialsProvider
- DH-20018: Update Python Arrow to Table Converter Type Mapping
- DH-20058: Address inappropriate chunk freeing in CountWhereOperator (aggBy and updateBy)
- DH-19970, DH-19958: Make it harder to accidentally create unpooled chunks, refactor pooling code to improve giving pattern, and make poolable capacities configurable
- Guard against nulls when transforming filter messages
- DH-20035: whereIn must coalesce set table.
- DH-19935: ensure CharSequenceUtils case-insensitive is consistent
- DH-20002: Mismatched Tree Table ID and Parent Column Results in Poor Error Message.
- DH-19924: Rewrite ungroup.
- DH-20003: auth transform should not be applied to outputs of HierarchicalTable or PartitionedTable service ops.
- DH-20027: ModifiedColumnSet.ALL.containsAll does not always return True.
- DH-19964: Absolute Rollup Sorts Broken
|
| 101 | DH-20384: Discover schema from CSV screen
DH-20414: Temporarily disable CorePlus CSV import integration tests
DH-20441: Add linting/type-checking/formatting for Core+ Py
DH-19985: gRPC/proto/barrage/arrow/dhc versions should be consistent |
| 100 | Merge updates from 1.20240517.521 - DH-20442: Restrict plugin publishing to the publishing stage
- DH-20430: Fix publication of io.deephaven.gradle:tools jar
- DH-20343: Disallow Pivots without Any Output Columns
- DH-20392: Add TstUtils methods to support array codec and BigDecimal unit tests
- DH-20394: Handle row groups in parquet from TLMI
- DH-20284: Minikube test fix to use Deephaven packaged etcd instead of bitnami
- DH-18806: Coreplus Benchmarks Nightly CI/CD Workflow
|
| 099 | DH-20461: Migrate UpdatePerformanceAncestors to BLF
DH-20346: Remove unnecessary JDKs from tests
DH-20450, DH-20388, DH-20401: Update Web Version 1.6.0
DH-20332, DH-18648, DH-19948, DH-20255: Update Web Version 1.5.3
[DH-19898](#http2-support-in-deephaven): Require h2 everywhere
DH-20400: Core+ Merge should filter intraday source on partition
DH-19235: EnterpriseCorePlusManager cache management
DH-20356: Add py.typed marker file for generated py proto package |
| 098 | Merge updates from 1.20240517.519 - DH-20393: Update hostconfig to use DH_JAVA over ILLUMON_JAVA
- DH-20372: Teach RPM installs to write correct value to JAVA_VERSION during install
- DH-20128: Add script to install K8s etcd from distributable package
- DH-20125: Revise js pivot table root expansion methods
- DH-19719: Handle same name files in different locations in DHFileDigester
- DH-20359: Trim whitespace from previousReleaseFile for upgrade tests
|
| 097 | DH-20333: Create new CSV import source screen
DH-20397: failure to creat auth client
DH-20356: linting-typechecking-coreplus-py-client
DH-20316: exclude circular BLF output directory from javadoc task |
| 096 | [DH-19534](#add-core-csv-import-job): Core Plus CSV import
DH-20337: WCD2 query shutdown/kept restarting due to a suspected authentication issue
DH-18062: Fix Iceberg javadocs |
| 095 | Merge updates from 1.20240517.517 - DH-20326: fix add-opens for DB.gradle
- [DH-19055](#one-artifact-supports-all-java-versions): Make gradle plugins publish with the same version as iris
- [DH-19055](#one-artifact-supports-all-java-versions): Fix java_env checks
- DH-20327: Remove jdk8/11 Jenkinsfiles
- [DH-19055](#one-artifact-supports-all-java-versions): Fix java_env to do a < check instead of a != check
- DH-20328: Fix plugin_hash.sh to avoid mac-incompatible `uniq -z`
- [DH-19055](#one-artifact-supports-all-java-versions): Publish to Google Artifact Registry, support all java versions with one artifact.
- DH-19865: add --add-opens=java.base/jdk.internal.misc=ALL-UNNAMED to test parameters
- DH-20163: Fix broken link in version logs
- DH-19954: Correct JIRA ticket number in version log
- DH-19762: Release JavaFileManager after compilation
- DH-19860: Disable web jupyter grid
- [DH-19055](#one-artifact-supports-all-java-versions): Remove developer branch from Jenkinsfiles
- [DH-19055](#one-artifact-supports-all-java-versions): Remove JavaVersion.current() from core+ test-conventions.gradle
- [DH-19055](#one-artifact-supports-all-java-versions): Publish to Google Artifact Registry, support all java versions with one artifact.
- DH-20205: Fix crosscluster xml issue
- DH-20205: Add GPlus Cluster to automated client tests
- DH-20168: Fix broken link in release notes
- DH-20162: Fix broken links in release notes
- DH-20291: remove baltocdn from ubuntu build images
- [DH-19055](#one-artifact-supports-all-java-versions): Merge artifact registry from next/grizzly to rc/grizzly
|
| 094 | DH-18062: Added fix for failing iceberg merge tests |
| 093 | DH-20196: Publish npm should fail on error
DH-18062: Added support for merging into iceberg tables
DH-19990: Update some dbaWorkflow PQs to use Core+ versions |
| 092 | [DH-19055](#one-artifact-supports-all-java-versions): Merge artifact registry from next/gplus to rc/gplus
DH-20196: GH action to NPM Publish Core+ JS API types |
| 091 | Merge updates from 1.20240517.515 - DH-20312: ResolverReader uses wrong deadline when fetching with etcd watcher
- DH-20293: Disable directory listing for SAML server
- DH-20276: Multiple authentication servers race between session purge and token use
- DH-20191: Avoid no-backoff etcd watcher retries that go into a tight retry loop
|
| 090 | DH-20311: Update Core+ C++ and R client dockerized build for lib.versions.toml
DH-20065: Schema Config
DH-19001: ui.resolve to reference widgets from other PQs that resolve on the web client
DH-20280: Migrate coreplus-loggers
DH-20221: Check object definition in query before attempting to fetch from server
DH-20289, DH-18443, DH-18653: Update plotly-express to v0.17.2 |
| 089 | Merge updates from 1.20240517.513 - DH-20290: Integration test failures after changes to ConfigurationServicePropertyInputStreamLoader
- DH-19425: correct use of hashed password in examples
|
| 088 | DH-20181: Fix deserialization of shadowed ImportStatePartitionIndex
DH-20252: correct text in dhctl intraday loggers command |
| 087 | Merge updates from 1.20240517.512 - DH-20185: Add 2 hour time to all installer tests
- DH-20259: Log unused tokens when an auth client session is removed in the auth server
|
| 086 | DH-20286, DH-18443: Update deephaven.ui to 0.32.1
DH-19668: backport Python Version splitting between legacy and core engines
DH-20261: try to make LocalReadUsesCheckpoint less flaky |
| 085 | DH-20246: Import coreplus prop files in k8s install script
DH-20204: remove sidecar BLF code generation
DH-18711: activate 9.10 installer in gplus, restore capability to build the installer project
DH-20237, DH-18601, DH-19416, DH-19988, DH-10205: Update deephaven.ui to v0.32.0 |
| 084 | Merge updates from 1.20240517.511 - DH-20226: Update Core+ to 0.39.8
- DH-16341: Pivot tables as real tables supporting downstream operations
- DH-20166: IllegalStateException in TicketTransfomer did not produce a log message
- DH-20195: Error during KeyedObjectHash rehashing
- DH-19237: KeyedObjectHash#replace() can throw an NPE in normal operation
- DH-18711: use Launcher 9.10 in grizzly
|
| 083 | DH-20177, DH-19601, DH-10205: Update web version to v1.5.1 |
| 082 | Merge updates from 1.20240517.510 - DH-20218: create Java client session with provided RootAllocator
- DH-19876: Nonexistent Table Should Result in a Better Error
- DH-20179: JDBC driver does not work outside localhost
- DH-20131: Mention RHEL 9 in README.md
|
| 081 | DH-19367: fix DB test
DH-20208: Get catalog table from wcd2 service factory |
| 080 | DH-19487: Add validator for comparing Intraday and Historical row counts
DH-19367: Use data sizes from checkpoint records
DH-20180: make V2Logger Immutable
DH-20176: FileSearchViewportUpdater was wired up poorly
DH-20102: rename test binlogs package to binlog
DH-20136: Backport to gplus remaining Core+ V2 Loggers from sanluis |
| 079 | Merge updates from 1.20240517.509 - DH-20167: Update Grizzly Core+ to 0.39.7
- DH-20129: Fix DeephavenS3ClientCredentialsProvider improperly caching AwsCredentials
- DH-19970: makeWritableChunkForPool should either be protected/private or be renamed
- DH-19958: Pooled chunk range should be configurable
- DH-20058: Fix CountWhereOperator is freeing chunks it does not own
- DH-20132: Fix broken case insensitive where in for Core+ historical tables
- DH-20161: SimpleFilterGenerator incorrectly reuses WhereFilter
- DH-19988: Update Deephaven UI JS to 0.31.1
- DH-19988: Update Deephaven UI to 0.31.1
- DH-19498: increase a timeout for data population in a test
- DH-19873: Publish typedoc .tar.gz to Jenkins artifacts.
- DH-20047: Allow mount of ssh secret in controller for git actions in K8s
- DH-18106: Controller logs should explicitly specify which host is the leader after election
- DH-18312, DH-20075: Improve test reliability, remove nfs on nightly test query nodes
- DH-20131: Add support for ubi 9.6 to cpp docker build.
- DH-20076: Fix typo and share implementation of small method
- DH-20079: Make Docker Core+ C++ build indifferent to name of directory
- DH-19768: Fix condition that could prevent worker startup on K8s platforms
- DH-20078: Fix broken docker C++ build on fedora and RHEL
|
| 078 | [DH-19793](#exception-thrown-if-filehandle-key-changes): Throw error if FileHandle key changes
[DH-19536](#core-validation-queries): use Immutables for ValidationTableDescription |
| 077 | [DH-20157](#on-demand-asynchronous-cleanup-of-the-databufferpool): on-demand, asynchronous DataBufferPool cleanup
DH-17960: WebClientData Core+ Frontend
DH-19800: correctly source logroot property for web_api_service logs
DH-20095: Account for sub-pixel rendering in right chevron disable state
DH-13241: Operate As For Web Console Creation
DH-19632: Add shortcuts to cycle stacks and panels
DH-20105: Set connection headers only once
DH-19529: Core+ embed widget
DH-20137: Permit empty URL segments for CUS |
| 076 | DH-20134: Ensure Core+ WorkspaceSnapshot uses non-refreshing data
DH-20106: Disable SNI Host Check on Kubernetes Installs
DH-19915: Add coreplus properties to Configuration Service (Backport)
DH-20124, DH-18281, DH-18840, DH-19839: Update plotly-express to v0.17.1
DH-16676: Port WebClientData to Core+ (Backend, gplus)
DH-20114: Restore missing annotation processor
DH-17858: replace javax.servlet-api 3.0.1 with 4.0.1 for saml support
DH-20100: Backport Envoy fixes with Jetty 12 to gplus
DH-19609: Schema XML Editor
DH-20117: restore spotless exclusion for /generated/ files |
| 075 | Merge updates from 1.20240517.507 - DH-20097: Include machine load sampling in dispatcher and auth server logs
- DH-20071: UOE when attempting to merge to extended storage
- DH-20067: Use only-binary=:all: flag to allow downgrading to pyarrow 20 instead of failing to build 21 on Ubuntu 20.04.
|
| 074 | DH-20111: Handle undefined dashboardid
[DH-19536](#core-validation-queries): Port Validation Job (PQ) to Core+ |
| 073 | Merge updates from 1.20240517.506 - DH-20068: make jq install more defensive
- DH-20061: fix podman nightly tests for rocky8
- DH-20029: Update Helm chart appVersion without modifying working tree
- DH-19883: fix flaky test
- DH-19567: Use the materialized NameMapping
- DH-19498: address flaky test, add logging
- DH-19452: allow ImporterDatabase to use existing authentication
- DH-20003: Test for tree operation in a PQ with ACLs.
- DH-20057, DH-19792, DH-20035, DH-20003: Update Grizzly to Core 0.39.6
- DH-19702: Acl Transformer is not Producing Actionable Server-side Error Message
- DH-18836: Test failures with enterprise IrisGridPanel linker
|
| 072 | DH-20082: Fix shadowed README local instructions
DH-20028: syncWeb action was not filtering outputs before copying |
| 071 | Merge updates from 1.20240517.505 - DH-20034: Properly defer the resolution of JDK download URL until it is needed
- DH-19983: Backport [DH-18365](#improved-support-for-iceberg-tables-in-core): Introduce 'iceberg' extended storage type
- DH-20017: fix ubuntu20 test failures
|
| 070 | DH-20038: Backport to gplus DH-17714 BLF2 loggers for controller, DH-17753 BLF2 listeners
DH-19892: Backport kafka tests from San Luis to GPlus
DH-20028: Fix copying web IDE files into the jsJar
DH-19529: Embedded dashboard route |
| 069 | Merge updates from 1.20240517.504 - DH-19974, DH-19428, DH-18836: Update deephaven.ui to version v0.31.0
- DH-19959: Add `curl`, `net-tools`, `less`, and `jq` packages to deephaven_os image
- DH-17554: Allow building images for AMD64/ARM64 explicitly in buildAllForK8s.sh
- DH-16723: Add missing labels to certificates and secrets in Kubernetes
- DH-18853: Update Helm chart appVersion
- DH-19671, DH-18912, DH-19385: Open ports automatically; add diff to image; return on success instead of exit
- DH-20004, DH-18976, DH-19614, DH-19693, DH-19963: Update web version v0.85.34
- DH-19925: Verify tokens directly to auth server origin from java auth client
- DH-19894, DH-19036: Update plotly-express to v0.16.1
|
| 068 | DH-20028: Incorrect caching for child web packages
DH-19903: upgrade jetty to 12.0.18
DH-14431: Add shortcuts to cycle dashboards
DH-20005, DH-19897, DH-18976, DH-19917, DH-19963, DH-19882, DH-19911: Update web version to v1.3.0 |
| 067 | Merge updates from 1.20240517.503 - DH-18607: Added support to reinterpret bytes as booleans at region level
- DH-19979: Add deephaven.PythonExec.fullPath config
- DH-19955: Default QueryLogsHelper to Query_1
- DH-18490: Ensure Gradle knows about inputs and outputs for tasks
|
| 066 | DH-18057: Add hasTable(...) method to Database interface
DH-18490: Ensure Gradle knows about inputs and outputs for tasks
DH-19951: Add isConnected property to EnterpriseClient |
| 065 | Merge updates from 1.20240517.502 - DH-19921: Use build module instead of setup.py.
- [DH-19399](#tailer-cleanup-of-old-binary-log-files): Tailer binlog deletion improvements
- DH-19711: Fix QueryLogs IllegalStateException
- DH-19927: React Spectrum process undefined error
- DH-19933: Update Sonatype Repository for Core Nightly Snapshot Builds.
- DH-19478: qa-results dashboard lineup
- DH-19744: Fix Query Monitor Disable Selection Menu Item
- DH-17767: Load Balancing - fix slot assignment table rendering
- DH-19392, DH-19864: Update web version to v0.85.33
- DH-19886, DH-19292, DH-18354, DH-19000, DH-18349: Update deephaven.ui to v0.30.0
- DH-19880: Pivots with Instants Fail with ClassCastException.
|
| 064 | Merge updates from 1.20240517.500 - DH-19904, DH-18998, DH-19748, DH-19338, DH-19792, DH-19830, DH-19808: Update Grizzly to Core 0.39.5.
- [DH-19662](#timeseriesfiltergenerator): Java 11 testCompile fix.
- DH-19884: Remove js-client dependencies
- [DH-19662](#timeseriesfiltergenerator): Add TimeSeriesFilterGenerator to ACL filter generators
- DH-19862: TDCP cannot apply Core+ filter generators for access check.
- DH-19739: Disable TestAbstractMultiSeries.
- DH-19724: Fix permissions for queries with mixed status replicas.
- DH-19434: File explorer not reconnecting after WebClientData restart
- DH-19884: Remove js-client dependencies
|
| 063 | Merge updates from 1.20240517.498 - DH-19767: Fix link in release notes file
- DH-19728: Add inotifywait to rocky8 jenkins images
- DH-17440: Migrate all Jenkins builds off gcr.io images
- DH-19455: Update bard VM images for Ubuntu 20.04 EOL
- DH-12106: Correct locking around ScriptRepository script lookups
- DH-12106: Improve locking around controller git actions
- DH-19692: PQ backed dashboards shared with multiple users not always visible
- DH-19074: Disable :js-client:gwtCheck.
- DH-19074: JS API support for pivot tables
- DH-19871: Pivot filtered after sort would drop sorts.
- DH-17737: Publish Core+ Client to Jfrog (minor fixes)
- DH-17737: Publish Core+ Client to Jfrog
|
| 062 | DH-19829: Make docker image building from source work with toml change
DH-19834: Fix missing gradle bit from sphinxTar target.
DH-19834: Backport Py changes in SanLuis to GPlus
DH-19651: Backport [DH-16190](#improved-binary-logger-and-listener-generation) Improved Binary Logger to G+ |
| 061 | Merge updates from 1.20240517.496 - DH-19850: Sort Query Logs by Timestamp
- DH-19813: py client util.py import issue
- DH-19803: Pivot key table compatibility check, better duplicate columns check.
- DH-19759: Copy Core Docker.groovy and use copy specs.
- DH-19808, DH-19809, DH-18315: Expose the owned FlightSession in DndSession
|
| 060 | DH-19849, DH-19632, DH-18906, DH-14431, DH-19731, DH-19693, DH-19614: Update web version v1.1.0 |
| 059 | Merge updates from 1.20240517.495 - DH-19803: Pivot Table key table validation.
- DH-19726: Fix Podman cluster.cnf generation and non-envoy client configuration
- DH-19766: Fix swing client connecting to non-Envoy Grizzly Podman deployment
- DH-19022: Check Controller Connected on Web Login Failure
- DH-18703: Update deephaven.ui to v0.29.4
- DH-18906: Update web version to 0.85.32
- DH-19705, DH-19696: Update deephaven.ui to v0.29.3
|
| 058 | DH-19727: Use property in Merge job that allows force-close of file-handles |
| 057 | Merge updates from 1.20240517.493 - DH-19686: Merge common logic from snapshot backed table location types
- DH-19302: Allow for custom base images in containers for K8s
- DH-19743, DH-19713, DH-19501, DH-19694: Update Grizzly to Core 0.39.4.
- DH-18842: Advanced Pivots
- DH-19681: Add property to MergeData that allows force-close of file-handles
- DH-19504: Configurable worker pod DNS lookup with delay on Kubernetes
- DH-19738: Fix Draft Query Reselects on Update
|
| 056 | DH-19673: Improve reliability of Kafka integration-tests
DH-19754: make client-base depend on deephaven-java-client-session
DH-19660: improve another error message in 'dhconfig dis add' |
| 055 | Merge updates from 1.20240517.490 - DH-19363: Separate non-worker annotations from worker templates in K8s
- DH-18752: Set only a worker cpu request and not a limit in Kubernetes
- DH-19700: Fix a few unit tests
- DH-19718, DH-19612: Update Web UI to v0.85.30
- DH-15595: Print volume delete warning and look for etcd backup pvc to delete in K8s uninstall script
- DH-19708: Fix QueryLogs Exception when Query is not Running
- DH-19265: avoid sudo usage and other installer improvements
- DH-19556: NewTabScreen checkboxes hit target size increased
- DH-19706: enable flight sql in grizzly
- DH-19704: Query monitor showed incorrect WorkerKind for workers not started yet
- DH-19633: Move Virtual Environment Creation into Separate Gradle Tasks
- DH-19677: Fix Race in performance_overview_binds.py Integration Test
- DH-19500: Fix Safe Mode Logout Crashes with 20k Queries
- DH-19395: Internal Installer ensure FeedOS pulled in with force no-compile
- DH-19649: Keep track of opened channels and close them upon SessionManager closing
|
| 054 | DH-19660: improve error message in 'dhconfig dis add' |
| 053 | DH-19684: Update web packages to v1.0.0
DH-18562: Deephaven UI picker hover blends in with non hovered styling in dark mode
DH-18921: CountDistinct aggregation name overflows background in web UI
DH-19307: Theme overrides in iframes
DH-19350: Ruff WASM - Dev Tools console error
DH-19393: Fix select distinct from table sidebar if aggregation is applied
DH-19673: Improve reliability of Kafka integration-tests |
| 052 | Merge updates from 1.20240517.489 - DH-19360: remove unused property
- DH-19360: convert LAS audit logging to use current features
- DH-19505: Fix release notes
- DH-19144: correction to in-process LAS for unit tests
- DH-19457: JS API usage of GetAttributesQuery should be concurrent
- [DH-19365](#new-api-to-format-the-log-format-suffix-of-internal-partitions): Added releases notes
- [DH-19365](#new-api-to-format-the-log-format-suffix-of-internal-partitions): Add printf-style formatting for log-format suffix
- DH-19144: correction to removeTable method
- DH-19144: add audit logging to user table operations in legacy workers
- DH-2972: Display Query Logs in Client UI
- DH-19462: Remove the rest of the legacy jupyter code from build
|
| 051 | DH-19679: add safety checks around FileHandle write
DH-19497: Ensure atomic blocking-add for input-tables |
| 050 | Merge updates from 1.20240517.487 - DH-19557: Fix the props used for enabling CORS on BHS
- DH-19545: expose auth external login
- DH-19630: Update generated ResourceUtilizationFormat2Logger to match schema
- DH-19654: Web SAML login error
- DH-19577: Add missing 'f' for f-string
- DH-19623, DH-19646: Fix a number of build and jenkins related reliability issues
|
| 049 | DH-19233: Port WorkspaceSnapshotQuery to Core+
DH-18548, DH-17600, DH-19466: Cherry-picking back remaining web changes for iframes, canceled interactive workers
DH-19337: Possibly include sort-ordering in core+ merge-job |
| 048 | Merge updates from 1.20240517.485 - DH-19627: Core+ build should useMavenLocal=true by default
- DH-19592: fix ubuntu nightlies on TaDriver prop file
- DH-19022: Better Login Error Message When Controller Disconnected
- DH-19607: Correctly expose DEBIAN_FRONTEND so that "apt" actually sees it
- DH-19571: Clarify meaning of empty RefreshCookieResponse.cookie field
- DH-18925: Configurable annotations can be set on processes in Kubernetes
- DH-19583, DH-19570, DH-19561, DH-19594: Update Grizzly to Core 0.39.3
- DH-19557: Internal BHS installations should enable CORS
- DH-19394: prevent installs from failing if hostname command fails
- DH-19462: Completely remove all legacy jupyter code from build
- DH-18791: Remove default com.sun.management.jmxremote.ssl=false
- DH-15595: Add dh_uninstall.sh script to remove everything from a Kubernetes namespace
- DH-19562: permit new grpcio versions for Core+ client
- DH-19581: Fix tailer link
- DH-19438: Wait for PQ state change before checking again to avoid log flooding
|
| 047 | DH-18483, DH-18492, DH-18470, DH-17922, DH-19603: Cherry-pick interactive consoles back to G+ |
| 046 | [DH-18365](#improved-support-for-iceberg-tables-in-core): Introduce 'iceberg' extended storage type
DH-19580: fix missing import
DH-19469: Fix broken uploadDocs
DH-19469: Backport TOML changes to Grizzly+ |
| 045 | DH-18826: Cherry-pick back UI changes from 1.20250801.229beta
DH-19333: Update web version to v0.108.0
DH-13244: remove trailing whitespace from console log message
DH-18152: Fix PQ Explorer resetting load balancing settings on query update
DH-19271: Update web version to v0.107.2
DH-13095: Fix right click while dragging column freezes UI
DH-19205: Resolve import order issue from Grizzly forward merge
DH-19037: Server Config and UI Settings for Display of Null and Empty Strings
DH-19190: Update web version to v0.107.1
DH-17599: Fix table name validation
DH-19089: Fix context menu using stale selection
DH-19138: Determine Totals Column Name by Num Aggs Per Column
DH-19153: Split out a couple of login components to make them more re-usable
DH-19141: Update Web UI to to v0.107.0
DH-17599: Web ACL Editor Does not Permit Hyphen in Names
DH-18279: Fix unstable one click plot titles on Web
DH-18681: Fix web inability to delete IT rows with null or empty keys
DH-18856: Support for Median in "Aggregate Columns" in UI
DH-19015: PartitionAwareSourceTable UI Widget Swaps from `Merge` to `Coalesce`
DH-19080: Remove sessionWrapper from exported logs
DH-19119: Update deephaven.ui to v0.29.1
DH-18461: deephaven.ui dashboard error is shown after query restart
DH-19014: Update deephaven.ui to v0.29.0
DH-18090: Handle document delta updates sent from the server
DH-18652: Programmatically display aggregates rows with ui.table
DH-18185: ui.date_picker not calling on_change handler for granularity="day"
DH-18854: Implement list format options for ui.labeled_value
DH-18650: Implement dates and date formatting for ui.labeled_value
DH-18894: Update deephaven.ui to v0.28.1
DH-18398: Fix ui.dialog should throw error for invalid children
DH-18131: Update deephaven.ui to v0.28.0
DH-18135: ui.toast component
DH-18089: ui.menu and ui.menu_trigger component
DH-18320: ui.color_picker component
DH-18136: ui.accordion component
DH-18090: Document delta updates
DH-18536: Fix Callable not found error in dh.ui
DH-18582: Update deephaven.ui plugin to v0.26.1
DH-18132: ui.labeled_value component
DH-18133: ui.logic_button component
DH-18134: ui.disclosure component
DH-18137: ui.breadcrumbs component
DH-18138: ui.divider component
DH-18397: ui.footer component
DH-18591: Fix ui.markdown code blocks styling
DH-18461: Ensure ReactPanelErrorBoundary does not throw an error itself
DH-18415: Cannot expand rows after applying a rollup to tables wrapped with ui.table
DH-18359: ui.tag_group
DH-19128: Resolve type errors from Grizzly forward merge
DH-18292: Fix Worker Kind Summary for null Status Query
DH-18965: Update Web UI to to v0.106.3
DH-18734: Fix column width calculation logic in grid
DH-18964: Console history changes when holding shift or other modifier keys to navigate text
DH-18895: Update Web UI to to v0.106.2
DH-18645: Fix Don't use innerHTML to populate drag item
DH-18852: Fix avoid exceeding call stack when exporting logs with large number of queries
DH-18341: Method to export logs when login or connection fails
DH-18545: Update to web dependencies to 0.106.0 for Core+ Proxy Model Partition Fix
DH-18171: Resize all columns option in web UI
DH-18695: Update web version to v0.105.0
DH-18542: Ruff quick fix quirks
DH-18392: Columns not auto-sizing correctly in some cases
DH-18645: Security vulnerability: Stored XSS
DH-18358: No context menu item for "Paste" in an input table
DH-18624: Paste option shows when it shouldn't
DH-17517: New tab screen sharing text is not aligned
DH-17704: WebClientData is down prompt should make the current status of the PQ clear to the user
DH-17510: Long dashboard titles overflow the navbar
DH-17642: Fix incorrect DB Server value when changing query type
DH-18434: Fix markdown inline code appearing incorrectly
DH-18465: Update Restart Attempts label
DH-18427: Update to deephaven.ui v0.25.0
DH-18030: Allow double and floats to be rollupable
DH-18158: Fix San Luis build broken by a wrong QueryColumns import
DH-17497: Don't show replicas in PQ Explorer
DH-17988: Fix Web PQ Editor not updating after save
DH-17997: Fix DropdownFilter unusable after console disconnect
DH-18078: Fix widget plugins not always loading correctly
DH-18025: Fixed vite.config.mts input in gradle CI build
DH-17923: Fix for login when upgrading server to support Ruff
DH-17923: Enable Ruff Python linter and formatter
DH-14318: Fix QM Save Button Layout on Summary
DH-17778: Fix circular references in support logs, update Web UI to v0.98.0
DH-17459: Fix a typo in DefaultWorkspaceData typo
DH-14318: Show Save Button on Query Summary
DH-17986: Change Question Tooltips to Contextual Help
DH-16608: UI to Select Core Worker Thread Counts
DH-17459: Grid Density Setting
DH-17797: Fixed a double encoding bug
DH-17797: Split out @deephaven-enterprise/auth-nodejs package
DH-16081: Checkbox Filters for Panels Menu
DH-17964: Updated dh packages version to ^0.97.0 and jsapi-types to ^1.0.0-dev0.36.1
DH-17907: Option for "Thousands" in default number format dropdown
DH-17797: Fixed env variable bug in publish-alpha
DH-17797: build: Personal access token override for alpha publishing
DH-17796: build: Lerna npm publishing
DH-17796: Fixed working directory in alpha GH action
DH-17796: Set lerna.json version from GH action
DH-17797: Handle TemporaryAutoDelete
DH-17797: QueryScheduler.makeTemporaryScheduling function
DH-17851: DH-17861: Unable to copy TreeTable data if selection contains rows after the viewport
DH-17416: Fix Console Connection Issue from Grizzly Merge
DH-17865: Fix grizzly to sanluis merge
DH-17796: Removed @deephaven/console dependency and updated package.json
DH-17833: Update @deephaven/eslint-config to v0.95
DH-17797: build: Split out @deephave-enterprise/query-utils npm package
DH-17796: build: Github action for publishing alpha npm packages for web
DH-16263: Core UI plugins (Grid, Chart, ChartBuilder, Pandas)
DH-17797: refactor: Cleaned up query types a bit
DH-17425: Split out @deephaven-enterprise/jsapi-types sub package.
DH-17679: Fix New Unchanged Dashboards being Saved
DH-17425: refactor: Removed DraftQuery dependency from Iris types
DH-17699: Remove ts-nocheck from WorkspaceStorage
DH-17644: Remove TS No Check from Login
DH-17694: Upgrade to Vite 5
DH-17581: Remove TS No Check from AppMainContainer
DH-17567: Remove @ts-nocheck from DashboardContainer
DH-17425: Split out minimal @deephaven-enterprise/types npm package |
| 044 | Merge updates from 1.20240517.484 - DH-18996: Allow disabling DHE JS examples
- DH-19554: Update Grizzly to Core 0.39.2
- [DH-17509](#enabled-several-http-security-headers-by-default): CUS must also support http HEAD method
- DH-19453: better JAVA_HOME error message
- DH-18145: Write timeout configuration with S3
- DH-18260: Added support to read/write list types to Iceberg
- DH-19386: Allow disabling of directory listing for /iriside/static/
- DH-19448: Use S3 client for Iceberg from S3FileIO
- DH-19465: Sort on rollup table breaks when keys are removed
- DH-19523: Respect Future API by Respecting thenApply May Run on
- DH-19525: HTTP Customizers on CUS Port 8443
- DH-19527: Allow Overriding Metadata for BarrageMessageWriterImpl.SubView
- DH-19540: NPE in uncoalesced SourceTable Ancestor Discovery
|
| 043 | DH-19440: Drop java11 builds in G+
DH-19543: Backport Upgrade to gradle 8
DH-19528: Fix Controller test failure
DH-19479: Do not generate DH-format grouping files for parquet merge |
| 042 | Merge updates from 1.20240517.483 - DH-19431: Use tailer cleanup functionality on QA servers
- DH-18646: Disable CORP header to allow JS API cross origin load
- DH-16032: Fix Query Monitor not Updating on Save
- DH-16032: Reduce Query Monitor Viewport Size for Stability
- DH-19081: retry opening ReferenceCountedStringCache to fix race
- [DH-19152](#optional-limit-on-appendlivetable-table-size): client side limit on size of atomic table append via LAS (Core+)
- DH-19300: add project defaults for DhcInDhe
- DH-19396: Add rc build ID parsing script
- DH-19477: add in the pids limit to Podman
|
| 041 | DH-19418: build new gplus VM images to fix rhel8 tests |
| 040 | Merge updates from 1.20240517.481 - DH-19398: Increase worker resource overhead defaults in Kubernetes
- DH-18959: Core+ Java client cannot access underlying BarrageSession
- DH-19470: Add prepareCorePlusTask to publish Core+ dependencies from Main Iris Project
- DH-19468: Refactor Protobuf Generation into Reusable Gradle Convention
|
| 039 | DH-19467: Backport DH-18917, avoid shutdown deadlock |
| 038 | Merge updates from 1.20240517.480 - DH-19398: Allow Kubernetes worker memory overhead default values to be helm-configurable
- DH-18646: Drop duplicate headers in Envoy
- [DH-19183](#combined-jars-for-core-clients): Fix dependency for combined client jars
- [DH-19183](#combined-jars-for-core-clients): Add combined jar for Core+ client variants
- DH-19439: don't run spotless checks on generated code
- DH-19433: fix republishing for branch splitting
- DH-19426: Update web version to v0.85.27
|
| 037 | DH-19449: fix csv import unit tests |
| 036 | [DH-19347](#data-import-server-aggressively-releases-unused-resources): DIS aggressively removes unused table locations and associated resources
[DH-19286](#backport-core-merge-to-grizzly-plus): Fix j11 build |
| 035 | Merge updates from 1.20240517.477 - DH-19418: fix minikube, rhel8 tests and python versioning
- DH-19419: Update Grizzly Core+ to 0.39.1
- DH-19415: Update bcrypt-cost after update
- DH-19311: Fix errors opening PEL PartitionedTable in groovy and python
- DH-19357: Fix pydeephaven.experimental.plugin_client
- DH-19384: Barrage and Client Refactors For Pivots
- DH-19417: Incorrect Error Message for Invalid Login Credentials
- DH-15042: Use Correct Permissions for Query Monitor Context Menu
- DH-19359: Update vm-tools readme
- [DH-17509](#enabled-several-http-security-headers-by-default): Enforce stricter web security rules
- DH-19381: Use internal google artifact registry for docker images
- DH-14382: Make failed worker start error more actionable.
- DH-19405: Ignore new UpdatePerformanceAncestors table for QA merges
- DH-18025: fix web cache, stop accruing deleted files in cache
- DH-18083: Reduce memory overhead for hive .location_table reads
- DH-16032: Web UI has issues displaying script and query details when very busy
- DH-18832: Can't change axis ranges in web plotting
- DH-18124: Fix Widget Panel Overlay z-index
- DH-19383: Update plotly-express to v0.16.0
- DH-18685: Express plots have too much top padding if title not specified
- DH-19371: fix versioning script to mkdir before tee
- DH-19371: Fix release version numbering in jenkins
- [DH-19297](#directly-create-core-aclfiltergenerator-for-database-acls): Add ability to directly create Core AclFilterGenerator for Database ACLs
|
| 034 | [DH-19286](#backport-core-merge-to-grizzly-plus): Backport Core+ Merge to Grizzly Plus
DH-19348: force .header to disk after writing |
| 033 | Merge updates from 1.20240517.473 - DH-19060: Display Replica Heap Sum with same Decimals as Heap Size
- DH-19336: Always include `InternalPartition` in `db.historicalPartitionedTable` & `db.livePartitionedTable`
- DH-19371: release branch version numbering fixes
- DH-18581: Avoid ephemeral ports; use defined range
- DH-19321: Correct Defaults for Copied Draft Queries
- DH-19298: Update deephaven-ui to 0.29.2
- DH-18869: Provide a test script for easier validation of C++/R clients.
- DH-19223: Log UpdatePerformanceTracker ancestors
- DH-19341: Fix equals versus equals equals in DhcInDhe/Main/build.gradle
- DH-19362: Update Grizzly Core+ to 0.39.0
- DH-18551: add updateView() capabilities to rollup tables
- DH-18926: pydeephaven ticking client: Can’t convert pyarrow type list<:string> to Deephaven type
- DH-19167: Constituent filtering for rollups
- DH-19274: Flush HTVS Barrage Metrics At Least Once
- DH-19289: NPE Generating Compiler Diagnostic Message
- DH-18581: Avoid ephemeral ports for podman; use defined range
- DH-19039: Improved Auth Login Error
|
| 032 | DH-18949: Revert makePartitionedTable should use SPT‐provided partitioning columns
DH-19369: Update shadow version for gplus |
| 031 | Merge updates from 1.20240517.471 - DH-19354: fix integration test failures
- DH-19349: Fix date command for mac
|
| 030 | Merge updates from 1.20240517.470 - DH-18821: Split release branches in git
- DH-18947: Auto-numbering of rc branches
- DH-18821: Update github workflows to accomodate rc/grizzly branch
|
| 029 | Merge updates from 1.20240517.468 - DH-19332: Update web version to v0.83.23
- DH-13244: remove trailing whitespace from console log messages
- DH-19304: Release notes fixes
- DH-19216: CART clearOnDisconnect is not reliably honored.
- [DH-19219](#removed-jupyter-notebook-integration): Remove Jupyter notebook integrations
- DH-19208: Add __DbConfig.Tables as a default irisInternal schema to import
- [DH-19129](#optional-limit-on-appendcentral-table-size-server-side), [DH-17574](#optional-limit-on-appendcentral-table-size-client-side): correct release note, add bounds checking to properties
- [DH-19129](#optional-limit-on-appendcentral-table-size-server-side): server side limit on size of atomic table append via LAS
- [DH-17574](#optional-limit-on-appendcentral-table-size-client-side): client side limit on size of atomic table append via LAS
- DH-14383: make result of IntradayControlImpl commands easier to use
- DH-19179: Fix NPE in Kafka ingestion with transformation
- DH-19135: Disable nightly podman tests (for vplus only)
- DH-18984: Connected Legacy CodeStudios cause an unexpectedly large support log file
|
| 028 | Merge updates from 1.20240517.466 - DH-19249: Add a check for bcrypt-cost etcd setting to integration test setup
- DH-19213: Remove Java17 annotation from ExportedObjectInfo
- DH-19213: Make ExportedObjectInfo use proto serialization to allow custom class tolerance.
- DH-18559: Register podman ingesters with externally-resolvable name
- DH-19295: envoy on podman version support to match supported docs
|
| 027 | Merge updates from 1.20240517.461 - DH-19280: Add ability to use Core SNAPSHOT jars from sonatype in Enterprise Build
- DH-19250: Python wrappers for the results of performance_overview()
- DH-19255: Separate Core+'s Core JAR version from Core Python version
- DH-19291: ACL etcd watcher should be setup with WithRequireLeader etcd option
- DH-18330: Revert AutoMerge and AutoQuery for system queries
- DH-18330: Use AutoMerge and AutoQuery for system queries
- DH-19060: Fix floating point display issue in Heap Size
- DH-19275: Fix release-note-generation script and wrong link in release note
|
| 026 | Merge updates from 1.20240517.453 - DH-19221: Adding internally-facing README for podman
- DH-19207: fix: client.getDbServersForType incorrectly returns empty arrays for certain query types
- DH-19142: Cleanup coreplus venvs on clusters
- DH-19195: Fix bad image save in podman
|
| 025 | DH-19020: remove inter-grizzly compatibility bridge |
| 024 | Merge updates from 1.20240517.449 - DH-19214: Update Web UI to v0.85.21
- DH-19089: Fix Right clicking does not trigger the full secondary table menu when 1st clicked
- DH-19097: Fix Row deletion in Input Tables sometimes removes the wrong row
- DH-19138: Fix Adding aggregations Sum and Count crashes the table
- DH-19208: Add __DbConfig.Tables as a default irisInternal schema to import
- DH-19151: Update Web UI version to 0.85.20
- DH-17599: Fix Namespace and Table name validation in Web ACL Editor
- DH-19079: Fix large log files when active legacy code studio
|
| 023 | DH-18977: Auth server should not hold client calls when forwarding RPCs |
| 022 | DH-18949: makePartitionedTable should use SPT‐provided partitioning columns |
| 021 | Merge updates from 1.20240517.446 - DH-19162: Stop using getQuerySerialsForDependent
- DH-19088: Fix stale pid in podman
- DH-19133: Fix Multi-user Podman upgrade fails with Permission denied
- DH-18599: CorePlusBenchmark Project First Check-in
- [DH-17387](#ensure-partitioned-user-table-additions-and-deletions-are-reflected-in-future-historical-table-calls): Ensure partitioned user table changes are reflected in future historical table calls
|
| 020 | DH-16905: Add etcd monitoring to Prometheus/Grafana |
| 019 | DH-18662: Update Shadow to for TOML for dependabot |
| 018 | Merge updates from 1.20240517.441 - DH-18956: Fix eggplant manager url for multiple repos
- DH-19149: dhconfig must have GIT_SSH set to work properly with check-repo
- DH-19139: Release note documentation fixes
- DH-18651: Use cache for pypi in podman
|
| 017 | Merge updates from 1.20240517.437 - DH-19122: Release note documentation fixes
- DH-18792: Config server deadlock (fishlib push)
- DH-18792: Config server deadlock
- DH-18723: Input Tables cannot paste more rows than number of visible rows
- DH-18622: Fix controller issue for started-then-deleted PQs
- DH-17824: Fix docs for restart
- DH-18954: updateBy ArrayIndexOutOfBoundsException
- DH-18967: Do not use local -n in locally-run installer scripts
- DH-17419: Show dashboard modifications with deephaven.ui changes
- DH-17418: Fix dashboard major/minor notifications
- DH-18442: Fix Export Logs Fails with Large Number of Queries
- DH-18830: Update internal VM images to version 7
- DH-18645: Fix XSS issue in file list drag and drop
- Update UI packages to v0.78.9
- DH-18798: Fix token cache growing indefinitely
- DH-18101: Adding keepalive seconds for win boxes
- DH-18125: close the LAS logger in DatabaseImpl.appendLiveTable
- DH-18708: Change gRPC logging exclusion list separator from semicolon to comma
- DH-18701: Update web packages to v0.78.8
- DH-18645: Fix panel titles using html instead of just text
- DH-18346: Fix partial holiday range breaks
- DH-16016: Fix xBusinessTime throwing errors
- DH-18176: Suppress scary "non-fatal" warnings; only upload missing files
- DH-15878: Automatically upload etcd*tar.gz files to remote machines
- DH-18422: Update generation of iris-endpoints.prop for Podman so Web ACL Editor will work correctly
- DH-18345: Update USNYSE calendar with national day of mourning for Jimmy Carter
- DH-18166: Avoid lock inversion in OneClickUtils (swing)
- DH-17927: Backport [DH-16434](#automatic-server-selection), automatic node being at the top of the list, to jackson
- DH-18028: Fix ConnectorWrapper race conditions
- DH-18468: Wire up kubernetes flag to jenkins for eggplant
- DH-18519: Allow adding GrpcLogging exclusions via properties and env vars
- DH-18510: Ensure the exclusions list class names for gRPC logging match inner classes as well
- DH-18153: Fix bad substitution in installer script error handling function
- DH-18426: Expose DHLog in global context to allow changing the log level via the browser console
- DH-16191: Core+ Python Auth Context Methods
- DH-16872: Fix Web not displaying PQ error restart count >10 correctly
- DH-18329: Allow user calendars to override system calendars in Core+
- DH-18187: Fix console history not sticking to bottom
- DH-18071: Add test to support DeephavenUI dashboards from a code studio.
- DH-18175: Modified Podman start_command.sh to support Podman on MacOS and to fix --nohup always being applied
- DH-17696: Added A to start_command.sh dig call, to ensure IPv4 address is retrieved.
- DH-17932: Change array handling and add label searches to dh_helm uninstall functions
- DH-16189: Fix deephaven.ui panels when permissions change
- DH-17936: Warn when DH_JAVA is set to an invalid path
- DH-17798: Pin deephaven.ui version to 0.15.4
- DH-16150: deephaven.ui in Enterprise
- DH-17292: Fix tables opened with deephaven.ui throw error when disconnected
- DH-17880: Change Podman start_command.sh default behavior to preserve existing properties
- DH-17977: Add volume options to Podman start_command.sh for illumon.d/java_lib and illumon.d/calendars volumes
- DH-17999: Fix coreplus_test_query.py nightly test
|
| 016 | Merge updates from 1.20240517.436 - DH-18956: Fix eggplant nightly test compilation
- DH-19110: Fix R client methods live_table and historical_table
- DH-18368: Closing a ui.dashboard in a code studio shouldn't prompt
- DH-18694: The gear icon on login screen appears to be broken in web with saml auth plugin
|
| 015 | Merge updates from 1.20240517.432 - DH-18279: Fix unstable one click plot titles in web
- DH-18893: Update deephaven-hash to 0.3.0
- DH-18778: Fix wrong Assert import used.
- DH-18727: Fix unbound variable in podman for envoy admin
- DH-18729: Podman change image creation to be single-user
- DH-18930: handle SocketException, Connection reset better in LAS client
- DH-18988: Python Core+ auth client should log client UUID to facilitate troubleshooting
- DH-16352: Ability to disable password authentication in web UI
|
| 014 | Merge updates from 1.20240517.425 - DH-19061: Update web packages to v0.85.17
- DH-18856: Support Median Aggregation in the UI
- DH-18681: Fix Inability to delete Input Table row with null key
- DH-18778: Javadoc fix.
- DH-19041: Updates to the version log generation script
- DH-19052: Core+ test stage should not cause Jenkins pipeline failures.
- DH-18778: Cannot apply ACLs to Rollups or Trees
- DH-18756: Make sure that internal partitions do not have invalid characters.
- DH-19028: Update Grizzly to Core 0.38.0
- DH-18351: Add CountWhere feature to UpdateBy Rolling and Cumulative
- DH-18491: Implement optimized FirstBy / LastBy + NaturalJoin feature
- DH-18414: SourcePartitionedTable: Allow deferred existence checking and add partitioning columns
- DH-18856: Add Median to jsapi Aggregation Options
|
| 013 | Merge updates from 1.20240517.418 - DH-18989: Misconfiguring git repositories results in opaque controller crash loop and inability to login
- DH-18754: Web API Service should create workers off-thread, avoid blocking other calls
- DH-18815: Enable TCP KeepAlive for clients downstream of Envoy
- DH-18986: Fix bugs in Py Client's controller module
- DH-18941: NPE in local swing console log when creating a new PQ
- [DH-18001](#changes-to-tailer-process-memory-requirements): correct consumerBufferSize calculation
|
| 012 | Merge updates from 1.20240517.412 - DH-19007: Adjust formatting in Grizzly Release Notes to be Salmon-compatible
- DH-19009: Fix EggplantTask gradle wiring
- DH-19006: Disable DynamicTableWriter Integration test for now.
- [DH-18682](#databaseinputtableupdater-improvements): Make InputTableUpdater a LivenessReferent, able to materialize input table views
- [DH-18001](#changes-to-tailer-process-memory-requirements): Tailer reduces buffer size to match DIS
- DH-18751: report on tailer/DIS buffer configuration errors better
- DH-14692: Stop exporting client from support logs
- DH-18744: Add support for VPlus to Grizzly upgrade of Podman deployments
- DH-18838: port fishlib Client fix to Deephaven
- DH-18981: Update CODEOWNERS for Enterprise.
- DH-18669: Revert scoping changes from DH-18877
|
| 011 | Merge updates from 1.20240517.402 - DH-18946: Make dh_preinstall_check require/install rsync if needed
- DH-16487: Validate installer host uses rsync>=3.1
- DH-18669: Improve handling of internal partition column
- DH-18877: UncoalescedBlinkTable must manage its source, Use LivenessScope.computeEnclosed in DatabaseImpl
|
| 010 | DH-18560: Merge common logic from snapshot backed table location types |
| 009 | Merge updates from 1.20240517.399 - DH-18439: Introduce dh_preinstall_check.sh for early installation validation
- DH-18800: Reliability changes for automation and integration tests.
|
| 008 | DH-18940: Fix previousReleaseBranch for MajorVersionUpgradeTests |
| 007 | Merge updates from 1.20240517.397 - DH-18867: Include the proto-wrappers dir in the C++ client source tarball
- DH-18754: Add missing JS client details for replica instances
|
| 006 | Merge updates from 1.20240517.395 - DH-18897: Check condition for PqStorageEtcdV2Impl delete is wrong
- DH-18794: Allow kubernetes flags to align input params to eggplant manager
- DH-18747: Per-worker pod cleanup delay
- DH-18794: Investigate bhs not contactable by eggplant
- DH-18709: Performance under load of Controller Query Tracker operations
- DH-18691: Automatically migrate sql->etcd acls
- DH-18620: Provide means to change timeout to get properties from etcd and increase default
- DH-18660: Scripts for load testing of Controller subscriptions and PQ restart, stop and modify requests
- DH-18741: Improved Error Message when Shortcuts Fail to Load
|
| 005 | DH-18167: Fix LivenessStateException with plotly-express |
| 004 | Merge updates from 1.20240517.386 - DH-18732: Fix XSS issue in file list drag and drop
- DH-18596: Fix MultiScriptPathLoader#getAvailableScriptPaths caching
- DH-18569: Allow configuration of worker pod toleration on authenticated username
- DH-18747: Per-worker pod cleanup delay
- Update web UI packages to v0.85.15
- DH-18798: Fix token cache growing unbounded
- DH-18820: Fix jenkins publish docs script
|
| 003 | DH-3262: introduce 'dhconfig \ edit' commands |
| 002 | Merge updates from 1.20240517.380 - DH-18758: Fix C++ Client Docker build
|
| 001 | Initial release creation from 1.20240517.379 |
## Disable temporary virtual environments per worker kind
Administrators can now disable temporary (ephemeral) virtual environments for specific worker kinds by setting a per-kind property in `iris-environment.prop`:
```properties
WorkerKind.DeephavenCommunity.ephemeralVenv.enabled=false
```
If not set, the default is `true`.
Existing Persistent Queries that previously used temporary venvs will fall back to the default virtual environment. If a query does not depend on custom packages beyond those in the default environment, it will continue to run normally.
After changing this property, users must reload their browser for the UI to reflect the new setting. The controller enforces the restriction server-side regardless of the UI state.
When disabled:
- **Existing PQs** that had a temporary venv configured will show a warning in the UI. If the user unchecks the temporary venv checkbox, the warning is removed.
- **New PQs** will not have the option to create a temporary venv.
- The controller disables all ephemeral venv fields when creating workers.
## Default limit on user table appends
Operations that append to live user tables send table data to the Log Aggregator Service as an atomic update.
A large enough table can cause the LAS to run out of memory.
The maximum table size (number of rows or number of bytes) that will be accepted by the Log Aggregator is now set by default, with the properties
`LogAggregatorService.transactionLimit.rows` and `LogAggregatorService.transactionLimit.bytes`. Set these to zero to remove the limits. When the Log Aggregator accumulates more rows or more bytes in a transaction than the configured limit, it will abort the transaction and release the accumulated memory. The client will get an error.
The default limit is 2 million rows or 128MiB.
See [User tables](../../deephaven-database/user-tables.md#add-rows-to-a-live-partition) and [Server-side transaction limits](../../data-guide/streaming/streaming-binary-logs.md#server-side-transaction-limits) for details.
## Changes for `Instant` handling in `Schema` generation
When generating a schema from a table definition, `Instant` columns will be stored as a `DateTime` type. `DateTime`
is an aliased type which is seen as a `DBDateTime` in Legacy workers and as an `Instant` in Core+ workers. Both types
are persisted to disk as a `long` representing nanoseconds since Unix Epoch, and are written to Parquet format as a
`timestamp[ns, tz=UTC]`.
Schemas that already exist with an `Instant` column will not be changed, and will continue to use an `Instant` for
appropriate columns.
## Added support for Java 21 and 25
Deephaven deployments now support Java versions 21 and 25
## TimeSeriesFilterGenerator
Core+ workers can now apply a TimeSeriesFilter as part of table ACLs. The
`io.deephaven.enterprise.acl.generator.TimeSeriesFilterGenerator` is
constructed with three arguments:
1. The period as a String (e.g. `PT15m`).
2. The column name to filter.
3. Whether to exclude recent values or past values. For example, with a period
of PT15m and excludeRecent=true, only data that is 15 minutes or more old is
displayed.
For convenience, the `AclFilterGenerator.outOfWindow` and
`AclFilterGenerator.inWindow` static methods are provided to include only rows
that are less recent than the specified period or more recent than the specified period,
respectively.
If a TimeSeriesFilterGenerator is applied for a user, then they cannot access
the table from Legacy workers.
## Add Core+ CSV import job
CSV import persistent queries can now be executed in a Core+ worker. Previously, all CSV import job workers were Legacy.
Since legacy workers will not be supported after Grizzly Plus, users are encouraged to migrate their CSV import jobs to Core+ as soon as possible.
## Input Table specification updates
### io.deephaven.enterprise.inputtables.ColumnSpec
#### dataType
`ColumnSpec` has been updated to properly enforce the expected type restrictions. Previously, callers who used
`ColumnSpec.Builder.dataType` could construct a `ColumnSpec` with any `dataType`. Now, `ColumnSpec` explicitly checks
that `dataType` is one of:
- `byte`
- `char`
- `short`
- `int`
- `long`
- `float`
- `double`
- `Boolean`
- `String`
- `Instant`
The helper method `ColumnSpec.Builder.setDataType`, which applies a data type conversion (converts the incoming
`dataType` from `boolean` to `Boolean`, and from non-`Boolean` boxed primitives to primitives) has been deprecated;
callers are encouraged to migrate to the more explicit method `ColumnSpec.Builder.dataType`.
#### enumValues
The requirements for `enumValues` remains the same: if `dataType` is a primitive, the enum values must be an instance
of the boxed version of that primitive (for example, if `dataType` is `int`, the `enumValues` instances must be
`Integer`s); if `dataType` is not a primitive, the enum values must be an instance of the same `dataType`.
The helper method `ColumnSpec.Builder.addToEnumValues`, which applies an automatic conversion of incoming values from
`BigDecimal` to `Double`, has been deprecated; callers are encouraged to migrate to the more explicit method
`ColumnSpec.Builder.addEnumValues` or `ColumnSpec.Builder.addAllEnumValues`.
## Core+ Input Table Validation
Core+ Input Tables now validate additions and deletions. In particular, columns created with an [enum](https://docs.deephaven.io/javadoc/20240517/io/deephaven/enterprise/inputtables/ColumnSpec.Builder.html#addToEnumValues(java.lang.Object...)) reject updates containing values that do not belong to the permitted set of values.
Input Table updates and deletions are now validated both for gRPC initiated updates and programatically initiated updates within a worker. Previously, updates initiated within a worker were not validated. The most noticeable change is that in-worker deletion operations now reject invalid key columns. The [delete](https://docs.deephaven.io/core/javadoc/io/deephaven/engine/util/input/InputTableUpdater.html#delete(io.deephaven.engine.table.Table)) method requires a table argument that contains only key columns; a table with additional columns results in an [ArgumentException](https://docs.deephaven.io/core/javadoc/io/deephaven/engine/exceptions/ArgumentException.html).
## Deephaven-managed Envoy installation
For Deephaven native installations, the Envoy process can now be [automatically installed and managed by Deephaven](../../sys-admin/envoy/installing-envoy.md#deephaven-managed-envoy).
#### Installer-managed Envoy modes
[`DH_ENVOY_INSTALL_MODE`](../../sys-admin/installation/cluster-config-guide.md#dh_envoy_install_mode) controls how Envoy is installed/configured.
- The default value of `NONE` matches the behavior of previous releases where your system administrator must [manually install and restart Envoy](../../sys-admin/envoy/installing-envoy.md#manual-envoy-installation).
- To have Deephaven install and restart Envoy as needed, you must set [`DH_ENVOY_INSTALL_MODE` to `NATIVE`, `DOCKER`, or `PODMAN`](../../sys-admin/installation/cluster-config-guide.md#dh_envoy_install_mode).
If you previously installed Envoy manually and want the Deephaven installer to manage Envoy, [remove the manual Envoy installation](../../sys-admin/envoy/installing-envoy.md#uninstall-envoy) before upgrading, so the installer can install, configure, and restart Envoy.
#### Per-node certificates generated automatically when Envoy is used
For native Deephaven installations, when [Envoy is enabled](../../sys-admin/installation/cluster-config-guide.md#dh_configure_envoy) (when, `DH_CONFIGURE_ENVOY=true`), the installer, by default, generates the required [per-node certificate material](../../sys-admin/security/tls-certificates.md#one-certificate-per-machine) for each machine in your cluster.
The automatic generation of these certificates can be [disabled by setting `DH_GENERATE_CERTIFICATES=false`](../../sys-admin/installation/cluster-config-guide.md#dh_generate_certificates), in which case you will be required to [supply one certificate per machine](../../sys-admin/installation/basic-install.md#tls-certificates) in addition to supplying the [Envoy TLS signing certificate via `DH_ENVOY_LOCAL_CERT`](../../sys-admin/installation/cluster-config-guide.md#dh_envoy_local_cert).
Generated TLS certificates are not available unless Envoy is used.
## ObjectCodec deprecations
The `com.illumon.util.codec.ObjectCodec` interface is being deprecated in favor of `io.deephaven.util.codec.ObjectCodec`.
Any custom codecs that have been written against `com.illumon.util.codec.ObjectCodec` should be updated to implement
`io.deephaven.util.codec.ObjectCodec` instead. The interfaces are otherwise identical.
### Built-in codec updates
The following codecs have been re-implemented against `io.deephaven.util.codec.ObjectCodec`, and should otherwise be
identical (see the Notes column for exceptions). While these deprecated codec classes still exist, customers are
encouraged to use the replacement codecs going forward.
| Replacement | Deprecated | Notes |
| ---------------------------------------------------- | --------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------- |
| `io.deephaven.util.codec.BigDecimalCodec` | `com.illumon.util.codec.BigDecimalCodec` | |
| `io.deephaven.util.codec.BigDecimalCodec` | `com.illumon.util.codec.BigDecimalCodec` | |
| `io.deephaven.util.codec.ExternalizableCodec` | `com.illumon.util.codec.ExternalizableCodec` | |
| `io.deephaven.enterprise.codec.IntArrayCodec` | `com.illumon.util.codec.IntArrayCodec` | |
| `io.deephaven.util.codec.LocalDateCodec` | `com.illumon.util.codec.LocalDateCodec` | |
| `io.deephaven.util.codec.LocalTimeCodec` | `com.illumon.util.codec.LocalTimeCodec` | |
| `io.deephaven.enterprise.codec.LongArrayCodec` | `com.illumon.util.codec.LongArrayCodec` | |
| `io.deephaven.util.codec.SerializableCodec` | `com.illumon.util.codec.SerializableCodec` | |
| `io.deephaven.enterprise.codec.StringArrayCodec` | `com.illumon.util.codec.StringArrayCodec` | |
| `io.deephaven.util.codec.StringBooleanMapCodec` | `com.illumon.util.codec.StringBooleanMapCodec` | The replacement codec can read data written by the deprecated codec, but the deprecated codec can't read data written by the replacement codec. |
| `io.deephaven.util.codec.StringDoubleMapCodec` | `com.illumon.util.codec.StringDoubleMapCodec` | |
| `io.deephaven.util.codec.StringFloatMapCodec` | `com.illumon.util.codec.StringFloatMapCodec` | |
| `io.deephaven.util.codec.StringIntMapCodec` | `com.illumon.util.codec.StringIntMapCodec` | |
| `io.deephaven.util.codec.StringLongMapCodec` | `com.illumon.util.codec.StringLongMapCodec` | |
| `io.deephaven.util.codec.StringStringMapCodec` | `com.illumon.util.codec.StringStringMapCodec` | |
| `io.deephaven.util.codec.UTF8StringAsByteArrayCodec` | `com.illumon.util.codec.UTF8StringAsByteArrayCodec` | |
| `io.deephaven.util.codec.ZonedDateTimeCodec` | `com.illumon.util.codec.ZonedDateTimeCodec` | |
### Future release
While the deprecated classes will be removed in a future release, any data written using the deprecated codecs will
continue to be readable indefinitely, and new data written from Schemas that reference the deprecated codecs will
inherit the replacement codecs automatically.
## Schema interface in Core+
Core+ workers are now able to access `Schema` and `SchemaService` implementations without the need to directly access shadowed classes.
### Class packages changed
A number of classes have changed packages in order to allow non-shadow package access from Core+.
1. Sub-interfaces and helper-classes of the Legacy `Schema` are moved to `io.deephaven.enterprise.schema.internal`, which are included in the shadow jar, but not in a shadowed package. This allows the Core+ `Schema` interface to use the interfaces/classes "as-is", without using shadow packages. The `.internal` package is likely to change and is intended for Deephaven internal use only.
2. XML implementations of some interfaces are moved to `io.deephaven.enterprise.schema.xml`, which are included in the shadow jar, but not in a shadowed package. This allows the Core+ `Schema` implementation(s) to use the objects directly without using shadow packages. The `.xml` package is likely to change and is intended for Deephaven internal use only.
3. `Schema` related exceptions have been moved to `io.deephaven.enterprise.schema.exception`, which matches the target package in Sanluis.
4. `NamespaceSet` has been copied to `io.deephaven.enterprise.database`, which matches the target package in Sanluis.
5. `SchemaConstants` has been safely moved from `com.illumon.iris.db.tables.dataimport` to `io.deephaven.enterprise.schema`. A simple wrapper-class has been left at `com.illumon.iris.db.tables.dataimport` to prevent Legacy workers from breaking. Core+ workers should prefer `io.deephaven.enterprise.schema.SchemaConstants` over the shadowed version, which will be removed in Sanluis.
6. A new `StorageType` enum is added to Core+, which wraps the `DefaultTableDefinition.STORAGETYPE_*` constants. This enum should be preferred over using the shadowed `DefaultTableDefinition.STORAGETYPE_*` constants because the package for the constants will change (no longer be shadowed) in Sanluis.
## Changes to data routing filtering
This corrects several errors and ambiguities in how filters were applied to sources in Table Data Services (TDS) and failover groups.
### Sources with single elements not honoring filter
If the `sources` of a TDS had only one value, the filter (if any) on that source was not honored.
When multiple sources are listed (as in `source_composite`), the filters on the sources were checked.
This creates inconsistent processing, although in most cases the result was the same because the source (incorrectly) queried for table locations would just return an empty set.
```
source_single:
sources:
- name: source1
# this filter would be ignored
filters: {whereTableKey: "Namespace = `SkipMe`"}
source_composite:
sources:
- name: source1
# this filter would be honored
filters: {whereTableKey: "Namespace = `DontSkipMe`"}
- name: source2
```
### Sources without a filter
Sources that are not Data Import Servers or failover groups are now assigned the null filter, instead of the `if not claimed` filter.
When a source is a Data Import Server or failover group, the filter for that DIS or group is used.
Otherwise, the source is some other delegate TDS, and it was assigned an `if not claimed` filter. This was an incorrect assumption, because the delegate TDS might actually handle a claimed table.
```
some_tds:
sources:
- name: source1
# now the null filter
```
### Failover groups
Ad hoc failover groups are now assigned the correct filter for the group members (which must all be identical), instead of the `if not claimed` filter.
A failover group defines multiple DISes that process the same data and can serve as backups to each other.
You can create a failover group using the [`failoverGroup`](../../sys-admin/configuration/yaml.md#failover-groups) keyword in each member DIS configuration. This creates a TDS for the group that you can use in the data routing configuration.
You can also define a failover group inline in the `sources` of a TDS by listing the member names in a list.
Deephaven recommends explicit configuration using the [`failoverGroup`](../../sys-admin/configuration/yaml.md#failover-groups) keyword to define the group and create a TDS with the given name.
See [The `dataImportServers` keyword](../../sys-admin/configuration/yaml.md#the-dataimportservers-keyword) for some important caveats when using ad hoc failover groups.
## Simplify of default tailer config file, `tailerConfigDbInternal.xml`
The Tailer process is configured with an XML file described in [Tailer XML configuration files](../../sys-admin/configuration/data-tailer.md#tailer-xml-configuration-files). The default tailer configuration file
is `/usr/illumon/latest/etc/tailerConfigDbInternal.xml`. In current installations, binary log files are named in a standard way,
and the `StandardBinaryLogFileManager` class is sufficient for managing them.
This change simplifies the default tailer configuration file and removes a complex configuration section that is largely obsolete.
The new file contains:
```xml
```
The original file contained:
```xml
```
## Breaking changes in TLS certificate policy
The Grizzly+ changes how TLS certificates are provided and validated.
Deephaven no longer generates signing certificates for the Configuration Server, Authentication Server or Persistent Query Controller processes. These processes, like all other [TLS servers](../../sys-admin/admin-glossary.md#tls-server), now share a single certificate per machine, which signs all TLS requests made to that server.
### One certificate per machine
For native installations, TLS is now configured using [**one certificate per machine**](../../sys-admin/security/tls-certificates.md#one-certificate-per-machine). This matches the TLS security model used by Podman installations.
Previously, a single `tls.crt` / `tls.key` signing certificate and private key were reused across multiple machines. You must now [provide a separate certificate/key per machine](../../sys-admin/installation/basic-install.md#tls-certificates). This prevents processes running on one machine from impersonating processes running on another machine.
### SAN / hostname verification
Each machine’s certificate must match the hostname used to reach that node.
All processes running on each machine now share the same certificate, and all [hostname verification](../../sys-admin/admin-glossary.md#hostname-verification) is performed using only the [Subject Alternative Name](../../sys-admin/admin-glossary.md#san). Certificate common name and authority overrides are no longer used.
- Native installations use the [`DH_NODE_N_DOMAIN` flag in `cluster.cnf`](../../sys-admin/installation/cluster-config-guide.md#dh_node_n_domain) to determine the hostname each supplied certificate must cover.
- When Envoy is used in native installations, a separate certificate configured via [`DH_ENVOY_LOCAL_CERT`](../../sys-admin/installation/cluster-config-guide.md#dh_envoy_local_cert) must sign requests for the hostname specified by [`DH_ENVOY_FQDN`](../../sys-admin/installation/cluster-config-guide.md#dh_envoy_fqdn).
- When Envoy is used, the default [`DH_GENERATE_CERTIFICATES=true` flag](../../sys-admin/installation/cluster-config-guide.md#dh_generate_certificates) will tell the installer to generate all per-machine certificates, so you only need to supply the Envoy certificate.
- Podman installations use the [`--hostname` flag passed to `start_command.sh`](../../sys-admin/installation/podman-installation.md#start_commandsh-details) to determine the hostname of each server.
- Kubernetes installations manage all intra-cluster communication, so the only certificate and hostname to consider are the [`envoyFrontProxyUrl`](../../sys-admin/kubernetes/kubernetes-configuration-settings.md#configuring-envoy) which uses the [`deephaven-tls` TLS certificate secret](../../sys-admin/kubernetes/kubernetes-install-guide.md#create-a-kubernetes-secret-for-the-tls-certificate).
- Authority overrides and certificate common names are no longer used by Deephaven.
## Client truststores are optional
Deephaven-generated TLS certificate truststores are now optional for native and Podman installations. Kubernetes must be manually configured to forego the use of an explicit client truststore.
If your Deephaven endpoint certificate is issued by a well-known public CA (already trusted by client OSes, browsers, JVMs and other language runtimes), clients can rely on their existing system trust. In this case, you do not need to distribute Deephaven-specific client truststores.
By default, no truststore will be created or used, and all TLS connections will rely on OS / JVM / Python system truststores.
### Enable explicit truststore file
If your endpoint certificate is issued by a private/corporate CA which is not already trusted by client processes, or if you want to strictly limit what servers are trusted by Deephaven processes, you can provide the CA material to your installer to generate and use client truststores.
CA certificate bundles supplied to Deephaven installers must be PEM-formatted X.509 certificate files, which do NOT contain any private keys. Truststore files are considered world-readable and must contain only public certificates.
- For native installations, the CA certificate bundle is supplied via a file on your Installation host specified by the `cluster.cnf` property [`DH_CA_CERTIFICATE` in native installations](../../sys-admin/installation/cluster-config-guide.md#dh_ca_certificate).
- For Podman installations the [`--ca-cert-file` flag](../../sys-admin/installation/podman-installation.md#supplying-trusted-certificates-to-podman) is passed to `start_command.sh`.
- For Kubernetes installations, the CA certificates are not yet configurable, and must use the same generated `truststore-iris.p12` file as previous releases.
### Remote truststores are always overwritten
In past releases, Deephaven always generated a stateful TLS truststore containing a mix of user-supplied certificates and Deephaven-generated certificates, and all TLS connections were forced to use the server's truststore, rather than their local Operating System / JVM / Python truststore. Updates to the remote system truststore files persisted between upgrades and certificate rotations.
New in Grizzly+, when an explicit truststore file is used, all truststore files on all Deephaven servers will be overwritten on all upgrades and during all certificate rotations.
If you are upgrading from a previous version, and you have automated processes which rely on updating the Deephaven truststore file, you should remove any manual updates to files in `/etc/sysconfig/deephaven/trust` on your Deephaven servers, and instead pass the complete bundle of trusted certificates to your installer.
### Multiple TLS trust boundaries
In past releases, a single truststore was used to validate all TLS connections between [Deephaven services](../../sys-admin/admin-glossary.md#deephaven-services), and for [Deephaven client](../../sys-admin/admin-glossary.md#deephaven-client) connections to Deephaven services.
In Grizzly+, it is now possible to use [separate TLS models](../../sys-admin/security/tls-certificates.md#tls-trust-boundaries) to differentiate which signing certificates a Deephaven client trusts versus which signing certificates Deephaven services trust.
This allows for fine-grained control over how TLS certificates are trusted by clients and servers.
### Removed TLS files and configuration
- Previous versions of Deephaven generated a truststore from the customer-provided `tls.crt` and a Deephaven-generated `dh-root-ca.pem`.
- `dh-root-ca.pem` is no longer used, and no certificates are generated on remote machines.
- `DH_CA_CERTIFICATE` is the only supported input for the CA material used to generate Deephaven client truststores.
- When `DH_CA_CERTIFICATE` is set, the installer overwrites the generated client truststores (`truststore-iris.p12` and `truststore-iris.pem`) on every install, including inspect/update operations.
## Custom gRPC-web transport for Deephaven JS API
The `createClient` function in the `clientUtils` module in `auth-nodejs` now supports a `ConnectOptions` object that
allows customization of the gRPC-web transport used by the Deephaven JS API client. See TypeScript definitions for
details on how to create a custom transport.
Additionally, the `clientUtils` module in `auth-nodejs` no longer exports a `getWsUrl` function. This function should
no longer be necessary when using `dh.Client`, and URL will always be rewritten to use the correct protocol and path
as needed.
## One Artifact Supports All Java Versions
In previous versions of Deephaven, there was a different set of product tar files for each supported JDK.
Starting in versions `1.20231218.550` and `1.20240517.527`, there is only one set of artifacts to support all JDK versions.
The mechanisms for selecting your JDK, such as `DH_JAVA_VERSION` in `cluster.cnf` or `--jdk*` flags passed to containerized deployments, remain unchanged.
The Enterprise installer and Core+ tar files no longer have a -jdkN classifier.
For example, `deephaven-enterprise-1.20231212.123-jdk17.tar.gz` is now `deephaven-enterprise-1.20231212.123.tar.gz`.
The Enterprise rpm no longer has the jdk major version as deephaven-enterprise minor version; the minor version is always `1`.
For example, `deephaven-enterprise-1.20231212.123-17-1.rpm` is now `deephaven-enterprise-1.20231212.123-1-1.rpm`.
The Core+ tar file has removed its jdkN classifier.\
For example, `deephaven-coreplus-0.32.0-1.20231212.123-jdk17.tgz` is now `deephaven-coreplus-0.32.0-1.20231212.123.tgz`.
Note that ONLY the filenames and RPM package name have changed. All paths on the filesystem still reflect previous locations.
## Rename core+ artifacts to use io.deephaven.coreplus maven groupId
Previously, Core+ artifacts were published as `io.deephaven.dnd` in Deephaven maven repositories.
These artifacts now use `io.deephaven.coreplus` for their groupId.
## Fix Core+ mis-decoding of certain String and StringSet values
Previously, Core+ reading of Deephaven-format Table data would assume all String and StringSet columns were encoded
using ISO-8859-1; this is an issue for encoded characters that aren't the same as in ISO-8859-1. All encodings should
now decode correctly.
The issue would manifest differently depending on the character set / encoding:
### ASCII
Corresponds to Schema Column with attribute `encoding="US_ASCII"`.
No issues. (ASCII is a subset of ISO-8859-1.)
### ISO-8559-1 (also known as Latin-1)
Corresponds to Schema Column with attribute `encoding="ISO_8559_1"`, or a Schema column without the `encoding` attribute.
No issues.
### UTF-8
Corresponds to Schema Column with attribute `encoding="UTF_8"`.
All UTF-8 single-byte characters (ASCII) will decode correctly. All other characters would have decoded incorrectly.
### UTF-16
Corresponds to Schema Column with attribute `encoding="UTF_16"`, `encoding="UTF_16LE"`, or `encoding="UTF_16BE"`.
All UTF-16 characters would have decoded incorrectly.
## Rename DH_DND_VERSIONS to DH_COREPLUS_VERSIONS
The legacy name for Deephaven Enterprise + Deephaven Core was "DnD",
but the name was changed to "Core+" so we have renamed the installer's
cluster.cnf property `DH_DND_VERSIONS` to `DH_COREPLUS_VERSIONS`.
The legacy `DH_DND_VERSIONS` will be accepted (with command-line warnings) for the lifetime of the 20240517 "grizzly" release, but will be deleted in future versions.
## Column Expression Validation
Column expression validation now uses the `parsed` validator by default, which provides more precise control over which methods users may invoke.
See [Formula validation configuration](https://deephaven.io/core/groovy/docs/conceptual/formula-validation-configuration/) for more details.
# HTTP/2 support in Deephaven
The Grizzly Plus version of Deephaven now supports HTTP/2 for all Core+ web connections. Legacy Enterprise workers only support HTTP/1.1, and may require configuring your Envoy YAML to allow HTTP/1.1 WebSocket connections to continue to work.
Grizzly Plus is the last version of Deephaven to support legacy enterprise workers. All query code must be migrated to Core+ workers before your next major version upgrade.
## HTTP+TLS required for all Deephaven web connections
All Deephaven servers now require TLS for web connections, using a [unique, per-machine TLS certificate](../../sys-admin/security/tls-certificates.md) to sign all requests.
## Envoy must remove HTTP/2 CONNECT websockets
Deephaven only uses WebSockets for legacy workers. Core+ workers using HTTP2 do not use WebSockets, so the `upgrade_type: CONNECT` configuration should be removed, with `upgrade_type: websocket` included only if legacy query workers are still in use.
If your `envoy.yaml` file contains the following:
```yaml
upgrade_configs:
- upgrade_type: websocket
- upgrade_type: CONNECT
http2_protocol_options:
allow_connect: true
```
Change it to:
```yaml
upgrade_configs:
- upgrade_type: websocket
http2_protocol_options:
allow_connect: false
```
## Exception thrown if FileHandle key changes
A safety check has been added for whenever a FileHandle is refreshed to ensure it represents the same physical file as it did previously. When this is not the case, it can lead to very hard to debug downstream issues.
This check is enabled by default. In order to revert to previous behavior, the following flag may be added to a query's configuration:
```properties
FileHandle.safetyCheckEnabled=false
```
## Core+ Validation Queries
Validation Jobs may now be executed in a Core+ worker. Previously, all Validation Job workers were Legacy. Schema-based Validation queries should migrate seamlessly.
There are a number of steps required to convert custom a Legacy Validation class to a Core+ Validation class.
- A number of supporting classes have changed package-path from `com.illumon.iris.validation` to `io.deephaven.enterprise.validation`, including:
- `DataQualityTestCase`
- `ValidationTableDescription`
- `ImportDetailsUtils`
- ...
- The following Deephaven classes have changed from Legacy to Core+, which may require a number of changes each. See [Converting Legacy scripts to Core+ Scripts Cheat Sheet](../../legacy/legacy-to-core.md) for a more in-depth analysis.
- `Database`
- `db.i(...)` -> `db.liveTable(...)`
- `db.t(...)` -> `db.historicalTable(...)`
- `Table`
- Numerous changes
- `TableDefinition`
- Please note that the Core+ `TableDefinition` does not include grouping information. Grouping information may still be accessed from the `Schema` or from the shadowed `TableDefinition` provided by the`Schema`.
- `com.fishlib.io.logger.DelegatingLoggerImpl` may be replaced with `io.deephaven.internal.log.LoggerFactory.getLogger()`
- The `ValidationTableDescription` has been modified to remove `FullTableLocationKey` implementation details. The `getLocation()` method has been replaced with a self-reference to the `ValidationTableDescription` instance in order to simplify the porting process. The following new methods have been added to the `ValidationTableDescription` interface:
- `String getTableName()` - the Table Name for the associated `Table`
- `String getNamespace()` - the Namespace for the associated `Table`
- `String getColumnPartition()` - the Partition Value (for the Partition Column) for the associated `Table`
- `String getInternalPartition()` - the Internal Partition, if applicable, for the associated `Table`
**Note** that `RunDataQualityTests#main` is not ported. In effect, this disables the `RunDataQualityTests` command-line utility for Core+ validations. All Core+ validations should be executed in a `Data Validation` PQ .
## On-Demand Asynchronous Cleanup of the DataBufferPool
The `AutoReclaimingObjectPool` (DataBufferPool) now triggers asynchronous cleanup **as soon as** the pool occupancy
exceeds the configured threshold, rather than waiting for the next scheduled interval. Consequently, the synchronous
cleanup path—logged as `"Failed to take() an item for thread=, initiating synchronous cleanup"`—is invoked
far less often.
Because of this, the `DataBufferConfiguration.cleanupIntervalMillis` setting has become largely irrelevant and may be
removed in a future release.
## Improved support for Iceberg tables in Core+
Core+ has better support for reading Iceberg tables as historical tables.
This includes correctly handling Iceberg Schema evolution, nested Iceberg Structs, and proper field id mapping into
Parquet files.
### Configuration
Iceberg-specific configuration options is out-of-scope for release notes, as they are highly dependent on the specifics
of the Iceberg Catalog and data storage setup. In general, Deephaven has good support for the "rest" and "glue" catalog
types, but should support other Catalog implementations as well. The Iceberg-specific configurations options that work
with Deephaven will be similar to the configuration options needed for Spark (given that Spark is also a JVM-based
application). See the [Iceberg Documentation](https://iceberg.apache.org/docs/latest/), or the documentation for your
specific Catalog, for configuration property details.
```groovy
import io.deephaven.enterprise.iceberg.IcebergTableOptions
import io.deephaven.iceberg.util.BuildCatalogOptions
import io.deephaven.iceberg.util.LoadTableOptions
// The options to read an Iceberg Catalog.
catalogOptions = BuildCatalogOptions.builder()
.putAllProperties(Map.of(
"type", "",
// ... additional properties here ...
))
.build()
// The options to load an Iceberg Table from the catalog.
tableOptions = LoadTableOptions.builder()
.id("IcebergNamespace.IcebergTableName")
.build()
// Load the Iceberg Catalog and Table and infer the best mapping into a
// Deephaven Table Definition.
options = IcebergTableOptions.builder()
.tableKey("DHNamespace", "DHTableName")
.catalogOptions(catalogOptions)
.tableOptions(tableOptions)
.build()
.materialize()
```
Verification:
```groovy
// Verify the resulting Table data looks correct
myTable = options.table()
```
### Deployment
```groovy
import com.illumon.iris.db.schema.SchemaServiceFactory
schemaService = SchemaServiceFactory.getDefault()
// Admins are encouraged to explicitly manage the deployment logic of their Schema with
// the SchemaService.
mySchema = options.schema().get()
schemaService.addSchema(mySchema)
// Alternatively, admins may directly deploy from the IcebergTableOptions. The following
// will create the Schema namespace if it doesn't exist, and will create the Schema if
// it doesn't exist, or update the Schema if it does exist.
// options.deploy(schemaService)
```
Verification:
```groovy
myTable = db.historicalTable("DHNamespace", "DHTableName")
```
## Tailer cleanup of old binary log files
A new property, `log.tailer.fileCleanup.startupDeletionCutoffTime`, allows the tailer to find and delete old binary log files when it starts. Further information can be found in the [tailer configuration page](../../sys-admin/configuration/data-tailer.md#binary-log-file-cleanup-properties).
## Improved Binary Logger and Listener Generation
Previously, to generate Java binary loggers from Deephaven schema, the
`IntradayLoggerFactory` was the preferred tool. In this release, we have
introduced a new binary logger factory that generates much improved logging
classes that can operate more independently of the Deephaven system and with
far fewer Java-level dependencies. The existing `IntradayLoggerFactory`
continues to generate loggers and listeners for schema elements that are
labelled `Logger` or `LoggerListener`. The new factory uses `LogFormat`
elements.
See [binary Log format configuration](../../data-guide/streaming/binary-log-format-configuration.md) for more details.
### Deprecated Features and Java Changes
The `com.illumon.iris.binarystore.RollingFileManagerBase.ExistingFilePolicy` values for `DELETE` and `APPEND`, which
were deprecated in 2018, have been removed from this release.
The `com.illumon.iris.binarystore.RollingFileManagerBase` provides the same functionality, but custom extensions must
now provide template parameters for the expiration type.
## New API to format the log-format suffix of internal partitions
A new builder method `IntradayLoggerBuilder#setSuffixInternalPartitionWithLogFormat(String)` has been added that lets caller provide a single-argument `String.format` pattern. The formatted log-format value is appended to the internal-partition name.
This overloads the existing `IntradayLoggerBuilder#setSuffixInternalPartitionWithLogFormat(boolean)` which, when `true`, appends the suffix using the default `%d` pattern.
**Example:**
For internal partition `"ABC"` and log-format version `4`:
- For `setSuffixInternalPartitionWithLogFormat(true)`, the actual partition used would be `ABC-4`
- For `setSuffixInternalPartitionWithLogFormat("%02d")`, the actual partition used would be `ABC-04`
## Enabled several HTTP security headers by default
Previously, when used with Envoy, Deephaven had several optional HTTP security
headers configured, but left disabled. These defaults are now also available
without Envoy, and additionally, some of them are on by default.
Configuration properties prefixed with `envoy.add.header.` will be set on outgoing
responses from Envoy, while `http.add.header.` will be set on outgoing responses from
the server itself, regardless of whether Envoy is used or not.
The following headers are now enabled by default:
- `X-XSS-Protection: 1; mode=block` - Enables the Cross-Site Scripting (XSS) filter
built into some browsers.
- `X-Content-Type-Options: nosniff` - Prevents the browser from MIME-sniffing a
response away from the declared content-type, but instead requires that the server
deliberately set a content type.
- `Refer-Policy: no-referrer` - Disables sending any `Referer` headers.
- `Cross-Origin-Resource-Policy: same-origin` - Restricts the ability of a document to
load 'no-cors' resources from other origins.
- `Cross-Origin-Embedder-Policy: require-corp` - Limits embedding cross origin resources
into the document.
- `Cross-Origin-Opener-Policy: same-origin` - Prevents cross-origin documents from being
able to interact with pages.
## Optional limit on appendLiveTable table size
`WritableDatabase.appendLiveTable(...)` sends the given table to the Log Aggregator Service as an atomic update. A large enough table can cause the LAS to run out of memory.
You can now set a maximum table size (number of rows) that will be accepted by the appendLiveTable call, by setting the optional property `LogAggregatorService.transactionLimit.rows`.
This check only looks at the number of rows and does not take the number of columns or actual data size into account.
## Combined Jars for Core+ clients
Combined jars are now available for Core+ clients allowing you to use a single jar for client applications. The Legacy Core+ client jar is `deephaven-ent-client-combined-.jar` and the Core+ Client combined jar is `deephaven-coreplus-client-combined-.jar`
## Data Import Server aggressively releases unused resources
The Data Import Server (DIS) now aggressively releases resources that are no longer in use. This change eliminates the slow accumulation of resources that could result from ingesting data over many days.
The DIS serves two functions: ingesting data from tailers, and serving intraday data to queries. When a tailer disconnects (e.g. when it finishes a day's data) and when the last subscriber to a location unsubscribes or disconnects, the relevant table locations are dropped when unused.
### New information added to the DIS Web Server
The Data Import Server's web server now includes summary information about the table locations in the active set.
## Backport Core+ Merge to Grizzly Plus
Merge Jobs may now be executed in a Core+ worker. Previously, all Merge Job workers were Legacy. The following tickets were backported;
- DH-17611: Write to DH format from Core+ with Core chunks
- DH-17680: Port Merge PQ to Core+ Engine (builder)
- DH-18060: Add Core+ option to Engine drop-down for Merge PQs
- DH-18377: Specify Merge_1 instead of AutoMerge for Core+ Kafka integration tests
- DH-18531: Performance updates for Core+ Merge Jobs
- DH-18463: Add sort formula handling to Core+ MergeJob
- DH-18763: Fix Kafka integration-test failure
## Directly create Core AclFilterGenerator for Database ACLs
Previously, the row and column ACLs applied to tables retrieved from a Database must have implemented the [FilterGenerator](https://docs.deephaven.io/javadoc/20240517/com/illumon/iris/db/v2/permissions/FilterGenerator.html) interface, which produces Legacy filters. Optionally, the FilterGenerator can provide a Core filter generator using the [getCommunityFilterGenerator](https://docs.deephaven.io/javadoc/20240517/com/illumon/iris/db/v2/permissions/FilterGenerator.html#getCommunityFilterGenerator(com.illumon.iris.db.v2.permissions.PermissionFilterProvider,com.illumon.iris.db.tables.databases.Database)) method. This means that to build a Core+ [AclFilterGenerator](https://docs.deephaven.io/javadoc/coreplus/20240517/io/deephaven/enterprise/acl/AclFilterGenerator.html) for source tables, you must create a corresponding Legacy FilterGenerator.
You can now provide a Core+ AclFilterGenerator directly in the ACL editor. In Core+ workers, the generated Core WhereFilter is applied to the returned table without the need to instantiate a Legacy FilterGenerator.
In a Legacy worker, an error occurs applying the ACL (typically a compilation error). If the user has no other ACLs defined, the table will not accessible. The tables with Core+ filters are not visible in the catalog table if the `acl.filter.namespaces` or `acl.filter.tables` Configuration properties are set to true.
The order that ACLs for different groups are generated is not guaranteed, and the user receives a union of the permissions across all their groups with defined ACLs. Therefore, you cannot depend on the existence of a Core+ filter generator to deny access to a table. If an all-access ACL for another of the user's group is processed first, then no other ACLs are processed and the table will be accessible. When evaluating catalog filtering, the system can short circuit evaluation after the first successful ACL application. Similarly, the existence of an another ACL does not ensure access to the table -- if the Core+ AclFilterGenerator fails to compile before another ACL is processed the table is inaccessible.
## Removed Jupyter Notebook integration
Server side Jupyter Notebook integration has been removed from Deephaven. The Legacy worker Jupyter Notebook is no longer supported and will not be updated. Use the Deephaven Core+ Python client from Jupyter notebooks beginning in Deephaven 1.20231218 and later.
## Optional limit on appendCentral table size (server side)
`Database.appendCentral(...)` and `RemoteTableAppender.appendAtomic(...)` calls send the given table to the Log Aggregator Service as an atomic update. A large enough table can cause the LAS to run out of memory.
You can now set a maximum table size (number of rows or number of bytes) that will be accepted by the Log Aggregator, by setting the optional properties
`LogAggregatorService.transactionLimit.rows` or `LogAggregatorService.transactionLimit.bytes`. Zero or unset means no limit is enforced. When the Log Aggregator accumulates more rows or more bytes in a transaction than the configured limit, it will abort the transaction and release the accumulated memory. The client will get an error.
To make updates larger than the configured limit, either break the table into smaller pieces, or use the RemoteTableAppender directly to make a non-atomic update:
```groovy
rta = new com.illumon.iris.db.util.logging.RemoteTableAppender(log, table.getDefinition().getWritable(), namespace, tableName, columnPartitionValue)
rta.append(table)
rta.flush()
rta.close()
```
See also [Optional client-side limit on appendCentral table size](#optional-limit-on-appendcentral-table-size-client-side) for related client-side changes.
## Optional limit on appendCentral table size (client side)
`Database.appendCentral(...)` sends the given table to the Log Aggregator Service as an atomic update. A large enough table can cause the LAS to run out of memory.
You can now set a maximum table size (number of rows) that will be accepted by the appendCentral call, by setting the optional property `LogAggregatorService.transactionLimit.rows`.
This check only looks at the number of rows and does not take the number of columns into account. Zero or unset means no limit is enforced.
To make updates larger than the configured limit, either break the table into smaller pieces, or use the RemoteTableAppender directly to make a non-atomic update:
```groovy
rta = new com.illumon.iris.db.util.logging.RemoteTableAppender(log, table.getDefinition().getWritable(), namespace, tableName, columnPartitionValue)
rta.append(table)
rta.flush()
rta.close()
```
See also [Optional server-side limit on appendCentral table size](#optional-limit-on-appendcentral-table-size-server-side) for related server-side changes.
## Ensure partitioned user table additions and deletions are reflected in future historical table calls
The following code block documents the expected behavior for partitioned user table with additions and deletions:
```groovy
// Creates an empty directory structure for date1, possibly, /db/Users//Partitions/0//
db.addTablePartition(namespace, tableName, date1, table)
db.deleteTablePartition(namespace, tableName, date1, table)
// Does not have date1 (as expected).
t1 = db.historicalTable(namespace, tableName).coalesce()
db.addTablePartition(namespace, tableName, date1, table)
// Does have date1 (as expected, previously did not work).
t2 = db.historicalTable(namespace, tableName).coalesce()
```
This reflection of this change is specific to the worker where these `deleteTablePartition`, `addTablePartition` calls
were made. Other processes that have previously read this historical table may retain the previous behavior (that is,
calls to historicalTable may not reflect the newly added partitions).
Note, the previous empty location caching behavior could also be exhibited without using `db.deleteTablePartition`, as
illustrated by the following script:
```groovy
// Creates the partition date in the same namespace as tableName2
db.addTablePartition(namespace, tableName1, date, x)
// Does not have date1 (as expected).
t1 = db.historicalTable(namespace, tableName2).coalesce()
db.addTablePartition(namespace, tableName2, date, x)
// Does have date1 (as expected, previously did not work).
t2 = db.historicalTable(namespace, tableName2).coalesce()
```
## Automatic Server Selection
[Automated server-selection](../../sys-admin/pq-controller/automated-server-selection.md#simple-server-selection-provider) is now turned on by default on new non-Kubernetes installations. To turn it off or change the defaults, edit your `iris-environment.prop` file and remove or edit the properties from the `iris_controller` stanza, as described in [automated server selection](../../sys-admin/pq-controller/automated-server-selection.md).
## Changes to tailer process memory requirements
### Tailer now uses constrained and pre-allocated buffer pools for both User and System tables
With default configuration, the tailer now uses constrained and pre-allocated buffer pools for sending data to Data Import Servers.
This makes the tailer's memory consumption more predictable, and avoids potential out-of-memory conditions. There are separate pools for User and System tables, governed by the following properties:
| Property | Default | Description |
| --------------------------------------- | ---------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| `DataContent.userPoolCapacity` | 128 | The maximum number of User table locations that will be processed concurrently. If more locations are created at the same time, the processing is serialized. |
| `DataContent.producerBufferSize.user` | 256 * 1024 | The size in bytes of the buffers used to read and send data for User table locations. |
| `DataContent.disableUserPool` | false | If true, user table locations are processed without a constrained pool, in which case user actions can consume unbounded tailer resources. |
| `DataContent.systemPoolCapacity` | 128 | The maximum number of System table locations that will be processed concurrently. If more locations are created at the same time, the processing is serialized. |
| `DataContent.producerBufferSize` | 256 * 1024 | The size in bytes of the buffers used to read and send data for System table locations. |
| `DataContent.disableSystemPool` | false | Disable the system pool, which results in an unconstrained number of buffers being used in the tailer. |
| `DataContent.producersUseDirectBuffers` | true | Producers (the tailer) use a direct buffer for reading and sending data. |
The tailer allocates two pools of buffers, one for user tables and one for system tables. Each item in that pool requires two buffers for concurrency, so the memory required will be double the buffer size times the pool capacity.
Total direct memory required for the tailer is approximately `2 * (DataContent.producerBufferSize * DataContent.systemPoolCapacity + DataContent.producerBufferSize.user * DataContent.userPoolCapacity)`.
### Tailer now adjusts to DIS buffer size
When the tailer establishes a connection to a DIS, the processes now exchange configuration information. If the tailer is configured with a larger maximum message size than the DIS can accept, it will reduce it's maximum message size to match the DIS.
### Change configuration to handle older tailers sending data to newer Data Import Servers
This section applies only to environments using default configuration values, and where tailers are outside the Deephaven system, either tailing from external systems or from different Deephaven installations. In this scenario, the tailer may send messages that are too large for the DIS to accept.
Older tailers do not accommodate to DIS settings, and may have default configuration settings that allow them to send larger messages than a DIS with default configuration can accept.
This typically only happens when the tailer gets behind, or otherwise has file to process with more than 327,710 bytes.
When this happens, the DIS will reject the tailer with a message like:
```text
WARN - DataImportServer-db_dis-TailerConnection-/127.0.0.1:55638-FullTableLocationKey{TableLookupKey.Immutable[Namespace/table/U],TableLocationLookupKey.Immutable[internal_partition/date]}:Rejecting and closing channel: Protocol error while processing stream: Message size 4400021 exceeds the maximum 327710. The client is configured with a larger maximum message size than this server. Check parameters DataContent.producerBufferSize and DataContent.consumerBufferSize. This most likely applies to the DIS and tailer processes.
```
A similar message might appear in the tailer log.
When an old tailer sends data to a new DIS, the DIS will log a warning like this:
```text
WARN - Received TableIdentifierDataItem with old version: 4. The tailer will not protect against causing a read buffer overflow.
```
If your environment includes older tailers that send data to current DISes, you should make one of the following configuration changes:
1. update the tailers to the current Deephaven version
2. update the tailer configurations to set the max message size, by setting the following properties in the tailer configuration or properties file:
```text
DataContent.producerBufferSize = 262144
DataContent.producerBufferSize.user = 262144
```
3. update the DIS max message size to match the tailer max message size by setting the following properties in the DIS configuration or properties file:
```text
DataContent.producerBufferSize = 2097160
```
> [!NOTE]
> The default max messages size from the tailer is reduced as of 20240517.262. Tailers respond to DIS configuration settings as of 20240517.403.
## Database.inputTableUpdater improvements
The `Database.inputTableUpdater` method has been updated to return a new, more general interface
`io.deephaven.enterprise.database.inputtables.InputTableUpdater`, which allows callers to have more control over table
lineage with input tables. The `InputTableUpdater` can also be explicitly managed with a liveness scope, and is also
now more efficient in caching intermediate operations.
When sourcing both an `InputTableUpdater` and an input `Table` view from `db`, the resulting objects may not share a
common lineage:
```groovy
def myTableUpdater = db.inputTableUpdater("MyNamespace", "MyTable")
def myTable = db.inputTable("MyNamespace", "MyTable")
myTableUpdater.add(new_data)
// myTable is not guaranteed to have new_data
```
With the new interface, callers can explicitly derive the corresponding input `Table` view from the `InputTableUpdater`:
```groovy
def myTableUpdater = db.inputTableUpdater("MyNamespace", "MyTable")
def myTable = myTableUpdater.table()
myTableUpdater.add(new_data)
// myTable is guaranteed to have new_data
```
Note, the python layer does not currently expose a stand-alone equivalent of `InputTableUpdater`;
an input `Table` view must be created, and in that context, table lineage is already guaranteed.
```python
my_table = db.input_table("MyNamespace", "MyTable")
my_table.add(new_data)
# my_table is guaranteed to have new_data
```