How do I delete historical data?

Can I delete historical data from Deephaven tables? I've heard that Deephaven is an append-only database.

It depends on the type of table you're working with. Deephaven tables are views over data held in memory or read from external storage. If you need to remove persisted history (such as Parquet or Iceberg files), you'll need to delete or rewrite it at the source. Within the engine, whether you can delete rows depends on the table type:

Keyed input tables

Yes, you can delete data from keyed input tables. Input tables are user-created, in-memory tables that support both adding and deleting data.

To delete data from a keyed input table, use the delete or delete_async methods on the input table object. Make sure the table you pass to delete contains only the key columns — if you include value columns, you'll get an error. To delete rows selected from the input table itself, drop the value columns first with something like view("Key").

Note

delete_async returns immediately without waiting for the operation to complete. The deletion is applied on a later update cycle, so the table snapshot may still show the row briefly.

A couple of things to keep in mind:

  • Only keyed input tables support deletion. Append-only input tables do not.
  • The table you pass to delete must contain only key columns, not value columns.

Standard and append-only tables

Standard and append-only tables don't support direct row deletion. There's no API to delete individual rows from these table types:

  • Append-only tables: Rows can only be added to the end. Once added, rows cannot be modified, deleted, or reindexed.
  • Standard streaming tables: Rows can be added, modified, removed, or reindexed by whatever updates the table (its data source or upstream operations), but there's no method to delete individual rows yourself.

For these table types, you can:

  • Use where to filter out unwanted rows (creates a new filtered view, doesn't delete data).
  • Use head or tail to limit the table size (creates a new view with limited rows).
  • If the data arrives as a stream, ingest it as a blink table and build a ring table from it, so only the latest N rows are kept. A ring table built on an append-only table does not save memory, because the append-only table still keeps every row.

Ring tables: automatic data disposal

Ring tables automatically manage data retention by maintaining a fixed maximum number of rows. As new rows are added, the oldest rows are automatically discarded:

Ring tables are ideal for scenarios where you need a sliding window of recent data without unbounded memory growth.

Blink tables automatically clear all data after each update cycle, retaining only the most recent batch of rows. This makes them excellent for low-memory streaming applications:

Blink tables don't require manual deletion — they automatically discard previous data with each update.

Partitioned table partitions

For partitioned tables, you can exclude entire constituent tables (partitions) by creating a new, filtered partitioned table, but you cannot delete individual rows within a partition unless the underlying table type supports it (e.g., if the constituent tables are input tables).

To work with specific partitions:

  • Use get_constituent to retrieve a specific partition by key.
  • Create a new partitioned table excluding unwanted partitions using filter.

Summary

Table typeCan delete data?How?
Keyed input tables✅ Yesdelete or delete_async methods
Append-only input tables❌ NoNot supported
Standard and append-only (non-input) tables❌ NoUse filtering, or ingest as blink + ring instead
Ring tables✅ AutomaticOld data discarded automatically when capacity is reached
Blink tables✅ AutomaticData cleared after each update cycle
Partitioned tables⚠️ PartialCan filter partitions; row deletion depends on constituent table type

Note

These FAQ pages contain answers to questions about Deephaven Community Core that our users have asked in our Community Slack. If you have a question that is not in our documentation, join our Community and we'll be happy to help!