Skip to main content

How to export data to CSV or other delimited files

This guide discusses how to export table data to CSV (or other delimited) files by using writeCsv.

The basic syntax follows:

from deephaven import write_csv

write_csv(table, "/data/outputFile.csv")
note

Deephaven writes files to locations relative to the base of its Docker container. See Docker data volumes to learn more about the relation between locations in the container and the local file system.

We'll create a table to export by using emptyTable and update. The table contains 100 rows of trigonometric values.

from deephaven.TableTools import emptyTable

source = emptyTable(100).update(
"X = 0.1 * i",
"SinX = sin(X)",
"CosX = cos(X)",
"TanX = tan(X)"
)

Standard CSV files

The simplest way to use writeCsv is to supply two input parameters:

  • The Deephaven source table.
  • The path of the output CSV file.
from deephaven import write_csv

write_csv(source, "/data/TrigFunctions.csv")

img

Null values

Null values are common in tables. How are they handled when exporting data to a CSV? This depends on how you call writeCsv.

First, let's create a table with null values. The example below uses a function to fill the SinX column with a large number of nulls.

from deephaven.TableTools import emptyTable

sourceWithNulls = emptyTable(100).update(
"X = 0.1 * i",
"SinX = X % 0.2 < 0.01 ? NULL_DOUBLE : sin(X)",
"CosX = cos(X)",
"TanX = tan(X)"
)

The SinX column contains many null cells. The example below writes this table to a CSV file called TrigFunctionsWithNulls.csv.

from deephaven import write_csv

write_csv(sourceWithNulls, "/data/TrigFunctionsWithNulls.csv")

img

Column selection

In the event you don't want to write every column in the table to a CSV file, you can specify which columns to write. This is done by providing a list of column names, as shown below.

from deephaven import write_csv

write_csv(sourceWithNulls, "/data/Cosine.csv", ["X", "CosX"])

img