Skip to main content

Flat File Destination Connector

The Flat File destination connector in DataSync lets you write extracted data into CSV or TXT flat files for storage, sharing, or processing. For large files, you can adjust row scanning or override automatic detection using a custom Schema.ini file. You can also connect to local, network, or cloud‑hosted CSV resources by setting the URL parameter and any required authentication properties.

After creating all required destination connections, create your extraction.

Create a destination connection in DataSync

  1. Log in to DataSync.
  2. From the welcome screen, select Connections.
  3. Next to Destination Connections, click New.
  4. Select Flat File.
  5. In the Connection Properties panel, enter the connection properties.
  6. (Optional) In the Additional Connection Properties panel, select Add property and enter the parameters for each property.
  7. Click Save.

Parameters

Connection properties

ParameterDescription
DescriptionUnique name for the connection. Example: Flat File
URIFile location for the destination flat file(s). Can be a single CSV/TXT file or a folder containing multiple files. Local and network paths are supported.
Example: C:\Exports\Data.csv
File extensionFile type to include in the output. Options: CSV, TXT.
Add date and time to the filename..
DelimiterFormat used for parsing: Comma, Tab, or Custom.
Custom DelimiterCharacter used when delimiter is set to Custom. Example: ;
Quote CharacterCharacter used to quote values in the file.
First row contains headerHeader row setting where the first row is treated as column headers.
Verbosity
  • 1 – Log queries, row counts, execution start/end, errors.
  • 2 – Includes level 1 plus cache queries, HTTP headers.
  • 3 – Includes level 2 plus request/response bodies.
  • 4 – Includes level 3 plus transport-level communication.
  • 5 – Includes level 4 plus all interface commands.
Enable PoolingConnection pooling option for performance.
Pool idle timeoutMaximum idle time for connections before returning them to the pool, in seconds.
Max Pool SizeMaximum number of connections allowed in the pool.
Pool wait timeMaximum wait time for connection allocation before error is thrown, in seconds.

Additional connection properties

Additional connection string properties not specified in the Connection Properties panel. For each property added, you can choose Visible or Encrypted. Selecting Encrypted hides the value from the interface and stores it encrypted in the back end, such as when defining passwords. Typical properties are listed below.

PropertyValue
CharsetCharacter encoding for the source file when encoded in ANSI. No parameter is needed for UTF‑8 encoded files.
Example: windows-1252
CultureRegional format determining decimal and thousands separators. Must match between source/destination files and DataSync configuration.
Examples: fr-FR for commas or en-US for periods.
RowScanDepthNumber of rows scanned to determine table column data types. Default: 100.
Examples:

  • 5000 to scan more rows for accuracy.
  • 0 scans the entire file.
AggregateFilesAll files combined from the URI directory into a single table called AggregatedFiles. Default schema is from the first file unless MetadataDiscoveryURI is set.
Example: aggregating multiple product inventory CSVs.
IncludeFilesComma-separated list of allowed file extensions. Default: CSV,TXT,TAB. Supports NOEXT for files without extensions and archives (ZIP, TAR, GZ). Can also filter by file masks and date/time attributes.
Examples:
IncludeFiles="TXT,CreatedDate<='2020-11-26T07:39:34-05:00'" or
IncludeFiles=2020*.csv,TXT
ExcludeFilesComma-separated list of excluded file extensions. Supports date/time filters similar to IncludeFiles.
Example: ExcludeFiles="TXT,CreatedDate<='2020-11-26T07:39:34-05:00'"
InsertModeMode for inserting into CSV files:

  • FilePerBatch – Creates a new CSV per batch (mandatory for NEC Cloud).
  • SingleFile – Inserts all data into one file, for local/network paths only.
CreateBatchFolderOption to create a folder when InsertMode is set to FilePerBatch. Default: true.
BatchNamingConventionNaming format for batch files:

  • Timestamp_BatchNumberyyyyMMddhhmmssSSS_batchNumber.
  • TableName_BatchNumberTableName_batchNumber.csv (default).

Example