Skip to main content

CSV

CSV (Comma-Separated Values) is a simple file format for storing tabular data, where each line represents a data record and fields are separated by delimiters.

Supported Storage Locations

  • FTP/SFTP: File Transfer Protocol servers
  • SMB: Server Message Block protocol (versions 1.x, 2.x, 3.x)
  • Amazon S3: AWS S3 buckets
  • Alibaba OSS: Object Storage Service

Supported Data Types

BOOLEAN, DATETIME, INTEGER, NUMBER, STRING, TEXT

Quick Setup Guide

1. Prepare File Access

Ensure your CSV files are accessible via one of the supported protocols:

  • FTP/SFTP: Configure server credentials and file paths
  • SMB: Set up network share access
  • Amazon S3: Configure AWS access keys and bucket permissions
  • Alibaba OSS: Set up OSS access credentials

2. File Format Requirements

  • Use consistent delimiters across files
  • Include headers in the first row
  • Ensure data types are compatible with supported types

Limitations

  • Source only: CSV can only be used as a source in XPipes
  • One table per connection: Each connection represents a single table/model
  • No deletion sync: File or data deletions are not synchronized
  • Schema merging: Files with different headers are merged using union logic
  • Polling frequency: Changes are detected every minute (not real-time)