Create an SFTP Data Stream

Create a data stream in Data Cloud to start the flow of data from your SFTP-enabled server source.

  1. In Data Cloud, on the Data Streams tab, click New.

    You can also use App Launcher to find and select Data Streams.

  2. Select Secure File Transfer (SFTP), and click Next.

  3. Choose from the available SFTP connections.

  4. Enter the import details.

    FieldDescription
    Import from DirectoryRemaining folder path under the parent directory that points to a file’s specific location.
    File NameThe file name to retrieve. The file name supports wildcards, and CSV file formats. For example, you can use abc.csv to retrieve all file names containing “abc.” Each time the stream runs, all files that match the name, including wildcards, are imported.
    SourceThe external system where data is sourced. Multiple data streams can have the same source.
  5. Click Next.

  6. Create a data lake object (DLO) or use an existing DLO.

    If you’re creating a DLO, see Naming standards for data lake objects. If you’re using an existing DLO, see Using existing data lake object to create a data stream.

  7. If you’re creating a DLO, edit the fields identified in the table.

  8. Enter a DLO label, API name, and object details.

    FieldDescription
    CategoryIdentify the type of data in the data stream.
    Primary KeySelect a unique field to identify a record.
    Record Modified FieldIf data is received out of order, the system uses the record modified field as a reference point to determine whether to update the record. The record with the most up-to-date timestamp is loaded.
    Organization Unit IdentifierSelect the business unit to use for a record’s data lineage.
  9. (Optional) Add formula fields.

  10. Click Next.

  11. Enter the deployment details, and click Deploy.

Your data stream is created, and you can now map your DLO to the semantic data model to use the data in segments, calculated insights, and other use cases.