Set Up a Spark SQL Connection (Beta)

Set up the Spark SQL connection to start the flow of data into Data Cloud.

This feature is a Beta Service. A customer may opt to try a Beta Service in its sole discretion. Any use of the Beta Service is subject to the applicable Beta Services Terms provided at Agreements and Terms. If you have questions or feedback about this Beta Service, contact the Data Cloud Connector team at datacloud-connectors-beta@salesforce.com.
User Permissions Needed 
To create a connection:System Administrator

Before you begin:

  • Enable the Beta connector through the feature manager. See Enable Data Cloud Features.
  • Verify your admin has enabled firewalls on the system you want Data Cloud to connect to by including these IP addresses to your allowlists.

  1. In Data Cloud, click Setup, and select Data Cloud Setup.

  2. Under External Integrations, select Other Connectors.

  3. Click New.

  4. On the Source tab, select Spark SQL and click Next.

  5. Enter a connection name, connection API name, and provide the authentication and connection details.

  6. For Authentication Details, enter the username, password, and SSL server certificate.

    1. For Username and Password, enter the credentials to authenticate the user.

    2. Enter the SSL Certificate as a string or upload the string as a .pem file.

  7. For Connection Details, provide the URL, database and port.

    1. For the Connection URL, provide the URL as a simple FQDN or IP address.

    2. For Database, enter a value that the schema uses.

    3. For Port, enter the port that the server is running on. The default is 10000, but it can be changed.

  8. To review your configuration, click Test Connection.

  9. Click Save.

After the connector details are accepted, the connection is created and listed under Connectors. You can now create data streams.