Azure Synapse/Data Lake connection setup guide

You can now sync your distributor and retailer data from Crisp securely to Azure Data Lake as your cloud destination or to an Azure Synapse workspace via Azure Data Lake. 

To create this connection, you need to have an Azure subscription. If you are connecting to Azure Synapse, you need to create a Synapse workspace. When you set up a Synapse workspace, a blob storage container and data lake storage account are created. 

Note: Azure Blob Storage and Azure Synapse are only compatible with Azure Data Lake Storage (ADLS) Gen2 (not Gen1), so this Crisp connector is also only compatible with Gen2. 

If you have direct access to the storage blob container, we recommend setting up the connection by OAuth token. If you don't have direct access to the container you can create the connection by SAS token. Whichever method you choose, you need to obtain your container's URL.

Obtaining the container URL from the Azure Storage Explorer

1. Navigate to the blob container linked to your Azure Synapse workspace, then right-click it and select Properties.

2. 

3. Copy the URL from the resulting Properties window.

   

Obtaining the container URL from the Azure portal

1. Log in to the Azure portal, from the main menu at the top-left of the screen hover over Storage accounts.
   A panel appears with a list of your storage accounts.
2. From the Recent resources section, select the storage account for the the container linked to your Synapse workspace.
   Hint: If the storage account does not appear in the recent resources list, you can select the View button to open a list of all your storage accounts.

   

3. Once you are in the appropriate storage account, from the Blob service section, select Containers.

   

4. Right-click the appropriate container name, then select Container properties.

   

5. Copy the container's URL.

   

Adding the Azure Connector in Crisp

1. Log into your Crisp account.
   1. From the main menu on the left side of the screen, select Connectors.

      

   2. Select the Add connector button.
      
      

   3. Select the Data Destinations tab, then select the Azure Data Lake Storage Gen 2 connector tile. 
      Note: Connecting to Azure Synapse/Data Lake utilizes Azure Blob Storage, so you can select either tile in this step and the set up for each is the same. Crisp offers two connector tiles to make it clear that Crisp integrates with both Azure Blob Storage and Azure Synapse/Data Lake. 
      
   4. If you want, update the default name of the connector, then copy and paste your URL into the Container URL field.

      

You can now authorize Crisp to access your account. If you have direct access to your storage blob container, you can authorize the connection by OAuth token by following the instructions below. If you do not have direct access, follow the instructions in the Authorizing the connection by SAS token section. 

Authorizing the connection by OAuth token (recommended)

1. From the Authorization section, select Azure OAuth, then select the Sign in with Microsoft button.
   
2. Select or log into your Microsoft account.
   
   
   
   
3. To grant the permissions, select the Accept button.

The token is generated, and you can see who created the token and when. You can now follow the instructions in Selecting the Export Format & Settings to finalize your connection. 

Authorizing the connection by SAS token

This secondary method is only recommended if you are setting up the connector but do not have direct access to the container. Otherwise, we advise authenticating via OAuth token. 

Before starting, make sure you've obtained the container URL and begun the setup process in Crisp.

1. Follow the instructions in Microsoft blob storage help > Get the SAS for a blob container.
2. When adding the connector in Crisp, under Authorization, select SAS token, then paste the URL you copied from Azure into SAS Token field that appears. 
   
   

You can now complete the instructions in the following section to finalize your connection. 

Selecting the Export Format & Settings

1. In the Export Format section, select an output format (e.g., CSV), then choose whether you want the files to be delivered compressed or not.

   

2. If you selected CSV as your data format, you can apply a delimiter to your export. 

   

3. If you want, enter a destination path and/or blob relative path.

   

4. In the Connector source data section, select the Select button. 
   
   
5. Select the retailer(s) for which you want to export data (e.g., UNFI), then choose which data tables and columns to include in the export. For detailed instructions on making your data feed selections, see Selecting Destination Data Sources.
   Hint: You can select the book icon to the right of a table name to see its documentation.
   
   
6. To complete your selections, select the Accept button.
   
   The window closes and you return to the connector setup screen.

7. If you want to include a column in your export that identifies which source connector the data came from, select the Include Source Connector Configuration ID option.

8. Select the Save button.

   

   Your Crisp data is now connected to your Azure Synapse workspace.

9. To access your data from Synapse:

   1. From the left sidebar, select the data icon.
      
      

   2. Select the Linked tab.
      
      
      

   3. Select the Azure Data Lake Storage Gen2 folder to expand it. 
      
      
      
      Your Crisp data is located in the folders that appear.