Overview Sections:
What is Amazon S3?
Crisp Amazon S3 Cloud Storage Connection
Data Sync Timing
What is Amazon S3?
Amazon Simple Storage Service (S3) is Amazon Web Service's (AWS) object cloud storage platform for all file types and sizes. This platform has been a top three cloud storage solution for over a decade as it offers scalable and dynamic data storage and services. S3 also supports multiple development languages to build application frameworks utilizing structured and unstructured data types.
Crisp Amazon S3 Cloud Storage Connection
Crisp offers a direct connection to your organization’s S3 account, allowing you to obtain the source and normalized data tables Crisp ingests from your distributors and retailers. To ensure data is securely transferred, Crisp provides two authentication options: AWS Access Key authentication or AWS Security Token Service using OpenID Connect (OIDC) federation.
Note: Crisp recommends creating a dedicated IAM user and policy for the connection. For more on preparing to set up this connection, see Amazon S3 connection setup guide.
To get started, you will need an Amazon S3 account in an AWS cloud region along with a storage bucket created in the cloud region. The S3 bucket is where your data from Crisp will go once the connection is established. For a guide on creating the connection in Crisp, see Amazon S3 connection setup guide.
Data Sync Timing
After successfully configuring your S3 connector, Crisp initiates a batch job within 10 minutes to export the first dataset that includes backfill data. Overall timing to backfill data for the first time depends on the number of tables requested. However, it should not take more than a few hours.
Once the initial data set is loaded in your cloud storage, recurring batch jobs are run thereafter to update the data (typically taking several minutes to complete).
Since source data syncs are scheduled by the data provider, data availability varies based on the portal and ranges from daily, weekly, to monthly reports. Crisp ingests the data to normalize and export to users within six hours of the data's availability.
Click here to book a demo and learn more about Crisp's AWS S3 connector
Â