Guides

Storage creation

This page allows you to create Bidstream Storage for further events export.

To configure events export, you first need to create and set up an appropriate Storage. Epom DSP supports such storages as Google Cloud Storage, Amazon S3, Storage, Azure Blob Storage, or user's server via SSH File Transfer Protocol.

In order to set up the appropriate type of Storage, please follow the next steps:

  1. Go to Bidstream settings on the right side pane in General Settings category;
  2. Press the Create new Storage button;
  3. Select the desired type of Storage in the Select type field;
  4. Fill in all the required fields;
  5. Press the Save button.

Google Cloud

Google Cloud Storage – a secure and flexible object storage service provided by Google Cloud Platform. Use it to store and access data globally with support for service account credentials and custom bucket configuration.

Before configuring Google Cloud Storage, ensure you have:

  • A Google Cloud account with access to the Cloud Storage service;
  • The necessary permissions to create and manage storage buckets;
  • A Project ID, Private Key, and Client Email for authentication.

Here, you can find instructions on setting up Google Cloud Storage via your Google Cloud account.

Bucket Configuration

  • Bucket Name: Provide a unique, globally available name for the bucket;
  • Root Directory: Specify the root directory;
  • Storage Class: Choose an appropriate storage class based on your needs:
    • Nearline – best for backups and data accessed less than once a month;
    • Coldline – best for disaster recovery and data accessed less than once a quarter;
    • Archive – best for long-term digital preservation of data accessed less than once a year.
  • Location: Select the appropriate region for the storage bucket.

Access Configuration

  • Enter Project ID: Input the Google Cloud Project ID associated with your storage bucket;
  • Private Key ID & Private Key: Enter the Private Key ID and Private Key generated from your Google Cloud service account;
  • Client Email – Provide the Client Email linked to the service account;
  • Client ID – Input the Client ID associated with the service account.

Once all required fields are filled, click the Save button to save the Storage configuration.

Amazon S3

Amazon S3 storage – a reliable and scalable cloud storage service by Amazon Web Services. Ideal for users who need to store large volumes of data with granular permission control using Access Keys and Regions.

Before configuring, ensure you have the following:

  • An active Amazon Web Services (AWS) account;
  • S3 bucket name with appropriate permissions;
  • Access Key ID and Secret Access Key;
  • The desired AWS region for data storage;
  • Ensure that your AWS IAM user has S3 full access permissions to read and write data.

Here, you can find instructions on setting up Amazon S3 via your AWS Management Console account.

Bucket Configuration

  • Bucket Name: Enter the name of your S3 bucket;
  • Root Directory: Specify the root directory path where data should be stored;
  • Location: Choose the AWS region where your bucket is hosted (e.g., US East (Ohio)).

Access Configuration

  • Access Key: Enter your AWS Access Key ID;
  • Secret Access Key: Provide your AWS Secret Access Key.

Once all required fields are filled, click the Save button to save the Storage configuration.

SFTP

SFTP (Secure File Transfer Protocol) storage – a secure protocol for transferring files between systems over SSH. Best suited for users who prefer direct server-to-server file transfers using host, port, and user authentication.

Before proceeding, ensure you have the following:

  • Access to a valid SFTP server;
  • A designated host address (IP or domain);
  • A valid username and password;
  • The correct port number;
  • Proper write permissions to the root directory on the server;

Bucket Configuration

  • Root Directory: Enter the full path to the folder where the bidstream data should be stored;
  • Host: Provide the IP address or domain name of your SFTP server;
  • Port: Enter the port used for SFTP access.

Access Configuration

  • User: Enter the username for authenticating with the SFTP server;
  • Password: Enter the password associated with the user account.

Once all required fields are filled, click the Save button to save the Storage configuration.

Azure Blob

Azure Blob Storage – a Microsoft cloud-based storage solution for unstructured data. Offers flexible access through connection strings or SAS tokens and is great for integrating with other Azure services.

Before configuring, ensure you have the following:

  • An active Microsoft Azure account;
  • A Blob storage container set up in your Azure Storage Account;
  • A valid Connection String or SasToken & Endpoint;
  • If using a SAS token, double-check the expiry and permissions.

Here, you can find instructions on setting up Blob Storage via your Azure Portal account.

Bucket Configuration

  • Container Name: Enter the name of your Azure Blob container;
  • Root Directory: Specify the directory path within the container where your data should be stored (optional).;

Access Configuration

  1. Connection String: Enter your full Azure Blob connection string;
  2. SasToken & Endpoint: Alternatively, select this option if you're using a Shared Access Signature (SAS) and provide the required details.

Once all required fields are filled, click the Save button to save the Storage configuration.

🚧

Attention to access

Always ensure that your Storage Account has proper read and write access enabled for the target directory.

By completing these steps, you will successfully set up appropriate Storage for your Bidstream data delivery and storage workflows. After this, you can move on to Export configuration creation.

Updated about 1 year ago