Google Cloud Storage

Google Cloud Storage is a managed object storage service for storing and accessing files in Google Cloud buckets.

You can use Google Cloud Storage as a source for Import, as a target for Export, and as source and target for Data Flow.

Establishing Connection

Getting Credentials

Bucket Name

To create a new bucket or select an existing one, perform the following steps:

  1. Open the Google Cloud Console.

  2. In the navigation menu, select Products → Cloud Storage → Buckets.

    Main screen

  3. In the opened table, view the list of existing buckets or create a new bucket.

    List of buckets

  4. Open the required bucket and copy its name.

Creating Service Account

If you want to use a service account for authentication and don't have one, you can create and configure it in the following way:

  1. In the Google API Console, in the navigation menu, select APIs & Services and click Credentials.

    Credentials menu

  2. Click Manage Service Accounts.

    Manage Service Accounts

  3. Click + Create Service Account.

    Create new service account

  4. Enter Service account name, for example, Skyvia service account, and click Create and Continue.

    Fields to fill in to create a service account

  5. Configure the service account privileges. You need to grant the Storage Object User role to the service account.

    Select role

Obtaining Private Key JSON

Here is how you can obtain the Private Key JSON file for an existing service account:

  1. Open the service account that you want to use.

  2. Switch to the Keys tab.

    Create new key

  3. Click Add Key and then Create new key.

    Add new key

  4. Make sure that Key type is set to JSON and click Create.

    Select the type of the key file

  5. After this, the JSON key is downloaded to your computer. Store it in a safe place.

    The key is available once when created. If you lose the key, you will need to create a new one.

To create a connection to Google Cloud Storage, select the authentication type and enter the required credentials.

Creating Connection

OAuth 2.0 Connection

To connect using the OAuth 2.0 connection, click Sign in with Google.

OAuth Connection editor

Service Account Connection

Enter Private Key JSON for Service Account authentication.

Service Account Connection

For both authentication types, you also need to specify Bucket Name.

Connector Specifics

File Masks

When you use Google Cloud Storage as CSV source, you can specify a file mask using a date/time template instead of selecting a file. When integration runs, it will search the file in the folder by substituting the current date to the mask.

On This Page