Configure a Google Cloud Storage source

You can migrate data from a Google Cloud Storage (GCS) filesystem by configuring it as your source filesystem for Data Migrator.

note

Data Migrator supports one-time migrations or recurring migrations for GCS sources.

Prerequisites

You need the following:

• A GCS bucket.
• A service account with at least Storage Admin role permissions to your GCS bucket.

Configure a GCS source filesystem with the UI

1. From the Dashboard, select an instance under Instances.

2. In the Filesystems & Agents menu, select Filesystems.

3. Select Add source filesystem

4. Select GCS from the Filesystem Type dropdown list.

5. Enter the following details:

   • Display Name - Enter a name for your source filesystem.
   • Bucket Name - Enter the name of your GCS bucket.
   • Key File Options - Select either Upload JSON Key File or Hashicorp Vault if you have configured a Vault for secrets storage.
     • Hashicorp Vault - In the Key File path in secrets store field, enter the Hashicorp Vault reference to the location of the content of the GCS Key File using the Reference format.
     • Upload JSON Key File - Drag and drop your key file into the box below or select Browse to browse your local machine for the json file.
   info

   If using the Upload JSON Key File option, Data Migrator imports GCS credentials from your JSON key file, stores them internally as configuration properties, then removes the file.

6. Select Save.

Configure a GCS source filesystem with the CLI

To create a GCS source, use the filesystem add gcs command in the Data Migrator CLI including the --source option:

Example

filesystem add gcs --bucket-name mygcsgbucket --file-system-id GCS1 --service-account-json-key-file-server-location /var/tmp/key-999999.json --source

See the filesystem add gcs command for information on all available options

Next steps

Configure a target filesystem to migrate data to. Then create a migration.