Google Drive to AWS S3 File Sync with Deduplication

High-Level Summary

This workflow automates the synchronization of files from a specific Google Drive folder to an AWS S3 bucket. When a file is updated in the watched Google Drive folder, the workflow triggers, compares existing S3 objects, and uploads only the updated or new files, preventing duplicates. An error handler ensures failures are caught and logged. This is ideal for backup, migration, or continuous sync scenarios.

Node Breakdown

• Google Drive Trigger (OAuth2) — Watches a specific folder for file updates. Configured to trigger on fileUpdated events within a folder specified by the folderToWatch parameter (uses {{ $env.WEBHOOK_URL }}[your_id] — you must replace [your_id] with the actual Google Drive folder ID). No additional options set.
• Merge (No auth) — Compares incoming data from the trigger with existing S3 objects. Uses removeKeyMatches mode, comparing the property name.value (from trigger) against Key.value (from S3 list). This filters out files already present in S3.
• AWS S3 – get (AWS Credentials) — Lists all objects in the S3 bucket mybucket using the getAll operation. This provides the reference list for the merge step.
• AWS S3 – upload (AWS Credentials) — Uploads files that are new or updated. The filename is taken from $json["name"]. Uploads to bucket mybucket with server-side encryption AES256 and a tag YOUR_CREDENTIAL_HERE: gdrive (you should replace the tag key with an actual value). Binary data is not enabled – you will need to adjust if file content is passed as binary.
• Error Handler (No auth) — A Stop and Error node that catches any workflow error and stops execution with a custom message.

Setup Instructions

1. Google Drive: Enable the Google Drive API in your Google Cloud Console, create OAuth2 credentials (Web application), and set up an n8n Google Drive OAuth2 credential. The trigger requires a folder ID – retrieve it from the folder’s URL (e.g., https://drive.google.com/drive/folders/abc123).
2. AWS S3: Create an IAM user with programmatic access (Access Key ID and Secret Access Key). Attach a policy granting s3:ListBucket, s3:PutObject, and s3:GetObject for the target bucket (mybucket). Create the bucket if it doesn’t exist.
3. Environment Variable: The trigger’s folderToWatch uses $env.WEBHOOK_URL. Define this variable in your n8n instance (e.g., as a placeholder or actual webhook URL). Alternatively, replace the expression with the folder ID directly.
4. Connect the nodes: The current workflow has no connections drawn – you must manually link: Google Drive Trigger → Merge (Input 1), AWS S3 – get → Merge (Input 2), Merge → AWS S3 – upload. Also connect the error output of any node to Error Handler.

Use Cases and Adaptations

• Automated backup: Replace the merge step with a conditional to always upload even if files exist.
• Cross-account sync: Change the S3 bucket to a different AWS account or region.
• File type filtering: Add a Filter node after the trigger to only process certain file extensions.
• Notifications: Insert a Slack or email node after successful upload.
• Two-way sync: Extend with a reverse trigger from S3 events to update Google Drive.

{
  "nodes": [
    {
      "name": "Google Drive Trigger",
      "type": "n8n-nodes-base.googleDriveTrigger",
      "position": [
        480,
        1480
      ],
      "parameters": {
        "event": "fileUpdated",
        "options": {},
        "triggerOn": "specificFolder",
        "folderToWatch": "{{ $env.WEBHOOK_URL }}[your_id]"
      },
      "credentials": {
        "googleDriveOAuth2Api": {
          "id": "{{ $credentials.googleDriveOAuth2Api.id }}",
          "name": "Google Drive account"
        }
      },
      "typeVersion": 1,
      "id": "0feb2324-889c-404d-9131-d63e8d0ba893",
      "notes": "This googleDriveTrigger node performs automated tasks as part of the workflow."
    },
    {
      "name": "Merge",
      "type": "n8n-nodes-base.merge",
      "position": [
        680,
        1560
      ],
      "parameters": {
        "mode": "removeKeyMatches",
        "propertyName1": "name.value",
        "propertyName2": "Key.value"
      },
      "typeVersion": 1,
      "id": "b163b0d1-ef02-49c2-a49b-75dfe4fd5923",
      "notes": "This merge node performs automated tasks as part of the workflow."
    },
    {
      "name": "AWS S3  - get",
      "type": "n8n-nodes-base.awsS3",
      "position": [
        480,
        1660
      ],
      "parameters": {
        "options": {},
// ... truncated (copy to see full JSON)