Skip to main content

Configuration

FieldRequiredDescription
project_urlYesSupabase S3 endpoint URL
bucketYesStorage bucket name
pathsYesStorage object paths (supports glob patterns)
formatNoFile format: parquet, json, csv, or file
secret_nameYesReference to project secret with Supabase credentials

Setup Methods

  1. Click Connect with Supabase
  2. Authenticate with your Supabase account
  3. Select your project from the list
  4. Select the storage bucket
  5. Endpoint and credentials are automatically configured

Manual Setup

  1. Get your S3 endpoint URL from Supabase
  2. Create a project secret with your credentials
  3. Enter the endpoint URL and bucket name
  4. Select your secret

Endpoint URL Format

https://[project-ref].storage.supabase.co/storage/v1/s3
Replace [project-ref] with your Supabase project reference.

Credentials

Store your Supabase S3 credentials as a project secret:
{
  "access_key_id": "...",
  "secret_access_key": "..."
}
Find these credentials in Supabase Dashboard > Project Settings > S3 Access Keys.

Glob Pattern Support

Paths support standard glob patterns:
PatternDescription
*Matches any characters except /
?Matches any single character
[...]Matches any character in the brackets
**Matches any path segment

Example

import daft

def process_supabase_data(uploads: daft.DataFrame):
    """Process data from Supabase Storage."""
    return uploads.select("filename", "size").to_pydict()

File Formats

FormatExtensionDescription
Parquet.parquetColumnar format, best for analytics
JSON.jsonJSON files, one object per line (JSONL)
CSV.csvComma-separated values
FileAnyBinary files (images, PDFs, audio, video, etc.)