Uploading large files

Upload files over 64 MiB with multipart uploads: the part size to use and the settings for the aws CLI, boto3, the JavaScript SDK, and rclone.

One request to Graphon can carry at most 200 MiB. For a file over 64 MiB, use a multipart upload with 16 MiB parts. Parts upload in parallel, and a failed part is the only thing sent again. The CLI and the web app do this for you. Set your S3 tool to do the same.

Configure your client

First configure your client with the workspace endpoint and path-style addressing. See S3 compatibility or the S3 API reference. The Python and JavaScript examples below use that configured s3 client.

Set the multipart size

aws CLI

aws configure set default.s3.multipart_threshold 64MB
aws configure set default.s3.multipart_chunksize 16MB

boto3

from boto3.s3.transfer import TransferConfig

config = TransferConfig(multipart_threshold=64 * 1024 * 1024, multipart_chunksize=16 * 1024 * 1024)
s3.upload_file("backup.tar", "support-tickets", "backups/2026-09.tar", Config=config)

AWS SDK for JavaScript

import { Upload } from '@aws-sdk/lib-storage';

await new Upload({
  client: s3,
  params: { Bucket: 'support-tickets', Key: 'backups/2026-09.tar', Body: stream },
  partSize: 16 * 1024 * 1024,
  queueSize: 4,
}).done();

rclone

rclone copy ./backup.tar graphon:support-tickets/backups \
  --s3-upload-cutoff 64M --s3-chunk-size 16M

Was this page helpful?

View as Markdown