Slow Upload Speed for S3 Managed Storage
Original Question or Issue:
Already tested uploading multiple files and am wondering why a single file upload could only reach 10MB/s, but if I upload 5 files, I've got 4-5 times the speed (S3 Managed Storage).
Environment:
- Product - FileCloud Server
- Version - Any
- Platform - Any
Steps to Reproduce:
Error or Log Message:
Slow upload process using S3 as Managed Storage Path
Defect or Enhancement Number:
Cause:
When uploading files to S3, there are two stages:
Stage 1: Client Machine -> FileCloud Server
Stage 2: FileCloud Server -> S3 Bucket.
Resolution or Workaround:
Adjusting the upload chunk size for both flags will significantly speed up the upload process.
TONIDOCLOUD_UPLOAD_CHUNK_SIZE_MB is used for chunked uploads browser -> FileCloud server (cloudconfig.php)
TONIDOCLOUD_S3_MULTIPART_CHUNKSIZE_IN_MB is used for the upload FileCloud server -> object storage (amazons3storageconfig.php)
Notes:
https://www.filecloud.com/supportdocs/fcdoc/latest/server/filecloud-administrator-guide/filecloud-site-setup/storage-settings/filecloud-managed-storage/setting-up-filecloud-managed-s3-storage