Implemented
13
Optimize uploads when using S3 object storage
Source: nextcloud/server#19414 · opened by @tcoupin
Is your feature request related to a problem? Please describe.
I use a private S3 as primary storage. When I upload a big file using webui or desktop sync client, this file is send by chunk. Each chunk is store on S3 and finaly nextcloud download all chunks, assemble them and upload the entire file to s3.
The webDAV steps:
• MKCOL request
• PUT request of 10 MBytes
• MOVE request to merge
Describe the solution you'd like
It would be great if the sending of each chunk could match an S3 multipart sending. So the final merge step would be useless and the upload more fast.
S3 steps corresponding to webdav steps:
• • • Describe alternatives you've considered
Pay beers to nextcloud developpers?
Additional context
no
I use a private S3 as primary storage. When I upload a big file using webui or desktop sync client, this file is send by chunk. Each chunk is store on S3 and finaly nextcloud download all chunks, assemble them and upload the entire file to s3.
The webDAV steps:
• MKCOL request
• PUT request of 10 MBytes
• MOVE request to merge
Describe the solution you'd like
It would be great if the sending of each chunk could match an S3 multipart sending. So the final merge step would be useless and the upload more fast.
S3 steps corresponding to webdav steps:
• • • Describe alternatives you've considered
Pay beers to nextcloud developpers?
Additional context
no
No pledges yet. Be the first to back this.
Comments
Similar requests
Admin tooling for local->object Primary Storage migrations
0 votes · 0 comments
RFC Direct downloads and uploads from S3 compatible storage and CDNs (chunking v3)
0 votes · 0 comments
Show details of object storage `Storage Location` column when used as primary storage
0 votes · 0 comments
Add support to custom user uploads dir
0 votes · 0 comments
File Locking and (S3) Object Storage or NFS (v3/v4)
2 votes · 0 comments
No comments yet.