Skip to content

Conversation

@wayfarer3130
Copy link
Collaborator

This PR changes the upload to upload in parallel.

Copy link
Collaborator

@rodrigobasilio2022 rodrigobasilio2022 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested and create a new distribution and worked very fast

image

@rodrigobasilio2022
Copy link
Collaborator

@wayfarer3130 I approved the code, but I noticed to problems:

  • a bug in the update of the index at the end of the process
  • a delay after the process was finished

I fixed both but I want you to look

@rodrigobasilio2022
Copy link
Collaborator

client upload

image

images upload

@wayfarer3130 wayfarer3130 merged commit 9425cf6 into master Feb 14, 2025
@wayfarer3130 wayfarer3130 deleted the feat/fast-s3-upload branch February 14, 2025 12:38
wayfarer3130 added a commit that referenced this pull request Mar 3, 2025
* upload files in parallel

* Fix index update in deploy

* Fix node hangs after upload

* Add progress bar in processing images

---------

Co-authored-by: rodrigobasilio2022 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants