About DEFAULT_BUFFER_SIZE, DEFAULT_MIN_PART_SIZE #720

Unanswered

vincent-herlemont asked this question in Q&A

vincent-herlemont
Sep 7, 2022

I see here DEFAULT_BUFFER_SIZE is 128 Ko, and DEFAULT_MIN_PART_SIZE is 50 Mo.

That means that the smart_open read file with chunks of 16 Ko and wait to have 50 Mo of chunks to send it to S3?

So why DEFAULT_BUFFER_SIZE != DEFAULT_MIN_PART_SIZE ?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment