Limitations: It is suggested to use a consistent store with staging committers together.
from here.
Can you elaborate more about that? Isn't S3 has Strong Consistency?
From my AWS bills I see that we're doing a lot of ListBucket requests. I wonder if the default committer is responsible for that under the hood.
Do I have to use either EFS (for staging committer) or DynamoDB (for magic committer)?
Can you elaborate more about that? Isn't S3 has Strong Consistency?
From my AWS bills I see that we're doing a lot of
ListBucketrequests. I wonder if the default committer is responsible for that under the hood.Do I have to use either EFS (for staging committer) or DynamoDB (for magic committer)?