Skip to content

HADOOP-18366. Fix ITestS3Select.testSelectSeekFullLandsat is timing out. #4702

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
steveloughran merged 2 commits into from
Aug 5, 2022
Merged

HADOOP-18366. Fix ITestS3Select.testSelectSeekFullLandsat is timing out. #4702

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c2aad16
reduces size of data read
ahmarsuhail Aug 4, 2022
b9ae5d3
fixes eol error
ahmarsuhail Aug 5, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 1 addition & 6 deletions ...-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/select/ITestS3SelectLandsat.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -415,19 +415,14 @@ public void testSelectSeekFullLandsat() throws Throwable {
long increment = 64 * _1KB;

// seek forward, comparing bytes
for(offset = 32 * _1KB; offset < actualLen; offset += increment) {
for(offset = 32 * _1KB; offset < _1MB; offset += increment) {
seek(seekStream, offset);
assertEquals("Seek position in " + seekStream,
offset, seekStream.getPos());
// now do a read and compare values
assertEquals("byte at seek position",
dataset[(int) seekStream.getPos()], seekStream.read());
}
for(; offset < len; offset += _1MB) {
seek(seekStream, offset);
assertEquals("Seek position in " + seekStream,
offset, seekStream.getPos());
}
// there's no knowledge of how much data is left, but with Gzip
// involved there can be a lot. To keep the test duration down,
// this test, unlike the simpler one, doesn't try to read past the
Expand Down