HBASE-28946 Update nightlies to run with HADOOP2_VERSION = 2.10.2 #6420

NihalJain · 2024-10-30T12:12:14Z

We are running nightlies with older hadoop2 and hence expected failures are not seen:

I see hadoop 2.10.0 installed for last nightly run, whereas our minimum supported version is 2.10.2

NihalJain · 2024-10-30T12:14:40Z

From Jira discussion HBASE-28946

I think we should also update the version in the POMs, not just the nightlies.
Also bump the minimum supported version in the docs.

Hi @stoty Verified hadoop version is already 2.10.2 in pom.xml. Also support matrix is up to date for hadoop2 at https://hbase.apache.org/book.html#hadoop

stoty · 2024-10-30T12:18:57Z

Nice.
I must have confused this with something.
Maybe the same old versions used for tests that you've found.

stoty · 2024-10-30T12:20:42Z

Let's wait with this until the Hadoop 3 test changes are backported everywhere.

Apache-HBase · 2024-10-30T12:22:36Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 49s		Docker mode activated.
-0 ⚠️	yetus	0m 5s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2 Compile Tests _
+0 🆗	mvndep	0m 10s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 4s		Maven dependency ordering for patch
			_ Other Tests _
		1m 59s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#6420
Optional Tests
uname	Linux 89168f2ae8c0 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `8ca7e34`
Max. process+thread count	29 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

NihalJain · 2024-10-30T12:22:51Z

Let's wait with this until the Hadoop 3 test changes are backported everywhere.

Sure

Apache-HBase · 2024-10-30T12:22:54Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 55s		Docker mode activated.
-0 ⚠️	yetus	0m 6s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2 Compile Tests _
+0 🆗	mvndep	0m 12s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 5s		Maven dependency ordering for patch
			_ Other Tests _
		2m 9s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR	#6420
Optional Tests
uname	Linux b8e56fcad205 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `8ca7e34`
Max. process+thread count	44 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-10-30T12:23:17Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 55s		Docker mode activated.
-0 ⚠️	yetus	0m 8s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2 Compile Tests _
+0 🆗	mvndep	0m 18s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 13s		Maven dependency ordering for patch
			_ Other Tests _
		2m 33s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#6420
Optional Tests
uname	Linux 7ec46c3ded42 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `8ca7e34`
Max. process+thread count	37 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-10-30T12:23:57Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 44s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ branch-2 Compile Tests _
+0 🆗	mvndep	0m 9s		Maven dependency ordering for branch
+1 💚	spotless	0m 43s		branch has no errors when running spotless:check.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 6s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	spotless	0m 40s		patch has no errors when running spotless:check.
			_ Other Tests _
+0 🆗	asflicense	0m 0s		ASF License check generated no output?
		3m 22s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#6420
Optional Tests	dupname asflicense codespell detsecrets shellcheck shelldocs spotless
uname	Linux a03fe34feedc 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `8ca7e34`
Max. process+thread count	45 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6420/1/console
versions	git=2.34.1 maven=3.9.8 shellcheck=0.8.0
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

stoty · 2024-10-30T15:07:19Z

Also, we have a unified Jenkinsfile for all branches (99%), so this should also be applied to master and branch-3, so that we do not accidentally revert this when backporting changes.

NihalJain · 2024-11-04T05:21:20Z

Also, we have a unified Jenkinsfile for all branches (99%), so this should also be applied to master and branch-3, so that we do not accidentally revert this when backporting changes.

Right have raise for master as well to keep everything in sync. #6419

NihalJain · 2024-11-04T05:21:38Z

Let's wait with this until the Hadoop 3 test changes are backported everywhere.

Hi @stoty Please let me know if we are good to go here!

stoty · 2024-11-04T08:17:02Z

You're good to go, @NihalJain .

HBASE-28946 Update nightlies to run with HADOOP2_VERSION = 2.10.2

8ca7e34

NihalJain added the backport This PR is a back port of some issue or issues already committed to master label Oct 30, 2024

Apache9 approved these changes Oct 30, 2024

View reviewed changes

NihalJain merged commit 50876f9 into apache:branch-2 Nov 6, 2024

HBASE-28946 Update nightlies to run with HADOOP2_VERSION = 2.10.2 #6420

HBASE-28946 Update nightlies to run with HADOOP2_VERSION = 2.10.2 #6420

Uh oh!

Conversation

NihalJain commented Oct 30, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

NihalJain commented Oct 30, 2024

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

NihalJain commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

NihalJain commented Nov 4, 2024

Uh oh!

NihalJain commented Nov 4, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

stoty commented Nov 4, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

NihalJain commented Oct 30, 2024 •

edited

Loading

NihalJain commented Nov 4, 2024 •

edited

Loading