feat: Add image for OpenSearch Dashboards (#1248)

* add image for OpenSearch Dashboards including the securityDashboards plugin

* add changelog entry

* add boil config for opensearch-dashboards

* fix build args for boil

* wip: add sbom generation with cdxgen

* remove debug code from Dockerfile

* address feedback on PR

* fix vector image tag

* address feedback on PR & download nodejs as tar.gz instead of tar.xz

* fix update-readme-badges

* download node from stackable mirror

* add opensearch-dashboardsto various lists

* wip: opensearch-dashboards plugins

* fix(opensearch-dashboards): Fix the version arguments

* fix(opensearch-dashboards): Fix the installation of the plugins

* fix whitespace errors

* add comment on tar usage

* update issue template to use boil instead of bake

* fix hadolint

* remove unused copy instruction

* update bake reference in workflow

* fix boil syntax

* remove unnecessary grep

---------

Co-authored-by: Siegfried Weber <[email protected]>

Author: labrenbe

.github/ISSUE_TEMPLATE/early-pre-release.md

@@ -56,6 +56,7 @@ Part of <https://github.com/stackabletech/issues/issues/xxx>.
 - [ ] [Create issue from template: update-product-nifi.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-nifi.md)
 - [ ] [Create issue from template: update-product-opa.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-opa.md)
 - [ ] [Create issue from template: update-product-opensearch.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-opensearch.md)
+- [ ] [Create issue from template: update-product-opensearch-dashboards.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-opensearch-dashboards.md)
 - [ ] [Create issue from template: update-product-spark.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-spark.md)
 - [ ] [Create issue from template: update-product-superset.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-superset.md)
 - [ ] [Create issue from template: update-product-trino.md](https://github.com/stackabletech/docker-images/issues/new?template=update-product-trino.md)

.github/ISSUE_TEMPLATE/update-product-opensearch-dashboards.md

@@ -0,0 +1,76 @@
+---
+name: Update OpenSearch Dashboards
+about: >-
+  This template contains instructions specific to updating this product and/or
+  container image(s).
+title: >-
+  chore(opensearch-dashboards): Update major/minor|patch versions for YY.M.X
+labels: []
+# Currently, projects cannot be assigned via front-matter.
+projects: ['stackabletech/10']
+assignees: ''
+---
+
+Part of <https://github.com/stackabletech/docker-images/issues/xxx>.
+
+<!--
+This gives hints to the person doing the work.
+Add/Change/Remove anything that isn't applicable anymore
+-->
+- Add: `x.x.x`
+- Remove: `y.y.y`
+
+> [!TIP]
+> Please add the `scheduled-for/YY.M.X` label, and add to the [Stackable Engineering][1] project.
+>
+> [1]: https://github.com/orgs/stackabletech/projects/10
+
+## Update tasks
+
+- [ ] Update `boil-config.toml` to reflect the agreed upon versions in the spreadsheet (including the removal of old versions).
+- [ ] Update other dependencies if applicable (eg: security-plugin, etc).
+- [ ] Check other operators (getting_started / kuttl / supported-versions) for usage of the versions. Add the PR(s) to the list below.
+- [ ] Update the version in demos. Add the PR(s) to the list below.
+
+## Related Pull Requests
+
+> [!TIP]
+> Delete any items that do not apply so that all applicable items can be checked.
+> For example, if you add release notes to the documentation repository, you do not need the latter two criteria.
+
+- _Link to the docker-images PR (product update)_
+- _Link to the operator PR (getting_started / kuttl / supported-versions)_
+- _Link to any other operator PRs (getting_started / kuttl)_
+- _Link to demo PR (raise against the `main` branch)_
+- _Link to the Release Notes PR in the documentation repo (if not a comment below)_
+
+## Acceptance
+
+> [!TIP]
+> This list should be completed by the assignee(s), once respective PRs have been merged. Once all items have been
+> checked, the issue can be moved into _Development: Done_.
+
+- [ ] Can build image (either locally, or in CI)
+- [ ] Kuttl smoke tests passes (either locally, or in CI)
+- [ ] Release notes added to documentation and linked as a PR above
+- [ ] Release notes written in a comment below
+- [ ] Applicable `release-note` label added to this issue
+
+<details>
+<summary>Testing instructions</summary>
+
+```shell
+# Where x.y.z is the new version added in this PR
+boil build opensearch-dashboards=x.y.z --strip-architecture --load
+
+kind load docker-image oci.stackable.tech/sdp/opensearch-dashboards:x.y.z-stackable0.0.0-dev
+
+# Change directory into the opensearch repository and update the
+# product version in tests/test-definition.yaml (once there is an integration test for opensearch-dashboards)
+./scripts/run-tests --test-suite smoke-latest # or similar
+```
+
+</details>
+
+_Please consider updating this template if these instructions are wrong, or
+could be made clearer._

.github/workflows/build_opensearch_dashboards.yaml

@@ -0,0 +1,36 @@
+---
+name: Build OpenSearch Dashboards
+run-name: |
+  Build OpenSearch Dashboards (attempt #${{ github.run_attempt }})
+
+on:
+  workflow_dispatch:
+  schedule:
+    - cron: '0 0 2/2 * *' # https://crontab.guru/#0_0_2/2_*_*
+  push:
+    branches: [main]
+    tags:
+      - "[0-9][0-9].[0-9]+.[0-9]+"
+      - "[0-9][0-9].[0-9]+.[0-9]+-rc[0-9]+"
+    paths:
+      # To check dependencies, run this ( you will need to consider transitive dependencies)
+      # cargo boil build PRODUCT -d
+      - opensearch-dashboards/**
+      - vector/**
+      - stackable-base/**
+      - stackable-devel/**
+      - .github/actions/**
+      - .github/workflows/build_opensearch_dashboards.yaml
+      - .github/workflows/reusable_build_image.yaml
+
+jobs:
+  build_image:
+    name: Reusable Workflow
+    uses: ./.github/workflows/reusable_build_image.yaml
+    secrets:
+      harbor-robot-secret: ${{ secrets.HARBOR_ROBOT_SDP_GITHUB_ACTION_BUILD_SECRET }}
+      slack-token: ${{ secrets.SLACK_CONTAINER_IMAGE_TOKEN }}
+    with:
+      product-name: opensearch-dashboards
+      sdp-version: ${{ github.ref_type == 'tag' && github.ref_name || '0.0.0-dev' }}
+      registry-namespace: sdp

.github/workflows/preflight.yaml

@@ -67,6 +67,7 @@ jobs:
           - omid
           - opa
           - opensearch
+          - opensearch-dashboards
           - spark-k8s
           - superset
           - trino

.scripts/update_feature_tracker_db.sh

@@ -34,6 +34,7 @@ PRODUCT_CODE_NAMES=(
   kafka
   nifi
   opensearch
+  opensearch-dashboards
   spark-k8s
   superset
   trino

CHANGELOG.md

@@ -11,6 +11,7 @@ All notable changes to this project will be documented in this file.
 - opensearch: Use build-repo.stackable.tech instead of Maven Central ([#1222]).
 - opensearch: Add the `opensearch-prometheus-exporter` plugin to the image ([#1223]).
 - opensearch: Replace the demo configuration of the OpenSearch Security plugin with a minimal one ([#1228]).
+- opensearch-dashboards: Add an image for Opensearch Dashboards with version `3.1.0` ([#1248]).
 - nifi: Backport NIFI-14848 to NiFi ([#1225]).
 - stackable-base: Add cert-tools ([#1247]).
 - kafka: Add jackson xml dataformat for Kafka 4.0.0 ([#1262]).
@@ -68,6 +69,7 @@ All notable changes to this project will be documented in this file.
 [#1228]: https://github.com/stackabletech/docker-images/pull/1228
 [#1230]: https://github.com/stackabletech/docker-images/pull/1230
 [#1247]: https://github.com/stackabletech/docker-images/pull/1247
+[#1248]: https://github.com/stackabletech/docker-images/pull/1248
 [#1253]: https://github.com/stackabletech/docker-images/pull/1253
 [#1258]: https://github.com/stackabletech/docker-images/pull/1258
 [#1262]: https://github.com/stackabletech/docker-images/pull/1262

README.md

@@ -8,9 +8,10 @@ This repository contains Dockerfiles and scripts to build base images for use wi
 | [![Build Airflow]][build_airflow.yaml] | [![Build Druid]][build_druid.yaml] | [![Build Hadoop]][build_hadoop.yaml] | [![Build HBase]][build_hbase.yaml] |
 | [![Build Hive]][build_hive.yaml] | [![Build Java Base]][build_java-base.yaml] | [![Build Java Development]][build_java-devel.yaml] | [![Build Kafka Testing Tools]][build_kafka-testing-tools.yaml] |
 | [![Build Kafka]][build_kafka.yaml] | [![Build Krb5]][build_krb5.yaml] | [![Build NiFi]][build_nifi.yaml] | [![Build Omid]][build_omid.yaml] |
-| [![Build OPA]][build_opa.yaml] | [![Build OpenSearch]][build_opensearch.yaml] | [![Build Spark Connect Client]][build_spark-connect-client.yaml] | [![Build Spark K8s]][build_spark-k8s.yaml] |
-| [![Build Stackable Base]][build_stackable-base.yaml] | [![Build Superset]][build_superset.yaml] | [![Build Testing Tools]][build_testing-tools.yaml] | [![Build Tools]][build_tools.yaml] |
-| [![Build Trino CLI]][build_trino-cli.yaml] | [![Build Trino]][build_trino.yaml] | [![Build Vector]][build_vector.yaml] | [![Build ZooKeeper]][build_zookeeper.yaml] |
+| [![Build OPA]][build_opa.yaml] | [![Build OpenSearch]][build_opensearch.yaml] | [![Build OpenSearch Dashboards]][build_opensearch_dashboards.yaml] | [![Build Spark Connect Client]][build_spark-connect-client.yaml] |
+| [![Build Spark K8s]][build_spark-k8s.yaml] | [![Build Stackable Base]][build_stackable-base.yaml] | [![Build Superset]][build_superset.yaml] | [![Build Testing Tools]][build_testing-tools.yaml] |
+| [![Build Tools]][build_tools.yaml] | [![Build Trino CLI]][build_trino-cli.yaml] | [![Build Trino]][build_trino.yaml] | [![Build Vector]][build_vector.yaml] |
+| [![Build ZooKeeper]][build_zookeeper.yaml] | | | |
 <!-- end:badges -->
 
 ## Prerequisites
@@ -79,6 +80,8 @@ preflight check container oci.stackable.tech/sdp/<IMAGE>:<VERSION>-stackable<REL
 [build_opa.yaml]: https://github.com/stackabletech/docker-images/actions/workflows/build_opa.yaml
 [Build OpenSearch]: https://github.com/stackabletech/docker-images/actions/workflows/build_opensearch.yaml/badge.svg
 [build_opensearch.yaml]: https://github.com/stackabletech/docker-images/actions/workflows/build_opensearch.yaml
+[Build OpenSearch Dashboards]: https://github.com/stackabletech/docker-images/actions/workflows/build_opensearch_dashboards.yaml/badge.svg
+[build_opensearch_dashboards.yaml]: https://github.com/stackabletech/docker-images/actions/workflows/build_opensearch_dashboards.yaml
 [Build Spark Connect Client]: https://github.com/stackabletech/docker-images/actions/workflows/build_spark-connect-client.yaml/badge.svg
 [build_spark-connect-client.yaml]: https://github.com/stackabletech/docker-images/actions/workflows/build_spark-connect-client.yaml
 [Build Spark K8s]: https://github.com/stackabletech/docker-images/actions/workflows/build_spark-k8s.yaml/badge.svg