Port Compile API extensions from EOPA (#7887)

* server: port compile API

Also adds e2e tests: These include coverage for ucast in the prisma
setting, and thus require some JS runtime.

* e2e: selectively skip e2e Compile API tests

...for macos runs, and for the go-compat suites.

* server: accept timer_rego_external_resolve_ns metrics with value 0

When running the tests in a loop for a while, I would see values of 0ns
for this metric. However, comparing with its non-zero values, which are
often 41 or 42ns, it seems like this is just not happening in this code
path. So if "almost nothing" actually goes below 1ns, it's OK.

* e2e: split dep-heavy e2e tests into their own go module
* Makefile: export DOCKER_RUNNING (make e2e read it)

---------

Co-authored-by: Philip Conrad <[email protected]>
Signed-off-by: Stephan Renatus <[email protected]>

Author: srenatus

.github/dependabot.yml

@@ -13,6 +13,22 @@ updates:
           - "*"
         exclude-patterns:
           - "go.opentelemetry.io/*"
+  - package-ecosystem: gomod
+    directory: /e2e
+    schedule:
+      interval: monthly
+    groups:
+      all:
+        patterns:
+          - "*"
+  - package-ecosystem: npm
+    directory: /e2e/api/compile/prisma
+    schedule:
+      interval: monthly
+    groups:
+      e2e/prisma:
+        patterns:
+          - "*"
   - package-ecosystem: github-actions
     directory: /
     schedule:

.github/workflows/pull-request.yaml

@@ -224,6 +224,9 @@ jobs:
       with:
         go-version: ${{ steps.go_version.outputs.go_version }}
 
+    - name: Install Node
+      uses: actions/setup-node@a0853c24544627f65ddf259abe73b1d18a591444 # v5.0.0
+
     - name: Download generated artifacts
       uses: actions/download-artifact@634f93cb2916e3fdff6788551b99b062d0335ce0 # v5.0.0
       with:
@@ -233,6 +236,9 @@ jobs:
       run: make test-coverage
       timeout-minutes: 30
 
+    - name: E2E Test Golang
+      run: make e2e
+
   go-lint:
     name: Go Lint
     runs-on: ubuntu-24.04

Makefile

@@ -32,7 +32,7 @@ GOLANGCI_LINT_VERSION := v2.4.0
 YAML_LINT_VERSION := 0.29.0
 YAML_LINT_FORMAT ?= auto
 
-DOCKER_RUNNING ?= $(shell docker ps >/dev/null 2>&1 && echo 1 || echo 0)
+export DOCKER_RUNNING ?= $(shell docker ps >/dev/null 2>&1 && echo 1 || echo 0)
 
 # We use root because the windows build, invoked through the ci-go-build-windows
 # target, installs the gcc mingw32 cross-compiler.
@@ -117,6 +117,13 @@ install: generate
 .PHONY: test
 test: go-test wasm-test
 
+.PHONY: e2e e2e-prep
+e2e: e2e-prep
+	cd e2e/ && $(GO) test $(GO_TAGS) -v ./...
+
+e2e-prep:
+	cd e2e/api/compile/prisma && npm ci
+
 .PHONY: test-short
 test-short: go-test-short
 

e2e/README.md

@@ -0,0 +1,6 @@
+# github.com/open-policy-agent/opa/e2e
+
+This Go module is for end-to-end tests that come with dependencies we don't otherwise need for OPA, to avoid bloat in OPA's Go module's deps.
+
+> [!warning]
+> This module should never be imported from any of the other `github.com/open-policy-agent/opa/*` packages!