Add support for MIRROR_URL build attribute by pavannaregundi · Pull Request #24510 · sonic-net/sonic-buildimage

pavannaregundi · 2025-11-12T10:45:41Z

This change adds support for BUILD_PUBLIC_URL and BUILD_SNAPSHOT_URL as a build parameters to sonic-buildimage.

BUILD_SNAPSHOT_URL can be any mirror of https://snapshot.debian.org/archive or http://packages.trafficmanager.net/snapshot
BUILD_PUBLIC_URL can be any mirror of https://packages.trafficmanager.net/public
BUILD_PACKAGES_URL can be any mirror of https://packages.trafficmanager.net/packages

Why I did it

Download from packages.trafficmanager.net is flaky. Due to this there is a requirement to create local mirror for the same.
Current build options does not give option to set alternative mirror url.

Work item tracking

Microsoft ADO (number only):

How I did it

Introduced BUILD_PUBLIC_URL variable to replace all occurrences of https://packages.trafficmanager.net/public.
Introduced BUILD_SNAPSHOT_URL variable to replace all occurrences of http://packages.trafficmanager.net/snapshot
Since packages.trafficmanager.net appears in multiple places with both HTTP and HTTPS links. BUILD_SNAPSHOT_URL is retained with http by default.
Support for https BUILD_SNAPSHOT_URL is added for bookworm and trixie dockers.
The variable can be overridden by passing it as a build argument.

BUILD_PUBLIC_URL=https://packages.trafficmanager.net/public BUILD_SNAPSHOT_URL=http://packages.trafficmanager.net/snapshot SONIC_VERSION_CONTROL_COMPONENTS=py2,py3,web,git,docker MIRROR_SNAPSHOT=y make configure PLATFORM=marvell-teralynx
BUILD_PUBLIC_URL=https://packages.trafficmanager.net/public BUILD_SNAPSHOT_URL=http://packages.trafficmanager.net/snapshot SONIC_VERSION_CONTROL_COMPONENTS=py2,py3,web,git,docker MIRROR_SNAPSHOT=y make target/sonic-marvell-teralynx.bin

How to verify it

Changes are verified with alternative local mirror of packages.trafficmanager.net.

Which release branch to backport (provide reason below if selected)

Tested branch (Please provide the tested image version)

Description for the changelog

Link to config_db schema for YANG module changes

A picture of a cute animal (not mandatory but encouraged)

mssonicbld · 2025-11-12T10:45:48Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-12T10:46:02Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-13T03:34:02Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-13T03:34:14Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-13T09:32:14Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-13T09:32:27Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-22T04:00:32Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-22T04:00:39Z

Azure Pipelines will not run the associated pipelines, because the pull request was updated after the run command was issued. Review the pull request again and issue a new run command.

mssonicbld · 2025-11-22T04:05:46Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-22T04:05:53Z

Azure Pipelines will not run the associated pipelines, because the pull request was updated after the run command was issued. Review the pull request again and issue a new run command.

mssonicbld · 2025-11-28T04:12:29Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-28T04:12:40Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-28T04:26:22Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-28T04:26:33Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-28T04:53:37Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-28T04:53:49Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-28T07:17:53Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2025-11-28T07:18:07Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2025-11-28T07:21:57Z

/azp run Azure.sonic-buildimage

mssonicbld · 2026-02-13T06:57:31Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2026-02-13T06:57:44Z

Azure Pipelines successfully started running 1 pipeline(s).

yijingyan2 · 2026-02-13T07:57:22Z

src/lldpd/Makefile

@@ -5,7 +5,7 @@ SHELL = /bin/bash
 MAIN_TARGET = $(LLDPD)
 DERIVED_TARGETS = $(LIBLLDPCTL) $(LLDPD_DBG)

-LLDP_URL = https://packages.trafficmanager.net/public/debian/pool/main/l/lldpd
+LLDP_URL = $(MIRROR_URL)/public/debian/pool/main/l/lldpd


Should this also be renamed to PACKAGE_MIRROR_URL?

Thanks. Done.

mssonicbld · 2026-02-13T08:05:49Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2026-02-13T08:06:02Z

Azure Pipelines successfully started running 1 pipeline(s).

liushilongbuaa · 2026-02-13T09:47:30Z

rules/config

+DEBIAN_SNAP_MIRROR_URL ?= http://packages.trafficmanager.net/snapshot
+
+# PACKAGE_MIRROR_URL - Default package mirror url
+PACKAGE_MIRROR_URL ?= https://packages.trafficmanager.net


It's better to use https://packages.trafficmanager.net/public
The following 3 URL are not related. They can share the same domain or not.

http://packages.trafficmanager.net/snapshot (debian snapshot mirror) https://packages.trafficmanager.net/public (Microsoft backup some files to avoid web file change.) https://packages.trafficmanager.net/packages (Microsoft hosted to support reproducible build feature.)

Good to know.
Is the current name of PACKAGE_MIRROR_URL fine for "https://packages.trafficmanager.net/public"? Or Should we use PUBLIC_URL_PREFIX similar to PACKAGE_URL_PREFIX as it exists for "https://packages.trafficmanager.net/packages"?

BUILD_SNAPSHOT_URL
BUILD_PUBLIC_URL
BUILD_PACKGES_URL
How about these names. It shows that they are not feature related, just for build.

Sure. Will work on this change.

Pushed the changes. Please review

Signed-off-by: Pavan Naregundi <[email protected]>

mssonicbld · 2026-02-13T13:07:22Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2026-02-13T13:07:34Z

Azure Pipelines successfully started running 1 pipeline(s).

pavannaregundi · 2026-02-16T02:52:34Z

/azpw run Azure.sonic-buildimage

mssonicbld · 2026-02-16T02:52:37Z

/AzurePipelines run Azure.sonic-buildimage

azure-pipelines · 2026-02-16T02:52:48Z

Azure Pipelines successfully started running 1 pipeline(s).

radha-danda · 2026-02-16T16:42:47Z

/azpw run Azure.sonic-buildimage

mssonicbld · 2026-02-16T16:43:03Z

/AzurePipelines run Azure.sonic-buildimage

azure-pipelines · 2026-02-16T16:43:15Z

Azure Pipelines successfully started running 1 pipeline(s).

mssonicbld · 2026-02-19T01:00:45Z

/azp run Azure.sonic-buildimage

azure-pipelines · 2026-02-19T01:00:58Z

Azure Pipelines successfully started running 1 pipeline(s).

* Add support for MIRROR_URL build attribute This change adds support for MIRROR_URL as a build parameters to sonic-buildimage. MIRROR_URL can be mirror of https://packages.trafficmanager.net. Signed-off-by: Pavan Naregundi <[email protected]> * Separate Debian snapshot mirror URL from general mirror URL Signed-off-by: Pavan Naregundi <[email protected]> * Revert changes for older debians Signed-off-by: Pavan Naregundi <[email protected]> * Install ca-certificates in pre_run_buildinfo Signed-off-by: Pavan Naregundi <[email protected]> * Change sed delimiter to avoid escape characters Signed-off-by: Pavan Naregundi <[email protected]> * Simplify the certificates install by bypassing peer check Signed-off-by: Pavan Naregundi <[email protected]> * Pass https verify peer as an argument for apt Signed-off-by: Pavan Naregundi <[email protected]> * Add changes for docker-base-trixie Signed-off-by: Pavan Naregundi <[email protected]> * Rename to all URL to BUILD_<suffix>_URL Signed-off-by: Pavan Naregundi <[email protected]> --------- Signed-off-by: Pavan Naregundi <[email protected]> Co-authored-by: Lihua Yuan <[email protected]> Signed-off-by: Feng Pan <[email protected]>

* Add support for MIRROR_URL build attribute This change adds support for MIRROR_URL as a build parameters to sonic-buildimage. MIRROR_URL can be mirror of https://packages.trafficmanager.net. Signed-off-by: Pavan Naregundi <[email protected]> * Separate Debian snapshot mirror URL from general mirror URL Signed-off-by: Pavan Naregundi <[email protected]> * Revert changes for older debians Signed-off-by: Pavan Naregundi <[email protected]> * Install ca-certificates in pre_run_buildinfo Signed-off-by: Pavan Naregundi <[email protected]> * Change sed delimiter to avoid escape characters Signed-off-by: Pavan Naregundi <[email protected]> * Simplify the certificates install by bypassing peer check Signed-off-by: Pavan Naregundi <[email protected]> * Pass https verify peer as an argument for apt Signed-off-by: Pavan Naregundi <[email protected]> * Add changes for docker-base-trixie Signed-off-by: Pavan Naregundi <[email protected]> * Rename to all URL to BUILD_<suffix>_URL Signed-off-by: Pavan Naregundi <[email protected]> --------- Signed-off-by: Pavan Naregundi <[email protected]> Co-authored-by: Lihua Yuan <[email protected]> Signed-off-by: dprital <[email protected]>

pavannaregundi requested review from lguohan, qiluo-msft and xumia as code owners November 12, 2025 10:45

pavannaregundi marked this pull request as draft November 12, 2025 10:48

pavannaregundi force-pushed the mirror_url branch from 9a81c60 to d83f6e3 Compare November 13, 2025 03:33

pavannaregundi force-pushed the mirror_url branch from d83f6e3 to 88a3945 Compare November 13, 2025 09:32

pavannaregundi force-pushed the mirror_url branch from 88a3945 to f3342f8 Compare November 22, 2025 04:00

pavannaregundi force-pushed the mirror_url branch from f3342f8 to d1e4096 Compare November 22, 2025 04:05

pavannaregundi force-pushed the mirror_url branch from be643e5 to 9c4bd85 Compare November 28, 2025 04:26

pavannaregundi force-pushed the mirror_url branch 2 times, most recently from 9294279 to 0bfd53c Compare November 28, 2025 07:21

pavannaregundi dismissed yijingyan2’s stale review via 2933e58 February 13, 2026 06:57

pavannaregundi force-pushed the mirror_url branch from a8a6f31 to 2933e58 Compare February 13, 2026 06:57

yijingyan2 reviewed Feb 13, 2026

View reviewed changes

pavannaregundi force-pushed the mirror_url branch from 2933e58 to 8137059 Compare February 13, 2026 08:05

liushilongbuaa reviewed Feb 13, 2026

View reviewed changes

Rename to all URL to BUILD_<suffix>_URL

aa29cd2

Signed-off-by: Pavan Naregundi <[email protected]>

pavannaregundi force-pushed the mirror_url branch from 8137059 to aa29cd2 Compare February 13, 2026 13:07

pavannaregundi requested a review from liushilongbuaa February 17, 2026 06:33

Merge branch 'master' into mirror_url

5be14f4

lihuay approved these changes Feb 19, 2026

View reviewed changes

saiarcot895 approved these changes Feb 19, 2026

View reviewed changes

lihuay merged commit d444f1f into sonic-net:master Feb 24, 2026
26 checks passed

rustiqly mentioned this pull request Feb 24, 2026

[build-hooks] Fix wget cache skip for trafficmanager.net URLs #25505

Closed

Conversation

pavannaregundi commented Nov 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Why I did it

Work item tracking

How I did it

How to verify it

Which release branch to backport (provide reason below if selected)

Tested branch (Please provide the tested image version)

Description for the changelog

Link to config_db schema for YANG module changes

A picture of a cute animal (not mandatory but encouraged)

Uh oh!

mssonicbld commented Nov 12, 2025

Uh oh!

azure-pipelines bot commented Nov 12, 2025

Uh oh!

mssonicbld commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

mssonicbld commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

mssonicbld commented Nov 22, 2025

Uh oh!

azure-pipelines bot commented Nov 22, 2025

Uh oh!

mssonicbld commented Nov 22, 2025

Uh oh!

azure-pipelines bot commented Nov 22, 2025

Uh oh!

mssonicbld commented Nov 28, 2025

Uh oh!

azure-pipelines bot commented Nov 28, 2025

Uh oh!

mssonicbld commented Nov 28, 2025

Uh oh!

azure-pipelines bot commented Nov 28, 2025

Uh oh!

mssonicbld commented Nov 28, 2025

Uh oh!

azure-pipelines bot commented Nov 28, 2025

Uh oh!

mssonicbld commented Nov 28, 2025

Uh oh!

azure-pipelines bot commented Nov 28, 2025

Uh oh!

mssonicbld commented Nov 28, 2025

Uh oh!

mssonicbld commented Feb 13, 2026

Uh oh!

azure-pipelines bot commented Feb 13, 2026

Uh oh!

yijingyan2 Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

pavannaregundi Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

mssonicbld commented Feb 13, 2026

Uh oh!

azure-pipelines bot commented Feb 13, 2026

Uh oh!

liushilongbuaa Feb 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

pavannaregundi Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

liushilongbuaa Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

pavannaregundi Feb 13, 2026

Choose a reason for hiding this comment

Uh oh!

pavannaregundi Feb 13, 2026

Choose a reason for hiding this comment

pavannaregundi commented Nov 12, 2025 •

edited

Loading

liushilongbuaa Feb 13, 2026 •

edited

Loading