-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Description
Is it platform specific
generic
Importance or Severity
Critical
Description of the bug
PYTHON traceback (error ? warning) on the AMD64 "sonic-installer install NewVer"
NewVer is built on branch HASH
4c84167 - 2026-03-05, yijingyan2 : [build] Use locally built libnetsnmptrapd40 and libsnmp-dev. (#25370)
The problem has NOT been seen on the build
56b54e2 - 2026-02-22, mssonicbld : [submodule] Update submodule sonic-linux-kernel to the latest HEAD automatically (#25610)
=================================================================
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs sonic-package-manager migrate /tmp/packages.json --dockerd-socket /tmp/docker.sock -y
Traceback (most recent call last):
File "/usr/local/lib/python3.13/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
conn,
...<10 lines>...
**response_kw,
)
File "/usr/local/lib/python3.13/dist-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
~~~~~~~~~~~~^
method,
^^^^^^^
...<6 lines>...
enforce_content_length=enforce_content_length,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/usr/local/lib/python3.13/dist-packages/urllib3/connection.py", line 500, in request
self.endheaders()
~~~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/http/client.py", line 1333, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/http/client.py", line 1093, in _send_output
self.send(msg)
~~~~~~~~~^^^^^
File "/usr/lib/python3.13/http/client.py", line 1037, in send
self.connect()
~~~~~~~~~~~~^^
File "/usr/local/lib/python3.13/dist-packages/docker/transport/unixconn.py", line 26, in connect
sock.connect(self.unix_socket)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory
Steps to Reproduce
Build AMD64 version on top of
4c84167 - 2026-03-05, yijingyan2 : [build] Use locally built libnetsnmptrapd40 and libsnmp-dev. (#25370)
sonic-installer install NewVersion
Check prints on the console
Actual Behavior and Expected Behavior
Actual: installation passed with Python errors
Excpected: clean installation
Relevant log output
root@sonic:/host/yanm# sonic-installer install http://10.2.141.103:8080/s-artifacts/amd64/master/ABP-master-05-03-2026_17-34/sonic-marvell-prestera.bin
New image will be installed, continue? [y/N]: y
Downloading image...
...98%, 849 MB, 108716 KB/s, 0 seconds left...
secure boot not enabled - exiting without image verification
Installing image SONiC-OS-master.0-dirty-20260305.223816 and setting it as default...
Command: bash /tmp/sonic_image
Verifying image checksum ... OK.
mount: (hint) your fstab has been modified, but systemd still uses
the old version; use 'systemctl daemon-reload' to reload.
Preparing image archive ... OK.
Installing SONiC in SONiC
ONIE Installer: platform: x86_64-marvell-prestera-r0
onie_platform: x86_64-marvell_db98cx8514_10cc-r0
Removing old SONiC installation /host/image-master.0-dirty-20260212.231237
Installing SONiC to /host/image-master.0-dirty-20260305.223816
Archive: fs.zip
creating: /host/image-master.0-dirty-20260305.223816/boot/
inflating: /host/image-master.0-dirty-20260305.223816/boot/System.map-6.12.41+deb13-sonic-amd64
inflating: /host/image-master.0-dirty-20260305.223816/boot/config-6.12.41+deb13-sonic-amd64
inflating: /host/image-master.0-dirty-20260305.223816/boot/vmlinuz-6.12.41+deb13-sonic-amd64
inflating: /host/image-master.0-dirty-20260305.223816/boot/initrd.img-6.12.41+deb13-sonic-amd64
extracting: /host/image-master.0-dirty-20260305.223816/fs.squashfs
ONIE_IMAGE_PART_SIZE=32768
EXTRA_CMDLINE_LINUX=
Switch CPU vendor is: GenuineIntel
Switch CPU cstates are: disabled
cp /tmp/tmp.e22eGEBiLO /boot/efi/EFI/debian/grub.cfg
EXTRA_CMDLINE_LINUX=
Installed SONiC base image SONiC-OS successfully
Command: grub-set-default --boot-directory=/host 0
Command: config-setup backup
Taking backup of current configuration
Command: mkdir -p /tmp/image-master.0-dirty-20260305.223816-fs
Command: mount -t squashfs /host/image-master.0-dirty-20260305.223816/fs.squashfs /tmp/image-master.0-dirty-20260305.223816-fs
Command: sonic-cfggen -d -y /tmp/image-master.0-dirty-20260305.223816-fs/etc/sonic/sonic_version.yml -t /tmp/image-master.0-dirty-20260305.223816-fs/usr/share/sonic/templates/sonic-environment.j2
Command: umount -r -f /tmp/image-master.0-dirty-20260305.223816-fs
Command: rm -rf /tmp/image-master.0-dirty-20260305.223816-fs
Command: mkdir -p /tmp/image-master.0-dirty-20260305.223816-fs
Command: mount -t squashfs /host/image-master.0-dirty-20260305.223816/fs.squashfs /tmp/image-master.0-dirty-20260305.223816-fs
Command: mkdir -p /host/image-master.0-dirty-20260305.223816/rw
Command: mkdir -p /host/image-master.0-dirty-20260305.223816/work
Command: mkdir -p /tmp/image-master.0-dirty-20260305.223816-fs
Command: mount overlay -t overlay -o rw,relatime,lowerdir=/tmp/image-master.0-dirty-20260305.223816-fs,upperdir=/host/image-master.0-dirty-20260305.223816/rw,workdir=/host/image-master.0-dirty-20260305.223816/work /tmp/image-master.0-dirty-20260305.223816-fs
Command: mkdir -p /tmp/image-master.0-dirty-20260305.223816-fs/var/lib/docker
Command: mount --bind /host/image-master.0-dirty-20260305.223816/docker /tmp/image-master.0-dirty-20260305.223816-fs/var/lib/docker
Command sync ... could take several seconds on slow or removable disk
Command: sync
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs mount proc /proc -t proc
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs mount sysfs /sys -t sysfs
Command: cp /tmp/image-master.0-dirty-20260305.223816-fs/etc/default/docker /tmp/image-master.0-dirty-20260305.223816-fs/tmp/docker_config_backup
Command: sh -c echo 'DOCKER_OPTS="$DOCKER_OPTS -H fd:// --storage-driver=overlay2 --bip=240.127.1.1/24 --iptables=false --ipv6=true --fixed-cidr-v6=fd00::/80 "' >> /tmp/image-master.0-dirty-20260305.223816-fs/etc/default/docker
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs /usr/lib/docker/docker.sh start
Command: cp /var/lib/sonic-package-manager/packages.json /tmp/image-master.0-dirty-20260305.223816-fs/tmp/packages.json
Command: mkdir -p /var/lib/sonic-package-manager/manifests
Command: cp -arf /var/lib/sonic-package-manager/manifests /tmp/image-master.0-dirty-20260305.223816-fs/var/lib/sonic-package-manager
Command: touch /tmp/image-master.0-dirty-20260305.223816-fs/tmp/docker.sock
Command: mount --bind /var/run/docker.sock /tmp/image-master.0-dirty-20260305.223816-fs/tmp/docker.sock
Command: cp /tmp/image-master.0-dirty-20260305.223816-fs/etc/resolv.conf /tmp/resolv.conf.backup
Command: cp /etc/resolv.conf /tmp/image-master.0-dirty-20260305.223816-fs/etc/resolv.conf
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs sh -c command -v sonic-package-manager
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs sonic-package-manager migrate /tmp/packages.json --dockerd-socket /tmp/docker.sock -y
Traceback (most recent call last):
File "/usr/local/lib/python3.13/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
conn,
...<10 lines>...
**response_kw,
)
File "/usr/local/lib/python3.13/dist-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
~~~~~~~~~~~~^
method,
^^^^^^^
...<6 lines>...
enforce_content_length=enforce_content_length,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/usr/local/lib/python3.13/dist-packages/urllib3/connection.py", line 500, in request
self.endheaders()
~~~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/http/client.py", line 1333, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/http/client.py", line 1093, in _send_output
self.send(msg)
~~~~~~~~~^^^^^
File "/usr/lib/python3.13/http/client.py", line 1037, in send
self.connect()
~~~~~~~~~~~~^^
File "/usr/local/lib/python3.13/dist-packages/docker/transport/unixconn.py", line 26, in connect
sock.connect(self.unix_socket)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory
During handling of the above exception, another exception occurred:
.....................
During handling of the above exception, another exception occurred:
.....................................
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
Command: chroot /tmp/image-master.0-dirty-20260305.223816-fs /usr/lib/docker/docker.sh stop
start-stop-daemon: warning: failed to kill 3462733: No such process
Command: mv /tmp/image-master.0-dirty-20260305.223816-fs/tmp/docker_config_backup /tmp/image-master.0-dirty-20260305.223816-fs/etc/default/docker
Command: cp /tmp/resolv.conf.backup /tmp/image-master.0-dirty-20260305.223816-fs/etc/resolv.conf
Command: umount -f -R /tmp/image-master.0-dirty-20260305.223816-fs
Command: umount -r -f /tmp/image-master.0-dirty-20260305.223816-fs
umount: /tmp/image-master.0-dirty-20260305.223816-fs: not mounted.
Command: rm -rf /tmp/image-master.0-dirty-20260305.223816-fs
Traceback (most recent call last):
File "/usr/local/bin/sonic-installer", line 8, in <module>
sys.exit(sonic_installer())
~~~~~~~~~~~~~~~^^
File "/usr/lib/python3/dist-packages/click/core.py", line 1161, in __call__
return self.main(*args, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/click/core.py", line 1082, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1697, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
File "/usr/lib/python3/dist-packages/click/core.py", line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/click/core.py", line 788, in invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.13/dist-packages/sonic_installer/main.py", line 626, in install
migrate_sonic_packages(bootloader, binary_image_version)
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.13/dist-packages/sonic_installer/main.py", line 395, in migrate_sonic_packages
run_command_or_raise(["chroot", new_image_mount, SONIC_PACKAGE_MANAGER, "migrate",
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
os.path.join("/", TMP_DIR, packages_file),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
"--dockerd-socket", os.path.join("/", TMP_DIR, DOCKERD_SOCK),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
"-y"], capture=False)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.13/dist-packages/sonic_installer/common.py", line 57, in run_command_or_raise
raise sre
sonic_installer.exception.SonicRuntimeException: Failed to run command '['chroot', '/tmp/image-master.0-dirty-20260305.223816-fs', 'sonic-package-manager', 'migrate', '/tmp/packages.json', '--dockerd-socket', '/tmp/docker.sock', '-y']'Output of show version, show techsupport
-