Support for ARM (dotnet core support ARM32 today)

[bbusacker]

Arm64 support is now available at the tip of the .Net Core libraries and I'm seeing some of its support trickling into vsts-agent. Do you know if building vsts-agent has been tested yet on arm64 systems running ubuntu and whether or not it should work? If not, do you know if you plan on supporting this platform in the future? And if you are when that would be. If not, could you give me some pointers on what it would take to get the library building? I can get the .NET core library downloaded an installed for the build but I'm not sure if there are a bunch of nuget packages that are also needed that would need to also be rebuilt for arm64. Just let me know. I have an arm64 system running Ubuntu 16.04 that I would like to run the build agent on.

[TingluoHuang]

@bbusacker we don't support Linux arm64 yet, and i don't know the timeline to support it.
I made up a user branch which should create the agent package that runnable in linux-arm64.
https://github.com/Microsoft/vsts-agent/tree/users/tihuang/linuxarm64
You can follow the instruction here to build the agent package.

@chrisrpatterson FYI,

[bryanmacfarlane]

we've talked about it. marking as enhancement for consideration

[jkleinsc]

@TingluoHuang I need an arm64 build agent so I checked out your branch, but it seems like there isn't a built version .net sdk for arm64:

-----------------------------------------
Ensure Dotnet SDK
-----------------------------------------
Download dotnetsdk into /root/vsts-agent/src/../_dotnetsdk/2.0.3
dotnet-install: Downloading link: https://dotnetcli.azureedge.net/dotnet/Sdk/2.0.3/dotnet-sdk-2.0.3-linux-arm64.tar.gz
curl: (22) The requested URL returned error: 404 Not Found
dotnet-install: Cannot download: https://dotnetcli.azureedge.net/dotnet/Sdk/2.0.3/dotnet-sdk-2.0.3-linux-arm64.tar.gz
dotnet-install: Downloading legacy link: https://dotnetcli.azureedge.net/dotnet/Sdk/2.0.3/dotnet-dev-ubuntu.16.04-arm64.2.0.3.tar.gz
curl: (22) The requested URL returned error: 404 Not Found
dotnet_install: Error: Could not download .NET Core SDK version 2.0.3
Failed: dotnet-install.sh Failed with return code 1

Any pointers on getting this working? Is there an alternate download for the SDK?

[TingluoHuang]

@jkleinsc i tweak the script a little bit, try git pull that branch and try run dev.sh layout again.

[TylerLeonhardt]

@TingluoHuang I'm hitting this issue:

Configuring...
-------------------
A command is running to initially populate your local package cache, to improve restore speed and enable offline access. This command will take up to a minute to complete and will only happen once.
Decompressing 100% 10497 ms
Expanding 100% 20798 ms
Microsoft (R) Build Engine version 15.6.82.30579 for .NET Core
Copyright (C) Microsoft Corporation. All rights reserved.

  2cbcf4bac192d1da6155331a99c128add035972b
  Building 2cbcf4bac192d1da6155331a99c128add035972b --- linux-arm64
  Microsoft (R) Build Engine version 15.6.82.30579 for .NET Core
  Copyright (C) Microsoft Corporation. All rights reserved.

    Restoring packages for /Users/tylerleonhardt/Downloads/vsts-agent/src/Microsoft.VisualStudio.Services.Agent/Microsoft.VisualStudio.Services.Agent.csproj...
    Installing Microsoft.IdentityModel.Logging 1.1.5.
    Installing Microsoft.IdentityModel.Tokens 5.1.5.
    Installing Microsoft.Bcl 1.1.9.
    Installing System.IdentityModel.Tokens.Jwt 5.1.5.
    Installing Microsoft.Net.Http 2.2.22.
    Installing System.ComponentModel.Annotations 4.4.1.
    Installing YamlDotNet.Signed 4.2.1.
    Installing System.Threading.Tasks.Dataflow 4.8.0.
    Installing Microsoft.IdentityModel.Clients.ActiveDirectory 3.17.2.
    Installing System.Security.Cryptography.OpenSsl 4.4.0.
    Installing System.Security.Cryptography.ProtectedData 4.4.0.
    Installing HtmlAgilityPack 1.6.5.
    Installing Microsoft.AspNet.WebApi.Client 5.2.3.
    Installing System.Configuration.ConfigurationManager 4.4.1.
    Installing vss-api-netcore 0.5.61-private.
    Generating MSBuild file /Users/tylerleonhardt/Downloads/vsts-agent/src/Microsoft.VisualStudio.Services.Agent/obj/Microsoft.VisualStudio.Services.Agent.csproj.nuget.g.props.
    Generating MSBuild file /Users/tylerleonhardt/Downloads/vsts-agent/src/Microsoft.VisualStudio.Services.Agent/obj/Microsoft.VisualStudio.Services.Agent.csproj.nuget.g.targets.
    Restore completed in 11.97 sec for /Users/tylerleonhardt/Downloads/vsts-agent/src/Microsoft.VisualStudio.Services.Agent/Microsoft.VisualStudio.Services.Agent.csproj.
/Users/tylerleonhardt/.nuget/packages/microsoft.netcore.app/2.0.0/build/netcoreapp2.0/Microsoft.NETCore.App.targets(19,5): error : Project is targeting runtime 'linux-arm64' but did not resolve any runtime-specific packages for the 'Microsoft.NETCore.App' package.  This runtime may not be supported by .NET Core. [/Users/tylerleonhardt/Downloads/vsts-agent/src/Microsoft.VisualStudio.Services.Agent/Microsoft.VisualStudio.Services.Agent.csproj] [/Users/tylerleonhardt/Downloads/vsts-agent/src/dir.proj]
/Users/tylerleonhardt/Downloads/vsts-agent/src/dir.proj(34,5): error MSB3073: The command "dotnet publish Microsoft.VisualStudio.Services.Agent/Microsoft.VisualStudio.Services.Agent.csproj --output "/Users/tylerleonhardt/Downloads/vsts-agent/src/../_layout/bin" --runtime linux-arm64 -c Debug" exited with code 1.
Failed: build

on macOS & Ubuntu.

On Windows it fails before that:

-----------------------------------------
Ensure Dotnet SDK
-----------------------------------------
Download dotnetsdk into /e/projects/vsts-agent/src/../_dotnetsdk/2.0.3
dotnet_install: Error: OS name could not be detected: UName = MINGW64_NT-10.0
Failed: dotnet-install.sh Failed with return code 1
/e/projects/vsts-agent/src

And then on my raspberry pi running Raspbian Stretch:

pi@raspberrypi:~/Desktop/vsts-agent/src $ ./dev.sh l
~/Desktop/vsts-agent/src ~/Desktop/vsts-agent/src


-----------------------------------------
Ensure Dotnet SDK
-----------------------------------------
Download dotnetsdk into /home/pi/Desktop/vsts-agent/src/../_dotnetsdk/2.0.3
dotnet-install: Downloading link: https://dotnetcli.azureedge.net/dotnet/Sdk/2.1.101/dotnet-sdk-2.1.101-linux-arm.tar.gz
curl: (22) The requested URL returned error: 404
dotnet-install: Cannot download: https://dotnetcli.azureedge.net/dotnet/Sdk/2.1.101/dotnet-sdk-2.1.101-linux-arm.tar.gz
dotnet_install: Error: Could not download .NET Core SDK version 2.1.101
Failed: dotnet-install.sh Failed with return code 1
~/Desktop/vsts-agent/src

[TingluoHuang]

I published 2 branch for ARM agent for people who want's to try out.
users/tihuang/linuxarm -> 32 bits ARM @tylerl0706 helped me tested out this one, seems to work.
users/tihuang/linuxarm64 -> 64 bits ARM <- don't use this one since dotnet core only support arm32

[TylerLeonhardt]

It's awesome 🎉

[bbusacker]

@TingluoHuang I tested arm64 and it fails with an illegal instruction error executing:

"dotnet msbuild"

This is the same issue I had before and seems to be some defect in the dotnet cli itself. Can anyone else confirm or deny this problem on an arm64 system?

[TylerLeonhardt]

@bbusacker are you building on the arm device?

[TingluoHuang]

@bbusacker what kind of device you are using? what's the OS?

[bbusacker]

Exynos-based phone development board. Unbuntu 16.04

…

Sent from my iPhone On May 25, 2018, at 8:52 PM, Ting <notifications@github.com<mailto:notifications@github.com>> wrote: @bbusacker<https://github.com/bbusacker> what kind of device you are using? what's the OS? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#1521 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ADwCYaXfAGtU1hLwT72SMiu-_X53MB6Cks5t2MN8gaJpZM4TfGuQ>.

[bbusacker]

@tylerl0706 are you building on the arm device? *Yes*

…

Sent from my iPhone On May 25, 2018, at 8:36 PM, Tyler James Leonhardt <notifications@github.com<mailto:notifications@github.com>> wrote: @bbusacker<https://github.com/bbusacker> are you building on the arm device? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#1521 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ADwCYeGHEeWLY8vX-vLmvpsplUM7YEtWks5t2L-HgaJpZM4TfGuQ>.

[TingluoHuang]

@bbusacker can you share the full output of ./dev.sh layout

[bbusacker]

Here is the output to stderr:

./dev.sh layout > output.log
./dev.sh: line 77: 19753 Illegal instruction dotnet msbuild /t:layout /p:PackageRuntime=${RUNTIME_ID} /p:BUILDCONFIG=${BUILD_CONFIG}
Failed: build

and attached is output.log
output.log