Skip to content

Corefile uploader service#3887

Merged
renukamanavalan merged 6 commits intosonic-net:masterfrom
renukamanavalan:core_uploader
Dec 16, 2019
Merged

Corefile uploader service#3887
renukamanavalan merged 6 commits intosonic-net:masterfrom
renukamanavalan:core_uploader

Conversation

@renukamanavalan
Copy link
Contributor

@renukamanavalan renukamanavalan commented Dec 12, 2019

  1. A service is added to watch /var/core and upload to Azure storage
  2. The service is disabled on boot. One may enable explicitly.
  3. The .rc file to be updated with acct credentials and http proxy to use.
  4. If service is enabled with no credentials, it would sleep, with periodic log messages
  5. For any update in .rc, the service has to be restarted to take effect.

- What I did

- How I did it

- How to verify it

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

@renukamanavalan
Corefile uploader service
743377f 
1) A service is added to watch /var/core and upload to Azure storage
2) The service is disabled on boot. One may enable explicitly.
3) The .rc file to be updated with acct credentials and http proxy to use.
4) If service is enabled with no credentials, it would sleep, with periodic log messages
5) For any update in .rc, the service has to be restarted to take effect.
@renukamanavalan renukamanavalan self-assigned this Dec 12, 2019
@jleveque
Copy link
Contributor

jleveque commented Dec 13, 2019

@renukamanavalan: This PR should also be labeled for cherry-picking into the 201911 branch, no?

yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
yxieca
yxieca reviewed Dec 14, 2019
View reviewed changes
@renukamanavalan
Changes per review comments.
4e97407 
Re-ordered .rc file per JSON.dump order.
Added a script to enable partial update of .rc, which HWProxy would use to add acct key.
@renukamanavalan
Azure storage upload requires python module futures, hence added it t…
061dcbb 
…o install list.
yxieca
yxieca reviewed Dec 15, 2019
View reviewed changes
@yxieca
Copy link
Contributor

yxieca commented Dec 15, 2019

You added a trailing space in you second last commit. Please remove it. Thanks!

@renukamanavalan
Copy link
Contributor Author

renukamanavalan commented Dec 16, 2019

Final version is tested on Starlab device with internal image built with these changes.

@renukamanavalan renukamanavalan merged commit 3ab4b71 into sonic-net:master Dec 16, 2019
@renukamanavalan renukamanavalan deleted the core_uploader branch December 16, 2019 00:48
renukamanavalan added a commit to renukamanavalan/sonic-buildimage that referenced this pull request Dec 16, 2019
@renukamanavalan
Corefile uploader service (sonic-net#3887)
82058cf 
* Corefile uploader service

1) A service is added to watch /var/core and upload to Azure storage
2) The service is disabled on boot. One may enable explicitly.
3) The .rc file to be updated with acct credentials and http proxy to use.
4) If service is enabled with no credentials, it would sleep, with periodic log messages
5) For any update in .rc, the service has to be restarted to take effect.

* Remove rw permission for .rc file for group & others.

* Changes per review comments.
Re-ordered .rc file per JSON.dump order.
Added a script to enable partial update of .rc, which HWProxy would use to add acct key.

* Azure storage upload requires python module futures, hence added it to install list.

* Removed trailing spaces.

* A mistake in name corrected.
Copy the .rc updater script to /usr/bin.
abdosi pushed a commit that referenced this pull request Jan 3, 2020
@renukamanavalan @abdosi
Corefile uploader service (#3887)
14f7b8d 
* Corefile uploader service

1) A service is added to watch /var/core and upload to Azure storage
2) The service is disabled on boot. One may enable explicitly.
3) The .rc file to be updated with acct credentials and http proxy to use.
4) If service is enabled with no credentials, it would sleep, with periodic log messages
5) For any update in .rc, the service has to be restarted to take effect.

* Remove rw permission for .rc file for group & others.

* Changes per review comments.
Re-ordered .rc file per JSON.dump order.
Added a script to enable partial update of .rc, which HWProxy would use to add acct key.

* Azure storage upload requires python module futures, hence added it to install list.

* Removed trailing spaces.

* A mistake in name corrected.
Copy the .rc updater script to /usr/bin.
yxieca pushed a commit that referenced this pull request Jan 6, 2020
@renukamanavalan @yxieca
Corefile uploader service (#3887)
6db0c76 
* Corefile uploader service

1) A service is added to watch /var/core and upload to Azure storage
2) The service is disabled on boot. One may enable explicitly.
3) The .rc file to be updated with acct credentials and http proxy to use.
4) If service is enabled with no credentials, it would sleep, with periodic log messages
5) For any update in .rc, the service has to be restarted to take effect.

* Remove rw permission for .rc file for group & others.

* Changes per review comments.
Re-ordered .rc file per JSON.dump order.
Added a script to enable partial update of .rc, which HWProxy would use to add acct key.

* Azure storage upload requires python module futures, hence added it to install list.

* Removed trailing spaces.

* A mistake in name corrected.
Copy the .rc updater script to /usr/bin.
mssonicbld added a commit that referenced this pull request Jan 10, 2026
@mssonicbld
[submodule] Update submodule sonic-swss to the latest HEAD automatica…
d25998d 
…lly (#24979)

#### Why I did it
src/sonic-swss
```
* a63ba5da - (HEAD -> master, origin/master, origin/HEAD) [LPO] Added support for serdes Tx/Rx polarity settings (#4053) (4 hours ago) [Prince George]
* bb691a5d - Merge pull request #3899 from rkavitha-hcl/bulk_neighbor (20 hours ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log c123c44c - Bulk support in neighbor manager. (28 hours ago) [mint570]
|/ 
* 505c4b7b - [HFT]: keep STATE_DB session stream_status in sync with profile stream_state (#4107) (34 hours ago) [Ze Gan]
* eed7900c - [countersyncd]: Add benchmark suite for countersyncd and optimize otel actor (#4016) (34 hours ago) [Janet Cui]
* 2de94bb9 - Merge pull request #3868 from rkavitha-hcl/neighbor_changes (2 days ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log 3f839f64 - Rename neiighor methods (3 days ago) [kishanps]
|/ 
* 34da384f - Merge pull request #3862 from rkavitha-hcl/acl_actions (3 days ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log b17e712d - Merge branch 'master' into acl_actions (3 days ago) [StephenWangGoogle]
| |\ 
| |/ 
|/| 
* | 0e233d18 - [gearsyncd,macsec]: Deterministic MACsec backend selection for gearbox ports (#3926) (3 days ago) [rajshekhar-nexthop]
* | c6b0c3e6 - [portsorch] DOM config change causes interface link to flap (#4056) (3 days ago) [mihirpat1]
| failure_prs.log skip_prs.log f4e65c92 - Merge branch 'master' into acl_actions (4 days ago) [rkavitha-hcl]
| |\ 
| |/ 
|/| 
* | 7297d14c - Merge pull request #3894 from divyagayathri-hcl/acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
|\ \ 
| failure_prs.log skip_prs.log \ d7fc9535 - Merge branch 'master' into acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
| |\ \ 
| |/ / 
|/| | 
* | | 1244a7df - [orchagent] support single ASIC VOQ Fixed-System (#4054) (4 days ago) [saravanan sellappa]
* | | c330c450 - [countersyncd]: Fix netlink fd leakage and deadlock issue (#4043) (4 days ago) [Ze Gan]
* | | ff585509 - Refactor OtelActor and message modules by removing unused code and improving clarity (#4072) (4 days ago) [Ze Gan]
* | | 68f081ae - [hftorch]: Handle exception of HFT instead of exit (#3887) (4 days ago) [Ze Gan]
* | | 4b81a3b8 - [hft]: Fix TAM type capability enable list (#4075) (4 days ago) [Ze Gan]
 / / 
* / 93ea8ef0 - [P4Orch] Update ACL VRF ID to use oid instead of u16. (5 weeks ago) [mint570]
 / 
* af78f1c0 - [P4Orch] Enable ACL Action SET_ACL_META_DATA and packet action COPY_CANCEL and DENY support (4 days ago) [mint570]
```
#### How I did it
#### How to verify it
#### Description for the changelog
jasonbridges pushed a commit to jasonbridges/sonic-buildimage that referenced this pull request Jan 22, 2026
@mssonicbld @jasonbridges
[submodule] Update submodule sonic-swss to the latest HEAD automatica…
e760db7 
…lly (sonic-net#24979)

#### Why I did it
src/sonic-swss
```
* a63ba5da - (HEAD -> master, origin/master, origin/HEAD) [LPO] Added support for serdes Tx/Rx polarity settings (sonic-net#4053) (4 hours ago) [Prince George]
* bb691a5d - Merge pull request sonic-net#3899 from rkavitha-hcl/bulk_neighbor (20 hours ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log c123c44c - Bulk support in neighbor manager. (28 hours ago) [mint570]
|/ 
* 505c4b7b - [HFT]: keep STATE_DB session stream_status in sync with profile stream_state (sonic-net#4107) (34 hours ago) [Ze Gan]
* eed7900c - [countersyncd]: Add benchmark suite for countersyncd and optimize otel actor (sonic-net#4016) (34 hours ago) [Janet Cui]
* 2de94bb9 - Merge pull request sonic-net#3868 from rkavitha-hcl/neighbor_changes (2 days ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log 3f839f64 - Rename neiighor methods (3 days ago) [kishanps]
|/ 
* 34da384f - Merge pull request sonic-net#3862 from rkavitha-hcl/acl_actions (3 days ago) [StephenWangGoogle]
|\ 
| failure_prs.log skip_prs.log b17e712d - Merge branch 'master' into acl_actions (3 days ago) [StephenWangGoogle]
| |\ 
| |/ 
|/| 
* | 0e233d18 - [gearsyncd,macsec]: Deterministic MACsec backend selection for gearbox ports (sonic-net#3926) (3 days ago) [rajshekhar-nexthop]
* | c6b0c3e6 - [portsorch] DOM config change causes interface link to flap (sonic-net#4056) (3 days ago) [mihirpat1]
| failure_prs.log skip_prs.log f4e65c92 - Merge branch 'master' into acl_actions (4 days ago) [rkavitha-hcl]
| |\ 
| |/ 
|/| 
* | 7297d14c - Merge pull request sonic-net#3894 from divyagayathri-hcl/acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
|\ \ 
| failure_prs.log skip_prs.log \ d7fc9535 - Merge branch 'master' into acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
| |\ \ 
| |/ / 
|/| | 
* | | 1244a7df - [orchagent] support single ASIC VOQ Fixed-System (sonic-net#4054) (4 days ago) [saravanan sellappa]
* | | c330c450 - [countersyncd]: Fix netlink fd leakage and deadlock issue (sonic-net#4043) (4 days ago) [Ze Gan]
* | | ff585509 - Refactor OtelActor and message modules by removing unused code and improving clarity (sonic-net#4072) (4 days ago) [Ze Gan]
* | | 68f081ae - [hftorch]: Handle exception of HFT instead of exit (sonic-net#3887) (4 days ago) [Ze Gan]
* | | 4b81a3b8 - [hft]: Fix TAM type capability enable list (sonic-net#4075) (4 days ago) [Ze Gan]
 / / 
* / 93ea8ef0 - [P4Orch] Update ACL VRF ID to use oid instead of u16. (5 weeks ago) [mint570]
 / 
* af78f1c0 - [P4Orch] Enable ACL Action SET_ACL_META_DATA and packet action COPY_CANCEL and DENY support (4 days ago) [mint570]
```
#### How I did it
#### How to verify it
#### Description for the changelog
FengPan-Frank pushed a commit to FengPan-Frank/sonic-buildimage that referenced this pull request Mar 6, 2026
@mssonicbld @FengPan-Frank
[submodule] Update submodule sonic-swss to the latest HEAD automatica…
b4476d3 
…lly (sonic-net#24979)

#### Why I did it
src/sonic-swss
```
* a63ba5da - (HEAD -> master, origin/master, origin/HEAD) [LPO] Added support for serdes Tx/Rx polarity settings (sonic-net#4053) (4 hours ago) [Prince George]
* bb691a5d - Merge pull request sonic-net#3899 from rkavitha-hcl/bulk_neighbor (20 hours ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log c123c44c - Bulk support in neighbor manager. (28 hours ago) [mint570]
|/
* 505c4b7b - [HFT]: keep STATE_DB session stream_status in sync with profile stream_state (sonic-net#4107) (34 hours ago) [Ze Gan]
* eed7900c - [countersyncd]: Add benchmark suite for countersyncd and optimize otel actor (sonic-net#4016) (34 hours ago) [Janet Cui]
* 2de94bb9 - Merge pull request sonic-net#3868 from rkavitha-hcl/neighbor_changes (2 days ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log 3f839f64 - Rename neiighor methods (3 days ago) [kishanps]
|/
* 34da384f - Merge pull request sonic-net#3862 from rkavitha-hcl/acl_actions (3 days ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log b17e712d - Merge branch 'master' into acl_actions (3 days ago) [StephenWangGoogle]
| |\
| |/
|/|
* | 0e233d18 - [gearsyncd,macsec]: Deterministic MACsec backend selection for gearbox ports (sonic-net#3926) (3 days ago) [rajshekhar-nexthop]
* | c6b0c3e6 - [portsorch] DOM config change causes interface link to flap (sonic-net#4056) (3 days ago) [mihirpat1]
| failure_prs.log skip_prs.log f4e65c92 - Merge branch 'master' into acl_actions (4 days ago) [rkavitha-hcl]
| |\
| |/
|/|
* | 7297d14c - Merge pull request sonic-net#3894 from divyagayathri-hcl/acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
|\ \
| failure_prs.log skip_prs.log \ d7fc9535 - Merge branch 'master' into acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
| |\ \
| |/ /
|/| |
* | | 1244a7df - [orchagent] support single ASIC VOQ Fixed-System (sonic-net#4054) (4 days ago) [saravanan sellappa]
* | | c330c450 - [countersyncd]: Fix netlink fd leakage and deadlock issue (sonic-net#4043) (4 days ago) [Ze Gan]
* | | ff585509 - Refactor OtelActor and message modules by removing unused code and improving clarity (sonic-net#4072) (4 days ago) [Ze Gan]
* | | 68f081ae - [hftorch]: Handle exception of HFT instead of exit (sonic-net#3887) (4 days ago) [Ze Gan]
* | | 4b81a3b8 - [hft]: Fix TAM type capability enable list (sonic-net#4075) (4 days ago) [Ze Gan]
 / /
* / 93ea8ef0 - [P4Orch] Update ACL VRF ID to use oid instead of u16. (5 weeks ago) [mint570]
 /
* af78f1c0 - [P4Orch] Enable ACL Action SET_ACL_META_DATA and packet action COPY_CANCEL and DENY support (4 days ago) [mint570]
```
#### How I did it
#### How to verify it
#### Description for the changelog

Signed-off-by: Feng Pan <[email protected]>
dprital pushed a commit that referenced this pull request Mar 19, 2026
@mssonicbld @dprital
[submodule] Update submodule sonic-swss to the latest HEAD automatica…
54893c8 
…lly (#24979)

#### Why I did it
src/sonic-swss
```
* a63ba5da - (HEAD -> master, origin/master, origin/HEAD) [LPO] Added support for serdes Tx/Rx polarity settings (#4053) (4 hours ago) [Prince George]
* bb691a5d - Merge pull request #3899 from rkavitha-hcl/bulk_neighbor (20 hours ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log c123c44c - Bulk support in neighbor manager. (28 hours ago) [mint570]
|/
* 505c4b7b - [HFT]: keep STATE_DB session stream_status in sync with profile stream_state (#4107) (34 hours ago) [Ze Gan]
* eed7900c - [countersyncd]: Add benchmark suite for countersyncd and optimize otel actor (#4016) (34 hours ago) [Janet Cui]
* 2de94bb9 - Merge pull request #3868 from rkavitha-hcl/neighbor_changes (2 days ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log 3f839f64 - Rename neiighor methods (3 days ago) [kishanps]
|/
* 34da384f - Merge pull request #3862 from rkavitha-hcl/acl_actions (3 days ago) [StephenWangGoogle]
|\
| failure_prs.log skip_prs.log b17e712d - Merge branch 'master' into acl_actions (3 days ago) [StephenWangGoogle]
| |\
| |/
|/|
* | 0e233d18 - [gearsyncd,macsec]: Deterministic MACsec backend selection for gearbox ports (#3926) (3 days ago) [rajshekhar-nexthop]
* | c6b0c3e6 - [portsorch] DOM config change causes interface link to flap (#4056) (3 days ago) [mihirpat1]
| failure_prs.log skip_prs.log f4e65c92 - Merge branch 'master' into acl_actions (4 days ago) [rkavitha-hcl]
| |\
| |/
|/|
* | 7297d14c - Merge pull request #3894 from divyagayathri-hcl/acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
|\ \
| failure_prs.log skip_prs.log \ d7fc9535 - Merge branch 'master' into acl_vrf_id_oid (4 days ago) [StephenWangGoogle]
| |\ \
| |/ /
|/| |
* | | 1244a7df - [orchagent] support single ASIC VOQ Fixed-System (#4054) (4 days ago) [saravanan sellappa]
* | | c330c450 - [countersyncd]: Fix netlink fd leakage and deadlock issue (#4043) (4 days ago) [Ze Gan]
* | | ff585509 - Refactor OtelActor and message modules by removing unused code and improving clarity (#4072) (4 days ago) [Ze Gan]
* | | 68f081ae - [hftorch]: Handle exception of HFT instead of exit (#3887) (4 days ago) [Ze Gan]
* | | 4b81a3b8 - [hft]: Fix TAM type capability enable list (#4075) (4 days ago) [Ze Gan]
 / /
* / 93ea8ef0 - [P4Orch] Update ACL VRF ID to use oid instead of u16. (5 weeks ago) [mint570]
 /
* af78f1c0 - [P4Orch] Enable ACL Action SET_ACL_META_DATA and packet action COPY_CANCEL and DENY support (4 days ago) [mint570]
```
#### How I did it
#### How to verify it
#### Description for the changelog

Signed-off-by: dprital <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yxieca yxieca yxieca approved these changes

@lguohan lguohan Awaiting requested review from lguohan lguohan is a code owner

@jleveque jleveque Awaiting requested review from jleveque

Assignees

@renukamanavalan renukamanavalan

Labels

Enhancement ➕ Included in 201811 Branch Included in 201911 Branch Request for 201811 Branch :shipit: Request for 201911 Branch :shipit:

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@renukamanavalan @jleveque @yxieca @abdosi