corefile uploader: Updates per review comments offline#3915
corefile uploader: Updates per review comments offline#3915renukamanavalan merged 5 commits intosonic-net:masterfrom
Conversation
1) core_uploader service waits for syslog.service 2) core_uploader service enabled for restart on failure 3) Use mtime instead of file size + ample time to be robust.
|
I have not tested the code yet. Can I get your comments please, before I do my last round testing. |
1) If rc file is missing or required data missing, it periodically logs error in forever loop. 2) If upload fails, retry every hour with a error log, forever.
renukamanavalan
changed the title
|
Changes:
|
| fail_msg = "" | ||
|
|
||
| while i <= MAX_RETRIES: | ||
| while True: |
There was a problem hiding this comment.
I think you can do retry in the big loop. if it fails, retry in the big loop.
There was a problem hiding this comment.
I guess no. The bigger loop is either scan/wait-for-core. In either case, the next one would suffer the same fate. So I rather spew log & retry, until either I succeed or service is restarted, by someone alerted by these log messages.
| Type=simple | ||
| ExecStart=/usr/bin/core_uploader.py | ||
| StandardOutput=null | ||
| Restart=on-failure |
There was a problem hiding this comment.
we need back off here? if core_uploader is constantly restarting?
There was a problem hiding this comment.
No need. The only failure that crashes the service, is some fatal things like, sonic_version.yaml does not have expected attributes or some fatal system related failure (which should crash many more ...), and running out of disk space.
The one thing, I would need to take care of "running out of disk space". This I can take care of inside the script.
|
vs & vsimage build failure are unrelated to this PR. console o/p: |
* Updates per review comments 1) core_uploader service waits for syslog.service 2) core_uploader service enabled for restart on failure 3) Use mtime instead of file size + ample time to be robust. * Avoid reloading already uploaded file, by marking the names with a prefix. * Updated failing path. 1) If rc file is missing or required data missing, it periodically logs error in forever loop. 2) If upload fails, retry every hour with a error log, forever. * Fix few bugs * The binary update_json.py will come from sonic-utilities.
* Updates per review comments 1) core_uploader service waits for syslog.service 2) core_uploader service enabled for restart on failure 3) Use mtime instead of file size + ample time to be robust. * Avoid reloading already uploaded file, by marking the names with a prefix. * Updated failing path. 1) If rc file is missing or required data missing, it periodically logs error in forever loop. 2) If upload fails, retry every hour with a error log, forever. * Fix few bugs * The binary update_json.py will come from sonic-utilities.
…AD automatically (sonic-net#1225) #### Why I did it src/sonic-utilities ``` * de2a0ad2 - (HEAD -> 202405, origin/202405) Merge pull request sonic-net#182 from mssonicbld/sonicbld/202405-merge (21 hours ago) [mssonicbld] * 713cd7f9 - Merge branch '202405' of https://github.com/sonic-net/sonic-utilities into 202405 (23 hours ago) [Sonic Automation] * ced89eb5 - [build] Update Azure pipeline to use Ubuntu 24.04 image (sonic-net#3915) (2 days ago) [mssonicbld] ``` #### How I did it #### How to verify it #### Description for the changelog
- What I did
- How I did it
- How to verify it
- Description for the changelog
- A picture of a cute animal (not mandatory but encouraged)