Batch Starter Refactoring

[tech3371]

This is a major task that will involve refactoring batch starter lambda logic into more simplified and structured look up. This is major because batch starter cover these major features of SDC infrastructure

• job kickoff
• dependency lookup
• event tracking
• cadence job kickoff
• reprocessing job handler

Current list of improvement requested to batch starter lambda

• Adding more precision to dependency query. Right now, it's yyyymmdd but it needs to be yyyymmddhhmmss. Also, move to string or datetime. But more precision.
• Refactor to use structure object similar to imap-data-access's <Science>FilePath object in dependency query.
• Remove or reduce if/else statement using outcome from above bullet point discussion

[maxinelasp]

MAG L1D would benefit from point 1.

[tech3371]

If it's blocking you right now, can we look into fix that right now Maxine? Otherwise, we will be working on this refactoring soon but it will take a bit more time since we need to revisit design, discussion and implementation.

[maxinelasp]

It's not blocking me, just something causing minor annoyances. But, it is not affecting processing at all and doesn't really have that much of an effect. So it doesn't need to be a top priority.