-
Notifications
You must be signed in to change notification settings - Fork 12
Open
Description
layup-list/apps/spider/tasks.py
Line 34 in 83073ff
| assert len(median_page_urls) == 10 # the registrar medians web page always keeps a list links to the past ten academic terms |
This line asserts that crawling the medians from the ORC should return results from the last ten terms. Looking at the medians page from March in the Wayback machine, the previous ten terms worth of medians were listed.
Looking at the current page, however, there are only eight medians listed, so the check is throwing an error based on a false negative (it is written to expect the median crawling function to return ten terms, there are only eight this term). I don't know if this reduction in the number of terms with medians available is unique to summer, a permanent change going forward, or specific to 22X. Either way,
- There should be some conditionals to guard against times when fewer than ten medians are listed.
- I wonder if this is causing issues in prod. Is there logging set up?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels