Added program totals management scripts and tables

[Amdrel]

Description

Added management commands for creating precomputed program totals from aggregate data.

• Added 'fill_top_organisations_totals' command and 'ProgramTopOrganisationsTotal' table
• Added 'fill_top_projects_totals' command and 'ProgramTopProjectsTotal' table
• Added 'fill_top_users_totals' command and 'ProgramTopUsersTotal' table
• Added cron jobs that run the totals commands daily after monthly aggregates are run

Rationale

Querying program data from our aggregates table is causing performance issues. We plan on archiving this data to help with performance, but for old program statistics to remain accurate we need to compute program totals for previous months that will be archived. As a byproduct this also improves program query performance substantially.

Phabricator Ticket

https://phabricator.wikimedia.org/T370980

How Has This Been Tested?

Existing programs tests cover the accuracy of the new program totals command output.

Totals Command Examples

Totals function can be tested like so:

python manage.py fill_top_organisations_totals -d 2025-02
python manage.py fill_top_projects_totals -d 2025-02
python manage.py fill_top_users_totals -d 2025-02

If no date option is passed then the earliest date possible is identified and totals are calculated for the whole dataset. The top organisations and top projects caclulate quickly, but top users can take ~10 minutes for the entire dataset.

Screenshots of your changes (if appropriate):

N/A

Types of changes

What types of changes does your code introduce? Add an x in all the boxes that apply:

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)

[suecarmol]

Thank you for all of the work on this PR. The UI now loads lightning-fast thanks to your changes 😄

I have a few minor comments and nits before we can merge this in.

Noting that the tests for the management commands will be added in PR #439, but that I tested the commands locally and they are working.

[suecarmol]

This looks good to me! Thank you so much for your efforts on making Wikilink load faster!

[katydidnot]

Thanks for your work, I validated that this works as expected locally with the exception that program stats will be unavailable until we start backfilling the new database tables.