Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Oct 29, 2025

Since bugbug is no longer hosted on Heroku, memory constraints that required single-process commit mining are no longer relevant. This restores parallel processing for performance.

Changes

  • Remove use_single_process=True from repository.download_commits() calls in:
    • http_service/bugbug_http/boot.py - commit DB updates during worker boot
    • http_service/bugbug_http/models.py - patch analysis for test selection

The function defaults to use_single_process=False, which enables ProcessPoolExecutor for parallel commit and patch processing across all available CPU cores.

Original prompt

This section details on the original issue you should resolve

<issue_title>Use multiple processes for mining commits in the HTTP service</issue_title>
<issue_description>Since we will no longer host bugbug on Heroku, we are not as concerned with memory usage as before.

Basically reverting b74bf96 and 2ac0bc4 will do the trick.</issue_description>

<agent_instructions>Follow the comments and issues mentioned. </agent_instructions>

Comments on the Issue (you are @copilot in this section)


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI changed the title [WIP] Revert commits to allow multiple processes for mining Enable multi-process commit mining in HTTP service Oct 29, 2025
Copilot finished work on behalf of suhaibmujahid October 29, 2025 17:33
Copilot AI requested a review from suhaibmujahid October 29, 2025 17:33
@suhaibmujahid suhaibmujahid marked this pull request as ready for review October 29, 2025 18:15
@suhaibmujahid suhaibmujahid requested a review from marco-c October 29, 2025 18:15
@marco-c
Copy link
Collaborator

marco-c commented Oct 29, 2025

Let's wait a bit on this until the new deployment is fully functional.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use multiple processes for mining commits in the HTTP service

3 participants