Error during import

[gayan-me]

A critical error occurred in the Check For Large Files step of the git migration. Files above push limit detected
Error Details
(1e801c5e57b27bdb189baa16452118794986b43e) => 1649MiB
(f4f5fd32f268e5c07747776f38bf17f46d13e972) => 1726MiB

I couldn't locate the above error files in the local repository.

I have already imported a few other repositories from Bitbucket to Github with a large history and all of them were imported without any error.

[chtholine]

The error indicates that some files in your repository exceed GitHub's push limit, preventing the migration. Here's how you can address this issue:

Steps to Resolve:

1. Identify Large Files:

   • Run the following command in your local repository to identify large files:

     git rev-list --objects --all | grep "$(git cat-file -s <commit-hash> | awk '{print $1}')"

     Replace <commit-hash> with the hash from the error (e.g., 1e801c5e57b27bdb189baa16452118794986b43e).

2. Filter Large Files:

   • Use git filter-repo or git filter-branch to remove the large files from your repository's history:

     git filter-repo --path <large-file-path> --invert-paths

     Make sure you back up your repository before doing this as it rewrites history.

3. Force Push:

   • After removing the large files, you will need to force push the cleaned repository to GitHub:

     git push origin --force

4. Alternative:

   • If you need to keep the files but they are too large for GitHub, consider using Git Large File Storage (LFS) for managing large files:

     git lfs install
     git lfs track "*.file-extension"
     git add .gitattributes
     git commit -m "Track large files with Git LFS"
     git push origin main

Additional Tips:

• Verify Removal: After filtering, verify that the large files are removed by checking the repository size and running the initial identification command again.
• Bitbucket to GitHub: If the files were in Bitbucket but not causing issues there, ensure you're within GitHub's file size limits and restrictions.

By following these steps, you should be able to resolve the error and complete the migration to GitHub.

[kevin-deloach]

Hi Gayan,

The error occurrs because GitHub has a hard limit of 100mb for individual files and recomends keeping repositories under 1gbB in total size.
The files listed in the error exceed this limit, preventing the migration.
To resolve this, you can use the https://rtyley.github.io/bfg-repo-cleaner/ or git filter-repo to remove large files from your repository's history. Once cleaned, try the migration again.

If you can't find the large files locally, ensure your clone includes the entire history using --mirror or --bare flags.

[IljaZimakovs]

Hey there!
That error means GitHub found files exceeding the size limit (100MB for regular files, 2GB for a single push).
These files might be hidden in your repo’s history.
You can use a tool like git filter-repo or BFG Repo-Cleaner to remove large files from history.
After cleaning, try pushing again.
Hope this helps!