A CLI tool designed to automate the process of scraping scholarly articles from Google Scholar and integrating them into your Zotero account. This tool is particularly useful for researchers collecting literature for meta-analysis.
- Scraping: Scrapes the specified number of top google scholar items for the given query
- Metadata Enrichment: Finds the metadata (authors, abstract, year, etc.) by finding a match in CrossRef
- CrossRef match is made by comparing the title, authors and abstract if available. Abstract is compared as an embedding.
- Download Attachments: Automatically downloads available PDFs and attaches them to the Zotero items
Install the tool using uv by running
$ uv tool install git+https://github.com/kunzaatko/bib-scraper(Note: You might need to install uv first: pip install uv)
Create a .env file in the root directory of the project by copying the .env.example file and filling in the required
variables.
Run the script from the command line using uv tool run --from scraper bib-scraper.
$ uv tool run --from scraper bib-scraper --query "\"SIM parameter estimation\" OR \"SIM image reconstruction algorithm\"" --item-limit 15
Full resolution showcase video
showcase.mp4
To see the command-line help and all the available options, use the --help flag:
$ uv run bib-scraper --help