Skip to content

Conversation

@ceewaigit
Copy link
Contributor

Got sick of not being able to find a simple & suitable groq crawl bot.
The pr adds a new web crawler and analyzer script for the groq_web_crawler example.

Key things includes the implementation of functions to scrape websites, summarize content, analyze sentiment, and extract key topics using the Firecrawl and Groq APIs. Additionally, i added the requirements.txt file to include necessary dependencies within the groq_web_crawler example.

New script implementation:

  • examples/groq_web_crawler/groq_website_analyzer.py: Added a new script that initializes the Firecrawl and Groq clients, defines functions for scraping websites, summarizing content, analyzing sentiment, and extracting key topics, the main function runs a cli for the users to interact with the functions.

Dependencies update:

@ericciarla
Copy link
Contributor

This is awesome! Nice work!

@ericciarla
Copy link
Contributor

Would it be okay if we post about this? If so what is your X?

@ericciarla ericciarla merged commit 522f2d2 into firecrawl:main Mar 2, 2025
@ceewaigit
Copy link
Contributor Author

Thank you for the merge. Feel free to post about it anywhere you'd like! Unfortunately I don't have an X account, but I appreciate the offer to include me in the mention.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants