Skip to content
This repository was archived by the owner on Feb 13, 2025. It is now read-only.

Conversation

@qpd-v
Copy link

@qpd-v qpd-v commented Feb 7, 2025

Changes

  • Remove hardcoded AWS credentials from document_processor.py and summarize_report.py
  • Add proper environment variable validation
  • Add .env.example as a template for required environment variables
  • Add .gitignore to prevent sensitive files from being committed

Security Improvements

  • Removes exposed AWS credentials
  • Adds environment variable checks
  • Prevents accidental commit of .env files
  • Provides clear template for required variables

Testing

To test these changes:

  1. Copy .env.example to .env
  2. Add your AWS credentials to .env
  3. Run the scripts as normal

All functionality remains the same, just with improved security practices.

qpd-v added 17 commits January 12, 2025 00:17
…ments and add reference to original mcp-webresearch server
…nfiguration; add new content and analysis types for research sessions; added deep_research option
…feat: Enhance search result relevance scoring and deduplication; update content types and improve search queries
…tignore; enhance README with configuration options and error handling; improve content analysis logic for technical content extraction.
Reduced maxDepth (2) and maxBranching (3) defaults for better reliability
Implemented timeout checks throughout research process
Optimized page loading with 10s timeout
Removed unnecessary waiting periods and content expansion
Limited parallel searches to 5 for stability
Updated default timeout to 55s to work within MCP limits
Added detailed timing information to research results
Updated documentation to reflect current capabilities
Removed unused tools from README
Added visit_page tool back for direct webpage content extraction
Integrated turndown for HTML to Markdown conversion
Implemented efficient page loading with 10s timeout
Added content cleaning to remove navigation/ads/footers
Preserved code blocks and technical content formatting
Maintained heading hierarchy and list structures
Added URL validation and security checks
Removed screenshot functionality for better performance
Updated documentation with new tool usage
…n to v0.3.0; enhance README with npm installation instructions and first-time setup
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant