Skip to content

A high-performance, professional web scraping engine designed to extract product data from any e-commerce platform with extreme speed and accuracy. Phase 1 Complete.

Notifications You must be signed in to change notification settings

EsLaM-Media/universalscraper.io

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 

Repository files navigation

πŸš€ Universal Scraper AI - Multi-User SaaS Platform

The Most Advanced AI-Powered Scraping SaaS Ecosystem on the Market


πŸ“Ί Watch the Demo in Action

Experience the power of Autonomous AI Scraping with our Stealth Engine


Click the thumbnail above to view the full platform walkthrough

πŸ€– Next-Gen AI & Extraction Core

  • RAG-Powered Learning: Advanced Retrieval-Augmented Generation system that learns and adapts to site structures dynamically.
  • Multi-Model AI Support: Seamlessly integrated with OpenAI (GPT-4), Google Gemini, Anthropic (Claude), and Groq (Llama 3).
  • Autonomous Platform Detection: Instantly recognizes and adapts to Shopify, WooCommerce, and Salla stores.
  • Visual Selector & No-Code Mapping: Sophisticated point-and-click interface for custom data field extractionβ€”no coding required.
  • Smart Workflow Engine: Build complex, multi-step scraping pipelines with advanced conditional logic.

πŸ›‘οΈ Professional Stealth & Performance Suite

  • Playwright Stealth Mode: Mimics human behavior to bypass advanced anti-bot systems (Cloudflare, Imperva, etc.).
  • Proactive Resource Blocking: Intelligently blocks images, fonts, and media to save bandwidth and boost speed.
  • Advanced Proxy Rotator: Built-in support for residential and mobile proxies with automatic failover.
  • Captcha Auto-Solver: Integrated support for multiple captcha-solving services.
  • Browser Fingerprinting: Randomizes headers and signatures to avoid IP flagging.

πŸ’Ό Full SaaS Business Features

  • Membership & Subscription: Full lifecycle management with Stripe and PayPal integration.
  • Interactive Dashboards: Modern React-based panels for both Users (Management) and Admins (System Health).
  • 2FA Security: Maximum account safety with Two-Factor Authentication via OTP and QR codes.
  • White-Label Panel: Fully customize branding, logos, and colors directly from the Admin UI.
  • Installation Wizard: A step-by-step UI to set up the entire platform on your server effortlessly.

πŸ“Š Connectivity & Export Power

  • Direct Store Syncing: One-click export/sync directly to WooCommerce.
  • Google Sheets Integration: Real-time data pushing for live reporting.
  • Telegram Bot Integration: Control your scraper and receive alerts via Telegram.
  • Developer API & Webhooks: Full REST API for 3rd party integrations.
  • Bulk Exporting: Supports JSON, CSV, Excel, and Markdown.

πŸ› οΈ Technical Specifications

Requirement Minimum Recommended
Python 3.10+ 3.12
Node.js 18 LTS 20+
RAM 4 GB 8 GB+
Services Redis Server Redis + Celery Workers
OS Linux (Ubuntu) Docker Compose

πŸš€ Getting Started

  1. Backend: Install dependencies via pip install -r requirements.txt.
  2. Browsers: Run playwright install chromium.
  3. Frontend: Run npm install and npm run build.
  4. Launch: Access the Installation Wizard via your domain to complete setup.

πŸ‘¨β€πŸ’» Developed By

EsLaM Hamed - Full Stack Developer & SaaS Architect


Β© 2026 Universal Scraper AI. All rights reserved.

About

A high-performance, professional web scraping engine designed to extract product data from any e-commerce platform with extreme speed and accuracy. Phase 1 Complete.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published