Automated Google Maps Business Scraper

Description:

This tool is a powerful Node.js & Puppeteer-based scraper that automates the extraction of business data from Google Maps. It allows users to provide keywords, locations, or geolocation coordinates and retrieves structured business information including names, addresses, phone numbers, websites, and distances within a specified radius.

Designed for marketers, researchers, or businesses needing bulk business data, the scraper supports real-time progress updates, duplicate filtering, and invalid data handling, ensuring reliable and efficient data collection.

Functionalities:

• 🔍 Keyword & Location Search – Input any keyword and a location or use live geolocation to target specific areas.

• 🏢 Business Data Extraction – Scrapes name, phone number, website, address, and calculates distance from a given point.

• 📏 Radius Filtering – Only returns businesses within a specified radius in meters/kilometers.

• 🔁 Duplicate Handling – Automatically detects and skips duplicate entries.

• 🚫 Invalid Data Filtering – Skips entries with missing or malformed addresses.

• 📡 Real-Time Streaming – Uses Server-Sent Events (SSE) to stream progress and results live to the client.

• 🧭 Geocoding & Distance Calculation – Converts locations to coordinates and calculates distances using Node-Geocoder + Geolib.

• 🗄️ Caching – Stores geocoding results with Node-Cache for 24 hours to speed up repeated searches.

• ⚙️ Error Handling & Logging – Detailed logs for debugging, automatic screenshots on scraping errors.

• 🖥️ Headless Browser Automation – Puppeteer navigates Google Maps, scrolls listings, and extracts relevant data efficiently.

Technology Stack:

Frontend / Client:

• ⚛️ React.js – Dynamic user interface (maps-scraper-client/src/App.js)

• 🌐 HTML5 & CSS3 – Public pages (index.html, styles.css)

• 🖥️ JavaScript – Client-side logic (script.js)

• 🔄 Server-Sent Events (SSE) – Real-time log & data streaming to the browser

Backend / Scraper Engine:

• 🟢 Node.js with Express.js – API endpoints (/api/scrape, /api/scrape-stream)

• 🤖 Puppeteer – Automated browser for Google Maps navigation & scraping

• 🗺️ Node-Geocoder + LocationIQ API – Converts typed locations into latitude/longitude

• 📏 Geolib – Distance calculations between user location and businesses

• 🗄️ Node-Cache – Stores geocoding results for repeated searches

• 🌐

• – Handles API requests safely

Additional Tools / Features:

• 📂 Automatic scrolling & panel handling to extract all visible businesses

• 🔄 Deduplication & invalid address skipping for cleaner datasets

• 📸 Automatic screenshots for debugging failures

• ⏱️ Configurable maximum results & timeout handling
  
  Project Structure:
  app/

  ├── page.tsx # Main page (orchestrates all components)

  ├── api/

  │ ├── scrape/route.ts # SSE streaming scraper endpoint

  │ └── export/

  │ ├── csv/route.ts # CSV export

  │ ├── xlsx/route.ts # Excel export

  │ └── pdf/route.ts # PDF export

  components/

  ├── scraper-form.tsx # Search form with all filters

  ├── counters.tsx # Live statistics

  ├── log-terminal.tsx # Real-time logs

  ├── results-table.tsx # Data display

  ├── export-section.tsx # Export buttons

  ├── header.tsx / footer.tsx

  └── particle-background.tsx

  lib/

  ├── maps-scraper.ts # Core Playwright scraper

  ├── email-extractor.ts # Email extraction logic

  ├── selectors-config.ts # Selector definitions & auto-update tracking

  └── rate-limit.ts # Rate limiting logic