Semrush scrapers compared

One keyword a domain ranks for, with position, volume, CPC and ranking URL

• Competitor found (competitor)

One keyword row: volume, CPC, difficulty, competition, intent and SERP features.

• Competitor result (competitor-result)
• Backlink result (backlink-result)
• Domain overview report (domain-report)

Cost per result item returned. Each search type counts as one individual result.

One keyword with full Semrush metrics (volume, CPC, KD, intent, ideas, SERP). Failed lookups are not charged.

One keyword's volume, CPC, competition & trend

• Keyword difficulty (keyword_kd)

Charged per website traffic stats record extracted.

• Run started (start)

One domain that came back with a current monthly visits estimate, together with its authority score, ranks, engagement, search traffic, backlinks and history. A domain with no page at all is never charged.

• Domain found (domain-found)

Event description unavailable.

One related or question keyword with volume, difficulty, CPC and competition

• Broad match keyword (keyword_broad)

One domain's full Semrush public overview: monthly visits with change %, Authority Score, Google penalty risk, global/country/category rank with trend, pages per visit, time on site, bounce rate, organic vs paid search traffic, backlinks and referring domains with history, top organic keywords with position/volume/CPC, organic competitors, traffic by country with device shares, desktop/mobile history and AI-assistant referral traffic. Domains Semrush does not cover are reported and never charged.

One supported domain with public authority, traffic, and backlink stats.

Single result in the default dataset.

• Keyword Analyzed (keyword_analyzed)
• Related Keywords Fetched (related_keywords_fetched)
• Phrase Match Fetched (phrase_match_fetched)
• Webhook Sent (webhook_sent)

Charged once per domain with a Semrush overview. Domains not in Semrush's public database, invalid input and blocked requests are never charged.

One domain whose website was read, returned with every section you chose (traffic rank, authority, tech stack, AI crawler policy, domain age, hiring). Websites that cannot be read (down, parked, for sale, coming soon, blocked, robots.txt disallows us), duplicates and invalid lines are free.

One domain returned with data: estimated organic and paid Google traffic and keyword counts. Domains without data, duplicates and invalid entries are never charged.

• Top keyword (ranked-keyword)

Charged once for each successful upstream SEO API task used to build the report.

• SEO record (seo-record)

Single result in the default dataset.

• Domain Analyzed (domain_analyzed)
• Webhook Sent (webhook_sent)

One Semrush domain profile delivered to the dataset. Failed and skipped domains are never charged.

One item saved to the dataset.

Charged per successful metric-bearing domain overview record.

• Start (start)

One fully validated DataForSEO row persisted in the dataset. DataForSEO usage remains on the credential owner account.

Single result in the default dataset.

• Domain Analyzed (domain_analyzed)
• Backlinks Fetched (backlinks_fetched)
• Referring Domains Fetched (referring_domains_fetched)
• Anchors Fetched (anchors_fetched)
• Webhook Sent (webhook_sent)

Charged once per domain successfully delivered with Authority Score, backlinks, referring domains, and organic traffic data from Semrush's free Website Authority Checker. Blocked, rate-limited, or failed checks are never charged.

One keyword compared between your domain and a competitor to find gaps

Single result in the default dataset.

• Domain Analyzed (domain_analyzed)
• Rankings Fetched (rankings_fetched)
• Webhook Sent (webhook_sent)

Charged per keyword, competitor, or ranked-keyword row returned.

• Domain/backlink report (report)

Single result in the default dataset.

• Domain Analyzed (domain_analyzed)
• Traffic Sources Fetched (traffic_sources_fetched)
• Geo Distribution Fetched (geo_distribution_fetched)
• Historical Data Fetched (historical_data_fetched)
• Webhook Sent (webhook_sent)
• Top Pages (top_pages_fetched)
• Top Subdomains (subdomains_fetched)
• Traffic Destinations (destinations_fetched)
• Audience Demographics (demographics_fetched)

Single result in the default dataset.

• Audit Launched (audit-launched)
• Audit Completed (audit-completed)
• Project Deleted (project-deleted)

Charged once after a complete Semrush Authority Score record is written to the dataset.

Single result in the default dataset.

• Gap Analysis Complete (gap_analysis_complete)
• Webhook Sent (webhook_sent)

Single result in the default dataset.

• Domain Analyzed (domain_analyzed)
• Organic Competitors Fetched (organic_competitors_fetched)
• Paid Competitors Fetched (paid_competitors_fetched)
• Webhook Sent (webhook_sent)