rdap.org scrapers compared

Event description unavailable.

Charged once per unique normalized domain checked.

• Actor start (actor_start)

One domain row: RDAP registration status, registrar, expiry, statuses, nameservers, DNSSEC, plus DNS records and inferred mail provider/SPF/DMARC when DNS lookups are on

• TLS check (tls-check)

Charged per domain RDAP/WHOIS lookup returned.

Charged per domainLookup extracted.

• Run started (start)

One domain checked (WHOIS/RDAP, DNS, email security, SSL, HTTP) returned in the dataset.

One domain looked up: WHOIS registration data, owner organization and/or DNS records. Invalid or completely failed domains are not charged.

One per domain with a WHOIS/RDAP result (registered or available). Failed lookups are free.

One domain with registration (RDAP) and/or DNS data returned. Invalid or empty results are free.

One domain looked up: registry RDAP data and DNS records, email provider, SPF and DMARC. Invalid entries, duplicates and domains where no source answered are not charged.

One domain looked up

One answered domain: registered with its WHOIS/RDAP record, or confirmed available. Domains whose registry has no RDAP service or that error out are not charged.

One registered domain whose WHOIS data (registration and expiry dates, registrar, nameservers, DNSSEC) was read over RDAP. Available (unregistered) domains, TLDs without RDAP and failed lookups are free.

One domain checked and delivered, including partial results.

Charged per domain checked pushed to the dataset. Error rows are free.

One result in the dataset

Domain checked

One output row: a domain with its registration and DNS data. Repeats, invalid input and failed lookups are free.

One query (a domain, IP address or AS number) whose registration record was found, with registrar, created, updated and expiry dates, days to expiry, nameservers, status values, DNSSEC and abuse contact where the registry publishes them. Queries with no record and failed lookups are free.

One domain looked up via RDAP

One domain checked: availability plus registrar, dates, nameservers and DNSSEC when registered.

Domain looked up

• Domain registration changed (monitor) (domain-changed)

Domain checked (RDAP and/or DNS data returned)

One domain looked up (WHOIS + DNS) and written to the dataset.

One domain row (registered or not registered). Invalid, unsupported, excluded (.de) and failed lookups are never charged.

Charged for each unique domain looked up.

One checked domain saved to the Dataset with status complete, partial or not_found. Rows with status error, invalid inputs and duplicates are not charged.

One domain with an RDAP registration record returned (plus the DNS records you asked for). Invalid names, unsupported TLDs, missing records, caps, registry errors and rate limits are free.

One domain checked (registration, DNS, email security and SSL).

Domain checked (RDAP and/or DNS data returned)

One domain with a definitive registry answer (registered with WHOIS/RDAP data, or not found = likely available). DNS, SPF and DMARC included. Failed lookups and TLDs without RDAP are free.

Each domain row is saved (Actor.pushData(item, 'domain')), whatever checks were selected

One domain successfully looked up in the registry (RDAP)

Charged once per domain successfully checked

One domain looked up (RDAP registration, DNS + email security, SSL certificate - whichever you enabled). Invalid inputs, duplicates and domains where every lookup failed are not charged.

Charged per distinct domain with data found (RDAP, DNS, email auth, TLS).

One domain with registration data returned (DNS included)

One domain looked up: registration data (RDAP), DNS with SPF/DMARC, SSL certificate and security headers. Invalid, unregistered or completely unreachable domains are not charged.

One domain looked up via RDAP with registration facts returned. Domains on TLDs without RDAP, unregistered domains and failed lookups are free.

Charged per domain row with registrationStatus registered or not_found. unsupported_tld and error rows are free.

• DNS records + email/SPF/DMARC add-on (dns-records)
• Monitor mode: domain changed (change-detected)

Charged once per valid domain for which at least one lookup section returned an answer, including a confirmed non-existent domain. Malformed input and fully failed domains are never charged.

Charged for each domain RDAP row written to the dataset.

• Actor start (actor-start)

One record returned by the run after your filters

Charged once per input successfully looked up and returned. Never charged when a lookup returns no data.

Charged once per distinct normalized domain that receives either a complete SUCCESS observation or an authoritative NOT_FOUND result. Duplicate aliases, retries, invalid inputs, PARTIAL, FAILED, RATE_LIMITED and UNSUPPORTED_TLD results are never charged.

Charged once per domain whose intelligence row was successfully stored in the dataset (rows where both RDAP and DNS lookups failed are free).

Charged per domain analysed.

One domain looked up (a 'not registered' answer counts). Registries without RDAP, invalid input and failed lookups are free.

One domain with a definite answer from the registry (registered with its dates, registrar and DNS — or not registered). Domains the registry doesn't answer for are free.

One domain with a definitive registry answer (registered or available), with its DNS and mail data. Domains that cannot be looked up are returned free.

One domain looked up: RDAP WHOIS, DNS records, email provider, SPF/DMARC.

One domain looked up and saved (filtered-out or empty lookups are free).

One domain with a definitive RDAP answer: registrar, creation and expiry dates, age, status, nameservers and DNSSEC, or an authoritative not-registered result. Failed lookups and TLDs without RDAP are free. First 2 rows per run are free.