Skip to documentation content

Introduction

Understand what this product makes possible and how the pieces fit together.

In this guide
  1. 1Choose a delivery model
  2. 2Define a stable schema
  3. 3Validate source coverage
In this guide
  1. 1Choose a delivery model
  2. 2Define a stable schema
  3. 3Validate source coverage

What Scraping Operations provides

Scraping Operations turns changing public web sources into stable, validated data products. You integrate with a predictable schema instead of maintaining source-specific collectors.

Choose the right product

Use the Scraping API for request-driven collection, Datasets for scheduled bulk delivery, and Real-time scraping when change latency matters.

NeedBest fit
One URL on demandScraping API
Recurring bulk feedDatasets
Immediate source changesReal-time scraping

The shared contract

Every product uses authenticated HTTPS, stable identifiers, explicit job states, and observable delivery metadata. This keeps integrations consistent as volume grows.

Was this page helpful?