Skip to documentation content

Real-time scraping

Detect important source changes with low latency.

In this guide
  1. 1Register sources
  2. 2Define change rules
  3. 3Consume verified events
In this guide
  1. 1Register sources
  2. 2Define change rules
  3. 3Consume verified events

Change events

Real-time scraping observes selected source fields and emits a verified event when a meaningful change passes your rules.

Define signal rules

  1. 1
    Field changed
  2. 2
    Threshold crossed
  3. 3
    New record appeared
  4. 4
    Record became unavailable

Delivery and latency

Events include observed and verified timestamps. Design downstream systems for duplicates and out-of-order delivery by using event IDs and source versions.

Was this page helpful?