Skip to main content
The scraper exposes a small HTTP API for the n8n orchestrator. It is not a public API: there is no published host, and the interactive playground is turned off for that reason. The endpoint pages in this section are generated from the FastAPI app’s OpenAPI spec.

Authentication

Every POST endpoint requires a shared secret in the X-Webhook-Secret header. The scraper compares it in constant time against its WEBHOOK_SECRET environment variable. A missing or wrong value returns 401.
/health needs no secret and reveals only which variable names are missing.

Response conventions

All three POST endpoints report unexpected failures in the response body with HTTP 200 and "status": "error", so n8n can branch on the result without treating it as a transport error. The one exception is the /append-index out-of-order case, which returns 409 (see below).
/append-index also uses HTTP status codes, including 409 for the one condition the workflow acts on: