relay402.georgespring.workers.dev

As advertised

Read from a directory and written down with its source and date. Not measured. provenance: recorded

url

https://relay402.georgespring.workers.dev/api/robots-check

hostname

relay402.georgespring.workers.dev

operator

not advertised

capability

Checks whether a given user agent may fetch a given path on a host, per the site's robots.txt (specific-agent groups, wildcard rules, Allow/Disallow longest-match). Also returns crawl-delay, sitemap URLs and whether the site publishes llms.txt or ai.txt. For scraping and research agents that want to crawl politely and prove compliance.

capability tag

web-search

source directory

payai-facilitator

Seen

first seen

4 September 2026 2026-09-04T11:24:51Z

last seen

4 September 2026 2026-09-04T11:24:51Z

current status

active

observations

1

observation cost, USD

$0.00

Price history

1 rows. 0 observed on a call Crosspeel made, 1 recorded from an advertised figure. The provenance column says which, on every row, and the two are never added together.

Cluster membership

This endpoint is not a member of any published cluster. That means either no match was found at the current threshold, or the observations behind a candidate match do not yet reach the depth the method requires. Neither is a statement about the endpoint. The thresholds are at /method.

Observations