robots

Robots directive inspection — coming soon

Planned: retrieve and inspect published robots.txt directives for a website.

3 credits · USD $0.003 · Coming soon; unavailable and unbilled.

Input schema

{
  "type": "object",
  "properties": {
    "url": {
      "type": "string",
      "maxLength": 2048,
      "x-maxUtf8Bytes": 2048
    },
    "agent": {
      "type": "string",
      "maxLength": 100,
      "x-maxUtf8Bytes": 100
    }
  },
  "required": [
    "url"
  ]
}

Request

curl -X POST 'https://staging.callmint.dev/v1/robots' \
  -H 'Authorization: Bearer YOUR_API_KEY' \
  -H 'Idempotency-Key: unique-request-001' \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com"}'

Response (503)

{
  "error": "endpoint_unavailable",
  "credits_charged": 0
}

Limitations

Unavailable: safe egress has not been verified. No authoritative bot allow/deny or RFC 9309 compliance is claimed. No outbound fetch or billing occurs.

All enabled routes accept a JSON object of at most 60,000 UTF-8 bytes. String limits are also measured in UTF-8 bytes.