Type: GET
URL: /robots.txt
Request made at:
- 10 hours ago
- 7:04:30 PM, 01-07-2025 UTC
Headers:
- connection: upgrade
- host: b8.pw
- x-forwarded-for: 104.210.140.130
- x-openai-originator-env: prod
- x-openai-product-sku: unknown
- x-envoy-expected-rq-timeout-ms: 15000
- x-request-id: c259aad9-504c-4b54-af85-9316c03b3525
- cf-ray: 95882b612c5fa381-SEA
- x-openai-internal-caller: webcrawler-robots-txt
- accept-encoding: gzip, br
- accept: text/plain
- cache-control: no-cache
- user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
- x-openai-traffic-source: user
- x-openai-originator: webcrawler-robots-txt
- x-forwarded-proto: https
- cdn-loop: cloudflare; loops=1
- cf-connecting-ip: 104.210.140.130
- cf-ipcountry: US
- cf-visitor: {"scheme":"https"}
No request body.