Type: GET
URL: /robots.txt
Request made at:
- 7 hours ago
- 2:59:42 AM, 03-07-2025 UTC
Headers:
- connection: upgrade
- host: b8.pw
- x-forwarded-for: 104.210.140.131
- x-openai-originator-env: prod
- x-openai-product-sku: unknown
- x-envoy-expected-rq-timeout-ms: 15000
- x-request-id: c18afedb-d49d-4fa3-a2b5-804174f04017
- cf-ray: 959320de0b6ce79a-DFW
- x-openai-internal-caller: webcrawler-robots-txt
- accept-encoding: gzip, br
- accept: text/plain
- cache-control: no-cache
- user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
- x-openai-traffic-source: user
- x-openai-originator: webcrawler-robots-txt
- x-forwarded-proto: https
- cdn-loop: cloudflare; loops=1
- cf-connecting-ip: 104.210.140.131
- cf-ipcountry: US
- cf-visitor: {"scheme":"https"}
No request body.