Free browser tool

AI crawler log command builder

Pick your log format and crawler token, then copy commands to inspect recent visits, top paths, and status code distribution.

Server log format Crawler token Log file path

How teams use this

Run these commands before changing robots policy. You want proof from logs: which crawler visited, which paths were requested, and whether status codes were healthy.