No matches.
Free SEO tool
Check the status code returned by a website for a generated missing page.
Share
Check if a website has a robots.txt file and review its sitemap and disallow rules.
Check for 301 & 302 redirects of a specific URL. It will check for up to 10 redirects.
Get all the HTTP headers that an URL returns for a typical GET request.
Popular tools
Find all internal links on a webpage.
Find plaintext email addresses exposed in a webpage source.
See which AI crawlers the robots.txt of a website allows or blocks for a URL, and which rule decides.
Check the Ahrefs Domain Rating of a website.
Test a URL against any user-agent on the live or a pasted robots.txt, and see the group and line that decide.