Technical SEO

Do you use robots.txt or noindex when you want to keep a page out of search?

John Carlsson · 16 October 2026 · 0 replies
The Robots Exclusion Protocol became RFC 9309 in September 2022, and the standard itself states that its rules are not a form of access authorisation.
https://datatracker.ietf.org/doc/html/rfc9309
The full answer on robots.txt versus noindex is here:
https://aiwebpageseo.com/blog/is-robots-txt-still-used-robots-vs-noindex
Have you ever found a page blocked in robots.txt still showing in search results, and what did you do about it?
0 Replies
No replies yet.

Join the discussion

Sign in to reply, share your SEO experience and connect with other members.