You may know that every website has a fill called robots.txt in it's root. This file allows or disallows the search engines to report that results to you that the website owner don't want to tell you about. BUT do you know that still you can view these results by typing /robots.txt after the website address.
for ex. if you want to know what Microsoft hides from you just type www.microsoft.com/robots.txt and you will find the list of directories that bill gates want to hide from you.
Thursday, July 31, 2008
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment