Question posted by crittercorral1 on February 10th, 2015
Robot Txt
what is robot txt, why & how is it used?
Current Answers
Answer #1: Posted by Odin on February 10th, 2015 11:24 AM
Odin
Member since:
April 10th, 2010 Points: 41,236,630
Member since:
April 10th, 2010 Points: 41,236,630
Your question, I believe, refers to robots.txt, which is instructions by website creators to search engine robots that scan websites for users of their respective search engines. The robots.text file defines text to be excluded from the scanning. More details here.
Hope this is useful. Please don't forget to click the Accept This Answer button if you do accept it. My aim is to provide reliable helpful answers, not just a lot of them. See https://www.helpowl.com/profile/Odin.
Similar Questions
I Put This Blog Up And Want To Remove It, But How? Dont Have Email Or Name Used
I need to remove this blog but forgot the user name and email address and name i used to create it?
I need to remove this blog but forgot the user name and email address and name i used to create it?
(Posted by flddrms 8 years ago)
Received A Txt Msg From 'google' On Cell Phone ... Is This From Google And Why
msg came fro 754 263 1778 .... said my verification code is 235868 ... what is this and why was it s...
msg came fro 754 263 1778 .... said my verification code is 235868 ... what is this and why was it s...
(Posted by chrislee61969 9 years ago)
Get Box Saying 'you Are Over Quota,please Reconfigure To Use Less Space'.
As soon as I started using the cloud I started getting a box in the middle of my screen saying "you ...
As soon as I started using the cloud I started getting a box in the middle of my screen saying "you ...
(Posted by murphy22 10 years ago)
Why Is It That I Cant Use My Txt Messeging Or It Cant Send Txt Messages
(Posted by ggmcorpinc 13 years ago)
How Do I Delete My Picture From Google Images?
My profile picture from Facebook is on google images and I want it deleted.
My profile picture from Facebook is on google images and I want it deleted.
(Posted by parmarjasmin 14 years ago)