Affiliates
Latest topics
why we use Robot.txt in SEO ?
2 posters
Page 1 of 1
why we use Robot.txt in SEO ?
by kavitajain9782 Tue Feb 03, 2015 5:52 pm
Hi
Please tell me why we use Robot.txt in SEO ?
Please tell me why we use Robot.txt in SEO ?
kavitajain9782- platinum
- Posts : 166
Earned : 761
Credit : 0
Join date : 2014-06-11
Re: why we use Robot.txt in SEO ?
by Radianinfosystems Thu Mar 05, 2015 6:30 pm
The location of robots.txt is very important. It must be in the main directory because otherwise user agents (search engines) will not be able to find it – they do not search the whole site for a file named robots.txt. Instead, they look first in the main directory and if they don't find it there, they simply assume that this site does not have a robots.txt file and therefore they index everything they find along the way. So, if you don't put robots.txt in the right place, do not be surprised that search engines index your whole site.
Web designing in Erode
Web designing in Erode
Radianinfosystems- gold member
- Posts : 36
Earned : 84
Credit : 0
Join date : 2015-03-05 -
Page 1 of 1
Permissions in this forum:
You cannot reply to topics in this forum
» What tag is used to insert the main and largest heading in HTML?
» Is any of the following software suitable for building websites?
» Browsers apply the tag feature until they encounter a ___ tag.
» Which language is helpful to create web pages?
» Which is the most common language used in web designing?
» Can comments be inserted into HTML code without being picked up by the browser?
» What is the point of marking an element as an ARTICLE, MAIN, HEADER, or ASIDE?
» Are there any ways to reduce the loading time for a page?