Search Engine Optimization
Would you like to react to this message? Create an account in a few clicks or log in to continue.
Search Engine Optimization

open discussion

Affiliates
What is robots.txt? Image-6549946-10459049
Latest topics
» How do you insert images in HTML?
What is robots.txt? EmptyTue Feb 14, 2023 1:39 pm by Designpluz

» What tag is used to insert the main and largest heading in HTML?
What is robots.txt? EmptyTue Feb 14, 2023 1:39 pm by Designpluz

» Is any of the following software suitable for building websites?
What is robots.txt? EmptyTue Feb 14, 2023 1:38 pm by Designpluz

» Browsers apply the tag feature until they encounter a ___ tag.
What is robots.txt? EmptyTue Feb 14, 2023 1:38 pm by Designpluz

» Which language is helpful to create web pages?
What is robots.txt? EmptyTue Feb 14, 2023 1:38 pm by Designpluz

» Which is the most common language used in web designing?
What is robots.txt? EmptyTue Feb 14, 2023 1:37 pm by Designpluz

» Can comments be inserted into HTML code without being picked up by the browser?
What is robots.txt? EmptyTue Feb 14, 2023 1:37 pm by Designpluz

» What is the point of marking an element as an ARTICLE, MAIN, HEADER, or ASIDE?
What is robots.txt? EmptyTue Feb 14, 2023 1:36 pm by Designpluz

» Are there any ways to reduce the loading time for a page?
What is robots.txt? EmptyTue Feb 14, 2023 1:36 pm by Designpluz


What is robots.txt?

2 posters

Search Engine Optimization :: Search Engine Corner :: Search Engine Optimization

Go down

What is robots.txt? Empty What is robots.txt?

Post by Designpluz Mon Aug 07, 2017 6:01 pm

What is robots.txt?
Designpluz
Designpluz
platinum
platinum

Posts : 6928
Earned : 34115
Credit : 0
Join date : 2017-01-04

http://www.designpluz.com.au/

Back to top Go down

What is robots.txt? Empty Re: What is robots.txt?

Post by bangalorewebguru Thu Aug 10, 2017 9:09 pm

This text file which sits in the root of your website's folder communicates a certain number of guidelines to search engine crawlers. For instance, if your robots.txt file has this line in it; User-agent: * Disallow: / it's basically telling every crawler on the web to take a hike and not index ANY of your site's content.

bangalorewebguru
platinum
platinum

Posts : 1204
Earned : 4896
Credit : 4
Join date : 2013-10-15
Age : 31
Location : Bangalore

Back to top Go down

Back to top

Search Engine Optimization :: Search Engine Corner :: Search Engine Optimization

 
Permissions in this forum:
You cannot reply to topics in this forum