Practically each webmaster tries to optimize pages of the website so that to receive as much as possible quantity of the indexed elements. But in certain cases the entry form of registration data, recovery of passwords, etc. is required to hide on the contrary some pages, for example.
It is required to you
- Editing Robots.txt file.
Instruction
1. The easiest way close indexation of several sections or specific all website is an introduction of the corresponding file recording of robots.txt. It is used as the guide for search engines. At run on pages of the website the search robot refers to this file if it is absent, it indexes all website, otherwise follows the recommendations specified in this file.
2. If you created the website independently, and you have no such application, in the form of the text document with the indication of the bans, easy to create it most. Open the new text document, for example, through the Notepad program. In a body of the document place the next lines: User-agent: * Disallow:/file.htmlDisallow: / directory /
3. Now let's understand that you set to the search engine as a task. The sign "*" opposite to User-agent means that all file systems need to carry out this instruction. For example, if you register instead of "*" Yandex value, this access will be read only by the robot of the search engine Yandex. Disallow operators prohibit indexation of the specific section (directory) or the file (файл.html).
4. After drawing up the robots.txt file it is possible to pass directly to texts on pages of the website. As you know, search engines are not loved when on your pages more than 3 external active references are located. What to do if it is necessary blood from a nose, but to place 5 or more references. In these cases it is possible to use the rel= attribute" nofollow" or the <noindex> tag.
5. For closing of links from indexation of the Google search engine it is necessary to give the reference in the following view: <href=http://website.ru rel= "" nofollow""> link anchor </a>. The body of an attribute needs to be implanted into any part of the link, without forgetting about division by a space, i.e. the attribute can be placed between "a" and "href" or between the link and its anchor.
6. For closing of links from indexation of the search engine Yandex it is necessary to give the reference in the following view: <noindex> <href=http://website.ru rel= "" nofollow""> link anchor </a> </noindex>. The tag is put at the beginning and at the end of the link. Do not forget that this tag pair: the second part, unlike the first, goes signed "/".