1. Consider whether the page is really necessary
First, consider whether the page is truly necessary for the site administrator and users.
We recommend deleting unnecessary pages rather than setting the noindex tag. If you have multiple similar pages, consider whether you can consolidate them.
2. Consider whether it needs to be crawled
After deleting or merging pages, consider whether they need to be crawled.
If the page is necessary but does not need to be crawled, the robots.txt settings guatemala phone number resources are appropriate.
For example, you should set the site's administrator page not to be crawled, since you do not want it to be accessed by outsiders.
3. Consider whether you need indexes
Finally, consider whether or not the page needs to be indexed. If you determine that the page needs to be crawled but does not need to be indexed, set the noindex tag.
Specific examples for determining the need for indexing are explained in the following chapter.