Setup robots.txt

Admin11 January 2017

From the beginning I made some mistakes in the indexing of SEO Hero site, but corrected.

Now indexing site happens according to plan.

I created a site map. Read more at the link — seoheronews.com/sitemap.

However, I did not realize the response codes of the server and did not close all the technical pages from the Google and Yahoo. Now I created a file robots.txt and closed from indexing irrelevant pages.

Some pages closed from indexing via a special meta tag robots.

User-agent: *
Disallow: /cp/
Disallow: /search/
Disallow: /goto?
Disallow: /login
Disallow: /api
Host: https://seoheronews.com
Sitemap: https://seoheronews.com/sitemap.xml

Wix

Wix news

LATEST POPULAR PICK DATE

2017-04-08

183DDoS Attack on SEO Hero

2017-03-30

1181Wix Contest

2017-03-19

2017-03-18

2017-03-15

129SEO Hero Cases

2017-03-14

2017-03-13

92SEO Hero Links

2017-03-11

95About SEO Hero

2017-03-10

54SEO Hero app for mobile devices

2017-02-28

23SEO Hero Firefox addon

2017-02-17

2017-02-16

18Preventing the attack

2017-02-15

136Privacy policy

2017-02-08

35Adding a site to DMOZ

2017-02-01

61SEO Hero conference 2017

2017-01-31

2017-01-30

24Image stocks

2017-01-28

70Google recommendations - DONE

2017-01-26

45SEO Hero extension for Opera

2017-01-25

21To protect SEO Hero in social networks against cybersquatting

2017-01-18

172SEO Hero extension for Google Chrome

2017-01-17

24SEO Hero in SERP

2017-01-14

60SEO Hero School by Wix

2017-01-13

24Mistake which cost SEO Hero 50 positions in Google

View all news

Google

Sergey Ludkiewicz

April 20

URL parameters of the Google search engine results page

There is a possibility to adjust the results for the base query (which corresponds to the value of the parameter q or as_q ) using a number of get-parameters of the format variable=value used in the URL of the page of search results after the substring /search? . The use of these parameters can be very useful when parsing search results.

SEO

Dmitriy SevalnevCEOPixel Plus

January 4

The basic SEO requirements

Here are the list of the most important SEO requirements that must be followed in each optimized page on the site. Requirements are also useful as a SEO guide for the developers of website, which will be optimized.