I am kind of dumb founded to learn about this politeness policy under one of the search engines webmaster tools.
Is the politeness issue refers to my blog tone or is it talking about repeated submissions of the web site URL or something totally different?
Under Wikipedia web page for Web Crawler, it has text as "The MercatorWeb crawler follows an adaptive politeness policy: if it took t seconds to download a document from a given server, the crawler waits for 10t seconds before downloading the next page." Now what does it mean? This is talking about something totally different about time and response.
I may have to hold on to this issue as I couldn't figure out what is what. If you have an answer to enlighten me please post it in the comments.
Thanks.
Is the politeness issue refers to my blog tone or is it talking about repeated submissions of the web site URL or something totally different?
Under Wikipedia web page for Web Crawler, it has text as "The MercatorWeb crawler follows an adaptive politeness policy: if it took t seconds to download a document from a given server, the crawler waits for 10t seconds before downloading the next page." Now what does it mean? This is talking about something totally different about time and response.
I may have to hold on to this issue as I couldn't figure out what is what. If you have an answer to enlighten me please post it in the comments.
Thanks.
Comments
Post a Comment