Greg M. Johnson wrote:
I don't think that Google Books at least gets this. I spent so much time at Google Books, browsing in apparently spider-like fashion, that I got this warning:
"We're sorry...
... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now."
That may not be a quetion of getting `it´ but of getting `hit´. gutenberg.org too gets hit by dozens of spiders a day, some of them sitting on big pipes and working with up to a hundred threads. While one of those spiders is at work, a human user can just about forget getting anything out of gutenberg.org because all server cycles are used to serve the spider. This is why gutenberg.org automatically denies access to IPs that make more than a certain amount of requests per hour. I think with Google the problem may be even worse than with gutenberg.org. -- Marcello Perathoner webmaster@gutenberg.org