ddruckenmiller opened this issue on Mar 25, 2004 ยท 22 posts
Erlik posted Thu, 25 March 2004 at 4:09 PM
Spiders are search robots. usually used by search sites like Google and Yahoo and the others. but also used for some less savory business, like looking exactly where they are told not to look, in order to discover "hidden" stuff and enable the download by direct links. that is, there's a file robots.txt put in the root directory and which tells the robots what pages they shouldn't index. Or a bit on the page itself... But since all the pages on Renderosity are dynamically generated and download directories protected, not much use sniffing here. (Can you guess I do that for living? :-) That is, write about computer stuff.) As to the SQL errors, we had them when they were upgrading, didn't we? So something in the code probably. And yeah, had a few of them myself, plus about 40 seconds for a page to start loading.
-- erlik