1.) Most spiders/crawlers download a file called robot.txt first. In this file you can specify files which should not be included in the analyze. I get around 30 hits per month for this file (404 error, because this file dont exist).

2.) I guess renderosity uses a pearl/cgi script to initiallize the download. Im not sure whether spiders can access and interpret cgi files.