On July 19, 2001, the WISEnutbot ignored my robots.txt file on my photo gallery. I contacted WISEnut via e-mail to complain, and on July 20, 2001, received the following reply:

From: Kimoon Kim Kimoon.Kim@WISEnut.com
Subject: RE: Respect robots.txt
Date: Fri, 20 Jul 2001 09:53:46 -0700
To: 'Rob Carlson' rob@lithium.elemental.org

Dear Rob Carlso:

I apologize for the inconvenience our crawler has caused and I will take immediate action on this matter.

We updated access control information for your site so that the crawler should respect your robots.txt file. Also, we're going to remove all the files we acquired because of this situation.

We make efforts to keep eye on robots.txt file and to ensure our crawler behaves itself. However, there was a possibility that we didn't keep up with the changes made in your robots.txt file. I apologize again for possible inconvenience from this belated activity.

If our crawler has caused any other problems, please contact us immediately.

Thank you for your cooperation.

Regards,

Kimoon Kim
Engineering Manager, WISEnut Inc.

No Comments | #1079

Unless noted, all content on epistolary.org is © Copyright 1999-2008 to Rob Carlson with all rights reserved. All information is verified when possible, cited as appropriate and applied in the real world at your own risk. Send all feedback to rob@vees.net.