View Single Post
Old 06-11-2008, 03:10 AM   #1
Greg
Da Guy Wut Owns Dis Joint
 
Greg's Avatar
 
Join Date: Mar 2007
Location: Texas
Posts: 3,566
Default Amusing web crawlers

I was merrily blocking a really nasty spambot from keymachine.de tonight and watching the Yahoo bots crawl around the board when I notice some amusing things.

The Yahoo bots attempt to access the download threads. Since they are not logged in, they can't get to them, of course. That's a good thing since otherwise they would be blowing megabytes of bandwidth on each crawl. That's a really strong reason for all sites to require logins and go the extra mile to block bots from creating accounts.

Another bit of amusement was someone from an irresolvable IP address (65.54.154.48) that turned out to be in a Microsoft netblock. I suspect that's a general net portal for employees and a sims fan happened to be surfing the sites at 10:00 PM on a Tuesday night, but still, it's still fun to think that maybe there's a reason why the corporation itself would be interested in the game!
__________________
Who are all these people and what do they know?
Greg is offline   Reply With Quote