NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.
All the Perl that's Practical to Extract and Report
Stories, comments, journals, and other submissions on use Perl; are Copyright 1998-2006, their respective owners.
Errrm (Score:1)
So you would prefer that the site be almost inaccessible sooner than you would ban MSNBot?
This is not GoogleBot we’re talking about here, or even the Yahoo crawler. Who really cares about MSN? Honestly? I mean, do you use MSN search? Do you
Re: (Score:2)
> So you would prefer that the site be almost inaccessible sooner than you would ban MSNBot?
I think that this is a signal to improve site's performance, not more that that.
> Who really cares about MSN? Honestly?
That does not matter. If they with to collect data, they should be able to do that, I think. And are you sure that msnbot is not used for bing.com, which is default search engine in Windows 7's MSIE.
Re:Errrm (Score:1)
"If they with to collect data, they should be able to do that, I think."
I think so too, but they should not be evil when being nice can do the job.
And this banning is part of what is getting their attention. Barbie can not make them be nice, only they can decide to be nice. In the meantime, cpan should not bend over for them being stupid and mean and uncaring.
They know they have a problem, and they choose to go on anyway for their own profit.
Let them in when they can act properly.
I understand they ignore robots.txt. _Bad_
Reply to This
Parent