Author: A.Z4 (6 Jun 07 6:25pm)
Your bot(MJ12bot) gets in to spider trap. does not follow robots.txt all the time.
Just picture this: there is a page with with a pixel link on it. human can't see it, you are not Google(yet) . So if your bot follows the pixel link, it gets banned and reported.
It is possible that some bad folk use fake user-agents, they do it all the time. Unfortunately if someones bot comes to a site and claims to be nice these days comming from Dynamic IP Ranges, it would certanly get banned on the sites like mine in a heart bit.
The user agent could say it is a SLURP bot, but unless there is a way to verify it, its not a slurp.
you might also want to programm it to :
once it gets a 403 to stop crawling the site.
check whois on
188.8.131.52(Managed Solutions Group, Inc.) Hosting
184.108.40.206(Managed Solutions Group, Inc.) Hosting
220.127.116.11(Charter Communications MDFRD-OR-68-185-0) Dynamic
what do you expect?