Message Board

Tracking Harvesters/Spammers

Feedfetcher-Google listed

Author: C.Carvalho2 (15 Nov 12 5:18am)

I started this week trying HP. We have several websites using Feeds.
I'm seeing that HP blocks all Feedfetcher-Google IP's

Example:
"Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=11280757161325417603)"

Feedfetcher-Google IP's blocked by HP in one site in the last 3 days:

72.14.199.114
72.14.199.119
72.14.199.120
72.14.199.73
74.125.16.222
74.125.16.83
74.125.16.84
74.125.16.86
74.125.16.87
74.125.16.88
74.125.16.92
74.125.16.94
74.125.17.149
74.125.17.150
74.125.17.208
74.125.17.210
74.125.17.215
74.125.17.217
74.125.17.224
74.125.17.225
74.125.17.226
74.125.17.93
74.125.176.41
74.125.178.156
74.125.179.86
74.125.18.155
74.125.18.162
74.125.18.227
74.125.181.26
74.125.182.34
74.125.183.22
74.125.19.209
74.125.19.36
74.125.19.46
209.85.238.103
209.85.238.110
209.85.238.44

Rss feeds are public, dont see the point to blacklist this IP's.
See http://support.google.com/webmasters/bin/answer.py?hl=en&answer=178852#robotsinfo

Some workaround for this issue? Or I have to deactivate HP for this website, as feeds are crucial for some users?

Hope I haven't to deactivate HP. The project is great. In this site alone blocked in the last 3 days 1983 offenders. Thanks for that :)

[EDIT]
Same issue for Feddburner!!
FeedBurner/1.0 (http://www.FeedBurner.com)

Today only, 9 Google IP's blocked:
74.125.182.27
74.125.182.36
74.125.183.21
74.125.183.31
74.125.182.38
74.125.182.47
74.125.182.26
74.125.182.24
74.125.182.35

Thanks in advance

Post Edited (15 Nov 12 7:16am)

Re: Feedfetcher-Google listed

Author: H.User1325 (15 Nov 12 7:28am)

When you say HP is blocking... I assume you mean you are using http:BL to check IP addresses and based on the results received YOU/your system is blocking the IPs. As a user of http:BL and Honey Pots, I don't mean to be a nit-picker, but help with a problem it is good to understand who is doing what.

If you are using http:BL it sounds like you need to adjust the threshold for rejection. I did not check all the IPs you listed but those I did check were identified as Google search engine addresses, for example my function returns "Google search engine 72.14.199.73" or not currently listed, 74.125.16.222.

How are you using http:BL?

Lou

Re: Feedfetcher-Google listed

Author: C.Carvalho2 (15 Nov 12 7:50am)

Thank you for replying H.User1325.

You are right, some come up with no reason!!
The IP range not identified as Google search and needs update in HP database is:

NetRange: 74.125.0.0 - 74.125.255.255
CIDR: 74.125.0.0/16
NetName: GOOGLE

About, the ... treshold for rejection. Im using joomla with a plugin that does the thing for me.
How can I adjust this?

Any help is appreciated from a newbie ;o)

Post Edited (15 Nov 12 7:50am)

Re: Feedfetcher-Google listed

Author: H.User1325 (15 Nov 12 7:55am)

Check http://www.projecthoneypot.org/httpbl_api.php
for a full explanation.
My app returned the following for your new list of IPs.

27 days 37 score Suspicious Comment Spammer 74.125.182.27
13 days 39 score Suspicious Comment Spammer 74.125.182.36
7 days 40 score Suspicious Comment Spammer 74.125.183.21
14 days 39 score Suspicious Comment Spammer 74.125.183.31
NXDOMAIN 74.125.183.38
NXDOMAIN 74.125.183.47
17 days 40 score Suspicious Comment Spammer 74.125.183.26
8 days 39 score Suspicious Comment Spammer 74.125.183.24
NXDOMAIN 74.125.183.35

It is of course your call as to how you use the information provided by http:BL. Personally I use http:BL to check only IPs that are accessing webpages to leave a comment. If their threat score is >40 I redirect them to a 406.3 error. All others are given the comment form. I do not care who sees other web pages. My objective is to block the comment spammers and I would have blocked two of your list.

Lou

Re: Feedfetcher-Google listed

Author: H.User1325 (15 Nov 12 8:08am)

"About, the ... treshold for rejection. Im using joomla with a plugin that does the thing for me.
How can I adjust this?"

You need to check the documentation for the plugin you are using. When I looked at the sample apps listed elsewhere on this site to get ideas about writing my implementation, I noticed that most included an options file with parameters for rejection criteria, etc.

Lou