Post Reply 
Stop a site from catching fake referers
Apr. 25, 2013, 03:13 PM
Post: #7
RE: Stop a site from catching fake referers
I think your filters will have to provide acceptable referer headers.

After I create a new cfg with only these two filters

Code:
[HTTP headers]
In = FALSE
Out = TRUE
Key = "Referer: Fake haaretz (Out)"
URL = "www.haaretz.co.il/opinions/.premium-1.2001807"
Match = "?"
Replace = "http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&ved=0CDEQqQIwAA&url=http%3A%2F%2Fwww.haaretz.co.il%2Fopinions%2F.premium-1.2001807&ei=pVJ4UcLlEciu4AT1-oGIAQ&usg=AFQjCNEYmboF_ZsMMtXZWteevEdabu1M2w"

In = FALSE
Out = TRUE
Key = "Referer: Fake haaretz (Out)"
URL = "www.haaretz.co.il/opinions/.premium-1.2001807"
Replace = "http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&ved=0CDEQqQIwAA&url=http%3A%2F%2Fwww.haaretz.co.il%2Fopinions%2F.premium-1.2001807&ei=pVJ4UcLlEciu4AT1-oGIAQ&usg=AFQjCNEYmboF_ZsMMtXZWteevEdabu1M2w"

and load www.haaretz.co.il/opinions/.premium-1.2001807, I see the subscribe overlay over the full article. The bot alert is not sent. I can dismiss the overlay and see the full article. So, the site appears to be looking for incorrect referer headers. A google referer is correct for www.haaretz.co.il/opinions/.premium-1.2001807 but not pages linked from www.haaretz.co.il/opinions/.premium-1.2001807. Your filters always provided a google referer.

I haven't tested beyond the above header filters and it was a quick test.

HTH
Add Thank You Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Stop a site from catching fake referers - JJoe - Apr. 25, 2013 03:13 PM

Forum Jump: