Comments on: Advanced spam control with mod_rewrite http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/ It's about the internet and stuff. Fri, 21 Aug 2009 20:29:07 +0000 hourly 1 http://wordpress.org/?v=3.0 By: Apache Access Control with mod_rewrite at Docunext Technology http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18819 Apache Access Control with mod_rewrite at Docunext Technology Sat, 19 Apr 2008 15:56:49 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18819 [...] This related link does a simple test to find if the User-Agent is empty and blocks it if it is: http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/ [...] [...] This related link does a simple test to find if the User-Agent is empty and blocks it if it is: http://www.ap4a.co...with-mod_rewrite/ [...]

]]> By: David Anderson http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18813 David Anderson Mon, 07 Apr 2008 15:17:57 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18813 Thanks Andreas :) Thanks Andreas :)

]]> By: Andreas Lagerkvist http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18812 Andreas Lagerkvist Mon, 07 Apr 2008 14:59:48 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18812 Ok, thanks for sharing. Nice site, bookmarked. Ok, thanks for sharing. Nice site, bookmarked.

]]> By: David Anderson http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18811 David Anderson Mon, 07 Apr 2008 14:01:15 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18811 <blockquote>Are there any SEO-issues with disallowing empty user-agent strings?</blockquote> Not as far as I'm aware, Andreas. Most/all SE spiders identify themselves with a UA string, so there shouldn't be a problem.

Are there any SEO-issues with disallowing empty user-agent strings?

Not as far as I'm aware, Andreas. Most/all SE spiders identify themselves with a UA string, so there shouldn't be a problem.

]]> By: Andreas Lagerkvist http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18810 Andreas Lagerkvist Sun, 06 Apr 2008 23:02:53 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18810 Cool idea, I may implement it on my site. Are there any SEO-issues with disallowing empty user-agent strings? Cool idea, I may implement it on my site.

Are there any SEO-issues with disallowing empty user-agent strings?

]]> By: jwcoggin http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18099 jwcoggin Wed, 19 Dec 2007 18:37:13 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18099 David, It is really good to hear someone who has a page and is not concerned with page rank. Your credit will come in time. Fine blog! David, It is really good to hear someone who has a page and is not concerned with page rank. Your credit will come in time.

Fine blog!

]]> By: jwcoggin http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-18098 jwcoggin Wed, 19 Dec 2007 18:36:04 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-18098 Jan, You are exactly right but it is also important to not harp on page rank. A good quality blog such as this will have "regular" users no matter what. Jan,
You are exactly right but it is also important to not harp on page rank. A good quality blog such as this will have "regular" users no matter what.

]]> By: David Anderson http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-17756 David Anderson Thu, 15 Nov 2007 17:53:46 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-17756 Since posting the above comment Google has now stripped all PR from this site (that's after already dropping 1 point after the update mentioned by Jan earlier). It's good to see the impartial criteria they place on ranking in action for the benefit of the end user. Pathetic. Since posting the above comment Google has now stripped all PR from this site (that's after already dropping 1 point after the update mentioned by Jan earlier). It's good to see the impartial criteria they place on ranking in action for the benefit of the end user. Pathetic.

]]> By: David Anderson http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-17677 David Anderson Mon, 05 Nov 2007 16:05:58 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-17677 Hi Jan, thanks for the comment! I understand what you're saying, however I don't place so much weight on Google PR that I'm going to allow Google to use it to dictate what appears on my site, or who/what I link to. To me such anti-competetive practices do nothing to instill anything other than a feeling of enmity towards them, and I'm not about to make any changes here out of fear for what they might do. At the end of the day they provide a second rate search service that is only at number one because the majority of users don't know any better than to use them. That'll change in time, the volume of rubbish results they provide will only continue to rise as they artificially alter them in ways like this, which will eventually result in more people switching to better services such as Yahoo's. Hi Jan, thanks for the comment!

I understand what you're saying, however I don't place so much weight on Google PR that I'm going to allow Google to use it to dictate what appears on my site, or who/what I link to. To me such anti-competetive practices do nothing to instill anything other than a feeling of enmity towards them, and I'm not about to make any changes here out of fear for what they might do.

At the end of the day they provide a second rate search service that is only at number one because the majority of users don't know any better than to use them. That'll change in time, the volume of rubbish results they provide will only continue to rise as they artificially alter them in ways like this, which will eventually result in more people switching to better services such as Yahoo's.

]]> By: Jan http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-17676 Jan Mon, 05 Nov 2007 15:51:23 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-17676 Hm, cool idea! However, after the latest update of the pagerank databases I'd turn off the TLA. When I browsed one blog I found one post explaining the penalty given to that site just because of selling text links. Immediately after removing the ads, the traffic returned to normal. Hm, cool idea! However, after the latest update of the pagerank databases I'd turn off the TLA. When I browsed one blog I found one post explaining the penalty given to that site just because of selling text links. Immediately after removing the ads, the traffic returned to normal.

]]> By: David Anderson http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-16836 David Anderson Thu, 02 Aug 2007 16:02:30 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-16836 <blockquote>I think .htaccess files do some amazing things</blockquote> They certainly do, Todd. By the way, I remembered where I got the idea of doing it from originally, and there's a very comprehensive list of spammer IPs and useragents available along with a walk-through on configuring them all. Very useful if you get a lot of junk coming through to your site. It's archived at <a href="http://diveintomark.org/archives/2003/02/26/how_to_block_spambots_ban_spybots_and_tell_unwanted_robots_to_go_to_hell" title="Tutorial on blocking spambots, at Dive into Mark">Dive into Mark</a>.

I think .htaccess files do some amazing things

They certainly do, Todd.

By the way, I remembered where I got the idea of doing it from originally, and there's a very comprehensive list of spammer IPs and useragents available along with a walk-through on configuring them all. Very useful if you get a lot of junk coming through to your site. It's archived at Dive into Mark.

]]> By: Todd Harrison - LA Headshot Photography http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-16835 Todd Harrison - LA Headshot Photography Thu, 02 Aug 2007 12:28:25 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-16835 I think .htaccess files do some amazing things anywhere from 301 redirct to blocking IP address. This is an interesting point you made I think I will try doing this in my site also. making sure to block those bots. and crazy spammers. I think .htaccess files do some amazing things anywhere from 301 redirct to blocking IP address. This is an interesting point you made I think I will try doing this in my site also. making sure to block those bots. and crazy spammers.

]]> By: Affiliate Marketing Journal | Oh, so I'm not the only one the TextLinkAds bot can't read ads on http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-16719 Affiliate Marketing Journal | Oh, so I'm not the only one the TextLinkAds bot can't read ads on Fri, 20 Jul 2007 17:02:05 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-16719 [...] - they just don’t care. Dave at ap4a has been back and forth with them because they’re using an empty user agent for their bot, just like most spammers and [...] [...] – they just don't care. Dave at ap4a has been back and forth with them because they're using an empty user agent for their bot, just like most spammers and [...]

]]> By: AIS by Sarah » Watch your .htaccess with Text Link Ads http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/comment-page-1/#comment-16605 AIS by Sarah » Watch your .htaccess with Text Link Ads Thu, 12 Jul 2007 09:04:30 +0000 http://www.ap4a.co.uk/archives/2007/advanced-spam-control-with-mod_rewrite/#comment-16605 [...] Dave’s full post plus the htaccess code used can be found on his post - Advanced Spam Control. [...] [...] Dave's full post plus the htaccess code used can be found on his post – Advanced Spam Control. [...]

]]>