Shirley Kaiser has produced another of her invaluable resource lists on web topics. This time it’s Behind the Scenes with Apache’s .htaccess.
Regarding combating bad bots and spammers, .htaccess is one of several tools and approaches that I use. My goal is to keep things simple and block the bad guys without blocking everyone else. No one single approach can do it all, though, and bad bots and spammers continually work on ways to get past all the blocking approaches discussed online. So far I’m able to block nearly all of the bad bots and spammers, but new ones always come along, so I watch my logs closely, too.
On to some website links that I’ve found especially helpful.
She’s kind enough to include the article I collated on behalf of Wise Women: Using the .htaccess File, but there are loads of links in her list. It’s thorough, comprehensive and extensive. It even goes on to robots.txt, HTTP Error Codes and more. Bookmark it now.