Home > How To's Library > Building A Website > Apache > Page 3

Apache

|< <

Using the Mod Rewrite URL Rewriting Engine to Deal with Bad Robots and Pesky Spambots

One of the greatest features of the APACHE server is Mod Rewrite. This optional module allows you to control URL access in an almost infinite manner of ways. Our task at hand though is to protect our server from wasteful accesses that for a variety of reasons can drag the server to its knees. The problems with many robots and spambots can be broken down into a few areas: * They either ignore the robots.txt instructions file, or attempt to exploit it to find otherwise unlinked directories. * Due to programming errors, they can get caught in loops, attempting to access files that do not exist. * If they are what is called multi-threaded, they can launch an almost unlimited number of concurrent connections to your site creating a serious system load.

Listing Last Modified: Mon Jun 13 2005

 


Views: 53


|< <