Getting visitors you really don't want to have on your site?

SpyderTrax Version 3.0, BETA 1 is a new way to completely manage the web crawlers and robots that download your website content. It is a PHP program that bans bad-robots.

View request and response header of a HTTP connection and HTML source

Checking accessibility and accessibility-checking tools - Durham University

PHP Freaks is an online PHP Help community that provides PHP Tutorials, PHP Examples, PHP Scripts, PHP Support, Web Developer Documentation and more.

This is not an uber-checklist. There are probably many items that could be added. More importantly, it should not be seen as a list of items that must be addressed on every site that you develop. It is simply a guide that can be used: * to show the breadth of web standards * as a handy tool for developers during the production phase of websites * as an aid for developers who are interested in moving towards web standards

An overview list.

Robots.txt generator designed by an SEO for public use. Includes tutorial.Robot Control Code Generation Tool.

mod_rewrite RewriteRule generator will take a dynamic url and generate the correct mod_rewrite syntax to allow the url to be rewritten in a spiderable format.

The .htaccess is a simple method that allows you to customise the way the webserver works on a per directory basis.

.htaccess generator - will generate the files you need (.htaccess and .htpasswd) to password protect a directory of your website.

Apace htaccess file generator

Htaccess disable image hotlinking code generator. Just enter the site you wish to allow to link to the images, and the filetypes you want to block and it will generate the code for you!

Htaccess disable image hotlinking code generator. Just enter the site you wish to allow to link to the images, and the filetypes you want to block and it will generate the code for you.