It is important to understand that a server header code is completely transparent to the end user (viewer) of the site. Every page in a website can put out a 404 (page not found) server header code, but the entire site can still be visible to a viewer of the site.
This presents itself as a problem when the "custom 404" page puts out a 200 server header code (page found) when it actually should be putting out the standard 404 server header code so the page is not indexed by a search engine.
So, here are the most important server header codes for a webmaster to use:
200 (page found). This is the normal code that most pages put out.
404 (page not found). Use this when you do not want a page to be indexed.
301 (page permanently moved). Use this whenever a page (or site) has been moved.
A 302 (temporary move) is very dangerous because there is no way for a search engine to know if the page will come back, so in some cases, the page will remain for many years in the search engine index. Yahoo is the worst at this, and will keep some pages for many, many years when the server header code is a 302, instead of a 301...
Labels: SEO