This is weird-- the White House web site's robots.txt file is configured to keep search engines from looking at several hundred directories with "Iraq" in the name.
I haven't looked real deep into this, but it strikes me as odd that an administration so concerned with getting its own version of events out (bypassing the "filter" as Dubya put it) would at the same time be trying to keep others from finding information that it has fully under its own control.
UPDATE: Some thoughts on this from the Democrats (echoed by others if you follow the links) on this. This could be an attempt to keep others from noticing when they change content on the website.
Posted by Jason at October 27, 2003 08:33 AM