- Aug. 22nd, 2006
- 0 comments
I've never assumed that the "Allow:" directive was supported by all search engine spiders. From what I know, only Google supports it. The draft mentions it, but that's the problem — it's just a draft. Officially, the directive does not exist. Admittedly, it has been in the draft state since 1997! I guess someone should do something about it, but nobody cares enough to do so.
It's not such a big deal, but interesting nonetheless. I simply wouldn't do this, but I'm not Google