 |
 | 
Submitting New URLs
|
 |
 |
Please submit only one URL. Our crawler, Scooter, will eventually explore your entire site by following links. |
|
Do not submit a description or keywords with a URL. To control the abstract served back with your page, use META tags. |
|
Remember that URLs are case-sensitive, and please check your spelling. |
|
If the page is successfully fetched, it is added to the index. It should be available for queries typically in less than a day, possibly two days for our mirror sites. |
Removing Pages from the Index
 To remove a bad link from the index, simply resubmit the URL. All URLs that return a 404 are removed from the index within a day or two of being submitted.
To remove a page that does exist from the index, it will be necessary to write a robots.txt file for the site.
To exclude all pages of a site from the index, it will be necessary to write a robots.txt file for the site.
|
