| Main page |
Google XML for Sitemap.xml |
||
| XML Files are in Beta testing with Google and
other search engines. I have found them useful in getting fast listings.
Writing them is another story. I have made very simple ones with Excel,
and I have made ones with various tools. But the real strong suit is the
liked DTD (See link below). http://www.cs.uiowa.edu/~rus/Courses/IntroXML/Notes/xml3_2.pdf
|
|||
https://www.google.com/webmasters/sitemaps/stats?view=all&reverse=0&page=1&hl=e
New
To see the proper format for a somewhat standard robots.txt file look directly below. That file should be at the root of the domain because that is where the crawlers expect it to be, not in some secondary directory.
Below is the proper format for a robots.txt file ----->
User-agent: *
Disallow: /cgi-bin/
Disallow: /images/
Disallow: /group/
User-agent: msnbot
Crawl-delay: 10
User-agent: Teoma
Crawl-delay: 10
User-agent: Slurp
Crawl-delay: 10
User-agent: aipbot
Disallow: /
User-agent: BecomeBot
Disallow: /
User-agent: psbot
Disallow: /
--------> End of robots.txt file
This tiny text file is saved as a plain text document and ALWAYS with the name "robots.txt" in the root of your domain.