Often when going though web error logs of clients I find that they are usually missing a robots.txt file. Most people don’t see it and it’s one of those things that falls through the cracks in the excitement of building a website.
There are hundreds of ways to build a robots.txt file but for the [...]
robots.txt SciFi book OR Helpful website tool?
October 16th, 2007 · No Comments
Tags: Search Engines · Web Development
Submitting your site to Search Engines Part 2 Sitemap Submission
October 16th, 2007 · No Comments
Following on the tails of how to create a sitemap file. Now that you have your site map all ready how do you let search engines know about it? There are a really two ways. One is ‘Passive Submission’ the other ‘Active Submission’.
Tags: Search Engines