The search engines use programs called “spiders” to discover new pages on the Internet. The spiders simply scan every page they know about, and find links to new pages. As they find them, new pages are added to the search engine’s database, or “index”.
It stands to reason, then, that in order to appear in the search engine results, your web pages must be in the index of each of the search engines.
How do you find out if your pages appear in the index? Just typing the URL of a page won’t necessarily tell you – you might just end up with a list of all your competitors sites. You need to use one of the search engine operators.
Here’a cheat sheet listing some of the operators you can use with Google: Google Cheatsheet.
The other search engines generally use similar operators.
The one we need to use to find out if a site is in Google’s index is “info:”. You would type info:yourwebsite.com to find out what Google knows about the site. (Make sure there’s no space between the colon and the first letter of the domain name.)
If Google tells you, “Sorry, no information is available for the URL yourwebsite.com”, it means that the site is not yet indexed.
It used to take a couple of months to get a site indexed. Fortunately, these days, it’s a lot quicker. It’s possible to get a new site indexed in a few hours, using the immense power of social media networks.
In fact, all you need to do is submit a single link to Digg.com and your site should be indexed within a few hours.
If you update your website regularly, as you should, you’ll find that the search engines come back and index your new pages within a few hours.
12 Comments
Hi Derrick
Thanks for a well writen and informative article.
Kind regards
Pearl
Pearl Seigel´s last blog post..Marketing, Mice and Mouse “Traps”
that was cool, google cheatsheat rocks, i’ve tried this to find flashy web templates, and believe me, this tricks work far more times better than general search in Google
Hey that was a very straightforward and informative article,Its gives you fair insight as to how to optimize your SEO work. A newbie in this field will get a lot of idea from your post.
wow, that was marvelous trick, i m sure it will help me to kick off many of mine competitor, but i didn’t got why it works with only digg ! or you were showing just an example.
Great way of knowing the real status of your website. But the tip of leaving a link at digg.com is smart.True its lot easier these days because we find whole world on internet.But its great that your sites gets updated and that too within the few hours.
Its really important for every websites to get indexed. If our web page is not indexed will have less search results and very less viewers, and our main idea of exchanging the knowledge as well as good earning will not be met. I wasnt aware about the operators by which we can check out whether our page is indexed or not. Thanx for the valuable info!
I find inserting robot crawl instructions into the coding of website designs also helps speed up the process of being indexed and also helps keep a site up high for findability once it’s up there, as well as submitting the site link to search engines once a month. Some blogs are indexed really quickly too, without doing anything about it, other than posting a new article – so it helps (getting traffic to your website) to have a blog on the same server as your main business website, with some links from the blog going to your website.
Teresa Schultz´s last blog ..We’re currently no.1 on Google.co.za for web design!
I would have to agree that a link from Digg will quickly get any page indexed and will also help to get an entire site indexed depending on the size. I just wish I could get to the front page of Digg, but my content/articles do not appeal to a wide audience.
It would be a waste of your time to optimize your website for keywords that are not even being searched for. Therefore you should invest some energy into finding the best keywords. There are several SEO tools available on the Internet to help you find the best keywords. Tip: Don’t be deceived by organizations that require you to register first. The two most popular resources are WordTracker and KeywordDiscovery.com.
It’s a fact and one of my top 10 SEO tips, that search engines analyze incoming links to your website as part of their ranking criteria. Knowing how many incoming links your competitors have will give you a fantastic edge. Of course, you still have to discover your competitors before you can analyze them.
Mark Daniel´s last blog ..Laugh and Live Happily
There are different theories about how long your Title should be. Since Google only displays the first 66 or so characters (with spaces), my Top 10 SEO Tips for the title would be to keep it under 66 characters and relevant to the content on the page. However, some may argue that the value of the homepage title may warrant additional search term inclusion.
Rob´s last blog ..Workout Inspiration Part Three
These are cool tips on search engine optimization for website. I do own few websites. Some are for adsense purpose and some are corporate service providing websites. Your tips on finding out the information about the website in search engines are really good, it is noteworthy and this article is very informative.