Showing posts with label SEO. Show all posts
Showing posts with label SEO. Show all posts

Wednesday, February 11, 2009

Search Engine Spiders

Search engines need a way to examine the websites that people submit to them. Some search engines like Yahoo!™ employ people to check each website registered with them, but these are in the minority. Most other search engines use specialized software called "spiders" or "robots" to do this. Spiders help search engines deliver accurate search results by determining how relevant a website is to the phrases and keywords a web surfer uses. Spiders “crawl” through websites, analyzing text content and following hyperlinks. This information about the website is used to determine how it should be categorized and ranked. Because the spider's functions are so critical, anything relating to the way they operate is a closely guarded secret that the search engines would prefer you not to know. It is, however, in our best interest to understand as much as we can about them, and to use that information to our advantage when designing a web page.

One of the most important things to keep in mind when designing your website is to see your site from a spider's point of view. A spider can only analyze text and words that are in a structured format. That is exactly why a frames-based site rarely ranks well on a search engine. The HTML for a frames site doesn't have a conventional format-- all of the content is jumbled about the page in different code sections and script excerpts, and that confuses spiders. Also, a spider needs to know right away what it should look for when it crawls your site. Using meta keywords is the best method for doing that. Otherwise, spiders will try to guess the content on your page and won't necessarily be successful -- getting ranked high for something unrelated to your site isn't helpful at all.

Descriptive and targeted meta keywords aren't the only thing search engine spiders look for. If you do use meta keywords, a spider tries to find out how relevant those keywords are for your site. For example, if your site is about recreational fishing, and you use the words fly-fishing, angling, and deep-sea fishing multiple times in your site, the spider will see your site being more relevant to those particular words than words which only appear once (for example, "commercial fishing"). Also, some spiders consider the position of a keyword to be important. If a keyword is in the page title, or in the first six lines of the page body, some search engine spiders consider that to be very significant. The "weight" of a keyword is a big factor, as well. If a keyword appears three times in a page with one thousand words, that keyword has a lower weight then if it was on a page with thirty words. Pages with heavily weighted keywords are considered more relevant to that keyword, and usually rank higher. However, it is possible to go too far and actually abuse the way a spider works.

While it is good to optimize your page, overdoing it can cause the spider to think that you are trying to fool it or spam the engine. The most common way of doing this is by using too many meta keywords. In an effort to rank their site higher, some webmasters will have an absurd amount of keywords. They'll include a meta keyword section two or three times in their page. Not only is this not effective, it is counter-productive. Something just as common is repeating a keyword over and over again on the page. Years ago it was useful to do this, but search engine spiders have advanced enough that simple tricks aren't going to fool them. Another, more devious plot, is called ghosting. When a spider accesses a site, it tells that site who it is. So, a webmaster can detect that a search engine spider is going to look at its site. Instead of serving up the normal web page that is seen in a web browser, the webmaster gives the search engine spider a specially optimized page designed to rank perfectly on that engine. While this practice may seem good for pages with a lot of dynamic content and not a lot of text, it is still abusing the purpose of spiders. The webmasters who practice ghosting aren't only misleading the search engines, but they are also misleading web surfers coming to their site expecting to find the information they are looking for, but instead find themselves at a site which they didn't want to visit. The people behind search engines are always updating their spiders, making them both more effective and better able to sniff out sneaky webmasters trying to abuse the system.

Spiders are the workers behind the scenes at the search engines. Some of them crawl through millions of websites every month. A website's success depends on cooperating with the search engines and their methods. To cooperate with the search engines, it is also important to understand how they and their spiders operate. AddWeb 5's Page Advisor is designed to help you determine what spiders are looking for when they award a page a high ranking position. Also, by comparing your website to the top three sites on an engine, you can learn what other webmasters do that give them a high position, and you can incorporate those features into your site.


If you want to become an author here, just send me an e-mail with subject "New Author : your Name" with any message you want to give me. I will add you as an author here. If you want detailed information regarding any related topic, just send me an e-mail at BeginnersOnline@gmail.com. I will post a new article regarding your request.

Homepage : http://beginonlineearning.blogspot.com/

Search Engine Positioning

Search Engine Positioning, or SEP, is the process of boosting and maintaining your website's position in the results that Internet users see when they run queries on different search engines.

There are two distinct steps you need to take in order to maximize the effectiveness of your position in a search engine listing. The first is to make key modifications to your pages in order to gain top positioning within a search engine's index. The second is something that is commonly ignored. That position needs to be maintained. Too often, webmasters gain a great position on a search engine only to let it slip away, taking business away with it. Don't make this mistake. This essay is written to give you a good idea of how important SEP is in bringing more people to your website.

As you probably know by now, merely being listed in a search index is not enough to bring new visitors to your website. Your website must rank at or near the top of the search results in order to collect all the traffic that search engines can produce. The first major step in positioning your site is choosing descriptive and focused meta-keywords. The importance of excellent keywords cannot be emphasized enough--you can read about keywords in the essay Keyword Importance. Once you have a list of candidates for your final meta-keywords, you can use AddWeb's Page Builder Plus to quickly create a test Doorway Page for your website using the keywords of your choice. Once the doorway page has been built it is time to analyze the page using Page Advisor.

Page Advisor will analyze your new page and give you a score based on real data taken live from the Internet's top-ranking websites. The report tells you where to make specific changes in the Doorway Page based on what the analysis finds. For example, the analysis might tell you to include a longer or shorter title. It may also tell you that there are not enough instances of the chosen keywords in your page. Or you may need to reduce or increase the amount of description text on the page. Keep in mind that while all of these items may seem minor, they are worth checking and modifying if necessary, as they may affect your ranking position. You can then build the changes into a new Doorway Page using Page Builder Plus.

Page Advisor can now be used to analyze the new page and return a score that gives you an estimate as to how well that page is optimized for good positioning on search engines in general, or one specific engine. The importance of this second analysis cannot be underestimated. In fact, the best results come from repeated building-and-analysis, until the Doorway Page is optimized as well as possible. Once you have a page that you are happy with, you can use AddWeb's AISubmit module to automatically register your new doorway page with all of the search engines you want to be listed on. The hardest part is now remaining patient as you wait for all of the indices to pick up your listing. This can take anywhere from several seconds to several months, depending on the individual search engine. Check for your ranking regularly to determine if you are listed, and if you are, where you are positioned.

If you have chosen good keywords, and followed the steps outlined above, you should have a good position near the top of the listings. Now the trick is to maintain that position. Just because you appear at the top of the search results doesn't mean that you are guaranteed to remain there. New websites appear by the second and search engines regularly change the methods they use to index them. To ensure that you maintain your position, you must first re-submit your site around once a month and check your ranking on each major search engine regularly, preferably once a week. By checking your ranking you can determine what your position is and whether it is trending upward or downward. If you are heading up over time, great, pat yourself on the back for a job well done. If your rank is spiraling downwards, or you just can't seem to push ahead of certain competitors, its time for some more advanced work.

Take a look at the websites that have higher listings than you and note their URL's. Go to Page Advisor and run a comparison analysis on the specific URL that is competing against you. Page Advisor's report will show you both your stats as well as those for your competitor. You can do a side by side comparison and see exactly what your competitor has that you don't have, or what you have that your competitor doesn't. Maybe that extra keyword or those extra hyperlinks are nosing them ahead of you into Position 1--use Page Advisor to find out. Once you've got an idea of what you can do to improve your ranking, use Page Builder Plus to make the necessary changes. Check your rankings again in a week or so and look for any differences. This is a constant process that you must maintain with some vigil. Don't let your competitors get a leg up on you by ignoring your ranking trends for too long. Maintain your position and you will get a constant, steady reward in the form of new visitors and increased traffic to your site.


If you want to become an author here, just send me an e-mail with subject "New Author : your Name" with any message you want to give me. I will add you as an author here. Good luck!

If you want detailed information regarding any related topic, just send me an e-mail at BeginnersOnline@gmail.com. I will post a new article regarding your request.

Homepage : http://beginonlineearning.blogspot.com/

Subscribe via email

Enter your email address:

Delivered by FeedBurner