Questions About Web Crawlers, Robots, Spiders
Send suggestions and comments to Martijn Koster. This information is in the public domain. Table of Contents About WWW robots What is a WWW robot? What is an agent? What is a search engine? What kinds of robots are there? So what are Robots, Spiders, Web Crawlers, Worms, Ants? Aren’t robots bad for the web? […]
Continue ReadingSEO Guide
SEO Guide Introduction This guide was written in 2004 and hasn’t been updated very often. A lot of the information within the guide is still useful to beginners. For a guide that’s updated frequently check the Moz Beginners Guide To SEO A strong understanding of HTML and the Internet. You should understand the basic purpose […]
Continue ReadingGoogle Business & Site Owner Help
I thought I’d put together a list of pages for business and site owner related help topics on Google. Sean Odom Sean is the founder of SeOpt Internet Marketing, a Houston based local SEO service provider. Sean is also co-founder of Socialot.com, a SAAS social contact management system for small businesses.
Continue ReadingHTML Validation
The W3C consortium defines valid HTML. They judge whether or not an HTML command or a piece of HTML code is legit–and search engines like legitimate code. However, browsers such as Netscape and Internet Explorer often understand and display HTML code that doesn’t validate. Because your website looks fine in your browser, you assume the […]
Continue ReadingSimple 301 Redirect Instructions
Definition of Canonical URLs The preferred address of a domain, which can be two different URLs. Although, both can be used to access the same domain/website, for example; www.yoursite.com or yoursite.com 301 Redirect Overview Follow the simple example below to redirect canonical URLs on your domain. Setting a 301 (permanent) redirect from yoursite.com to www.yoursite.com. […]
Continue ReadingHow To Use a Robots.txt File
Using a Robots Text File Search engines will search for a special file called robots.txt before spidering your site. The Robots Text File is created specifically to give directions to web crawlers/robots. Place the following two lines in your robots.txt file if you wish to allow search engines to crawl/spider everything on your site: The […]
Continue ReadingSEO Glossary & Definitions
Please see the following glossary below for definitions regarding SEO Algorithm: Search Engines all have their own set of programmed rules, their algorithm, for how they determine the rank of the results of specific queries. They keep these rules private to prevent spamming. ALT Tags: These are HTML tags that determine the text that pops […]
Continue ReadingFlash Search Engine Optimization
Introduction Our first tip for optimizing with Flash is: don’t. If you just create your site in HTML, you’ll know your design will be search engine friendly because HTML is what search engines are best at. All search engines can spider basic HTML documents. In order for a search engine to spider a Flash document, […]
Continue ReadingIncrease Website Conversion Rates
A Successful Website Is About Conversions There’s a lot of hype about visitors or pageviews these days, but let’s face it: A successful website isn’t just about how many visitors or pageviews you can attract. It’s about conversions. If you get 10,000 visitors a month, but only 1 conversion be it a sale or signup, […]
Continue ReadingThe Problem with Frames
What are Frames? A generic framed page looks like this. Frames allow a webmaster to load pages into windows or "frames" of a main "frameset page" while leaving other windows or "frames" in the pages unchanged. One of the biggest advantages of frames was the fact that a navigation bar or a header could exist […]
Continue Reading
