Brier Dudley's Blog
Brier Dudley offers a critical look at technology and business issues affecting the Northwest.
E-mail Brier|
206.515.5687
|
Follow Brier on Twitter|
Microsoft Pri0 blog|
Subscribe | Blog Home
October 6, 2008 11:23 AM
30 billion pages to start: SEOmoz builds its own Web index
Posted by Brier Dudley
Seattle search marketing firm SEOmoz today announced an impressive new tool to help the firm and its clients: A Web index with 30 billion pages to start.
Instead of just guessing how the indexes of Google, Microsoft and Yahoo work, SEOmoz is building its own and refreshing it monthly. Could they eventually do more than just use it as a marketing tool?
From Chief Executive Rand Fishkin's blog, announcing the index, along with other new tools and services for clients of SEOmoz:
For too long, data that is essential to the practice of search engine optimization has been inaccessible to all but a handful of search engineers. The connections between pages (links) and the relationship between links, URLs, and the web as a whole (link metrics) play a critical role in how search engines analyze the web and judge individual sites and pages. Professional SEOs and site owners of all kinds deserve to know more about how their properties are being referenced in such a system. We believe there are thousands of valuable applications for this data and have already put some effort into retrieving a few fascinating statistics:
Across the web, 58% of all links are to internal pages on the same domain, 42% point to pages off the linking site.1.83% of all links on the web are nofollowed and of these, 61% are external-pointing, while 39% link to pages on their own site. While those percentages may seem small, that's a massive number (~2 billion links) that are leveraging nofollow for link juice "sculpting."
While 0.08% of pages on the web use the 301 redirect, 0.12% (nearly twice as many) employ 302 redirects. Another 0.005% use the meta refresh.
About 1.5% of all pages use the meta noindex tag (which is a lot of content the engines don't get to see) and 0.87% of all pages use the meta nofollow tag.
From our entire index of pages, the median page received about 77 links (both internal and external), while the average page gets 32. If your pages have more than 32 links, congratulations! You're above average :-)
Over time, we hope to answer hundreds of questions that the major engines, due to their penchant for secrecy, have kept under wraps. We'll also be offering custom data reports for companies that would like to retrieve more specific information from our index.
The other announcements include a link analysis tool called "Linkscape" and a redesign of the SEOmoz site.

nwjobs

Post a comment

Michelle Goodman blogs about work/life balance.
How to tell your office you're gravely ill
Post a comment
nwautos

Choosing a new sedan? Weigh the impact of your choice on your wallet and on the planet.
Post a comment

- Flags were key link to cop slaying, bombings
- Suspect shot as city mourns slain officer
- Briefs | Soccer: New Mexico suspends hair-pulling player Elizabeth Lambert
- Bombs, guns found at home of suspect in Officer Brenton's slaying
- Huskies suffer another heartbreaking loss to UCLA
- How an underdog named Mike McGinn took City Hall
- McGinn pulling away as late ballots come in
- 3 Cascade Mountain passes close due to snow; more rain, wind expected Sunday
- Using anti-shooter tactics, civilian Army police officer brought down gunman
- Heavy snow in Cascades shuts down roads
- UCLA game thread
940 - Weapons, bomb-making materials found in suspect's apartment
336 - U.S. House passes health plan
300 - Bombs, guns found at home of suspect in Officer Brenton's slaying
222 - Decision day for health care in the House
204 - Grading the game
133 - Referendum 71 show's Washington's strategy for marriage equality is working
127 - Huskies suffer another heartbreaking loss to UCLA
108 - How an underdog named Mike McGinn took City Hall
72 - Sounders FC-Dynamo playoff Game 2 thread
56
- Suspect shot as city mourns slain officer
- Flags were key link to cop slaying, bombings
- The birth of 'Grunge,' in photos by Michael Lavine
- 10 investing missteps to avoid
- How do innovators think?
- 10 ways to take control of your health
- Bombs, guns found at home of suspect in Officer Brenton's slaying
- Danny Westneat | Lee the Horse Logger found slow wagon shrank tumor
- How an underdog named Mike McGinn took City Hall
- Tlingit heritage helps glass artist Preston Singletary break new ground

May
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
| 1 | 2 | |||||
| 3 | 4 | 5 | 6 | 7 | 8 | 9 |
| 10 | 11 | 12 | 13 | 14 | 15 | 16 |
| 17 | 18 | 19 | 20 | 21 | 22 | 23 |
| 24 | 25 | 26 | 27 | 28 | 29 | 30 |
| 31 |

Video
Demo of the Week: TeachStreet.com
Share your thoughts!
Gadgets and games | Fun stuff I've written about lately includes Apple's iPhone, Hewlett-Packard's HDX laptop and Microsoft's Halo3. Also on the radar are new digital video boxes such as the Tivo HD and the Vudu.






