Archive for December, 2006

Digg Podcasts Crawler

Sunday, December 31st, 2006

In case you were curious, here’s the crawler for the Digg podcasts service. There’s no identifying information (either referrer or user agent) on the crawler itself.

Host: (WHOIS)
Http Code: 200 Date: Dec 31 10:15:40 Http Version: HTTP/1.1 Size in Bytes: 62802
Referer: -
Agent: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)

Http Code: 200 Date: Dec 31 10:15:41 Http Version: HTTP/1.0 Size in Bytes: 37811
Referer: -
Agent: -

[tags]Digg, Digg Podcasts, crawler, user agents [/tags]

Texas Bowl: Rutgers 37 - Kansas State 10

Friday, December 29th, 2006

Since Rutgers had to go to a mediocre bowl, at least they did spank the competition.

Also, this NY Times article about the pregame festivities before the Texas Bowl is pretty amusing.

[tags]Rutgers Football, Texas Bowl, Next year it’s the BCS [/tags]

Tracking Santa 2006

Sunday, December 24th, 2006

A very excited 8 year old is tracking Santa via the NORAD Web site:

Update: As heard a few minutes ago: “Mom, will you stop blogging so I can track Santa?”

[tags]Santa Claus, Santa, NORAD[/tags]

Email Deliverability Update 12-21-06

Thursday, December 21st, 2006

Email deliverability update, from the front lines. Two trends I’ve heard of interest.

1)I’m hearing that Verizon residential email accounts can’t send outgoing email messages to more than 10 recipients at a time.

2)I’ve written in the past about Yahoo email deliverability issues, and I’m starting to hear of reports that Yahoo isn’t greylisting, but that they are rate-limiting incoming mail. Apparently, Yahoo will accept emails in queues of less than seven but not a continual mail queue.

A note, I’m still seeing lots of interest on this topic, as evidenced by the numbers of visitors from small and medium sized businesses who continue to find my earlier Yahoo deliverability posts.

[tags]Email deliverability, Verizon Mail, Yahoo Mail, mail, spam[/tags]

digg redesign including podcasts and video

Tuesday, December 19th, 2006

With the slight redesign of digg yesterday, I’ve heard good and so-so types of reviews about the redesign - the change to the sole right navigation, the secondary light green and dark green accent colors in the banner navigation, the prominent profile link in the banner and an increased use of tabbed and grouped navigation are all interesting little tweaks. Personally, I think the red font used for the “time dugg” is a little distracting.

The addition of new categories (nitpick: spaces around the ampersand are needed in World&Business), videos and podcasts are all interesting - I don’t know if digg will be as strong in non-traditional areas for their user base.

And since there are now podcasts on digg, you can now digg some cleverhack podcasts (why didn’t digg detect the feed image?) and befriend joyl.

[tags]digg, redesign, Web 2.0 [/tags]

Right hand Web navigation

Tuesday, December 19th, 2006

Is the right hand nav bar the rounded tab of (almost) 2007?

I hadn’t really thought about it before, but it seems that there is a higher concentration of content based Web sites with right hand nav bars, I mean not only this blog (and others), but also Google SERP pages (just think of the right hand Google ads) and now the newly redesigned digg with no sort of navigation on the left hand side.

Now I’m wondering how many other sites have right hand nav bars exclusively. And I wonder if right hand nav bars change Information Architecture in any significant way.

[tags]Web design, Web navigation, Web [/tags]

Fantasy Football - A season’s end

Tuesday, December 19th, 2006

Well, I’m sorry to say that I am officially out of the fantasy football league playoffs this year. My playoff opponent (who I beat once and then tied) had Peyton Manning, Frank Gore, Steven Jackson and the spitworthy T.O.

For me, while I had Tony Romo, LaDainian Tomlinson and Brian Westbrook, they just weren’t enough. My WRs were wildly inconsistent week to week along with a Dolphins D who piddled around on Sunday.

Ah well. Good matchup and I do hold the bragging rights (and prize money) of being the regular season leader. Not bad for someone who was asked before the draft “Hey, do you even watch football?”

[tags]Fantasy Football[/tags]


Monday, December 18th, 2006

Here’s one search engine that’s certainly not Web 2.0.

If you follow the URL in the user agent, you will go to While the Web site is rockin’ like it’s 1999, there’s a box at the top of the page which gives some information about the Blaiz-Bee crawler and tells visitors that the crawler belongs to the RawGrunt Search Engine. The most notable aspect of the RawGrunt search engine is the boast that it runs on Windows 98 using low cost domestic, clustered hardware.


Http Code: 200 Date: Dec 17 22:13:40 Http Version: HTTP/1.0 Size in Bytes: 41488
Referer: -
Agent: Blaiz-Bee/2.00.6000 (+

Blog SEO tips and tricks

Saturday, December 16th, 2006

Some quickie SEO analysis by searching for cleverhack on both Google and Yahoo.

Google results for cleverhack - 22,800 results

Yahoo results for cleverhack - 13,300 results

What’s obvious: Having a clever domain name helps with blog branding. Also, Google loves cleverhack.

What’s changed: It appears that raw RSS feeds are not as useful for blog SEO as they were a year or even 6 months ago. For example on the first few pages of the cleverhack Google results, we don’t see any mentions of the raw RSS feed.

What’s interesting: Both search engines have indexed directory listings for the cleverhack podcast. So, for you podcasters out there, it’s definitely worth your time to list your podcast URL with podcast directories.

What’s constant: Both search engines have indexed cleverhack RSS feed listings on RSS feed aggregators or directories.

What else I would recommend: Getting your blog listed on blog directories.

What’s variable: I’ve been using a few different descriptions for the blog on various directories, so that may have skewed results a bit.

A resource listing RSS feed and blog directories: Robin Good’s Best Blog Directory And RSS Submission Sites

A personal note

Thursday, December 14th, 2006

This is based on a link I found on a number of blogs today.

It wasn’t that long ago I was writing clever copy (among other duties) for some nifty products. And I’m pleased that my Web marketing efforts made this and other gadgets visible online, especially if one used Google.

Yahoo Mobile Crawler

Thursday, December 14th, 2006

Today a crawler from, an IP which apparently belongs to (WHOIS) started crawling my site. That in and of itself is not too unusual. What caught my eye, however, was that the crawler was attempting to find pages thathad something to do with presentation for mobile users. Which is fine, but the pages the crawler tried to get to are not industry standard, instead, it looks like some programmer at Yahoo just took a guess as to how, perhaps, a mobile version of a site may be presented.

I dunno, it seems like this crawler could have been written to be more efficient - aside from bandwidth issues, you’d think the crawler would try to look for a robots.txt first, which it failed to. A thread at WebmasterWorld comes to a similar conclusion.

More boring site logs after the jump…

Http Code: 404 Date: Dec 14 12:38:10 Http Version: HTTP/1.1 Size in Bytes: 29745
Referer: -
Agent: Nokia6600/1.0 (4.09.1) SymbianOS/7.0s Series60/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.0

Http Code: 404 Date: Dec 14 12:38:11 Http Version: HTTP/1.1 Size in Bytes: 29745
Referer: -
Agent: Nokia6600/1.0 (4.09.1) SymbianOS/7.0s Series60/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.0

[tags]Yahoo, Yahoo Mobile, Robots, Bots, Crawlers, robots.txt, Mobile, Wireless WAP, WML [/tags]


Thursday, December 14th, 2006

I know that some may think that I can emphasis on a call to action in a Web page design. However, I think I have found a blog that, well, highlights some calls to action tastefully and forcefully.

Search Engine High Guru Danny Sullivan just launched his blog and the blog very simply executed. Here’s a list of the obvious calls to action Danny wants to you to take.

-RSS feed and Newsletter subscription link large and on the upper left of the banner (I love this idea). If you click on the link, you will be taken to a separate page subscription for newsletters and RSS feeds.

-Huge header logo banner linking to the front page on every page.

-Simple subscribe to newsletter box (for the daily newsletter) in the top spot of the right nav bar. This is repeated on all pages.

-Text list of social bookmarking services (digg, related Sphere posts, Google Bookmarks) that one can submit a post to.

-Green “conversion box” at the bottom of each post with links to author, permalink, comments and categories.

There’s like two things which are annoying to me about navigation on the site, namely the archives are drop down menu based and I can’t find a search box to search the site. Also, you have to either have a TypeKey account or join the site to be able to comment, but that is just a nitpick.

[tags]SearchEngineLand, Danny Sullivan, Call To Action[/tags]