At 8:32 AM, Brad Stiritz said...

Hey Pete,

Great idea to have Google crawl your site. Do you know if it's supposed to also be crawling the comment threads? I checked via a couple of queries, and Google seemed not to have any of the comments in cache.

I've found that as discussions develop, people often mention related things that can be quite helpful. Could you please check into the possibility of having Google crawl the comments as well?

Thanks,

Brad

 

At 9:40 PM, Pete Walsh said...

Hi Brad, the blog had been indexed by Google since May but I wanted to make it more convenient by adding a search right here on the page.

I'm a little disappointed though with how Google indexes the blog, esp comments - or at least disappointed in the results it returns.

Not to worry though, I do still plan to build my own blog engine with its own search and move this blog into it.

 

At 11:15 PM, andrew said...

Build from scratch, or grab something like Blosxom or Wordpress and hack?

 

At 1:07 AM, Brad Stiritz said...

>>I'm a little disappointed though with how Google indexes the blog, esp comments - or at least disappointed in the results it returns.

Have you researched Google's crawler guidelines? This isn't my area of interest, but it may be something to look into..

http://www.google.com/bot.html

Also, I noticed that the popup window for comments has a different URL (www.blogger.com) than your main blog page (www.magicpixel.com). Could this explain why Google isn't associating the comment threads with the mainline blog?

Just a couple of wild ideas...

Brad

 

At 12:10 AM, Pete Walsh said...

Hi Andrew, just build from scratch. I should've done that initially but just wanted to get the blog live.

Thanks Brad, will check that out. The bots should follow the paths within the site e.g. all the comments also exist on this server which are all linked via the archiving.
http://www.petewalsh.com.au/epson4800blog/2005/07/roll-paper-maximum-joy.cfm

 

Post a Comment

Return to Blog Home