Searching for the Moon

.comment-link {margin-left:.6em;} Searching for the Moon

My original blog - I have moved to http://shannonclark.wordpress.com so this remains only as an archive.

Archives
<< current

Searching for the Moon
by Shannon Clark

Wednesday, January 07, 2004

Heritrix - Home Page

Heritrix - Home Page

Open source crawler used by the Internet Archive. Looks likely to be very useful, going to investigate further but certainly I can see many uses for a good, well written (and well behaving) web page crawler/archiver. Especially as a tool to help with my other AI research (i.e. didn't really want to write a crawler myself, but I do need a large archive of websites/pages for much of what my AI research leads to).

1/07/2004 12:15:00 PM 0 comments

Comments: Post a Comment

Shannon John Clark (email me), b. 1974.

Male (to hold off the assumptions), currently in Chicago, IL.
I am active on many other forums and sites around the Internet. If I am online, feel free to Skype me.

You are also welcome to connect with me on Omidyar Networks on LinkedIn or Ryze.com and my blog on Ecademy or see more about me at MeshForum or my corporate site, JigZaw . I also maintain piecing IT together, as my corporate blog for JigZaw Inc.