dotbot | DotNetDotCom.org
http://www.dotnetdotcom.org/

i find it cool that 7% of the web is not there.

We are just a few Seattle based guys trying to figure out how to make internet data as open as possible. You should be able to find everything you are looking for below. If not feel free to contact us. Happy Surfing!

Whole Internet in one file :)

technology, people and life in general

クローラーの話。botやクローラーを作るときに。

クローラーをどう実装すべきか、クローラーにどう対処すべきか。