80legs is powered by a grid computing architecture consisting of over 50,000 computers. This unique architecture allows 80legs to provide the fastest crawling possible while maintaining affordable pricing for its users.

The service provides a variety of tools for users to completely customize their web crawls. Users can use a web form, an API or an application framework to design their own crawling and processing logic. 80legs automatically handles link parsing, de-duplication, redirects, throttling and other crawling challenges so that users can focus on generating results.

The company offers a variety of pre-built 80apps that can be used for pattern matching, content gathering, or site-specific analysis. Data feeds for information from various sites are offered as well, as well as consulting services to meet specific needs.

Milestones
edit

80legs added Shion Deysarkar as CEO. (9/1/09)

Posted 7/11/11 at 6:46am
80legs added Jennifer Wilson as Plura Integration.

Posted 4/10/09 at 6:02am
80legs added Aliya Virani as Sr. Software Engineer.

Posted 4/10/09 at 6:02am
80legs added Toan Duong as CTO.

Posted 4/10/09 at 6:02am
80legs added Shion Deysarkar as CEO. (9/1/09)

Posted 4/10/09 at 6:02am
80legs added Brad Wilson as Advisor.

Posted 4/10/09 at 6:02am
80legs — 80legs launches private beta at Web 2.0 Expo 2009 (4/2/09)

Posted 4/6/09 at 12:06pm via techcrunch.com