Zixuan Zhuang

A cloud-based web crawler architecture

2015

Web crawlers work on the behalf of applications or services to find interesting and related information on the web. For example, search engines use web crawlers to index the Internet. Web crawlers have several challenges, …