Simple and very efficient multithreaded web crawler with pipeline based processing written in C#. Contains HTML, Text, PDF, and IFilter document processors and language detection(Google). Easy to add pipeline steps to extract, use and alter informati

Web Spider ... watch out ... hot to handle

本源代码是一个基于.net实现的，多线程的，网络爬虫。性能极好，稳定性强。-Source code is based. Net realized, multi-threaded, web crawlers. Excellent performance and stability.