搜索资源列表
gterCraw
- gter论坛的爬虫 爬取留学offer界面的offer信息并按格式保存为excel文件-gter forum crawling reptiles study offer interfaces offer information and press save as excel file format
Crawler
- Crawlar爬虫，可以爬取网页中的信息生成text文件-Crawlar reptiles can crawl the page information generated text file
wanghong
- python爬虫程序，爬取花椒直播首页热门主播的相关信息，结果保存到MySQL数据库，包含sql语句文件-python crawler, crawling pepper popular TV anchor Home related information, save the results to a MySQL containing sql statement file
Downhuawei
- 通过python的request库从华为应用商店爬取apk文件(Retrieve the apk file from the Huawei app store)
opera_spider
- scrapy爬虫示例，代码中为爬取京剧网站人物分类，并存储到本地文件(Scrapy crawler example, the code for crawling Beijing Opera website characters classification, and storage to the local document)
payipa
- 爬取天气数据，存为csv文件，包括温度、风速等元素，可以组合城市以及日期(Climbing weather data, Fast)
豆瓣爬虫
- 爬取豆瓣top250电影资料， ①requests库获取html信息 getHTMLText(url)方法实现 ②通过BeautifuSoup库与re库整理筛除信息 stringTidy(string) parsePage(html)方法实现 ③最后读入文件中 getMovieInfo(movieList,fpath)方法实现(python use request method getHTMLText(url) get html BeautifulSoup and re)