[爬虫的用途](%E7%88%AC%E8%99%AB%E7%9A%84%E7%94%A8%E9%80%94.md) [robots协议](robots%E5%8D%8F%E8%AE%AE.md) [http和https](http%E5%92%8Chttps.md) [常见请求头](%E5%B8%B8%E8%A7%81%E8%AF%B7%E6%B1%82%E5%A4%B4.md) [状态码](%E7%8A%B6%E6%80%81%E5%90%97.md) [字符串](%E5%AD%97%E7%AC%A6%E4%B8%B2111.md) [requests](requests.md) [代理](%E4%BB%A3%E7%90%86111.md) [cookie和session](cookie%E5%92%8Csession.md) [Fiddler](Fidder.md)