Python爬虫入门

这学期暑假的时候,打开了Learning mall下载下学期的课件,但是却发现LM并没有批量下载功能,最后只能通过一个一个点击来下载。无疑这是一个体验非常不好的过程。所以想写一个爬虫来下载learning mall的课件和资料。
遇到的问题是learning mall是需要登陆才能下载的,登陆无疑是爬虫操作中的一个较难解决的问题。这篇文章会通过爬豆瓣图片的过程和爬learning mall来讲解如何使用Python爬虫解决生活实际问题。

需要准备的工具有: Pycharm, Chrome(安装插件XPath helper)
豆瓣爬的图片😏

阅读更多
hexo部署步骤变化

hexo部署步骤变化

Problem

今天写完blog上传的时候,发现原来的GitHub输入用户名再输入密码push的方式没用了,报错如下:

1
2
3
4
5
6
7
8
9
10
11
remote: Support for password authentication was removed on August 13, 2021. Please use a personal access token instead.
remote: Please see https://github.blog/2020-12-15-token-authentication-requirements-for-git-operations/ for more information.
fatal: unable to access 'https://github.com/chenzhengde/chenzhengde.github.io.git/': The requested URL returned error: 403
FATAL {
err: Error: Spawn failed
at ChildProcess.<anonymous> (/Users/chenzhengde/Library/Mobile Documents/com~apple~CloudDocs/大三上学期/myblog/node_modules/hexo-util/lib/spawn.js:51:21)
at ChildProcess.emit (events.js:400:28)
at Process.ChildProcess._handle.onexit (internal/child_process.js:277:12) {
code: 128
}
} Something's wrong. Maybe you can find the solution here: %s https://hexo.io/docs/troubleshooting.html
阅读更多