这是崔斯特的第五十九篇原创文章
模拟登陆的两种方式,你喜欢哪种 (๑• . •๑)
本期讲一讲模拟登录相关的东西,目标网站是Github
简单的Selnium
想说说简单的方法,使用浏览器登录,基本上就是傻瓜操作了。
如上图所示,登录设计的很简单,没有验证码什么的,代码如下:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
#!/usr/bin/env python # -*- coding: utf-8 -*- import time from selenium import webdriver driver = webdriver.Chrome() driver.maximize_window() def login(account, password): driver.get('https://github.com/login') time.sleep(2) driver.find_element_by_id('login_field').send_keys(account) driver.find_element_by_id('password').send_keys(password) driver.find_element_by_xpath('//input[@class="btn btn-primary btn-block"]').click() # do whatever you want if __name__ == '__main__': account, password = 'account', 'password' login(account, password) |
分析请求之Requests
打开F12,使用错误的账号密码登录,复制curl
1 |
curl 'https://github.com/session' -H 'Cookie: has_recent_activity=1; _octo=GH1.1.1477592343.1531820067; logged_in=no; _gh_sess=UEZzYnVCMVlhNkVOdE5rU1hWRFpDbmFlY0UyQ1Y2b3Z4TGw2NFlTMmJLUWk5VENVQ3Q4TWxiSWN5ckEyZXN0MUFkT29XVjQvbWJVbm9RV0JNQmc1TmU0UnBtK0taUXJpcElqUk5PNGZ5TjZOQ2ZPRVR4NU5WQXcrb2xWRnRBMnRPMkRWYzYvWmVGY0FrYU12Q3BVVTY3dXVSblliNG4rWjc2QXVwR2pjQ1pzZXM1MFk1MjU5OUw2WkFLTU1BMzJDWGlTeXliNzNaejlUaW43cWhFNzQ0MFFVVmJ1aEppbzdtQTZkRERmUm5mWExkRDlmWW5lNk9mdlFYb05MQUtubDZBbXFJWjV6eFhic3JiWlRtZ2QxZ2FqZUxnOGFheUgzaXJmc290b0Jma09pRTJZdHZySEVmdVdGZHVBU3ZTVTJRM0pESnE1N1VPRDM0ck9FZzNJZTN5VWljUktyZ3FZQU16THVBeFBXV3BNPS0tSDh4WVV6U2RSNjlBL3FNQ3VaRGxEUT09--71cf0886128d55b42c82cf6f7b76e007ebfdc77b; _ga=GA1.2.57857743.1531820085; _gat=1; tz=Asia%2FShanghai' -H 'Origin: https://github.com' -H 'Accept-Encoding: gzip, deflate, br' -H 'Accept-Language: zh-CN,zh;q=0.9,en;q=0.8' -H 'Upgrade-Insecure-Requests: 1' -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36' -H 'Content-Type: application/x-www-form-urlencoded' -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8' -H 'Cache-Control: max-age=0' -H 'Referer: https://github.com/login' -H 'Connection: keep-alive' --data 'commit=Sign+in&utf8=%E2%9C%93&authenticity_token=%2BtgUHwMIxnoHOHNMqQFkLak9mJzrxt%2B4yfFiZaf66WiMB5ZyRaVXq%2BFpZsM%2BtxgaRRX6Fzfezu1IdRqy%2BTGHwg%3D%3D&login=123456788%40gmail.com&password=123456788' --compressed |
转为Python代码,
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
import requests cookies = { 'has_recent_activity': '1', '_octo': 'GH1.1.1477592343.1531820067', 'logged_in': 'no', '_gh_sess': 'UEZzYnVCMVlhNkVOdE5rU1hWRFpDbmFlY0UyQ1Y2b3Z4TGw2NFlTMmJLUWk5VENVQ3Q4TWxiSWN5ckEyZXN0MUFkT29XVjQvbWJVbm9RV0JNQmc1TmU0UnBtK0taUXJpcElqUk5PNGZ5TjZOQ2ZPRVR4NU5WQXcrb2xWRnRBMnRPMkRWYzYvWmVGY0FrYU12Q3BVVTY3dXVSblliNG4rWjc2QXVwR2pjQ1pzZXM1MFk1MjU5OUw2WkFLTU1BMzJDWGlTeXliNzNaejlUaW43cWhFNzQ0MFFVVmJ1aEppbzdtQTZkRERmUm5mWExkRDlmWW5lNk9mdlFYb05MQUtubDZBbXFJWjV6eFhic3JiWlRtZ2QxZ2FqZUxnOGFheUgzaXJmc290b0Jma09pRTJZdHZySEVmdVdGZHVBU3ZTVTJRM0pESnE1N1VPRDM0ck9FZzNJZTN5VWljUktyZ3FZQU16THVBeFBXV3BNPS0tSDh4WVV6U2RSNjlBL3FNQ3VaRGxEUT09--71cf0886128d55b42c82cf6f7b76e007ebfdc77b', '_ga': 'GA1.2.57857743.1531820085', '_gat': '1', 'tz': 'Asia%2FShanghai', } headers = { 'Origin': 'https://github.com', 'Accept-Encoding': 'gzip, deflate, br', 'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36', 'Content-Type': 'application/x-www-form-urlencoded', 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8', 'Cache-Control': 'max-age=0', 'Referer': 'https://github.com/login', 'Connection': 'keep-alive', } data = [ ('commit', 'Sign in'), ('utf8', '\u2713'), ('authenticity_token', '+tgUHwMIxnoHOHNMqQFkLak9mJzrxt+4yfFiZaf66WiMB5ZyRaVXq+FpZsM+txgaRRX6Fzfezu1IdRqy+TGHwg=='), ('login', '[email protected]'), ('password', '123456788'), ] response = requests.post('https://github.com/session', headers=headers, cookies=cookies, data=data) |
注意两个地方,cookies和参数,先来看看参数,稍微特别的就是authenticity_token
,感觉是验证。Ctrl+Shift+F
打开搜索,最终在返回的html中找到
1 |
<!-- '"` --><!-- </textarea></xmp> --></option></form><form action="/session" accept-charset="UTF-8" method="post"><input name="utf8" type="hidden" value="✓" /><input type="hidden" name="authenticity_token" value="CTujn/pHGMQBpEhYcJj9Mn6ChsNSkd5ul8rgNSP/6/KxdZlhS0ABKblsq1pLn6EaQvIGLMzl/IQawaDL8KFjDw==" /> <div class="auth-form-header p-0"> |
authenticity_token
解决了,下一步想办法获取cookies
继续搜索_gh_sess
与_octo
关键字,看到有这样一段js
1 |
var e, t = void 0, r = void 0, n = this._getCookie("_octo"), a = []; |
猜测cookies不是本地生成,查看打开Github首页的请求,果然在Response Cookies
中找到了相关数据,那么使用Session
就可以维持会话了。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
#!/usr/bin/env python # -*- coding: utf-8 -*- import re import requests headers = { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8', 'Accept-Encoding': 'gzip, deflate, br', 'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8', 'Connection': 'keep-alive', 'Host': 'github.com', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36' } s = requests.session() s.headers.update(headers) def get_token(): url = 'https://github.com/login' response = s.get(url) pat = 'name=\"authenticity_token\" value=\"(.*?)\"' authenticity_token = re.findall(pat, response.text)[0] return authenticity_token def login(authenticity_token, account, password): payload = { 'commit': 'Sign in', 'utf8': '\u2713', 'authenticity_token': authenticity_token, 'login': account, 'password': password, } url = 'https://github.com/session' response = s.post(url, data=payload) print(response) # do whatever you want if __name__ == '__main__': account, password = 'account', 'password' authenticity_token = get_token() login(authenticity_token, account, password) |
对比
Selenium:
- 优点:简单、无脑,不用分析复杂的网页请求,不用保持会话状态
- 缺点:速度慢,速度慢,速度慢(某些情况下会出现js加载不全)
Requests:
- 优点:速度快,可以增加自己对cookies登陆的理解
- 缺点:需要花时间寻找相关参数
如果对Github感兴趣,可以直接使用 Github API
最近在使用Selenium
处理验证码,发现很强大,如果模拟请求,难度会非常大。
在学习中有迷茫不知如何学习的朋友小编推荐一个学Python的学习裙【639584010】无论你是大牛还是小白,是想转行还是想入行都可以来了解一起进步一起学习!裙内有开发工具,很多干货和技术资料分享!