Update Packages 2021-03-12🎉

Author: XBCJWen

README.md

@@ -1,17 +1,17 @@
 # **Python3Webcrawler**
-## **[哔哩哔哩作者：-相依-](https://space.bilibili.com/343154012)**   **UPDATE 2021-01-18**
+## **[哔哩哔哩作者：-相依-](https://space.bilibili.com/343154012)**   **UPDATE 2021-03-12**
 > **精心挑选了几个爬虫，给大家在学Scrapy框架之前打基础。**
 >> **该项目仅限学习交流，请勿用于商业用途，如有侵权，请联系删除。**
 
 |**程序依赖**|**安装指令**|**项目使用版本**|
 |:----:|:--------:|:--------:|
 |**lxml**|**pip install lxml**|**4.6.2**|
-|**aiohttp**|**pip install aiohttp**|**3.6.2**|
-|**requests**|**pip install requests**|**2.24.0**|
+|**aiohttp**|**pip install aiohttp**|**3.7.4**|
+|**requests**|**pip install requests**|**2.25.1**|
 |**PyExecJS**|**pip install PyExecJS**|**1.5.1**|
-|**sqlalchemy**|**pip install sqlalchemy**|**1.3.18**|
-|**beautifulsoup4**|**pip install beautifulsoup4**|**4.9.1**|
-|**mysqlconnector**|**pip install mysql-connector-python**|**8.0.21**|
+|**sqlalchemy**|**pip install sqlalchemy**|**1.3.23**|
+|**beautifulsoup4**|**pip install beautifulsoup4**|**4.9.3**|
+|**mysqlconnector**|**pip install mysql-connector-python**|**8.0.23**|
 
  * ### **京东   [官网地址](https://item.jd.com)** 
  * ### **网易   [官网地址](https://www.163.com/)** 

requirements.txt

@@ -1,19 +1,19 @@
-aiohttp==3.6.2
+aiohttp==3.7.4
 async-timeout==3.0.1
-attrs==19.3.0
-beautifulsoup4==4.9.1
-certifi==2020.6.20
+attrs==20.3.0
+beautifulsoup4==4.9.3
+certifi==2020.12.5
 chardet==3.0.4
 idna==2.10
 lxml==4.6.2
-multidict==4.7.6
-mysql-connector-python==8.0.21
-protobuf==3.12.2
+multidict==5.1.0
+mysql-connector-python==8.0.23
+protobuf==3.15.6
 PyExecJS==1.5.1
-requests==2.24.0
+requests==2.25.1
 six==1.15.0
-soupsieve==2.0.1
-SQLAlchemy==1.3.18
-typing-extensions==3.7.4.2
-urllib3==1.25.10
-yarl==1.5.0
+soupsieve==2.2
+SQLAlchemy==1.3.23
+typing-extensions==3.7.4.3
+urllib3==1.26.3
+yarl==1.6.3

百度图片/crawl.py

@@ -8,7 +8,9 @@
 
 headers = {
     'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.141 Safari/537.36',
-    'Referer':'https://image.baidu.com/search/index?tn=baiduimage&ipn=r&ct=201326592&cl=2&lm=-1&st=-1&fm=result&fr=&sf=1&pv=&ic=0&nc=1&z=&hd=&latest=&copyright=&se=1&showtab=0&fb=0&width=&height=&face=0&istype=2&ie=utf-8&sid=&word=%E5%88%9D%E9%9F%B3%E6%9C%AA%E6%9D%A5'
+    'Referer':'https://image.baidu.com/search/index?tn=baiduimage&ipn=r&ct=201326592&cl=2&lm=-1&st=-1&fm=result&fr=&sf=1&pv=&ic=0&nc=1&z=&hd=&latest=&copyright=&se=1&showtab=0&fb=0&width=&height=&face=0&istype=2&ie=utf-8&sid=&word=%E5%88%9D%E9%9F%B3%E6%9C%AA%E6%9D%A5',
+    #参考链接:https://image.baidu.com/
+    #请在此处填写你的 Cookie
 }
 
 tasks = []

豆瓣读书/boook_db.py

@@ -23,6 +23,7 @@ class Book(Base):
 	pl = Column('pl',String(10))
 	introduce = Column('introduce',Text())
 
+Base.metadata.create_all(engine)
 
 session = sessionmaker(engine)
 sess=session()