• 28 comments
• Andrew Coyne

2. HTML文本解析

1. HTML文本解析

   工具: Beautifulsoup

   https://www.crummy.com/software/BeautifulSoup/bs4/doc/index.zh.html

2. 安装

   pip install beautifulsoup4

   解析器:

   pip install lxml

3. 导入

   from bs4 import BeautifulSoup

4. 简单示例

   import requests
   from bs4 import BeautifulSoup
   url = "http://www.shixiaolei.com/posts/1/"
   r = requests.get(url)
   r.text
   
   # HTML文本解析成Beautifulsoup对象
   soup = BeautifulSoup(r.text,'lxml')
   soup
   
   # CSS选择器
   data = soup.select(".title a")
   for d in data:
       print(d.get_text())