[问题] 请问批次抓取 哪边可以做修正呢?

楼主: garlic774 (蒜头)   2021-09-19 20:36:05
各位板大好,目前小弟想要爬取1-n页的特定标题,可目前都只能抓到第n页
请问哪边可以做修正呢? 程式码如下:
page = 10
products = []
keyword = "益生菌"
for page in range(1, page+1):
url =
'https://tw.mall.yahoo.com/search/product?p={}&pg={}'.format(keyword, page)
headers = {'User-Agent':"Mozilla/5.0 (Windows NT 10.0; Win64; x64)
AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36"}
r = requests.get(url, headers = headers )
soup = BeautifulSoup(r.text,"html.parser")
s = soup.find_all('span',class_="BaseGridItem__title___2HWui")
s
作者: s0914714 (YA)   2021-09-19 23:41:00
每次抓到的s要append到products
楼主: garlic774 (蒜头)   2021-09-19 23:55:00
成功了!!!谢谢

Links booklink

Contact Us: admin [ a t ] ucptt.com