BeautifulSoup无法获取TraderWagon页面HTML,求有效解决方案
如何提取TraderWagon网站的HTML内容?
我在Stack Overflow上查找了诸多类似问题,尝试多种方法均未解决。
尝试1 - requests + BeautifulSoup
预期doc对象中存在<table>标签,但实际不存在。
from bs4 import BeautifulSoup import requests headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'} url = "https://www.traderwagon.com/en/portfolio/156" result = requests.get(url, headers=headers) doc = BeautifulSoup(result.text, "html.parser") tableRows = doc.findAll(text="USDT") print(tableRows)
尝试2 - Selenium
import time from bs4 import BeautifulSoup from selenium import webdriver from webdriver_manager.chrome import ChromeDriverManager url = "https://www.traderwagon.com/en/portfolio/156" #options = Options() #options.add_argument('--headless') #options.add_argument('--disable-gpu') driver = webdriver.Chrome(ChromeDriverManager().install()) driver.get(url) time.sleep(3) page = driver.page_source driver.quit() soup = BeautifulSoup(page, 'lxml') container = soup.find_all('USDT') print(container)
内容的提问来源于stack exchange,提问作者02fentym
相关产品推荐
相关产品推荐

