如何用snscrape爬取Twitter列表？解决请求失败报错问题

需爬取指定Twitter列表（链接：https://twitter.com/i/lists/777955586638053376）的推文，尝试以下三种调用TwitterListPostsScraper的方式后均报错：

方式1：使用列表名称 #

from snscrape.modules.twitter import *
search = TwitterListPostsScraper("Abgeordnetenhaus #agh").get_items()
for item in search:
    print(item)

方式2：使用列表完整链接 #

from snscrape.modules.twitter import *
search = TwitterListPostsScraper("https://twitter.com/i/lists/777955586638053376").get_items()
for item in search:
    print(item)

方式3：使用列表ID #

from snscrape.modules.twitter import *
search = TwitterListPostsScraper("777955586638053376").get_items()
for item in search:
    print(item)

运行后统一出现如下错误：

Error retrieving https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&include_ext_has_nft_avatar=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&include_ext_sensitive_media_warning=true&include_ext_trusted_friends_metadata=true&send_error_codes=true&simple_quoted_tweet=true&q=list%3Ahttps%3A%2F%2Ftwitter.com%2Fi%2Flists%2F777955586638053376&tweet_search_mode=live&count=20&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel%2ChasNftAvatar%2CvoiceInfo%2Cenrichments%2CsuperFollowMetadata%2CunmentionInfo: 
non-200 status code
4 requests to https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&include_ext_has_nft_avatar=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&include_ext_sensitive_media_warning=true&include_ext_trusted_friends_metadata=true&send_error_codes=true&simple_quoted_tweet=true&q=list%3Ahttps%3A%2F%2Ftwitter.com%2Fi%2Flists%2F777955586638053376&tweet_search_mode=live&count=20&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel%2ChasNftAvatar%2CvoiceInfo%2Cenrichments%2CsuperFollowMetadata%2CunmentionInfo 
failed, giving up.

解决办法 #

将snscrape升级至最新版本即可解决该问题，执行以下命令完成更新：

pip install --upgrade snscrape

内容的提问来源于stack exchange，提问作者Vedant Jumle