基于Node.js的网页抓取选型咨询：从API、Phantom.js到request

Here’s a walkthrough of how I refined my web scraping approach for a target website:

• First, I noticed the target site provides official APIs, but following duraid’s advice, I decided not to leverage these APIs for my scraping task.
• Initially, I built a setup using Node.js paired with Phantom.js (a headless browser) to handle the scraping work.
• Then, fellow user Vaviloff pointed out that a headless browser wasn’t necessary here—instead, I could simply work directly with the site’s regular search request URLs.
• Taking that feedback on board, I adjusted my strategy to ditch Phantom.js and use standard HTTP requests instead. Here’s the starting code for my revised approach:

var cheerio = require('cheerio'); 
var request = require('...

内容的提问来源于stack exchange，提问作者user3808470