如何用R的htmlParse从HTMLInternalDocument提取指定script元素内容？

Hey there! Let’s break this down simply since you’re new to parsing—no stress, this is a common first step, and we’ll get you sorted.

Using the XML package (since you’re already using htmlParse) #

First, make sure you’ve got the XML package loaded (install it first if you haven’t):

install.packages("XML")
library(XML)

Assuming you already have your parsed document stored in an object (let’s call it doc—like doc <- htmlParse("your_webpage.html")), here’s how to grab those script elements and convert them to text:

1. Target the right script nodes
   Use an XPath expression to select all <script> tags with type="text/javascript". This will give you a list of nodes:

   script_nodes <- getNodeSet(doc, xpath = "//script[@type='text/javascript']")
   

   If you only need a specific script (e.g., one that contains a certain keyword like "productData"), you can narrow it down with a more precise XPath:

   script_nodes <- getNodeSet(doc, xpath = "//script[@type='text/javascript' and contains(text(), 'productData')]")
   

2. Extract and convert to character format
   The xmlValue() function pulls out the text content inside each script tag. Use sapply() to loop through all the nodes and turn them into a character vector:

   script_content <- sapply(script_nodes, xmlValue)
   

   Now script_content is a character vector where each element is the full JavaScript code from one of your target script tags—perfect for regex parsing later!

Bonus: A simpler alternative with rvest #

If you’re open to a more modern, user-friendly package (many R parsers prefer it these days), rvest makes this even cleaner:

install.packages("rvest")
library(rvest)

# Parse the page (works just like htmlParse but returns a nicer object)
doc <- read_html("your_webpage.html")

# Grab all matching script tags and extract their text
script_content <- doc %>%
  html_elements("script[type='text/javascript']") %>%
  html_text()

Once you have script_content ready, you can use regex tools like str_extract() or str_match() from the stringr package to pull out the specific data you need. If you run into trouble with the regex part, feel free to ask more questions!

内容的提问来源于stack exchange，提问作者VKorshunov