使用mechanize自动填表单遇FormNotFoundError问题求助

Hey Ben, let's break down what's going on here and fix your issue step by step.

Possible Reasons for the Error #

• Mechanize doesn't handle JavaScript-rendered content: A lot of modern websites load forms dynamically using JavaScript. Since mechanize is a headless browser that doesn't execute JS, it can't see forms that are added to the page after the initial HTML loads. This is likely the main issue here, as your form loop returns None—meaning the page source mechanize receives doesn't contain any forms at all.
• Incorrect form targeting: Even if the form existed, your code skips a critical step: you need to select a form first with br.select_form() before accessing br.form.find_control(). Trying to interact with br.form directly without selecting a form will cause errors even if forms are present.
• Advanced anti-bot measures: While you've disabled robots.txt handling and set a User-Agent, some sites use additional checks (like missing request headers, cookie validation, or requiring a prior page visit to establish a session) to block automated tools.

Fixes to Try #

1. Switch to a JS-capable tool (most reliable solution) #

Since mechanize can't handle dynamic JavaScript, switch to a tool that can render the full page, like Selenium or Playwright. Here's a quick Selenium example tailored to your use case:

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

# Initialize the browser
driver = webdriver.Firefox()
driver.get("http://www.danpatrick.com/meatbracket/")

# Wait for the radio button to load (handles dynamic content)
radio_button = WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.ID, "polls_25_ans"))
)
radio_button.click()

# Locate and submit the form
form = driver.find_element(By.ID, "polls_form_25")
form.submit()

# Clean up
driver.quit()

2. Debug and fix mechanize form handling (if you want to stick with it) #

First, check what raw HTML mechanize is receiving to confirm if the form exists in the initial page load:

import mechanize

br = mechanize.Browser()
br.set_handle_robots(False)
br.addheaders = [('User-agent', 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1')]
br.open("http://www.danpatrick.com/meatbracket/")

# Print the full page source mechanize sees
print(br.response().read().decode('utf-8'))

If the form is present in this output, fix your form selection logic:

# Select the form first (use ID, name, or action to target it)
br.select_form(id="polls_form_25")
# Set the radio button value (note: radio buttons use lists for selection)
br["polls_25_ans"] = ["poll_25"]
# Submit the form
br.submit()

3. Strengthen anti-bot evasion #

If the site is blocking mechanize despite your current settings, add more realistic request headers and establish a valid session:

br.addheaders = [
    ('User-agent', 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1'),
    ('Accept', 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'),
    ('Accept-Language', 'en-US,en;q=0.5'),
    ('Referer', 'http://www.danpatrick.com/'),
    ('Connection', 'keep-alive')
]

# Visit the homepage first to establish a session cookie
br.open("http://www.danpatrick.com/")
# Navigate to the target page
br.follow_link(url="http://www.danpatrick.com/meatbracket/")

内容的提问来源于stack exchange，提问作者Julia Fasick