Hey there, let's work through this SSL certificate issue you're hitting when scraping the ENTSO-E Transparency API. Since you suspect your VPN is the root cause, here are practical steps to resolve it:

• Check your VPN's SSL inspection settings
  A lot of VPNs use SSL/TLS interception (a man-in-the-middle approach) to filter or monitor traffic. This inserts a self-signed certificate into the chain, which triggers the certificate verify failed error. Head to your VPN's settings and look for options like SSL Inspection, HTTPS Scanning, or Content Filtering. Either disable this feature entirely, or add transparency.entsoe.eu to the list of trusted/whitelisted domains.

• Trust your VPN's root certificate in your code
  If you need to keep SSL inspection enabled, you can export your VPN's root certificate (usually a .pem file) and tell your HTTP client to trust it. For example, if you're using the requests library in Python:

  import requests
  
  # Replace with the actual path to your VPN's root certificate
  vpn_cert_path = "/path/to/your/vpn-root-cert.pem"
  api_url = "https://transparency.entsoe.eu/api?documentType=A44&in_Domain=10YES-REE------0&out_Domain=10YES-REE------0&securityToken=278a7d7b-0955-4fda-af4c-7843c28305e6&periodStart=202011302300&periodEnd=202012312300"
  
  response = requests.get(api_url, verify=vpn_cert_path)
  

• Temporarily disable certificate verification (for testing only!)
  If you just need to test your code and don't care about security risks (never do this in production), you can turn off SSL verification. This bypasses the check but leaves your requests vulnerable to interception:

  import requests
  import urllib3
  
  # Suppress the insecure request warning (optional)
  urllib3.disable_warnings(urllib3.exceptions.InsecureRequestWarning)
  
  api_url = "https://transparency.entsoe.eu/api?documentType=A44&in_Domain=10YES-REE------0&out_Domain=10YES-REE------0&securityToken=278a7d7b-0955-4fda-af4c-7843c28305e6&periodStart=202011302300&periodEnd=202012312300"
  
  response = requests.get(api_url, verify=False)
  

• Switch VPN nodes or providers
  If adjusting settings doesn't work, try connecting to a different VPN node—some nodes might not have SSL inspection enabled. If all nodes from your current provider cause the same issue, consider switching to a VPN service that doesn't perform SSL interception by default.

内容的提问来源于stack exchange，提问作者Almudena Huerta Miranda