thanks for taking a look at my problem. i would like to know if there is any way to pull the data-sitekey from this text... here is the url to the page
<div><div><div><iframe src="" title="recaptcha widget" width="304" height="78" frameborder="0" scrolling="no" name="undefined"></iframe></div><textarea name="g-recaptcha-response"></t here is my current code
import requests from bs4 import BeautifulSoup headers = { 'Host' : 'e-com.secure.force.com', 'Connection' : 'keep-alive', 'Upgrade-Insecure-Requests' : '1', 'User-Agent' : 'Mozilla/5.0 (Windows NT 6.1; WOW64)', 'Accept' : 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8', 'Accept-Encoding' : 'gzip, deflate, sdch', 'Accept-Language' : 'en-US,en;q=0.8' } url = ' r = requests.get(url, headers=headers) soup = BeautifulSoup(r, 'html.parser') c = soup.find_all('div', attrs={"class": "data-sitekey"}) print c 1 Answer
Ok now we have code, it is as simple as:
import requests from bs4 import BeautifulSoup soup = BeautifulSoup(requests.get("").content, "html.parser") key = soup.select_one("#ncaptchaRecaptchaId")["data-sitekey"] data-sitekey is an attribute, not a css class so you just need to extract it from the element, you can find the element by it's id as above.
You could also use the class name:
# css selector key = soup.select_one("div.g-recaptcha")["data-sitekey"] # regular find using class name key = soup.find("div",class_="g-recaptcha")["data-sitekey"] 
