python - Navigating to a new web page and accessing its contents -


i want navigate new page web page , access contents , again return original page , access contents of original page. throws error.

i able navigate new page , access contents , able navigate original page unable access contents of original page.

here webpage want parse.

here code have been working on :-

import sys import csv import os import time import urllib  selenium import webdriver selenium.webdriver.common.keys import keys selenium.webdriver.common.action_chains import actionchains  url = 'https://www.amazon.com/s/ref=sr_pg_1?sort=salesrank&ie=utf8&rh=n%3a133140011&page=1&unfiltered=1' driver = webdriver.chrome(); driver.maximize_window() #for maximizing window driver.get(url); driver.implicitly_wait(3) #gives implicit wait 3 seconds while driver.execute_script("return document.readystate") != 'complete':     pass; elem =driver.find_elements_by_xpath("/html/body/div[1]/div[2]/div/div[3]/div[2]/div/div[4]/div[1]/div/ul/li"); i,item in enumerate(elem):     temp = 0; #temp =0 refers best seller;     try:         if item.find_element_by_xpath("div/div[1]/div/a/span[1]/span").text.encode('utf-8') == "best seller":             print "best seller :- yes";     except:         print "best seller :- no"         temp = 1;     if temp == 0:          print "name of book :- %s" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/a/h2").text.encode('utf-8'));         #enter.write("name of book :- %s\n" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/a/h2").text.encode('utf-8')))          print "release date :- %s" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/span[3]").text.encode('utf-8'));         #enter.write("release date :- %s\n" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/span[3]").text.encode('utf-8')));          print "author :- %s" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[2]/span[2]").text.encode('utf-8'));         #enter.write("author :- %s\n" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[2]/span[2]").text.encode('utf-8')));          print "url-page of book :- %s" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/a").get_attribute("href"));         #enter.write("url-page of book :- %s\n" %(item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/a").get_attribute("href")));                   new_url = item.find_element_by_xpath("div/div[2]/div/div[2]/div[1]/div[1]/a").get_attribute("href")           driver.get(new_url);         while driver.execute_script("return document.readystate") != 'complete':             pass;         nums in range(1,10):                 if driver.find_element_by_xpath("""//*[@id="productdetailstable"]/tbody/tr/td/div/ul/li[%s]/b"""%(nums)).text == 'asin:':                 print driver.find_element_by_xpath("""//*[@id="productdetailstable"]/tbody/tr/td/div/ul/li[%s]"""%(nums)).text.encode('utf-8');                 break;         print "no. of 5 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[1]/td[3]/a""").text.encode('utf-8'));         print "no. of 4 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[2]/td[3]/a""").text.encode('utf-8'));            print "no. of 3 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[3]/td[3]/a""").text.encode('utf-8'));         print "no. of 2 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[4]/td[3]/a""").text.encode('utf-8'));         print "no. of 1 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[5]/td[3]/a""").text.encode('utf-8'));         driver.back();     else:         flag = item.find_element_by_xpath("div/div/div/div[2]")         print "name of book :- %s" %(flag.find_element_by_xpath("div[1]/div[1]/a/h2").text.encode('utf-8'));         print "release date :- %s" %(flag.find_element_by_xpath("div[1]/div[1]/span[3]").text.encode('utf-8'));         print "author :- %s" %(flag.find_element_by_xpath("div[1]/div[2]/span[2]").text.encode('utf-8'));         print "url-page of book :- %s" %(flag.find_element_by_xpath("div[1]/div[1]/a").get_attribute("href"));          new_url = flag.find_element_by_xpath("div[1]/div[1]/a").get_attribute("href")           driver.get(new_url);         while driver.execute_script("return document.readystate") != 'complete':             pass;         nums in range(1,10):                 if driver.find_element_by_xpath("""//*[@id="productdetailstable"]/tbody/tr/td/div/ul/li[%s]/b"""%(nums)).text.encode('utf-8') == 'asin:':                 print driver.find_element_by_xpath("""//*[@id="productdetailstable"]/tbody/tr/td/div/ul/li[%s]"""%(nums)).text.encode('utf-8');                 break;         print "no. of 5 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[1]/td[3]/a""").text.encode('utf-8'));         print "no. of 4 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[2]/td[3]/a""").text.encode('utf-8'));            print "no. of 3 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[3]/td[3]/a""").text.encode('utf-8'));         print "no. of 2 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[4]/td[3]/a""").text.encode('utf-8'));         print "no. of 1 star ratings :- %s"%(driver.find_element_by_xpath("""//*[@id="histogramtable"]/tbody/tr[5]/td[3]/a""").text.encode('utf-8'));                 driver.back();

it gives me following error

at line 57 i.e.

flag = item.find_element_by_xpath("div/div/div/div[2]") selenium.common.exceptions.staleelementreferenceexception: message: stale element reference: element not attached page document

can me on ?

your problem driver.back(); execute this. every single element have object reference in code becomes stale , invalid. , need re-create object.

so should recreate loop in such way inside loop 

elem =driver.find_elements_by_xpath("/html/body/div[1]/div[2]/div/div[3]/div[2]/div/div[4]/div[1]/div/ul/li");

and loop should not be

for i,item in enumerate(elem):

it should numeric loop, inside loop indexed association

item = elem[i]

Comments

Post a Comment

Popular posts from this blog

Is there a better way to structure post methods in Class Based Views -

i'm using class based views in django , never specify url in ajax calls , omit action parameter in form because know these requests go through post method of class based view. notice view - profile page make many requests depending on user updating on page - post method become convoluted , if/else mess example: def post(self, request, *args, **kwargs): # handle user changing available date if request.post.get('availabledate') != none: self.updateavailabledate(request) return jsonresponse({'result':'success'}) if request.post.get('newprojectname') != none: creative_user = creativeuserprofile.objects.get(id = request.user.id) project = project.create_project(creative_user, request.post['newprojectname']) project.save() return jsonresponse({'projectid': project.id }) if request.post.get('projectimage') != none , request.files['file']: proj...
Read more

performance - Why is XCHG reg, reg a 3 micro-op instruction on modern Intel architectures? -

i'm doing micro-optimization on performance critical part of code , came across sequence of instructions (in at&t syntax): add %rax, %rbx mov %rdx, %rax mov %rbx, %rdx i thought had use case xchg allow me shave instruction , write: add %rbx, %rax xchg %rax, %rdx however, dimay found agner fog's instruction tables , xchg 3 micro-op instruction 2 cycle latency on sandy bridge, ivy bridge, broadwell, haswell , skylake. 3 whole micro-ops , 2 cycles of latency! 3 micro-ops throws off 4-1-1-1 cadence , 2 cycle latency makes worse original in best case since last 2 instructions in original might execute in parallel. now... cpu might breaking instruction micro-ops equivalent to: mov %rax, %tmp mov %rdx, %rax mov %tmp, %rdx where tmp anonymous internal register , suppose last 2 micro-ops run in parallel latency 2 cycles. given register renaming occurs on these micro-architectures, though, doesn't make sense me done way. why wouldn't register renamer ...
Read more

c# - Asp.net web api : redirect unauthorized requst to forbidden page -

im trying redirect unauthorized request forbidden page instead i'm getting forbidden page in response body , how can fix ? here's startup class : app.createperowincontext(storecontext.create); app.createperowincontext<applicationusermanager>(applicationusermanager.create); app.createperowincontext<applicationsigninmanager>(applicationsigninmanager.create); app.usecookieauthentication(new cookieauthenticationoptions { authenticationtype = defaultauthenticationtypes.applicationcookie, expiretimespan = timespan.fromdays(30), }); app.useexternalsignincookie(defaultauthenticationtypes.externalcookie); app.usetwofactorsignincookie(defaultauthenticationtypes.twofactorcookie, timespan.fromminutes(5)); app.usetwofactorrememberbrowsercookie(defaultauthenticationtypes.twofactorrememberbrowsercookie); the method im trying reach : [httpget] [authorize(roles = "admin")] public string getcurrentusername() { return userman...
Read more