How to read a page with an infinite scroll bar using selenium's html unit driver for java? -

-

for example, if wanted find post on facebook year ago using selenium how able scroll down , text. have figured out how scroll using selenium whenever try elements or page source includes initial loaded page, nothing scrolled down to. i'm not using facebook, i'm using website doesn't have java developer tools, stock twits.

the logic followed in example find post text content

  let allposts      while timeout      visible posts has text in       remove allposts currentposts [so dont need check same post again]        , add currentposts allposts[to maintain list]          each post in currentposts            check if post's text contains given text            stop        scroll bottom[which invokes ajax call load more posts]        //replace above button loadmore or if scroll dint invoke ajax load        wait till page loaded     again

this worked me found post on wall on birthday[1 month ago].

it took 20 mins [depends on no of posts , time of post take more time]

the following search facebook news feed given text

public static void fbsearch() {     system.setproperty("webdriver.chrome.driver", "d:\\galen\\chromedriver.exe");     webdriver driver = new chromedriver();     driver.get("http://www.facebook.com");     driver.findelement(by.name("email")).sendkeys("phystem");     driver.findelement(by.name("pass")).sendkeys("yyy");     driver.findelement(by.id("loginbutton")).click();     waitforpageloaded(driver);     fbpostsearch(driver, "true story", 20);//timeout in mins }  public static boolean fbpostsearch(webdriver driver, string postcontent, int timeoutinmins) {     set<webelement> allposts = new hashset<>();     int totaltime = timeoutinmins * 60000; // in millseconds     long starttime = system.currenttimemillis();     boolean timeends = false;     while (!timeends) {         list<webelement> posts = getposts(driver);         posts.removeall(allposts);//to remove old posts searched         allposts.addall(posts);//append new posts posts         (webelement post : posts) {             string content = post.gettext();             if (content.contains(postcontent)) {                 //this our element                 system.out.println("found");                 new actions(driver).movetoelement(post).build().perform();                 ((javascriptexecutor) driver).executescript("arguments[0].style.outline='2px solid #ff0';", post);                 return true;             }         }         scrolltobottom(driver);         waitforpageloaded(driver);         timeends = (system.currenttimemillis() - starttime >= totaltime);     }     system.out.println("not found");     return false; }  public static list<webelement> getposts(webdriver driver) {     //finding posts has textcontent coz posts image     return driver.findelements(by.cssselector("div._4-u2.mbm._5v3q._4-u8 div._5pbx.usercontent")); }  private static void scrolltobottom(webdriver driver) {     long longscrollheight = (long) ((javascriptexecutor) driver).executescript("return math.max("             + "document.body.scrollheight, document.documentelement.scrollheight,"             + "document.body.offsetheight, document.documentelement.offsetheight,"             + "document.body.clientheight, document.documentelement.clientheight);"     );     ((javascriptexecutor) driver).executescript("window.scrollto(0, " + longscrollheight + ");"); }  public static void waitforpageloaded(webdriver driver) {     expectedcondition<boolean> expectation = new expectedcondition<boolean>() {         @override         public boolean apply(webdriver driver) {             return ((javascriptexecutor) driver).executescript(                     "return document.readystate").equals("complete");         }     };     webdriverwait wait = new webdriverwait(driver, 20);     wait.until(expectation); }

Comments

Post a Comment

Popular posts from this blog

Fail to load namespace Spring Security http://www.springframework.org/security/tags -

-
i have problem namespace of spring security on xhtml page. don't understand why can't load uri, , have following issue: whitelabel error page application has no explicit mapping /error, seeing fallback. tue jul 21 16:58:12 utc 2015 there unexpected error (type=not found, status=404). please need help! possible uri has been changed? best regards you using incorrect namespace url. correct url http://www.springframework.org/schema/security the error page seeing spring source website since not recognize url. try visiting http://www.springsource.org/security/tags in browser update : spring security tags used in jsp page correct tag lib declaration is: <%@ taglib prefix="sec" uri="http://www.springframework.org/security/tags" %>
Read more

sql - MySQL query optimization using coalesce -

-
can explain me why second query faster first? (first 1 takes around 40 seconds, second 1 less 0.1) select releases.feature_code, releases.platform_id, version, release_date, general_available, uri, filesize, display_name, feature_name.full_name, if ((select exists(select 1 release_exceptions releases.feature_code = release_exceptions.feature_code , releases.platform_id = release_exceptions.platform_id , releases.version = release_exceptions.version) = 1), 1, 0) release_exceptions releases left outer join platform using(platform_id) left outer join feature_name using(feature_code) order version desc; ~~~ query 2 ------------------ ~~~ select feature_code, version, release_date, general_available, platform_id, uri, filesize, display_name, feature_name.full_name, coalesce(release_exceptions, 0) release_exceptions mus.releases left outer join ( select distinct feature_code, version, platform_id, 1 release_exceptions mus.release_exceptions ) release_exceptions using ...
Read more

unity3d - Unity local avoidance in user created world -

-
i'm using unity3d networked multiplayer online game have large complex 3d terrain scene forest, trees, cliff, hills, mountains, bounders, etc. players can build structures sort of minecraft, , put them anywhere in scene, or move them around anytime. aside human controlled players, there automated ai players , objects animals roaming around scene following path. the problem how make these automated ai players , animals, able navigate around static , dynamic player created structures, because path follow can blocked player created structures, or other players , other ai objects, cliffs etc. have find away around them or on track if tumble down off high cliff example. so made navmesh , used navagents, takes care of static, non moving objects, how make ai players navigate around each other , dynamic structures created players can number in hundreds? i thought of adding navmeshobstacle everything, result in being attached hundreds of objects since user created structures b...
Read more