Skip to content Skip to sidebar Skip to footer

Selenium Jsoup Get Data From Javascript Webpage

Have asked a few questions around this recently, but haven't really found what I'm looking for. I am trying to get all of the matches from http://www.futbol24.com/Live/?__igp=1&

Solution 1:

If you are going to scrape / datamine someone's site, here are some considerations:

  1. Get permission from the site's owner! If you do not, you will piss off the owner and get blacklisted in the best case, or be served with a lawsuit in the worst case.
  2. Find out if the site exposes an . This is always the better way of scraping a site.
  3. Research tools / libraries that are more appropriate for this task. Some of these include , , , ..... Depending on your level of comfort / knowledge, you may need to research the underlying technologies: , , .....
  4. is a functional test library for browser applications, which makes it a poor choice for this task.

PS: I am fully expecting for this to get downvoted / closed, because discussions / opinions are off-topic for SO.

Solution 2:

This is working for me:

System.setProperty("webdriver.chrome.driver","C:\\tools\\chromedriver_win32\\chromedriver.exe");
WebDriverdriver=newChromeDriver();
driver.get(url);
Documentdoc= Jsoup.parse(driver.getPageSource());
// Jsoup code here to parse/scrape data
driver.close();
driver.quit();

Post a Comment for "Selenium Jsoup Get Data From Javascript Webpage"