Selenium And Java: Exception in thread "main" org.openqa.selenium.NoSuchWindowException: no such window: target window already closed

Question

I am accessing a Quebec Laws website and I am trying to web scrape all of its law names along with their associated PDFs. When doing this, I open each and every tab of each law and then go through all those tabs to get the information I am looking for. However, after a while of going through the tabs I get the following error: "Exception in thread "main" org.openqa.selenium.NoSuchWindowException: no such window: target window already closed ". I am unsure why this is popping up. I believe it's because the number of tabs is so long as the same code I used for a smaller number of tabs worked fine. Here is my code: `

System.setProperty("webdriver.chrome.driver", "C:\\WorkSpace\\Driver\\chromedriver.exe");
        WebDriver driver = new ChromeDriver();
        WebDriverWait wait = new WebDriverWait(driver, Duration.ofSeconds(5000));
        driver.manage().window().maximize();
        driver.get("http://www.legisquebec.gouv.qc.ca/en/chapters?corpus=regs&selection=all");
        wait.until(ExpectedConditions.numberOfElementsToBeMoreThan(By.cssSelector("tr.clickable a"), 100));
        Thread.sleep(50);

        List<WebElement> QuebecConsolidatedRegulations = driver.findElements(By.cssSelector("tr.clickable a"));
        String parent = driver.getWindowHandle();
        for (int i=0; i<QuebecConsolidatedRegulations.size(); i++){
            String opentabs = Keys.chord(Keys.CONTROL, Keys.ENTER);
            
            ((JavascriptExecutor) driver).executeScript("arguments[0].scrollIntoView(true);", QuebecConsolidatedRegulations.get(i));
            Thread.sleep(300);
            wait.until(ExpectedConditions.visibilityOf(QuebecConsolidatedRegulations.get(i)));
            QuebecConsolidatedRegulations.get(i).sendKeys(opentabs);
        }

        int i=0; 
            Set<String> tabs = driver.getWindowHandles();
            for (String child:tabs){
                // try{
                    if (!parent.equalsIgnoreCase(child)){
                        driver.close();
                        
                        driver.switchTo().window(child);
                        String StatuteName = driver.findElement(By.xpath("//*[@id='form']/div[2]/div[1]/h3")).getText();
                        String pagePdfUrl = driver.findElement(By.xpath("//*[@id='renditionPdf']")).getAttribute("href");
                        driver.manage().timeouts().implicitlyWait(Duration.ofSeconds(10));
                        if (i<QuebecConsolidatedRegulations.size()){
                            ConsolidatedRegulationsAndPDFs.put(StatuteName, pagePdfUrl);
                            i+=1;
                        }
                        else{
                            continue;
                        }
                    }
               // }
                // catch(NoSuchWindowException e){
                //     continue;
                // }
                
               
                    
            }
            return ConsolidatedRegulationsAndPDFs;
    }`

Please tell us the line which the error comes from. Also, you said you try for less tabs and it worked? Why don't you open all laws in the same tab? — YourHelper
– YourHelper, Commented Feb 5, 2022 at 1:58
My apologies. Line 117 is where the error occurs. Also I am unsure how I am supposed to open all laws in one tab? Opening a law leads to a new tab. Do you mean opening a law then returning to the main page to access a different law? — NoobCoder
– NoobCoder, Commented Feb 5, 2022 at 5:28

Max Daroshchanka · Accepted Answer · 2022-02-05 14:13:19Z

This definitely might depend on opened tabs count.

I've done some research with the next script (groovy):

static void main(a) {
    WebDriverManager.chromedriver().setup()
    WebDriver driver = new ChromeDriver(new ChromeOptions())
    driver.get('https://nbc.com')
    300.times {
        driver.executeScript("window.open('https://nbc.com')")
        println('windows size:' + driver.getWindowHandles().size())
        driver.switchTo().window(driver.getWindowHandles().first())
        driver.switchTo().window(driver.getWindowHandles().last())
    }
    driver.quit()
}

And it fails with

Exception in thread "main" org.openqa.selenium.WebDriverException: chrome not reachable

after 92 new tabs opened (note: I have 16GB RAM). Tabs count before fail depends on the site and the memory, it consuming..

And on your page there are 3000+ QuebecConsolidatedRegulations items.

I suggest do not keep so many tabs opened

I suggesting in a loop:

open a new tab,
collect data,
close the tab
switch to the first window

In this way you'll have 1 or 2 tabs opened simultaneously and not more.

List<WebElement> QuebecConsolidatedRegulations = driver.findElements(By.cssSelector("tr.clickable a"));
String parent = driver.getWindowHandle();
for (int i=0; i<QuebecConsolidatedRegulations.size(); i++){
    String opentabs = Keys.chord(Keys.CONTROL, Keys.ENTER);
    ((JavascriptExecutor) driver).executeScript("arguments[0].scrollIntoView(true);", QuebecConsolidatedRegulations.get(i));
    Thread.sleep(300);
wait.until(ExpectedConditions.visibilityOf(QuebecConsolidatedRegulations.get(i)));
    QuebecConsolidatedRegulations.get(i).sendKeys(opentabs);
    // do the action within a loop but in new window
    addPdfUrlFromTheNewPage(driver, ConsolidatedRegulationsAndPDFs);
}

implement the mehtod addPdfUrlFromTheNewPage

public static void addPdfUrlFromTheNewPage(WebDriver driver, Map resultsMap) {
    List<String> tabs = new ArrayList<>(driver.getWindowHandles());
    String lastTab = tabs.get(tabs.size()-1);
    driver.switchTo().window(lastTab);
    String StatuteName = driver.findElement(By.xpath("//*[@id='form']/div[2]/div[1]/h3")).getText();
    String pagePdfUrl = driver.findElement(By.xpath("//*[@id='renditionPdf']")).getAttribute("href");
    driver.manage().timeouts().implicitlyWait(Duration.ofSeconds(10));
    resultsMap.put(StatuteName, pagePdfUrl);
    driver.close(); //close current window
    driver.switchTo().window(tabs.get(0));  //switch to initial window
}

It had worked more than 20 minutes and I think 1500+ items were scraped. Then I just stopped execution. I think it will work without any issues.

output:

2018C23, r. 1 - Regulation respecting certain transitional measures for the carrying out of the Act mainly to improve the regulation of the financial sector, the protection of deposits of money and the operation of financial institutions=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/2018C23,%20R.%201.pdf
A-2.02, r. 1 - Regulation respecting the application of the Act to promote access to justice through the establishment of the Service administratif de rajustement des pensions alimentaires pour enfants=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.02,%20R.%201.pdf
A-2.1, r. 1 - Code of ethics of the members of the Commission d’accès à l’information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%201.pdf
A-2.1, r. 2 - Regulation respecting the distribution of information and the protection of personal information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%202.pdf
A-2.1, r. 3 - Regulation respecting fees for the transcription, reproduction or transmission of documents or personal information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%203.pdf
A-2.1, r. 4 - Regulation respecting public bodies that must refuse to release or to confirm the existence of certain information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%204.pdf
A-2.1, r. 5 - Regulation respecting the procedure for selecting persons qualified for appointment as members of the Commission d’accès à l’information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%205.pdf
A-2.1, r. 6 - Rules of Proof and Procedure before the Commission d’accès à l’information=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-2.1,%20R.%206.pdf
A-3, r. 1 - Regulation respecting financial assistance=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3,%20R.%201.pdf
A-3, r. 2 - Regulation respecting the impairment scale=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3,%20R.%202.pdf
A-3, r. 3 - Regulation respecting payment of expenses for organizing and maintaining rescue stations in mines by the Commission des normes, de l’équité, de la santé et de la sécurité du travail, and the reimbursement by interested employers of sums disbursed=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3,%20R.%203.pdf
A-3, r. 4 - Regulation respecting reimbursement of damaged or destroyed clothing, prosthesis or orthesis=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3,%20R.%204.pdf
A-3, r. 5 - Regulation respecting the transportation of the body of a worker=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3,%20R.%205.pdf
A-3.001, r. 1 - Regulation respecting medical aid=http://www.legisquebec.gouv.qc.ca/en/pdf/cr/A-3.001,%20R.%201.pdf

... +3000 lines

Collectives™ on Stack Overflow

Selenium And Java: Exception in thread "main" org.openqa.selenium.NoSuchWindowException: no such window: target window already closed

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related