Python Selenium can't select dropdown (chrome webdriver)

Question

I have a dropdown element, I want to select the All option, the corresponding HTML code is:

<div class="dataTables_length" id="indicators_length"> <label> <span class="result-mune"> <span>Results </span>per page: </span> <select name="indicators_length" aria-controls="indicators" class="jcf-hidden"> <option value="25">25</option> <option value="50">50</option> <option value="100">100</option> <option value="200">200</option> <option value="-1">All</option> </select> <span class="jcf-select jcf-unselectable"> <span class="jcf-select-text"> <span class="">25</span> </span> <span class="jcf-select-opener"></span> </span> </label> </div> 

the select element is not highlighted using the browser Inspect method, looks like this drop down is triggered by js. I tried to use the Select class described here:

select = Select(self._wait.until(EC.presence_of_element_located_by((By.XPATH, "//div[@id = 'indicators_length']//select[@name = 'indicators_length']"))) select.select_by_value('-1') 

not working. and ActionChain method and even execute_script method, all not working. This bothers me a lot, hope somebody can help.

Answer 1

you don't really need to select the option just click the span and it will set the option automatically.

driver = webdriver.Chrome() driver.get("......") # click "OK, I Agree" cookies driver.find_element_by_css_selector('.agree-button.eu-cookie-compliance-default-button').click() # scroll down to make dropdown option visible driver.find_element_by_css_selector('h4.pane-title').location_once_scrolled_into_view select = driver.find_element_by_xpath('//span[@class="result-mune"]/following-sibling::span') select.click() # wait until javascript generate fake option element because it actually span time.sleep(1) select.find_element_by_css_selector('ul li span[data-index="4"]').click() 

Answer 2

try this one:

driver.execute_script('document.getElementsByName("indicators_length")[0].value = 50; 

If its created and loaded after page load make sure you add some sleep to let it render;

Answer 3

I tried using the Selenium Select class, it can find the element but it cannot select an option from the element. Not sure whats going on, could be the class "jcf-hidden" on the element.

Having said that, I took a stab at it and below is my approach. Try it out, it worked on my system, you have to handle the clicking of "OK, I Agree" button click, I did that manually.

import time from selenium.webdriver import Chrome driver = Chrome() driver.get('https://www.topuniversities.com/university-rankings/world-university-rankings/2019') # Remove this nasty time.sleep and implement webdriver wait # Handle the OK, I Agree time.sleep(5) i_agree = driver.find_element_by_css_selector('button[class*="eu-cookie-compliance-default-button"]') i_agree.click() time.sleep(5) # Open the Select rankings_length = driver.find_element_by_id('qs-rankings_length') select_opener = rankings_length.find_element_by_class_name('jcf-select-opener') select_opener.click() # loop through the list select_content = rankings_length.find_element_by_class_name('jcf-list-content') for content in select_content.find_elements_by_tag_name('li'): if content.text == 'All': content.click()