I need to extract data from https://eservices.dha.gov.ae/DHASearch/UIPages/ProfessionalSearch.aspx?PageLang=En. I need 4 columns -"name","gender", "Titles" ,"Hospital Name", "Contact details". The "Titles" info will be shown when you click on a name. Another problem I am facing is to extract info from multiple pages. In total, there are 10071 records. I need info of all these records. Currently I am using rvest package in R but it's throwing error. See the code below - library(rvest) session = html_session("https://eservices.dha.gov.ae/DHASearch/UIPages/ProfessionalSearch.aspx") form = html_form(session)[[1]] Error : Subscript out of bounds I am open to solution in Python. I am novice in using beautifulsoup in Python. Any help would be highly appreciated! Continue reading...
