1. Anuncie Aqui ! Entre em contato fdantas@4each.com.br

[Python] Web Scraping in R / Python

Discussão em 'Python' iniciado por Stack, Setembro 13, 2024.

  1. Stack

    Stack Membro Participativo

    I need to extract data from https://eservices.dha.gov.ae/DHASearch/UIPages/ProfessionalSearch.aspx?PageLang=En. I need 4 columns -"name","gender", "Titles" ,"Hospital Name", "Contact details". The "Titles" info will be shown when you click on a name. Another problem I am facing is to extract info from multiple pages. In total, there are 10071 records. I need info of all these records. Currently I am using rvest package in R but it's throwing error. See the code below -

    library(rvest)
    session = html_session("https://eservices.dha.gov.ae/DHASearch/UIPages/ProfessionalSearch.aspx")
    form = html_form(session)[[1]]


    Error : Subscript out of bounds

    I am open to solution in Python. I am novice in using beautifulsoup in Python. Any help would be highly appreciated!

    Continue reading...

Compartilhe esta Página