![]() ![]() ![]() Knowledge of python or any general purpose scripting language.Įxperience with Big Data technologies such as Hive/Spark. I want the full job description of each job and tried getting it using the job_description_tag, but it just returns ‘N/A’ (I put the if statement there for the case where a job posting does not have job description.).Įach job post’s output returns an ‘N/A’ so there is obviously something wrong.įor reference, by inspecting the job description of one of the jobs, it is seen that the job_description_tag’s html code I tried to scrape looks like this: ġ+ years of experience as a Data Engineer or in a similar roleĮxperience with data modeling, data warehousing, and building ETL pipelines Print('Job Title:', title, 'nLink:', link, 'nJob Description:', job_description, 'n-') Job_description = job_description_tag.text if job_description_tag else "N/A" ![]() Soup = BeautifulSoup(data, 'html.parser') My code looks like this: from bs4 import BeautifulSoup I managed to scrape the titles and links for each job post, and now am struggling to scrape the full job descriptions of each job posting (I don’t want the summary – I want each job post’s full job description). I need to scrape job postings from Indeed. Beautifulsoup, css, html, python, web-scraping
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |