Thursday, May 8, 2025

Web Scraping and Data Extraction - Job Listing Aggregator

 


Notes:

  • Problem Solved: Extracts job postings from multiple job boards.

  • Customization Benefits: Filter by keywords, location, or salary.

  • Further Adoption: Feed into job boards, CRMs, or recruitment analytics platforms.

Python Code:


import requests
from bs4 import BeautifulSoup

def scrape_indeed_jobs(query, location):
    base_url = "https://www.indeed.com/jobs"
    params = {"q": query, "l": location}
    response = requests.get(base_url, params=params)
    soup = BeautifulSoup(response.text, 'html.parser')
    jobs = []
    for job_card in soup.select('.result'):
        title = job_card.select_one('h2.jobTitle').text.strip()
        company = job_card.select_one('.companyName').text.strip()
        jobs.append({'title': title, 'company': company})
    return jobs

print(scrape_indeed_jobs("data analyst", "New York, NY"))

No comments:

Post a Comment

IoT (Internet of Things) Automation - Smart Energy Usage Tracker

  Notes: Problem Solved: Logs and analyzes power usage from smart meters. Customization Benefits: Track per-device energy and set ale...