Skip to main content

Aroudas.lt website scraper

Project description

The Aroudas Web-scraper

Description

This web_scraper is designed to collect the following information for apartments listed on the Aroudas website.

  • City
  • Sub-district
  • Description
  • Link
  • Building number
  • Flat number
  • Area
  • Price per month
  • Build year
  • Building type
  • Heating system
  • Energy class
  • Nearest kindergarten
  • Nearest educational institution
  • Nearest stop
  • Nearest public transport stop

The scraper has 3 methods:

  • scrape - Loops through webpages and scrapes data off the aroudas.lt website.
  • to_csv - Used to save the dataframe to csv
  • scrape_to_csv - Used to scrape and save the data to csv

Usage

To use the scaper, pip install the package.

pip install vilnius-aroudas-scraper

one_four_rooms = Aroudas()

# to scrape and data
df = one_four_rooms.scrape(num_houses=1000, room_min=1, room_max=4)

# to save scraped data to csv
one_four_rooms.to_csv(df)

# to scrape and save data to csv
one_four_rooms.scrape_to_csv(num_houses=1000, room_min=1, room_max=4)

License

The MIT License - Copyright (c) 2021 - Blessing Ehizojie-Philips

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vilnius-aroudas-scraper-0.0.3.tar.gz (4.2 kB view details)

Uploaded Source

File details

Details for the file vilnius-aroudas-scraper-0.0.3.tar.gz.

File metadata

  • Download URL: vilnius-aroudas-scraper-0.0.3.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.5.0 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.7

File hashes

Hashes for vilnius-aroudas-scraper-0.0.3.tar.gz
Algorithm Hash digest
SHA256 a82e611f60a17cb0ff7abf2fb52a2c797f63f0bd824a810ceff9e9273c55a706
MD5 52861708e47258c3b96f89d6b63c787c
BLAKE2b-256 1a0374268a3f86831fe8b60745716ae8a49edcafc47888f734cfe9ca5b9c3ad7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page