Skip to main content

Aroudas.lt website scraper

Project description

The Aroudas Web-scraper

Description

This web_scraper is designed to collect the following information for apartments listed on the Aroudas website.

  • City
  • Sub-district
  • Description
  • Link
  • Building number
  • Flat number
  • Area
  • Price per month
  • Build year
  • Building type
  • Heating system
  • Energy class
  • Nearest kindergarten
  • Nearest educational institution
  • Nearest stop
  • Nearest public transport stop

The scraper has 3 methods:

  • scrape - Loops through webpages and scrapes data off the aroudas.lt website.
  • to_csv - Used to save the dataframe to csv
  • scrape_to_csv - Used to scrape and save the data to csv

Usage

To use the scaper, pip install the package.

pip install vilnius-aroudas-scraper

one_four_rooms = Aroudas()

# to scrape and data
df = one_four_rooms.scrape(num_houses=1000, room_min=1, room_max=4)

# to save scraped data to csv
one_four_rooms.to_csv(df)

# to scrape and save data to csv
one_four_rooms.scrape_to_csv(num_houses=1000, room_min=1, room_max=4)

License

The MIT License - Copyright (c) 2021 - Blessing Ehizojie-Philips

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vilnius-aroudas-scraper-0.0.2.tar.gz (4.2 kB view details)

Uploaded Source

File details

Details for the file vilnius-aroudas-scraper-0.0.2.tar.gz.

File metadata

  • Download URL: vilnius-aroudas-scraper-0.0.2.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.5.0 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.7

File hashes

Hashes for vilnius-aroudas-scraper-0.0.2.tar.gz
Algorithm Hash digest
SHA256 f7a60704c2fe547457c7915b279da4bacf9e5c6fd4d5a3a646fdef57f552528d
MD5 468d34d4d2e5d52831dad77db856a940
BLAKE2b-256 1b55cd14316f7f60d40ff8b4e4d4d39acd87da214cf14eb06bc44dd6cc25860c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page