Skip to main content

Find free stuff near you!

Project description

============
Introduction
============

Free Stuffs!
------------

This is a python 3.x package which scrapes free stuff from Craigslist.
freestuffs is under the MIT license. Check out the `source code <https://github.com/polypmer/freestuff-bot>`_
and the `docs <http://freestuffs.readthedocs.io/en/latest>`_.

* Using StuffScraper one can gather a list of free stuffs.
* Using StuffCharter, one can create an HTML map of the free stuffs.

This library can be used to create a simple web application, such as the
`Treasure map <https://github.com/polypmer/treasure-map>`_, or a simple
`Twitter bot <https://github.com/polypmer/freestuff-bot>`_

Installation
------------

Install using pip, requires python 3 and these dependences:

* requests
* geopy
* folium
* BeautifulSoup4
* unidecode

Install::

pip install freestuffs

Or, with virtualenvwrapper installed:

.. code-block:: bash

mkvirtualenv freestuffs
pip install freestuffs

Getting Started
---------------

Stuffs
******

The stuff class corresponds to a `Craiglist <https://www.craigslist.org>`_
free stuff posting. It's basic characteristics include title and location.
Notably, there is no price attribute. If the posting has no image, the
`Wikipedia <https://www.wikipedia.org>`_ no-image image is used in it's place.

::

>>> from freestuffs.stuff_scraper import StuffScraper
>>> stuffs = StuffScraper('montreal', 5).stuffs
>>> print(stuffs[0])
what: free shelves
where: Workman St, montreal
link: http://montreal.craigslist.ca/zip/5629811181.html
image: https://images.craigslist.org/00r0r_4p06sM5Hn4O_300x300.jpg

Scape Stuffs
************

The StuffScraper class will scrape Craiglist for
free stuff.

::

>>> from freestuffs.stuff_scraper import StuffScraper
>>> stuffs = StuffScraper('montreal', 5).stuffs # precise=False
>>> print(stuffs[0].thing) # Title
Meubles / furniture

In order for the scraper to automatically
scrape for latitude and longitude coordinates, pass in the
parameter precise=True into the constructor.

::

>>> from freestuffs.stuff_scraper import StuffScraper
>>> stuffs = StuffScraper('montreal', 5, precise=True).stuffs
>>> print(stuffs[0].coordinates)
['45.617854', '-73.633931']

Chart Stuffs
************

The StuffCharter class will produce a folium Map object populated
with free stuff from the StuffScraper.

::

>>> from freestuffs.stuff_scraper import StuffScraper
>>> from freestuffs.stuff_charter import StuffCharter
>>> stuffs = StuffScraper('montreal', 5, precise=True).stuffs
>>> stuffs_chart = StuffCharter(stuffs)
call save_map(path) generate html map
>>> type(map.treasure_map)
<class 'folium.folium.Map'>

The StuffCharter object is a wrapper around the folium.Map.
Call :code:`save_map(HTML_PATH, CSS_PATH)`

::

>>> stuffs_chart.save_map('webmap', 'static/style.css')

This function creates a directory if it is not found in the path. Call instead
:code:`save_test_map()` to generate an HTML map in the current directory.

Chart Legend
------------

Diminishing Order
+++++++++++++++++

- The smaller the posting, the older it is.
- The darker the border, the higher the amount of overlap.

Triage
++++++

The triage checks for regex search in this order:

#. Red are furniture "(wood|shelf|shelves|table|chair|scrap|desk)".
#. Blue are electronics "(tv|sony|écran|speakers|wire|electronic|saw|headphones|arduino)".
#. Black are the "desired" stuffs "(book|games|cool|guide|box)".
#. White is default (no regex search matches).


Support
-------

The easiest way to get support is to open an issue on Github_.

.. _Github: http://github.com/polypmer/freestuff-bot/issues

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

freestuffs-0.1.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

freestuffs-0.1-py3-none-any.whl (19.6 kB view details)

Uploaded Python 3

File details

Details for the file freestuffs-0.1.tar.gz.

File metadata

  • Download URL: freestuffs-0.1.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for freestuffs-0.1.tar.gz
Algorithm Hash digest
SHA256 4e7733e533a12f7e0dea2544ccafff3163ab329047cca279da84e2d848541db4
MD5 55987c3e1e71729053be3367bd9286c3
BLAKE2b-256 1e6b6e16785140b968cd225f25d728fe2456a02a7f75151e961cfed48dee3de1

See more details on using hashes here.

File details

Details for the file freestuffs-0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for freestuffs-0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 615f91d0ff683026e12bcb5323d76375d0134940a87e051018c4c8788165861e
MD5 a0ed9727212383143674afdd462193d8
BLAKE2b-256 c880b52ea3085cbbd6f1e705a3fb82f8c0e3af1c45331373071851f93e1e8c4c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page