Skip to main content

A package that helps extract Steam store and community market data as pandas DataFrame for better readabilty and usability.

Project description

PyPI License: MIT Repo Size GitHub follow

steamcrawl

This is still a work in progress. Some functionality are available but not quite fully tested. The final version will be release as v1.0.0.

A package that helps extract Steam store and community market data as pandas DataFrame for better readabilty and usability. The package mainlymake queries to different Steam api, clean and extract the important variables from the json object result and return a pandas Dataframe.

With Steam request limit, you can make 200 requests every 5 minutes. If you exceed the limit, Steam can give you a cooldown of (possibly) a few 1,2 minutes to 6 hours (depends on the API). Please make an appropriate number of requests at a given time. It is recommended to close any Steam web and application to limit the requests you are sending.

Installation and setup

The following library are used in the package.Thus, the requirement of their installation must be met:

  • pandas==1.5.1
  • selenium-wire==5.1.0
  • requests==2.29.0

You can download the package from PyPI using pip:

pip install steamcrawl

Before starting, you need to obtain the value of the cookie steamLoginSecure. This can be done by opening DevTools (Ctrl + Shift + I) on steamcommunity.com, Application (on the task bar), Cookies.

The package requires this value to be passed in order to return the data using the information related to you (for example currency). Please be aware that it is absolutely safe to put your steamLoginSecure into the program. The package does not attempt to record/send to another source any of your information; even with your steamLoginSecure value, there is nothing another user can extract but your public market listing history, because it is all data that Steam permits user to get from its API.

Documentation

The documentation is available at the GitHub Wiki.

Example

Initialize the Request class with your steamLoginSecure as string:

from steamcrawl import Request
import pandas as pd

request = Request('your steamLoginSecure here')

Get your market trade history:

data_frame = request.get_market_history(count = 10)
data_frame.to_csv('example.csv')

The obtained result is (this is only part of the result):

Get buy/sell orders of an item:

data_frame = get_buysell_orders(item_name = "USP-S | Printstream", appid="730")
# appid 730 indicates Counter-Strike: Global Offensive game. 
# Obtain the appid for a game using get_all_appid().
data_frame.to_csv('example.csv')

The obtained result is (this is again only part of the result).

A small note is: please do not be alerted by the popping up browser for this request, this is only the behavior of the seleniumwire package used for this function.

Legal

This project is in no way affiliated with, authorized, maintained, sponsored or endorsed by Valve or any of its affiliates or subsidiaries. This is an independent and unofficial project created by Hungreeee. Use it at your own risk.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

steamcrawl-0.1.8.tar.gz (8.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

steamcrawl-0.1.8-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file steamcrawl-0.1.8.tar.gz.

File metadata

  • Download URL: steamcrawl-0.1.8.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.4

File hashes

Hashes for steamcrawl-0.1.8.tar.gz
Algorithm Hash digest
SHA256 b8b70a699975040987d5c49e9d9f4483ed830f9fb0a8120eb9ac5c75186c38a1
MD5 d5fa7b54f58ea557aa9cb850c1cf59d2
BLAKE2b-256 14e82cac244e185c5afd3f0c6d0491ddd68e543b891a7a4c2191a72fc1eaed20

See more details on using hashes here.

File details

Details for the file steamcrawl-0.1.8-py3-none-any.whl.

File metadata

  • Download URL: steamcrawl-0.1.8-py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.4

File hashes

Hashes for steamcrawl-0.1.8-py3-none-any.whl
Algorithm Hash digest
SHA256 8b79f479a6e46de83e3d4ce8d0994011278cf425bf400ca54f1a9a915fecab5d
MD5 c00315edfa3a57387f423bcb18f18f14
BLAKE2b-256 0d98b932ded760821f9a97527577560e5d586580226fbc1f47c5404f1a0f4150

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page