Utilities that integrate advanced scraping knowledge into just one library.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for datamarket from gravatar.com datamarket

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: GNU General Public License v3 (GPLv3), GNU General Public License v3 or later (GPLv3+) (GPL-3.0-or-later)
  • Author: DataMarket
  • Requires: Python <4.0, >=3.9
  • Provides-Extra: aws, azure-storage-blob, boto3, chompjs, click, clickhouse-driver, croniter, datetime, demjson3, dnspython, drive, duckduckgo-search, fake-useragent, geoalchemy2, geopandas, geopy, google-api-python-client, google-auth-httplib2, google-auth-oauthlib, html2text, json5, lxml, nodriver, pandas, pandera, peerdb, pendulum, pillow, playwright, playwright-stealth, proxy, pyarrow, pydrive2, pymupdf, pysocks, pyspark, pytest, rapidfuzz, retry, shapely, soda-core-postgres, stem, tqdm, undetected-chromedriver, unidecode, xmltodict
Classifiers

Project description

DataMarket scraping core

Code style: black

Utilities that integrate advance scraping knowledge into just one library.

Installation

To install this library in your Python environment:

pip install datamarket

Documentation

This library has built functionalities for the following topics:

  • Databases: through sqlalchemy it allows to insert records and perform queries in any database.
  • Proxies: wide range of functions to perform HTTP requests through custom proxies or the Tor network.
  • Tinybird: a Python client for this popular API.
  • Drive: functions to upload, delete or authenticate to Google Drive.
  • FTP: functions to upload, delete or authenticate to an FTP, SFTP or FTPS server.
  • Selenium: wrapper for the main Selenium functions.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for datamarket from gravatar.com datamarket

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: GNU General Public License v3 (GPLv3), GNU General Public License v3 or later (GPLv3+) (GPL-3.0-or-later)
  • Author: DataMarket
  • Requires: Python <4.0, >=3.9
  • Provides-Extra: aws, azure-storage-blob, boto3, chompjs, click, clickhouse-driver, croniter, datetime, demjson3, dnspython, drive, duckduckgo-search, fake-useragent, geoalchemy2, geopandas, geopy, google-api-python-client, google-auth-httplib2, google-auth-oauthlib, html2text, json5, lxml, nodriver, pandas, pandera, peerdb, pendulum, pillow, playwright, playwright-stealth, proxy, pyarrow, pydrive2, pymupdf, pysocks, pyspark, pytest, rapidfuzz, retry, shapely, soda-core-postgres, stem, tqdm, undetected-chromedriver, unidecode, xmltodict
Classifiers

Release history Release notifications | RSS feed

0.7.18

0.7.17

This version

0.7.16

0.7.15

0.7.14

0.7.13

0.7.12

0.7.11

0.7.10

0.7.9

0.7.8

0.7.7

0.7.6

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10a0 pre-release

0.5.9

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1

0.5.0

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.9

0.3.8

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.6

0.2.5

0.2.4

0.2.3

0.2.2

0.2.1

0.2.0

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datamarket-0.7.16.tar.gz (28.6 kB view details)

Uploaded Source

Built Distribution

datamarket-0.7.16-py3-none-any.whl (32.3 kB view details)

Uploaded Python 3

File details

Details for the file datamarket-0.7.16.tar.gz.

File metadata

  • Download URL: datamarket-0.7.16.tar.gz
  • Upload date:
  • Size: 28.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for datamarket-0.7.16.tar.gz
Algorithm Hash digest
SHA256 ec60495c7f7e2b8e50052270ed65e001fdd9d1ed02d00e50fd93336aabda5804
MD5 1744d52f81c3a4405136d5068d5fc0b5
BLAKE2b-256 1d31923912de9ab6a4dab6dc02c75488d5a8a6515bd8bdbf85c4dccb526ede90

See more details on using hashes here.

File details

Details for the file datamarket-0.7.16-py3-none-any.whl.

File metadata

  • Download URL: datamarket-0.7.16-py3-none-any.whl
  • Upload date:
  • Size: 32.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for datamarket-0.7.16-py3-none-any.whl
Algorithm Hash digest
SHA256 8da0aba779c4bff870c8097d4c21f75452d0cb9127bc3068172d23e53336d133
MD5 452bec57523b5406e4da44fae55d5c00
BLAKE2b-256 ccfcbfd36c8cfd8568b1a8add5a56a02fd4827e5e1974485d6dd2cd85b4038a4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page