Skip to main content

Scrapy extension Feed Exporter Storage Backend to export items to a Azure blob container

Project description

PyPI Version License

scrapy-feedexporter-azure is a Scrapy Feed Exporter Storage Backend that allows you to export Scrapy items to an Azure Blob Container.

Using scrapy-feedexporter-azure-blob

Add a the following to your Scrapy settings:

FEED_STORAGES = {"azure": "scrapy_feedexporter_azure_blob.AzureBlobFeedStorage"}

FEED_URI = "azure://accountname/container"

AZURE_ACCOUNT_NAME = "mycrawldata"  # this is the subdomain to https://*.blob.core.windows.net/

AZURE_ACCOUNT_KEY = "your_account_key"

AZURE_CONTAINER = 'sites'   # the name of the container (you should have already created it)

AZURE_FILENAME = 'bob.json'   # the name of the file as it will be in blob storage

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file scrapy_feedexporter_azure_blob_3-0.4-py3-none-any.whl.

File metadata

  • Download URL: scrapy_feedexporter_azure_blob_3-0.4-py3-none-any.whl
  • Upload date:
  • Size: 2.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

File hashes

Hashes for scrapy_feedexporter_azure_blob_3-0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 99e36d5f25bdd5df0e3bef9043fba92f58c74a05e9a0a3606fa2225cd99108a9
MD5 f24a6bbdf64cdd913331f89e1c021f54
BLAKE2b-256 2d4f500b9970bc65add639d0941545a2cb592b188b168b6a07120a0e675bd441

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page