Migrates scrapy project to Apify platform
Project description
Apify Scrapy Migrator
This tool enables you to run scrapy project on Apify Cloud.
Usage
First run
- install the package -
pip install apify-scrapy-migrator
- locate your scrapy project and migrate -
apify-scrapy-migrator -m DESTINATION
Upload to Apify cloud
There are multiple ways how to do it. You can copy your source files to Apify Cloud manually or import code via Github. But it is recommended to use Apify CLI.
- install Apify CLI. Guide here.
- log in with your account -
apify login
- go to your migrated project -
cd DESTINATION
- push your project to Apify Cloud -
apify push
Update migration files
- If you want to update every file -
apify-scrapy-migrator -m DESTINATION
- If you want to update your input -
apify-scrapy-migrator -i DESTINATION
- If you want to update
requirements.txt
-apify-scrapy-migrator -r DESTINATION
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file apify_scrapy_migrator-0.0.3.tar.gz
.
File metadata
- Download URL: apify_scrapy_migrator-0.0.3.tar.gz
- Upload date:
- Size: 11.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5704d6c6902af93f301a73c0063a462f2bdb54d47aea6183d8a97cf0cd69d9a0 |
|
MD5 | 4598c28fc7816ad3d33ae9a4ab780dd6 |
|
BLAKE2b-256 | e4a095f7d8fba3a1f0c4c8de2f82b8f6f605e9f13da19f982da3ea51f7f0a8aa |
File details
Details for the file apify_scrapy_migrator-0.0.3-py3-none-any.whl
.
File metadata
- Download URL: apify_scrapy_migrator-0.0.3-py3-none-any.whl
- Upload date:
- Size: 12.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5683d332c1356bead3579b625047722127742303c69d2a45c765555962a72121 |
|
MD5 | 12db3c1e7560d36ae6bc9481c7134e4f |
|
BLAKE2b-256 | 8b41d184df0f4875a294ac378b533ad9d5539b4e4d2729dd5c9545dc0d944f20 |