Skip to main content

simplified-scrapy

simplified scrapy, A Simple Web Crawle

Requirements

  • Python 2.7, 3.0+
  • Works on Linux, Windows, Mac OSX, BSD

run

from simplified_scrapy.simplified_main import SimplifiedMain
SimplifiedMain.startThread()

Demo

Custom crawler class needs to extend Spider class

from core.spider import Spider 
class DemoSpider(Spider):

Here is an example of collecting data

from simplified_scrapy.spider import Spider, SimplifiedDoc
class DemoSpider(Spider):
  name = 'demo-spider'
  start_urls = ['http://quotes.toscrape.com/']
  allowed_domains = ['quotes.toscrape.com']
  def extract(self, url, html, models, modelNames):
    doc = SimplifiedDoc(html)
    lstA = doc.listA(url=url["url"])
    return [{"Urls": lstA, "Data": None}]

from simplified_scrapy.simplified_main import SimplifiedMain
SimplifiedMain.startThread(DemoSpider())

pip install

pip install simplified-scrapy

Examples

Legal Issues

In particular, please be aware that

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Translated to human words:

In case your use of the software forms the basis of copyright infringement, or you use the software for any other illegal purposes, the authors cannot take any responsibility for you.

We only ship the code here, and how you are going to use it is left to your own discretion.

Metadata

Release files for simplified_scrapy 2.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for simplified_scrapy 2.0.1
File Size Uploaded Provenance Actions
simplified_scrapy-2.0.1.tar.gz 39.0 kB Without provenance Details for simplified_scrapy-2.0.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for simplified_scrapy 2.0.1
File Interpreter ABI Platform Actions
simplified_scrapy-2.0.1-py3-none-any.whl Python 3 none any Details for simplified_scrapy-2.0.1-py3-none-any.whl

Total release size: 94.3 kB

Release files / simplified_scrapy-2.0.1.tar.gz

Download URL simplified_scrapy-2.0.1.tar.gz
Size 39.0 kB
Tags Source
SHA-256 checksum
How to use checksums
7c47d2e8d01db2d12dbfe3ca6a57d8c1d717290ee9dbcb430df1533c633ee62e
BLAKE2b-256 checksum
How to use checksums
d9c9d434399fe908de70ce832b807916797986cc2dab0a7e1dc825fef375196a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.2.1 CPython/3.13.7 Darwin/25.0.0

Release files / simplified_scrapy-2.0.1-py3-none-any.whl

Download URL simplified_scrapy-2.0.1-py3-none-any.whl
Size 55.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c4526b899bda0f559a19f7292add2637ab6113f49d0ff5a42c01cc2417e3a431
BLAKE2b-256 checksum
How to use checksums
1e45776c30e97c39bb442c98c4c5ee9ba21b02686e16ccb546d7c8fb6e77ab80
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.2.1 CPython/3.13.7 Darwin/25.0.0

Security for simplified_scrapy 2.0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page