news-please is an open source easy-to-use news extractor that just works.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for fhamborg from gravatar.com fhamborg

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache License 2.0)
  • Author: Felix Hamborg
  • Tags news , crawler , news , scraper , news , extractor , crawler , extractor , scraper , information , retrieval
Classifiers
Report project as malware

Project description

news-please is an open source, easy-to-use news crawler that extracts structured information from almost any news website. It can follow recursively internal hyperlinks and read RSS feeds to fetch both most recent and also old, archived articles. You only need to provide the root URL of the news website. Furthermore, its API allows developers to access the exctraction functionality within their software. news-please also implements a workflow optimized for the news archive provided by commoncrawl.org, allowing users to efficiently crawl and extract news articles including various filter options.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for fhamborg from gravatar.com fhamborg

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache License 2.0)
  • Author: Felix Hamborg
  • Tags news , crawler , news , scraper , news , extractor , crawler , extractor , scraper , information , retrieval
Classifiers

Release history Release notifications | RSS feed

This version

1.6.16

1.6.15

1.6.14

1.6.13

1.6.12

1.6.11

1.6.10

1.5.48

1.5.47

1.5.44

1.5.43

1.5.41

1.5.40

1.5.35

1.5.34

1.5.33

1.5.22

1.5.21

1.5.20

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.3

1.5.2

1.5.1

1.4.26

1.4.25

1.4.24

1.4.23

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.3.14

1.3.13

1.3.11

1.3.10

1.2.53

1.2.52

1.2.51

1.2.50

1.2.44

1.2.43

1.2.42

1.2.41

1.2.40

1.2.39

1.2.36

1.2.35

1.2.33

1.2.32

1.2.31

1.2.28

1.2.27

1.2.26

1.2.25

1.2.24

1.2.22

1.2.21

1.2.20

1.2.1

1.1.53

1.1.52

1.1.51

1.1.50

1.1.49

1.1.48

1.1.47

1.1.45

1.1.43

1.1.41

1.1.40

1.1.31

1.1.30

1.1.29

1.1.28

1.1.27

1.1.26

1.1.25

1.1.23

1.1.22

1.1.21

1.1.20

1.1.19

1.1.18

1.1.17

1.1.16

1.1.15

1.1.14

1.1.12

1.1.11

1.0.27

1.0.26

1.0.25

1.0.24

1.0.23

1.0.21

1.0.20

1.0.18

1.0.17

1.0.16

1.0.14

1.0.13

1.0.12

1.0.11

1.0.10

1.0.9

1.0.8

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0.post6

1.0.0.post5

1.0.0.post4

1.0.0.post3

1.0.0.post2

1.0.0.post1

1.0.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

news_please-1.6.16.tar.gz (76.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

news_please-1.6.16-py3-none-any.whl (96.6 kB view details)

Uploaded Python 3

File details

Details for the file news_please-1.6.16.tar.gz.

File metadata

  • Download URL: news_please-1.6.16.tar.gz
  • Upload date:
  • Size: 76.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for news_please-1.6.16.tar.gz
Algorithm Hash digest
SHA256 845f9442e83fe7647455f702ce68270dcdff6d9ec89b40639e571efd504d6e33
MD5 78c5422271c0fce4af3bcdb4450ef7e9
BLAKE2b-256 1a268052b1f3ce5de49b5595645c735c50107fe6c676d3cd5841a7b5ee711330

See more details on using hashes here.

File details

Details for the file news_please-1.6.16-py3-none-any.whl.

File metadata

  • Download URL: news_please-1.6.16-py3-none-any.whl
  • Upload date:
  • Size: 96.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for news_please-1.6.16-py3-none-any.whl
Algorithm Hash digest
SHA256 ea542de0cf7e24e11ccef38546106ffa93419559556e9a2b31b8af1a4c2be63c
MD5 02bbda6425d946b31e9872541608b363
BLAKE2b-256 1faa360b191e2d470059b4216f8bdc29953f665833bb91c7253037c3325b9265

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page