news-please is an open source easy-to-use news extractor that just works.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for fhamborg from gravatar.com fhamborg

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache License 2.0)
  • Author: Felix Hamborg
  • Tags news, crawler, news, scraper, news, extractor, crawler, extractor, scraper, information, retrieval
Classifiers

Project description

news-please is an open source, easy-to-use news crawler that extracts structured information from almost any news website. It can follow recursively internal hyperlinks and read RSS feeds to fetch both most recent and also old, archived articles. You only need to provide the root URL of the news website. Furthermore, its API allows developers to access the exctraction functionality within their software. news-please also implements a workflow optimized for the news archive provided by commoncrawl.org, allowing users to efficiently crawl and extract news articles including various filter options.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for fhamborg from gravatar.com fhamborg

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache License 2.0)
  • Author: Felix Hamborg
  • Tags news, crawler, news, scraper, news, extractor, crawler, extractor, scraper, information, retrieval
Classifiers

Release history Release notifications | RSS feed

This version

1.6.13

1.6.12

1.6.11

1.6.10

1.5.48

1.5.47

1.5.44

1.5.43

1.5.41

1.5.40

1.5.35

1.5.34

1.5.33

1.5.22

1.5.21

1.5.20

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.3

1.5.2

1.5.1

1.4.26

1.4.25

1.4.24

1.4.23

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.3.14

1.3.13

1.3.11

1.3.10

1.2.53

1.2.52

1.2.51

1.2.50

1.2.44

1.2.43

1.2.42

1.2.41

1.2.40

1.2.39

1.2.36

1.2.35

1.2.33

1.2.32

1.2.31

1.2.28

1.2.27

1.2.26

1.2.25

1.2.24

1.2.22

1.2.21

1.2.20

1.2.1

1.1.53

1.1.52

1.1.51

1.1.50

1.1.49

1.1.48

1.1.47

1.1.45

1.1.43

1.1.41

1.1.40

1.1.31

1.1.30

1.1.29

1.1.28

1.1.27

1.1.26

1.1.25

1.1.23

1.1.22

1.1.21

1.1.20

1.1.19

1.1.18

1.1.17

1.1.16

1.1.15

1.1.14

1.1.12

1.1.11

1.0.27

1.0.26

1.0.25

1.0.24

1.0.23

1.0.21

1.0.20

1.0.18

1.0.17

1.0.16

1.0.14

1.0.13

1.0.12

1.0.11

1.0.10

1.0.9

1.0.8

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0.post6

1.0.0.post5

1.0.0.post4

1.0.0.post3

1.0.0.post2

1.0.0.post1

1.0.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

news_please-1.6.13.tar.gz (75.3 kB view details)

Uploaded Source

Built Distribution

news_please-1.6.13-py3-none-any.whl (95.9 kB view details)

Uploaded Python 3

File details

Details for the file news_please-1.6.13.tar.gz.

File metadata

  • Download URL: news_please-1.6.13.tar.gz
  • Upload date:
  • Size: 75.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.14

File hashes

Hashes for news_please-1.6.13.tar.gz
Algorithm Hash digest
SHA256 4ccbe8d947fd77eca7c45b958bcdbf3a49b760493ff68a74e13b77adf36209b7
MD5 c5f9f966fd7022bdeab732ec3338e7bb
BLAKE2b-256 66f976ff255711723e9a1627a82080eee3cfc64fb810f3d3dd2d9c44afcc5917

See more details on using hashes here.

File details

Details for the file news_please-1.6.13-py3-none-any.whl.

File metadata

  • Download URL: news_please-1.6.13-py3-none-any.whl
  • Upload date:
  • Size: 95.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.14

File hashes

Hashes for news_please-1.6.13-py3-none-any.whl
Algorithm Hash digest
SHA256 0c378cc0c388cb5051e22493665bb714ab7ca057cf1c568ed015b1adbccbf373
MD5 b51310e2fd53fe9841aac1b2eddb42b8
BLAKE2b-256 1cfcb1bc36ac6acfc7f66088931217a86159c12c3227878e6df5fb62e9e2b074

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page