lefaso-net-scraper 0.2.0

The ultimate library for data scientist to scrape data from https://www.lefaso.net

lefaso-net-scraper

Description

lefaso-net-scraper is a robust and versatile Python library designed to efficiently extract articles from the popular online news source, lefaso.net. This powerful scraping tool allows users to effortlessly collect article content and data from Internet users’ comments on lefaso.net.

Data Format

Field	Description
article_topic	article topic
article_title	article title
article_published_date	article published date
article_origin	article origin
article_url	article url
article_content	article content
article_comments	article comments

Installation

• With poetry

poetry add lefaso-net-scraper

• With pip

pip install lefaso-net-scraper

Usage

# coding: utf-8

from lefaso_net_scraper import LefasoNetScraper

section_url = 'https://lefaso.net/spip.php?rubrique473'
scraper = LefasoNetScraper(section_url)
data = scraper.run()

Settings Pagination range

# coding: utf-8

from lefaso_net_scraper import LefasoNetScraper

section_url = 'https://lefaso.net/spip.php?rubrique473'
scraper = LefasoNetScraper(section_url)
scraper.pagination_range(start=20, stop=100)
data = scraper.run()

Save data to csv

# coding: utf-8

import pandas as pd

from lefaso_net_scraper import LefasoNetScraper

section_url = 'https://lefaso.net/spip.php?rubrique473'
scraper = LefasoNetScraper(section_url)
data = scraper.run()
df = pd.DataFrame.from_records(data)
df.to_csv('path/to/df.csv')