Consolidate, enrich and analyze the data gathered by warn-scraper
Project description
Consolidate, enrich and republish the data gathered by warn-scraper
Getting started
Clone the repository to your computer and navigate into the directory in your terminal.
The pipenv
package manager can install all of the Python tools necessary to run and test our code.
pipenv install --dev
Now install pre-commit
to run a battery of automatic quick fixes against your work.
pipenv run pre-commit install
Create a .env
file and define your BLN_API_TOKEN
.
BLN_API_TOKEN=<yourtoken>
Download the raw source files from biglocalnews.org.
make download
Consolidate the raw files into a single file.
make consolidate
Releasing
Our release process is automated as a continuous deployment via the GitHub Actions framework. The logic that governs the process is stored in the workflows
directory.
That means that everything necessary to make a release can be done with a few clicks on the GitHub website. All you need to do is make a tagged release at biglocalnews/warn-transformer/releases, then wait for the computers to handle the job.
Here's how it's done, step by step. The screenshots are from a different repository, but the process is the same.
1. Go to the releases page
The first step is to visit our repository's homepage and click on the "releases" headline in the right rail.
2. Click 'Draft a new release'
Note the number of the latest release. Click the "Draft a new release" button in the upper-right corner. If you don't see this button, you do not have permission to make a release. Only the maintainers of the repository are able to release new code.
3. Create a new tag
Think about how big your changes are and decide if you're a major, minor or patch release.
All version numbers should feature three numbers separated by the periods, like 1.0.1
. If you're making a major release that isn't backwards compatible, the latest release’s first number should go up by one. If you're making a minor release by adding a feature or major a large change, the second number should go up. If you're only fixing bugs or making small changes, the third number should go up.
If you're unsure, review the standards defined at semver.org to help make a decision. In the end don't worry about it too much. Our version numbers don't need to be perfect. They just need to be three numbers separated by periods.
Once you've settled on the number for your new release, click on the "Choose a tag" pull down.
Enter your version number into the box. Then click the "Create new tag" option that appears.
4. Name the release
Enter the same number into the "Release title" box.
5. Auto-generate release notes
Click the "Auto-generate release notes" button in the upper right corner of the large description box.
That should fill in the box below. What appears will depend on how many pull requests you've merged since the last release.
6. Publish the release
Click the green button that says "Publish release" at the bottom of the page.
7. Wait for the Action to finish
GitHub will take you to a page dedicated to your new release and start an automated process that release our new version to the world. Follow its progress by clicking on the Actions tab near the top of the page.
That will take you to the Actions monitoring page. The task charged with publishing your release should be at the top.
After a few minutes, the process there should finish and show a green check mark. When it does, visit warn-transformer’s page on PyPI, where you should see the latest version displayed at the top of the page.
If the action fails, something has gone wrong with the deployment process. You can click into its debugging panel to search for the cause or ask the project maintainers for help.
About
The project is sponsored by Big Local News, a program at Stanford University that collects data for impactful journalism. The code is maintained by Ben Welsh, a visiting data journalist from the Los Angeles Times.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for warn_transformer-0.0.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d343dddee1e985d9a4bdd5786830dd41daad9300dd4b7427a1bf4da532d1ece6 |
|
MD5 | 79eb201c642f7728c8e0acdf4fb9d0c0 |
|
BLAKE2b-256 | 44c52ff9d09c4fd1a28e1ec46bcb4746d35942e5a02745c69308e4d3414fcca5 |