Description
<Work In progress>
This is a tool that can be used for Analyzing and identifying the Deadlink in a website. This can come handy during the regular website maintenance.
The contents uploaded here is only the Alpha content. I’ve uploaded it here to get some feedback and suggestion as to how I can make this more efficient.
Any suggestion / comment / feedback / request is welcome. Please drop any of these messages using the following link.
https://www.assembla.com/spaces/deadcheck/tickets
Installation
pip install lxml pip install deadcheck or pip install lxml git clone git@github.com:harshanarayana/deadcheck.git python setup.py install
Usage
prompt>python run.py -url <baseURLToAnalyze> [-proxy <proxyURL>:<prompt> -username <userName for Protected Page> -password <Password to access Protected Page> -auth_base <Super URL for Authentication> -log <logFile> -exempt <ExceptionURL File> -depth <int, default = 1> -v <default = True> -out <OutputDir>]
Using DeadcheckAPI
from deadcheck.deadcheck import DeadcheckAPI checker = DeadcheckAPI([proxyURL, userName, password, auth_base_url]) urlObj = checker.amIDead(urlToCheck) print urlObj.info() children = urlObj.getChildren()
Pending Implementation
Report Generation. ( A custom Package / Using liches ) : DONE
Handling the Processing of Links using Multiple Threads. ( To reduce processing time )
Regex support to Exception links. DONE
Additional Log / Debug Option Support. DONE
GUI (Work In Progress)
Custom API to facilitate the validation of Minor Links or Single Links. DONE
Change Log
v0.0.1:
Initial Draft
Analysis method and URLLinks class were combined together.
Report Information Extraction was manual.
v0.0.2:
Second Draft
Code Re-structured. Independent classes created for URLLinks, handling Custom Error and Other necessary informaiton.
URLLinks
Custom Class for Storing URL information.
info() method for accessing the URLLink information in the form of a string to display / Report.
Additional parameters included for Reporting.
File Size
Dowload Time
Check Time
Last Modified.
Status Information ( With Error and / or other information as applicable )
ErrorCodes
Custom class created for Storing and retrieving HTTPError codes with suitable messages.
ErrorHandler
Custom Error handler class for Handling Custom errors. Additional items will be added to this during the course of development.
deadcheck
Main Package now containins a class Deadcheck which handles all the operations.
User the Deadcheck class to perform any operations.
v0.0.3:
Third Draft
Report Generation Modules Included.
Class documentations updated. (2013-12-17)
v0.0.3.1:
Low-level URL extraction from ‘javascript’ type hrefs.
Fix for UnicodeEncodeError.
Minor Cleanup / change for the reports.
v0.0.3.2:
Fix for AttributeError in __cleanupJavaScript Function ( Bug #3 )
Minor Modification for RegExp used in Exceptions file.
v0.0.3.3:
Addition of new Class ‘DeadcheckAPI’ that provides the user with a small scare function that can be used to analyze a single URL in the CLI
The Return value of this function call will be URLLinks Object and hence you can iterate through the Child Links and call the function amIDead manually to analyze ‘n’ number of links.
Custom Test Suite has been included to support the running of tests during Installation process.
v0.0.3.3.1:
Minor changes made into run.py
1 maintainer
Metadata
1 maintainer
Release files for deadcheck 0.0.3.3.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| deadcheck-0.0.3.3.1.zip | 26.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| deadcheck-0.0.3.3.1.win-amd64.exe | Details |
Total release size: 274.5 kB
Release files / deadcheck-0.0.3.3.1.zip
| Download URL | deadcheck-0.0.3.3.1.zip |
|---|---|
| Size | 26.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e80a64d8daa956d9aaf730705e3ea874ea4911f899c83dbc6b9f0540ff89a004
|
|
BLAKE2b-256 checksum How to use checksums |
7238722ac1668e5ba146552f573b0823113c45dfc12ef8871d613c43aab0991a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / deadcheck-0.0.3.3.1.win-amd64.exe
| Download URL | deadcheck-0.0.3.3.1.win-amd64.exe |
|---|---|
| Size | 248.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
079386c2d5f9a5442e3219fbd17351af92a755fbfbc9ef85156bc6813e6ca905
|
|
BLAKE2b-256 checksum How to use checksums |
cb50c303f312ce2690d108f6997ce8d6375e2e18cc2a5a6542fde528d632947b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
