Skip to main content

A python3 script to change your crawling logs to a mindmap

Project description

logo

A python3 script to change your crawling logs to a mindmap

IntroductionRequirementsInstallationUsageExamplesWiki

Created by Liodeus

Introduction

This tool is made to automate the process of creating a mindmap from crawling logs. This tool support logs from:

Requirements

  • python3 (sudo apt install python3)

Installation

pip install crawlmap

Usage

python3 crawlmap.py --help
 _____                    _                       
/  __ \                  | |                      
| /  \/_ __ __ ___      _| |_ __ ___   __ _ _ __  
| |   | '__/ _` \ \ /\ / / | '_ ` _ \ / _` | '_ \ 
| \__/\ | | (_| |\ V  V /| | | | | | | (_| | |_) |
 \____/_|  \__,_| \_/\_/ |_|_| |_| |_|\__,_| .__/ 
                                           | |    
                                           |_|
                                            By Liodeus
  
usage: crawlmap.py [-h] -u URL [-b BURP] [-g GOSPIDER] [-z ZAPROXY] [-o OUT] [--exclude EXCLUDE] [--nofiles] [--params]

optional arguments:
  -h, --help            show this help message and exit
  -u URL, --url URL     Base URL to filter on
  -b BURP, --burp BURP  Output from BurSuite (xml)
  -g GOSPIDER, --gospider GOSPIDER
                        Output from Gospider (json)
  -z ZAPROXY, --zaproxy ZAPROXY
                        Output from Zaproxy (har)
  -o OUT, --out OUT     Output file
  --exclude EXCLUDE     Exclude extensions (Example : "png,svg,css,ico")
  --nofiles             Don't print files, only folders
  --params              Print path with parameters if any
  --params-only         Only print path with parameters

Examples

Go to the wiki

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crawlmap-1.3.tar.gz (1.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crawlmap-1.3-py3-none-any.whl (20.7 kB view details)

Uploaded Python 3

File details

Details for the file crawlmap-1.3.tar.gz.

File metadata

  • Download URL: crawlmap-1.3.tar.gz
  • Upload date:
  • Size: 1.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.8.2 requests/2.27.1 setuptools/59.5.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.10

File hashes

Hashes for crawlmap-1.3.tar.gz
Algorithm Hash digest
SHA256 783f8b67f0594d6e657cf8c0bf6cd9398e06a912c55f2bb5db0282b97951d50d
MD5 cc5363dc760e158b3ccb89f8a71517b6
BLAKE2b-256 0165b4eb0522bc85ccb8186c43fe32d81230abfd17f1e5f7ec2f31ea301f6820

See more details on using hashes here.

File details

Details for the file crawlmap-1.3-py3-none-any.whl.

File metadata

  • Download URL: crawlmap-1.3-py3-none-any.whl
  • Upload date:
  • Size: 20.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.8.2 requests/2.27.1 setuptools/59.5.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.10

File hashes

Hashes for crawlmap-1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 9139d96809d027bb881ca8601df209e237e8ca94bd68823e266c44d0c4a54686
MD5 0b61c8a4c27c43762f2e7d1c501ff5f1
BLAKE2b-256 cd7a4e61aa6f93fb090c31f6d20486f2f1421041fa9a1c74b352250488ce9e05

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page