webctf 0.0.0

HTML source scraper

Web-CTF-Help

Description

A simple set of scripts (mainly scrapers for now) intended for aid in web CTFs. Find image sources (and alts), javascript sources and comments.

Usage

usage: webctf [-h] [-v] [--comments] [--scripts] [--images] [--headers] [-f] url

positional arguments:
  url            URL of the target website

optional arguments:
  -h, --help     show this help message and exit
  -v, --version  show program's version number and exit
  --comments     only display HTML comments (default: False)
  --scripts      only display script sources (default: False)
  --images       only display image sources (default: False)
  --headers      only display interesting response headers (combine with -f to display all) (default: False)
  -f, --full     enable full output for all options (default: False)

webctf https://example.com

Only display HTML commens and script sources:

webctf --comments --scripts https://example.com

=============
COMMENTS
=============

[+] 1 :   Internal game scripts/styles, mostly boring stuff
[+] 2 :   This is our database of messages

=============
SCRIPTS
=============

[+] 1 : /static/game-frame.js
[+] 2 : /static/post-store.js

Only display interesting headers:

webctf --headers https://example.com

===================
INTERESTING HEADERS
===================

Server : Google Frontend

Display all headers:

webctf --headers -f https://example.com

=============
ALL HEADERS
=============

Content-Type : text/html; charset=utf-8
Cache-Control : no-cache
X-Cloud-Trace-Context : df6d1758c776f4fbc4b3bab158818b64;o=1
Date : Fri, 01 Jan 2021 20:19:57 GMT
Server : Google Frontend
Content-Length : 2689
Alt-Svc : h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"

Installation

git clone https://github.com/xnomas/web-ctf-help
pip install -r requirements.txt
pip install -e .

Future plans

I plan to implement a download function, to download the images, js files and so on. If you have any suggestions feel free to give them to me, but please keep in mind that I am still a student :)