JSFinder2 can be used to find urls and subdomains in JS files.
Project description
JSFinder2
Find subdomains and urls in js files
Table of Contents
Introduction
Rewrite & loosely based on JSFinder.
This allows bug bounty hunters to find references, that you might not otherwise find in SSL cert scraping or similar.
Allows to recursively check for subdomains & urls in JS files. i.e.
Open a.js
finds references to hub.foo.bar
, opens hub.foo.bar
and finds b.js
, checks b.js
and finds zoo.foo.bar
, goes to zoo.foo.bar
etc...
Should be used together with other tools in automation. Though be aware, there might be a lot of false positives URLs. The tool uses regex, which is orginally from LinkFinder. (Though issue 59 has been applied.)
Furthermore, a couple of domains are blacklisted, such as:
"twitter.com",
"youtube.com",
"pinterest.com",
"facebook.com",
"w3.org",
"vimeo.com",
"redditstatic.com",
"reddit.com",
"schema.org",
"unpkg.com",
"gitter.im",
"cookielaw.org",
Furthermore if any of the following words appear in the url, they will not be saved:
"jquery",
"node_modules"
You won't find any of these in the urls.
Installation
Preferred via pipx
pipx install JSFinder2
or a simple pip command
pip install JSFinder2
The pip page is: https://pypi.org/project/JSFinder2/
Usage
python -m jsfinder2 -h
usage: jsfinder2 [-h] [-v] [--debug] [--deep] [-os [OUTPUT_FILE_SUBDOMAINS]] [-ou [OUTPUT_FILE_URLS]] [-c [COOKIE]] [-ua [USER_AGENT]] [-u [REMOTE_JS_FILE_URL] | -f [LOCAL_URL_LIST_FILE]]
Examples:
jsfinder2 -u https://www.example.com/js/main.js
options:
-h, --help show this help message and exit
-v, --verbose increase output verbosity (> INFO)
--debug sets output to very verbose
--deep sets to crawl very deep
-os [OUTPUT_FILE_SUBDOMAINS], --output-sub [OUTPUT_FILE_SUBDOMAINS]
Specify the output file otherwise subdomains.txt is used in ~/jsfinder2
-ou [OUTPUT_FILE_URLS], --output-url [OUTPUT_FILE_URLS]
Specify the output file otherwise urls.txt is used in ~/jsfinder2
-c [COOKIE], --cookie [COOKIE]
Optional Cookie
-ua [USER_AGENT], --user-agent [USER_AGENT]
Optional custom User-Agent
-u [REMOTE_JS_FILE_URL], --url [REMOTE_JS_FILE_URL]
Specify the url to a JS file
-f [LOCAL_URL_LIST_FILE], --file [LOCAL_URL_LIST_FILE]
Specify a local file with URLs
Deep check of url
Follows subdomains and looks for script tags
jsfinder2 --deep -u https://www.tesla.com/
Check urls from file
jsfinder2 -f myurls.txt
Custom User-Agent and Cookies
To specify the user agent and/or cookie use
-ua
for the User Agent and -c
for the Cookie.
Verbose output
You can use --debug
to show more developer infos and -v
for more console output (this might be a lot, as all urls and subdomains are shown!)
Results location
By default all findings are stored in the home directory of the user in the domains folder i.e.:
# Linux
cat ~/jsfinder2/tesla.com/urls.txt
cat ~/jsfinder2/tesla.com/subdomains.txt
# Windows
type C:\Users\<USERNAME>\jsfinder2\tesla.com\urls.txt
type C:\Users\<USERNAME>\jsfinder2\tesla.com\subdomains.txt
You can adjust the file location via -os
for subdomains and -ou
for urls.
Todo
- create a subfolder for each domain
- add option to load urls from file
- support flag that url is a js file
- crawl subdomains for more js files
- threading ?
- json output file ?
License
Contributing
Feel free to open an issue with any feedback, a PR or similar.
It would also help to star the project!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file JSFinder2-0.2.tar.gz
.
File metadata
- Download URL: JSFinder2-0.2.tar.gz
- Upload date:
- Size: 8.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
8994b27b72b1e7ff4127d9f2de48bab86c9d69bb6a7d87761c5692762351548d
|
|
MD5 |
7fad9154f54819b3c9a22f456dee99c2
|
|
BLAKE2b-256 |
f4557e5b58cb1576eed9c71d61f61d669ed038d6b6f64ebaf159a45ff0fd7fba
|
File details
Details for the file JSFinder2-0.2-py3-none-any.whl
.
File metadata
- Download URL: JSFinder2-0.2-py3-none-any.whl
- Upload date:
- Size: 10.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 |
a64d5f8f91b22a3b5646dba062dbe25c7414c374c6ef97025af43026b2f451e4
|
|
MD5 |
fa31ed6d7f2e297f2bc74262c5dd507b
|
|
BLAKE2b-256 |
dc172132b69546fcdca6fa656a66d5695eedfaeb2ab4728d370f0609a2b4cef3
|