Collect DNS records from various DNS and cloud providers.
Project description
D-Collector
TLDR; D-Collector is a tool that fetches DNS records from various DNS management and cloud providers and normalize all records to a unified format.
Description
Most of the enterprises nowadays are using multiple different cloud providers and DNS registrars. That creates a fertile ground for shadow IT to grow and makes it extremely hard for information security teams to map, manage and scan their attack surface.
The above led us to create D-Collector. Now, we can continuously scan our infrastructure for security vulnerabilities and drastically reduce the risk of shadow IT.
Who is this tool for?
This tool has been created for IT and information security practitioners to easily automate their domains management and attack surface management.
How it works?
- Provide D-Collector with your cloud providers API tokens/keys.
- D-Collector to fetch all DNS records from the given cloud providers.
- D-Collector to create a unified structured "domains.json" file with all the DNS records.
- Harness the magic for your needs.
Installation
Prerequisites
- Install requirements based on requirements.txt
pip install -r requirements.txt
- Copy 'config.py.example' to 'config.py'.
cp config.py.example config.py
- Fill the relevant variables (empty configs will be ignored).
- Define your company's known internal domain suffixes for the tool to classify as private.
E.g.,
.corp
,.internal
.
Usage
dcollector
Output Example
Output Domains file will be in the following format (JSON):
[{"name": "domain name", "record_type": "DNS type (CNAME,A)", "record_value": "value (ip,ec2 domain name)", "is_private": "false/true"}]
Cloud Providers and Tools Support
- Static domains from file
- AWS
- GCP
- Digital Ocean
- Prisma® Cloud (by Palo Alto Networks)
Roadmap
- Support for more cloud providers and DNS registrars.
Contributing
Feel free to fork the repository and submit pull-requests.
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for D_Collector-0.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b2a0a40b644a623c455f8bcc13826b321237118c62c57a0fc4a7ca30591151d1 |
|
MD5 | 0d477e3ffc5b14b0479cb564986c0674 |
|
BLAKE2b-256 | 258233adabe817cf6e9aec1069d040b65a6613d581b731ac08e67580f9ea48d7 |