Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

On demand query API for OSINT.digitalside.it project. You can query for souspicious domains, urls, IPv4 and file hashes.

Project description

DigitalSide-API v.1.8

On demand query API for OSINT.digitalside.it project. You can query for souspicious IPs, domains and urls Searches will be performed against the IoC lists stored in the GitHub Threat-Intel and OSINT.DigitalSide.it website

Usage

~$ apiosintDS -h
usage: apiosintDS [-h] [-e [IPv4|domain|url]] [-f /path/to/file.txt]
                  [-o /path/to/output.json] [-v] [-c] [-cd /path/to/cachedir]
                  [-cc] [-i] [-s]

DigitalSide-API v.1.8. On demand query API for OSINT.digitalside.it project.
You can query for souspicious domains, urls and IPv4.

optional arguments:
  -h, --help            show this help message and exit
  -e [IPv4|domain|url], --entity [IPv4|domain|url]
                        Single item to search. Supported entities are
                        IPv4/FQDN/URLs. It can't be used in combination with
                        the --file option.
  -f /path/to/file.txt, --file /path/to/file.txt
                        Path to file containing entities to search. Supported
                        entities are IPv4/FQDN/URLs. It can't be used in
                        combination with the --entity option.
  -o /path/to/output.json, --output /path/to/output.json
                        Path to output file (/path/to/output.json). If not
                        specified the output will be redirect to the STDOUT.
  -v, --verbose         Include unmatched results in report.
  -c, --cache           Enable cache mode. Downloaded lists will be stored a
                        won't be downloaded for the next 4 hours.
  -cd /path/to/cachedir, --cachedirectory /path/to/cachedir
                        The cache directory where the script check for cached
                        lists files and where them will be stored on cache
                        creation or update. Must be specified the same every
                        script run unless your are using the system temp
                        directory. Default is '/tmp'
  -cc, --clearcache     Force the script to download updated lists even if the
                        4 hours timeout has not yet been reached. Must be used
                        in combination with --cachedirectory.
  -i, --info            Print information about the program.
  -s, --schema          Display the response json schema.

Example usage and response for one listed item

~$ apiosintDS -e 104.217.254.20
{
    "ip": {
        "items": [
            {
                "item": "104.217.254.20",
                "response": true,
                "response_text": "Item found in latestips.txt list",
                "related_urls": [
                    "http://104.217.254.20/bins/hoho.arm5",
                    "http://104.217.254.20/bins/hoho.arm6",
                    "http://104.217.254.20/bins/hoho.arm7",
                    "http://104.217.254.20/bins/hoho.m68k",
                    "http://104.217.254.20/bins/hoho.mips",
                    "http://104.217.254.20/bins/hoho.x86"
                ]
            }
        ],
        "statistics": {
            "itemFound": 1,
            "itemSubmitted": 1
        },
        "list": {
            "file": "latestips.txt",
            "date": "2019-10-13 20:15:12+02:00",
            "url": "https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestips.txt"
        }
    }
}

Example usage and response submitting a file containing various entities

Example file ioc.txt

~$ cat ioc.txt 
104.217.254.20
helloyoungmanqq.com
http://hellomydearqq.com/80.exe

Response

{
    "url": {
        "items": [
            {
                "item": "http://hellomydearqq.com/80.exe",
                "response": true,
                "response_text": "Item found in latesturls.txt list",
                "related_urls": [
                    "http://hellomydearqq.com/69.exe"
                ]
            }
        ],
        "statistics": {
            "itemFound": 1,
            "itemSubmitted": 1
        },
        "list": {
            "file": "latesturls.txt",
            "date": "2019-10-13 20:15:12+02:00",
            "url": "https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latesturls.txt"
        }
    },
    "ip": {
        "items": [
            {
                "item": "104.217.254.20",
                "response": true,
                "response_text": "Item found in latestips.txt list",
                "related_urls": [
                    "http://104.217.254.20/bins/hoho.arm5",
                    "http://104.217.254.20/bins/hoho.arm6",
                    "http://104.217.254.20/bins/hoho.arm7",
                    "http://104.217.254.20/bins/hoho.m68k",
                    "http://104.217.254.20/bins/hoho.mips",
                    "http://104.217.254.20/bins/hoho.x86"
                ]
            }
        ],
        "statistics": {
            "itemFound": 1,
            "itemSubmitted": 1
        },
        "list": {
            "file": "latestips.txt",
            "date": "2019-10-13 20:15:12+02:00",
            "url": "https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestips.txt"
        }
    },
    "domain": {
        "items": [
            {
                "item": "helloyoungmanqq.com",
                "response": true,
                "response_text": "Item found in latestdomains.txt list",
                "related_urls": [
                    "http://helloyoungmanqq.com/25.exe",
                    "http://helloyoungmanqq.com/26.exe",
                    "http://helloyoungmanqq.com/34.exe",
                    "http://helloyoungmanqq.com/34.jpg",
                    "http://helloyoungmanqq.com/45.exe",
                    "http://helloyoungmanqq.com/45.jpg",
                    "http://helloyoungmanqq.com/59.exe",
                    "http://helloyoungmanqq.com/59.jpg",
                    "http://helloyoungmanqq.com/70.exe",
                    "http://helloyoungmanqq.com/70.jpg",
                    "http://helloyoungmanqq.com/80.exe",
                    "http://helloyoungmanqq.com/80.jpg",
                    "http://helloyoungmanqq.com/85.exe",
                    "http://helloyoungmanqq.com/85.jpg",
                    "http://helloyoungmanqq.com/87.exe",
                    "http://helloyoungmanqq.com/87.jpg",
                    "http://helloyoungmanqq.com/93.exe",
                    "http://helloyoungmanqq.com/93.jpg"
                ]
            }
        ],
        "statistics": {
            "itemFound": 1,
            "itemSubmitted": 1
        },
        "list": {
            "file": "latestdomains.txt",
            "date": "2019-10-13 20:15:12+02:00",
            "url": "https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.txt"
        }
    }
}

Json schema

Python 3 requiremet

The script runs using python intepreter at version 3.x. No support will be given to python 2.x.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for apiosintDS, version 1.8.3
Filename, size File type Python version Upload date Hashes
Filename, size apiosintDS-1.8.3-py3-none-any.whl (13.5 kB) File type Wheel Python version py3 Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page