Skip to main content

MetaFinder - Metadata search through Search Engines

Project description

Supported Python versions License

MetaFinder - Metadata search through Search Engines

   _____               __             ___________ .__               .___
  /     \     ____   _/  |_  _____    \_   _____/ |__|   ____     __| _/   ____   _______
 /  \ /  \  _/ __ \  \   __\ \__  \    |    __)   |  |  /    \   / __ |  _/ __ \  \_  __ \
/    Y    \ \  ___/   |  |    / __ \_  |     \    |  | |   |  \ / /_/ |  \  ___/   |  | \/
\____|__  /  \___  >  |__|   (____  /  \___  /    |__| |___|  / \____ |   \___  >  |__|
        \/       \/               \/       \/               \/       \/       \/

|_ Author: @JosueEncinar
|_ Description: Search for documents in a domain through Search Engines. The objective is to extract metadata
|_ Usage: metafinder -d domain.com -l 50 -o /tmp -go -bi

Installation:

> pip3 install metafinder

Upgrades are also available using:

> pip3 install metafinder --upgrade

Usage

CLI

metafinder -d domain.com -l 20 -o folder [-t 10] [-v] -go -bi -ba

Parameters:

  • d: Specifies the target domain.

  • l: Specify the maximum number of results to be searched.

  • o: Specify the path to save the report.

  • t: Optional. Used to configure the threads (4 by default).

  • v: Optional. It is used to display the results on the screen as well.

  • go: Optional. Search in Google. (Default)

  • bi: Optional. Search in Bing.

  • ba: Optional. Search in Baidu. (Experimental)

In Code

import metafinder.extractor as metadata_extractor

documents_limit = 5
domain = "target_domain"
data = metadata_extractor.extract_metadata_from_google_search(domain, documents_limit)
# data = metadata_extractor.extract_metadata_from_bing_search(domain, documents_limit)
# data = metadata_extractor.extract_metadata_from_baidu_search(domain, documents_limit)
for k,v in data.items():
    print(f"{k}:")
    print(f"|_ URL: {v['url']}")
    for metadata,value in v['metadata'].items():
        print(f"|__ {metadata}: {value}")

document_name = "test.pdf"
try:
    metadata_file = metadata_extractor.extract_metadata_from_document(document_name)
    for k,v in metadata_file.items():
        print(f"{k}: {v}")
except FileNotFoundError:
    print("File not found")

Author

This project has been developed by:

Contributors

Disclaimer!

The software is designed to leave no trace in the documents we upload to a domain. The author is not responsible for any illegitimate use.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

metafinder-0.2.1b0.tar.gz (8.7 kB view details)

Uploaded Source

File details

Details for the file metafinder-0.2.1b0.tar.gz.

File metadata

  • Download URL: metafinder-0.2.1b0.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/36.2.7 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.9

File hashes

Hashes for metafinder-0.2.1b0.tar.gz
Algorithm Hash digest
SHA256 6fd55c0e10bf82b2bc6ced658bc88fcbd643f01b024ad5da9fe1c0ac31855099
MD5 f55f12a77496ba5ffc77a3aa033bee48
BLAKE2b-256 85ebe68879125e2d4f0950ccf71742c0cb3cbc3843ad1acb37f82b0a383dc613

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page