Skip to main content

SecTXT: security.txt parser and validator

This package contains a security.txt (RFC 9116) parser and validator.

When security risks in web services are discovered by independent security researchers who understand the severity of the risk, they often lack the channels to disclose them properly. As a result, security issues may be left unreported. security.txt defines a standard to help organizations define the process for security researchers to disclose security vulnerabilities securely.

Installation

The package is available on pypi. It can be installed using pip:

> python -m pip install sectxt

Usage

>>> from sectxt import SecurityTXT
>>> s = SecurityTXT("www.example.com")
>>> s.is_valid()
True

Validation

>>> from sectxt import SecurityTXT
>>> s = SecurityTXT("www.example.com")
>>> s.errors
[{'code': 'no_uri', 'message': 'Field policy value must be an URI', 'line': 2}, {'code': 'no_expire', 'message': 'The Expires field is missing', 'line': None}]
>>> s.recommendations
[{'code': 'long_expiry', 'message': 'Expiry date is more than one year in the future', 'line': 3}]

The "errors", "recommendations" and "notifications" attribute return a list of entries. An entry is a dict with three keys:

key value
code A fixed error code string
message A human readable error message in English
line The 1 based integer line number where the error occurred or None when the error applies to the entire file

Possible errors

code message
"no_security_txt" "security.txt could not be located."
"location" "security.txt was located on the top-level path (legacy place), but must be placed under the '/.well-known/' path."
"invalid_uri_scheme" "Insecure URI scheme HTTP is not allowed. The security.txt file access must use the HTTPS scheme"
"invalid_cert" "security.txt must be served with a valid TLS certificate."
"no_content_type" "HTTP Content-Type header must be sent."
"invalid_media" "Media type in Content-Type header must be 'text/plain'."
"invalid_charset" "Charset parameter in Content-Type header must be 'utf-8' if present."
"utf8" "Content must be utf-8 encoded."
"no_expire" "'Expires' field must be present."
"multi_expire" "'Expires' field must not appear more than once."
"invalid_expiry" "Date and time in 'Expires' field must be formatted according to ISO 8601."
"expired" "Date and time in 'Expires' field must not be in the past."
"no_contact" "'Contact' field must appear at least once."
"no_canonical_match" "Web URI where security.txt is located must match with a 'Canonical' field. In case of redirecting either the first or last web URI of the redirect chain must match."
"multi_lang" "'Preferred-Languages' field must not appear more than once."
"invalid_lang" "Value in 'Preferred-Languages' field must match one or more language tags as defined in RFC5646, separated by commas."
"no_uri" "Field '{field}' value must be a URI."
"no_https" "Web URI must begin with 'https://'."
"prec_ws" "There must be no whitespace before the field separator (colon)."
"no_space" "Field separator (colon) must be followed by a space."
"empty_key" "Field name must not be empty."
"empty_value" "Field value must not be empty."
"invalid_line" "Line must contain a field name and value, unless the line is blank or contains a comment."
"no_line_separators" "Every line, including the last one, must end with either a carriage return and line feed characters or just a line feed character"
"signed_format_issue" "Signed security.txt must start with the header '-----BEGIN PGP SIGNED MESSAGE-----'. "
"data_after_sig" "Signed security.txt must not contain data after the signature."
"no_csaf_file" "All CSAF fields must point to a provider-metadata.json file."
"pgp_data_error" "Signed message did not contain a correct ASCII-armored PGP block."
"pgp_error" "Decoding or parsing of the pgp message failed."
"bom_in_file" "The Byte-Order Mark was found in the UTF-8 File. Security.txt must be encoded using UTF-8 in Net-Unicode form, the BOM signature must not appear at the beginning."

Possible recommendations

code message
"long_expiry" "Date and time in 'Expires' field should be less than a year into the future."
"no_encryption" "'Encryption' field should be present when 'Contact' field contains an email address."
"not_signed"[1] "security.txt should be digitally signed."
"no_canonical" "'Canonical' field should be present in a signed file."
"multiple_csaf_fields" "It is allowed to have more than one CSAF field, however this should be removed if possible."

Possible notifications

code message
"unknown_field"[2] "security.txt contains an unknown field. Field {unknown_field} is either a custom field which may not be widely supported, or there is a typo in a standardised field name.

Security.txt scraping information

The scraper attempts to find the security.txt of the given domain in the correct location /.well-known/security.txt. It also looks in the old location and with unsecure http scheme which would result in validation errors. To prevent possible errors getting the file from the domain a user-agent is added to the header of the request. The user agent that is added is Mozilla/5.0 (Windows NT 6.1; WOW64; rv:12.0) Gecko/20100101 Firefox/12.0, which would mock a browser in firefox with a Windows 7 OS. If a security.txt file is found that file is than parsed. Any errors, recommendations or notifications that are found would be returned.


[1] The security.txt parser will check for the addition of the digital signature, but it will not verify the validity of the signature.

[2] Regarding code "unknown_field": According to RFC 9116 section 2.4, any fields that are not explicitly supported must be ignored. This parser does add a notification for unknown fields by default. This behaviour can be turned off using the parameter recommend_unknown_fields:

>>> from sectxt import SecurityTXT
>>> s = SecurityTXT("www.example.com", recommend_unknown_fields=False)

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sectxt-0.9.1.tar.gz (17.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sectxt-0.9.1-py3-none-any.whl (14.2 kB view details)

Uploaded Python 3

File details

Details for the file sectxt-0.9.1.tar.gz.

File metadata

  • Download URL: sectxt-0.9.1.tar.gz
  • Upload date:
  • Size: 17.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.7

File hashes

Hashes for sectxt-0.9.1.tar.gz
Algorithm Hash digest
SHA256 5c6edb3132e42a11fe56ec3d78582cc5ff2c5cec3d7410347985f5f81858892c
MD5 859beab84eadd9a16376ebcd7cb9bc65
BLAKE2b-256 73d29f842c5d4ba0fa0a4e039286fe1bb22022ef0048e55c4e33fda47eb434c5

See more details on using hashes here.

File details

Details for the file sectxt-0.9.1-py3-none-any.whl.

File metadata

  • Download URL: sectxt-0.9.1-py3-none-any.whl
  • Upload date:
  • Size: 14.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.7

File hashes

Hashes for sectxt-0.9.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9a5c4b317f938512e9b2c73ef7042be05d2c690768804efed8a2d5397b2c4741
MD5 e5727dd550af62671622211ab0e5f42d
BLAKE2b-256 4fdbe7a00c81e257cab969fe259678360e0b37993297b65ac3cd13a19b3188f6

See more details on using hashes here.

Release history Release notifications | RSS feed

0.9.8

2 files

0.9.7

2 files

0.9.6

2 files

0.9.5

2 files

0.9.4

2 files

0.9.3

2 files

0.9.2

2 files

This release

0.9.1 This release

2 files

0.9.0

2 files

0.8.3

2 files

0.8.2

2 files

0.8.1

2 files

0.8

2 files

0.7

2 files

0.6

2 files

0.5

2 files

0.4

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page