Skip to main content

A package to add metadata tags to objects saved in s3

Project description

AWS S3 Metadata Tagger

The S3 Metadata tagger adds information in the form of metadata to files saved in S3.

To do this, the central handler takes a file location and a metadata extracting function. It first checks whether the file already contains the requested information via a HEAD request. If it does not, it downloads the file, invokes extracting function, and adds the metadata to the s3 object with a inplace COPY, MetadataDirective="REPLACE" operation.

This package comes with two optional variants for metadata extraction:

  • pdf: for determining the number of pages in a pdf
  • picture: for determining the dimension of an image


The entrypoint into the tagger is the object_tagger.tag_file function.

It expects an object_tagger.S3ObjectPath(key, bucket) and a object_tagger.MetadataHandler(already_tagged, extraction_function, versioning_tag) object as its parameters. The parameters of the MetadataHandler are as follows:

  • already_tagged: a function which receives the metadata tags already present on the object, and returns a boolean indicating whether the object should be tagged.
  • extraction_function: a function receiving the path to the downloaded object, and returning a string -> string dictionary embodying the metadata to add to the object
  • versioning_tags: a string -> string dictionary which contains further tags to add to the s3 object, which can for example be used for tag versioning

The function tries to extract the metadata and add it to the object for up to three times. On success, the added metadata is returned, upon failure an exception is thrown.

For an example, see the service utilizing this library for automatically tagging pdfs uploaded to s3 via aws lambda in the examples directory.



contains the higher-level orchestration:

  • contains all the logic for checking whether the file has already been tagged, downloading it, invoking the metadata script, creating the tag object, and adding it to the s3 resource.

The metadata scripts are stored in their respective folders


The pdf tagger uses PyPDF2 to determine the amount of pages in a pdf. Install with the [pdf] extra option.


Using Pillow, the script gets the width and height of the passed image. Install with the [picture] extra option.


Both pdf_tagger and picture_tagger come with unittests. There is also an integration test in tests/, which expects a localstack instance to run in the background. Furthermore, the following environment variables need to be set:


Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s3-metadata-tagger-1.0.1.tar.gz (7.8 kB view hashes)

Uploaded source

Built Distribution

s3_metadata_tagger-1.0.1-py3-none-any.whl (7.6 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page