Skip to main content

A package for getting cloud product descriptions from the provider website.

Project description

cloud-products

pypi Version Latest Tag Build Dependencies

A package for getting cloud products and product descriptions from a cloud provider website with cache support.

Currently supports getting AWS product information from https://aws.amazon.com/products

GCP and Azure product information will be added in time.

Install from PyPi

pip install cloud-products

Example 1: List AWS products

from cloud_products.aws import AwsCrawler
for product in AwsCrawler().get_products():
    print(f"{product.code}: {product.name}: {product.desc}")

Example output:

alexaforbusiness: Alexa for Business: Empower your Organization with Alexa
amazon-mq: Amazon MQ: Managed Message Broker for ActiveMQ
amplify: AWS Amplify: Build and deploy mobile and web applications
api-gateway: Amazon API Gateway: Build, Deploy, and Manage APIs
...

Example 2: Get product descriptions as a list of lines

from cloud_products.aws import AwsCrawler
cloud_products = AwsCrawler()
product = cloud_products.get_products()[0]
lines = cloud_products.get_product_text(product)
print(lines[4])

Example output:

Alexa for Business is a service that enables organizations and employees to use Alexa to ...

Example 3: Usage to get matching product(s):

from cloud_products import aws
cloud_products = aws.AwsCrawler()
sagemaker_products = cloud_products.get_products_matching("sagemaker")
sagemaker_description = cloud_products.get_product_text(sagemaker_products[0])
print(sagemaker_description[3])

Example output:

Amazon SageMaker is a fully managed service that provides every developer and data scientist with ...

Example 4: Save product descriptions and FAQ pages to files:

from cloud_products import aws
cloud_products = aws.AwsCrawler()
for product in cloud_products.get_products():
    print(f"Saving {product.name}")
    cloud_products.save_product(product, output_path)
    cloud_products.save_faq(product, output_path)

Example output:

Saving Alexa for Business
Saving Amazon MQ
Saving AWS Amplify
Saving Amazon API Gateway
...

Example 5: Get Pandas dataframe of products:

Note: requires the optional pandas package to be installed.

This dataframe has the product name, code, url and full descriptions.

from cloud_products.aws import AwsCrawler
df = AwsCrawler().get_products_as_df()
print(df)

Example output:

                   name            std_name              code  ...                          seed_url                                               desc                                       product_text
0    Alexa for Business  alexa for business  alexaforbusiness  ...  https://aws.amazon.com/products/               Empower your Organization with Alexa  Alexa for Business Use Alexa for work Get Star...
1             Amazon MQ              aws mq         amazon-mq  ...  https://aws.amazon.com/products/                     Managed Message Broker Service  Amazon MQ Fully managed service for open sourc...
2           AWS Amplify         aws amplify           amplify  ...  https://aws.amazon.com/products/       Build and deploy mobile and web applications  AWS Amplify Fastest, easiest way to build mobi...
3    Amazon API Gateway     aws api gateway       api-gateway  ...  https://aws.amazon.com/products/                     Build, Deploy, and Manage APIs  Amazon API Gateway Create, maintain, and secur...
4          AWS App Mesh        aws app mesh          app-mesh  ...  https://aws.amazon.com/products/                  Monitor and control microservices  AWS App Mesh Application-level networking for ...

Cloud Products is distributed under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloud-products-1.1.4.tar.gz (6.9 kB view details)

Uploaded Source

Built Distribution

cloud_products-1.1.4-py3-none-any.whl (7.4 kB view details)

Uploaded Python 3

File details

Details for the file cloud-products-1.1.4.tar.gz.

File metadata

  • Download URL: cloud-products-1.1.4.tar.gz
  • Upload date:
  • Size: 6.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/53.0.0 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.7.7

File hashes

Hashes for cloud-products-1.1.4.tar.gz
Algorithm Hash digest
SHA256 2e7148fc9265199ae1a689adef3df640082ae8b01513e344c0ca6bd123582f90
MD5 c6e1a2e7e9fefc8c73515b39880dd97e
BLAKE2b-256 ca65c29c7e19731ddba5f476f92c1cc9648c331f4c9bdc2a06906976590ae5a8

See more details on using hashes here.

File details

Details for the file cloud_products-1.1.4-py3-none-any.whl.

File metadata

  • Download URL: cloud_products-1.1.4-py3-none-any.whl
  • Upload date:
  • Size: 7.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/53.0.0 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.7.7

File hashes

Hashes for cloud_products-1.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 39c0b17e3de3224a1509d482882e4fe5c7b8d3f3ea6d2808f5e13173dd08394d
MD5 19a27678cd53c828e08fd216f55d7043
BLAKE2b-256 1c3b4affc2b29e63c77ed601e11c0ab432fc89881624df9e0cadbcc35ccb3360

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page