Skip to main content

A package for getting cloud product descriptions from the provider website.

Project description

cloud-products

pypi Version Latest Tag Build Dependencies

A package for getting cloud products and product descriptions from a cloud provider website with cache support.

Currently supports getting AWS product information from https://aws.amazon.com/products

GCP and Azure product information will be added in time.

Install from PyPi

pip install cloud-products

Example 1: List AWS products

from cloud_products.aws import AwsCrawler
for product in AwsCrawler().get_products():
    print(f"{product.code}: {product.name}: {product.desc}")

Example output:

alexaforbusiness: Alexa for Business: Empower your Organization with Alexa
amazon-mq: Amazon MQ: Managed Message Broker for ActiveMQ
amplify: AWS Amplify: Build and deploy mobile and web applications
api-gateway: Amazon API Gateway: Build, Deploy, and Manage APIs
...

Example 2: Get product descriptions as a list of lines

from cloud_products.aws import AwsCrawler
cloud_products = AwsCrawler()
product = cloud_products.get_products()[0]
lines = cloud_products.get_product_text(product)
print(lines[4])

Example output:

Alexa for Business is a service that enables organizations and employees to use Alexa to ...

Example 3: Usage to get matching product(s):

from cloud_products import aws
cloud_products = aws.AwsCrawler()
sagemaker_products = cloud_products.get_products_matching("sagemaker")
sagemaker_description = cloud_products.get_product_text(sagemaker_products[0])
print(sagemaker_description[3])

Example output:

Amazon SageMaker is a fully managed service that provides every developer and data scientist with ...

Example 4: Save product descriptions and FAQ pages to files:

from cloud_products import aws
cloud_products = aws.AwsCrawler()
for product in cloud_products.get_products():
    print(f"Saving {product.name}")
    cloud_products.save_product(product, output_path)
    cloud_products.save_faq(product, output_path)

Example output:

Saving Alexa for Business
Saving Amazon MQ
Saving AWS Amplify
Saving Amazon API Gateway
...

Example 5: Get Pandas dataframe of products:

Note: requires the optional pandas package to be installed.

This dataframe has the product name, code, url and full descriptions.

from cloud_products.aws import AwsCrawler
df = AwsCrawler().get_products_as_df()
print(df)

Example output:

                   name            std_name              code  ...                          seed_url                                               desc                                       product_text
0    Alexa for Business  alexa for business  alexaforbusiness  ...  https://aws.amazon.com/products/               Empower your Organization with Alexa  Alexa for Business Use Alexa for work Get Star...
1             Amazon MQ              aws mq         amazon-mq  ...  https://aws.amazon.com/products/                     Managed Message Broker Service  Amazon MQ Fully managed service for open sourc...
2           AWS Amplify         aws amplify           amplify  ...  https://aws.amazon.com/products/       Build and deploy mobile and web applications  AWS Amplify Fastest, easiest way to build mobi...
3    Amazon API Gateway     aws api gateway       api-gateway  ...  https://aws.amazon.com/products/                     Build, Deploy, and Manage APIs  Amazon API Gateway Create, maintain, and secur...
4          AWS App Mesh        aws app mesh          app-mesh  ...  https://aws.amazon.com/products/                  Monitor and control microservices  AWS App Mesh Application-level networking for ...

Cloud Products is distributed under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for cloud-products, version 1.1.4
Filename, size File type Python version Upload date Hashes
Filename, size cloud_products-1.1.4-py3-none-any.whl (7.4 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size cloud-products-1.1.4.tar.gz (6.9 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page