AWSCLI CloudWatch Logs plugin
Project description
This awscli plugin provides the pull, push and filter commands to access AWS CloudWatch Logs service.
The awscli-cwlogs package works on Python versions:
2.6.5 and greater
2.7.x and greater
3.3.x and greater
Installation
The easiest way to install awscli-cwlogs is to use pip:
$ pip install awscli-cwlogs
or, if you are not installing in a virtualenv:
$ sudo pip install awscli-cwlogs
If you have the awscli-cwlogs installed and want to upgrade to the latest version you can run:
$ pip install --upgrade awscli-cwlogs
This will install the awscli-cwlogs package as well as all dependencies, including awscli.
Getting Started
Before using awscli-cwlogs plugin, you need to configure awscli first.
Once that’s done, to enable awscli-cwlogs, you can run:
$ aws configure set plugins.cwlogs cwlogs
The above command adds below section to your aws config file:
[plugins] cwlogs = cwlogs
To verify if awscli-cwlogs plugin is installed and configured properly, you can run:
$ aws logs help
You will see the pull, push and fitler commands from available commands, otherwise it means the cwlogs plugin is not registered properly.
If you see ImportError: No module named cwlogs error, it means the cwlogs plugin is registered in config file, but the plugin is not installed.
Examples
Push command
You can use aws logs push help to check supported options. The push command is used by CloudWatch Logs agent, check the CloudWatch Logs Agent Reference to see all supported options or if you want to keep the push command running.
Uploading a single log event to CloudWatch Logs service. The log group and log stream get created automatically if they don’t exist.
echo "Hello World" | aws logs push --log-group-name MyLogGroup --log-stream-name MyLogStream
The following push command pushes log events from a syslog file to log stream which is specified by /var/log/syslog and myhost1 and exits after pushing all log events. This command doesn’t push the incremental log events. To achieve that, use tail -f file | aws logs push ....
cat /var/log/kernel.log | aws logs push --log-group-name /var/log/syslog --log-stream-name myhost1 --datetime-format '%b %d %H:%M:%S' --time-zone LOCAL --encoding ascii
The following push command pushes log events from multiple files based on configuration file. The initial_position determines where to start if the state of file is not available.
aws logs push --config-file push.cfg
[general] state_file = push-state [logstream-messages] datetime_format = %b %d %H:%M:%S time_zone = LOCAL file = /var/log/messages file_fingerprint_lines = 1 log_group_name = /var/log/messages log_stream_name = {hostname} initial_position = start_of_file encoding = utf_8 buffer_duration = 5000 [logstream-system.log] datetime_format = %b %d %H:%M:%S time_zone = UTC file = /var/log/system.log file_fingerprint_lines = 1-3 log_group_name = /var/log/system.log log_stream_name = {hostname} initial_position = end_of_file encoding = ascii buffer_duration = 10000
Pull command
You can use aws logs pull help to check supported options.
The following pull command pulls log events starting at 2014-01-23T00:00:00Z from one log stream which is specified by website1/access_log and webhost-001 and exits after pulling all log events.
aws logs pull --log-group-name website1/access_log --log-stream-name webhost-001 --start-time 2014-01-23T00:00:00Z
When invoked with the --end-time option, the following pull command pulls all log events between 2014-01-23T00:00:00Z (inclusive) and 2014-01-23T01:00:00Z (not inclusive).
aws logs pull --log-group-name website1/access_log --log-stream-name webhost-001 --start-time 2014-01-23T00:00:00Z --end-time 2014-01-23T01:00:00Z
When invoked with the --follow option, the following pull command does not exit after pulling all log events, but polls continuously for new log events.
aws logs pull --log-group-name website1/access_log --log-stream-name webhost-001 --start-time 2014-01-23T00:00:00Z --follow
When invoked with the --output-format option, the following pull command only outputs the message field. By default, the output format is "{timestamp} {message}". Ingestion time can be included with "{timestamp} {ingestionTime} {message}".
aws logs pull --log-group-name website1/access_log --log-stream-name webhost-001 --start-time 2014-01-23T00:00:00Z --output-format "{message}"
Filter command
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file awscli-cwlogs-1.4.6.tar.gz
.
File metadata
- Download URL: awscli-cwlogs-1.4.6.tar.gz
- Upload date:
- Size: 37.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.8.1 pkginfo/1.4.1 requests/2.13.0 setuptools/35.0.2 requests-toolbelt/0.7.1 clint/0.5.1 CPython/2.6.9 Linux/4.9.184-0.1.ac.235.83.329.metal1.x86_64
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44d2fe77d109b7b630fb8f6c06760ff6c5ec9861be16413fd5b977f5a4971f83 |
|
MD5 | a05a77af193943ae79cb1af553c02bcd |
|
BLAKE2b-256 | 56b22938eea88ed35dee5768f4b25a2a7ea36b40d8b6b6324f9b3f3815b7050f |