Yandex-tank tools
Project description
Yandex-tank prepare phout file with statistics after load testing. tanktools module helps to parse such files and convert to DataFrame. You can use pandas module in manual mode to handle DataFrame or use build-in functions.
To convert pcap file to Yandex-tank ammo format pcap2ammo tool was added. It should be available in your system bin directory right after the package installation. HTTP request from pcap file is extracted completely with line breakers headers and body.
So you can:
calc quantiles
get information about timings, latency, status codes
extract requests by timestamp, tag and other columns
group and analyze specific data like total/partial RPS, average request/response size
calc statistical metrics
convert pcap file to ammo
filter out and modify requests
Installation
pip install tanktools
Import
from tanktools import phout
Examples
Select DataFrame by timestamp
It is possible to parse a part of staistics by time and overal count
flags = {
'from_date': '2018-01-18 20:09:50.123',
'to_date' : '2018-01-18 20:10:00.456',
'limit': 100
}
data = phout.parse_phout(args.input, flags)
print("Total count: %d" % phout.size(data))
Total count: 100
Print percentiles
data = phout.parse_phout('phout.log')
phout.print_quantiles(data, 'receive_time')
Percentiles for 150030 requests
from 2018-01-18 20:09:42.983
to 2018-01-18 20:10:55.108:
quantile (%) receive_time (mks)
10.0 9
20.0 9
30.0 10
40.0 10
50.0 10
60.0 10
70.0 11
80.0 12
90.0 13
95.0 14
98.0 16
99.0 17
100.0 716
Print latency median
data = phout.parse_phout('phout.log')
# Convert and print timing in milliseconds
print("\n\nLatency median: %d ms" % int(data.latency.median() / 1000))
Latency median: 30 ms
Get RPS
data = phout.parse_phout('phout.log')
rps = phout.get_rps(data)
Print HTTP response statistics
data = phout.parse_phout('phout.log')
phout.print_http_reponses(data)
HTTP code count percent (%)
500 83429 56.38
200 61558 41.60
502 2944 1.99
0 41 0.03
Select 200 OK responses and print latency median
data = phout.parse_phout('phout.log')
selected_http_responses = data[data.proto_code == 200]
print("Latency median for 200 OK: %d" %
selected_http_responses.latency.median())
Latency median for 200 OK: 3539
Print average request/response size
print("Avg. Request / Response: %d / %d bytes" % (
data.size_in.astype(float).mean(),
data.size_out.astype(float).mean()
))
Avg. Request / Response: 364 / 26697 bytes
Print RPS at Nth request
print("RPS at request:")
chunk_size = int(phout.size(data) / 2)
for start in range(0, phout.size(data), chunk_size):
data_subset = phout.subset(data, start, chunk_size)
print("\t%s: %.2f" %
(start + chunk_size, phout.get_rps(data_subset)))
RPS at request:
73986: 2062.50
147972: 2530.56
pcap2ammo
Convert pcap file to Yandex-tank ammo
pcap2ammo -i file.pcap
73
GET https://rambler.ru/ HTTP/1.1\r\n
Host: rambler.ru\r\n
Content-Length: 0\r\n\r\n
Count statistics about HTTP requests
pcap2ammo -f "ip.src == 10.10.10.10" -i file.pcap -S
Stats:
total: 1
complete: 1
incorrect: 0
incomplete: 0
Print to file
pcap2ammo -i file.pcap -o out.ammo
Add or delete headers
Applyed for all requests, containing specified headers
pcap2ammo -i file.pcap --add-header 'Referer: http://domain.com' --add-header 'X-Ip: 1.1.1.1'
pcap2ammo -i file.pcap --delete-header 'Content-Length'
pcap2ammo -i file.pcap --delete-header 'Connection' --add-header 'Connection: keep-alive'
Filter TCP/IP packets
pcap2ammo -i file.pcap -f 'ip.src==10.10.10.10 and tcp.dport==8080'
Filter HTTP packets
pcap2ammo -i file.pcap -F '"rambler.ru" in http.uri'
You can use logical expressions in filters
pcap2ammo -i file.pcap -F '"keep-alive" in http.headers["connection"] or "Keep-alive" in http.headers["connection"]'
String functions over HTTP headers
pcap2ammo -i file.pcap -F '"keep-alive" in http.headers["connection"].lower()'
Use excluding filters also
pcap2ammo -i file.pcap -F '"rambler.ru" != http.headers["host"]'
See more information about filters in pcaper package description.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for tanktools-1.0.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b57adc0bed6058d31b993140139b13fd05d6e663024b0e332654dba44e063d6d |
|
MD5 | 08180489297269484a5848082e97fd1e |
|
BLAKE2b-256 | 1f0e50cb2113ce2359f0fce71212ce36bd5c7a39872e9a8fe5c4d34471d1142a |