A new kind of Progress Bar, with real time throughput, ETA and very cool animations!
Project description
alive-progress :)
A new kind of Progress Bar, with real time throughput, ETA and very cool animations!
Ever wondered where your lengthy processing was in, and when would it finish? Ever found yourself hitting [RETURN] now and then to ensure it didn't hang, or if in a remote SSH session the connection was still working? Ever needed to pause some processing for a while, return to the Python prompt for a manual inspection or fixing an item, and then resume the process seamlessly? I did...
I've started this cool progress bar thinking about all that, the alive-progress! ๐
I like to think of it as a new kind of progress bar for Python, since it has among other things:
- a live spinner that is incredibly cool, and clearly shows your lengthy process did not hang, or your ssh connection did not drop;
- a visual feedback of your current processing, as the live spinner runs faster or slower with it;
- an efficient multi-threaded bar, which updates itself at a fraction of the actual processing speed (1,000,000 iterations per second equates to roughly 60 updates per second) to keep CPU usage low and avoid terminal spamming (you can also calibrate this to your liking);
- a nice monitoring of both position and throughput of your processing;
- an ETA (expected time of arrival) with a smart exponential smoothing algorithm, that shows the time to completion;
- automatic print and logging hooks, which allows print statements and logging messages to work effortlessly in the midst of an animated bar, and even enriching them with the current bar position when they occurred;
- a nice receipt is printed when your processing finishes, including the last bar rendition, the elapsed time and the observed throughput;
- it detects under and overflows, enabling you to track hits, misses, or any desired count, not necessarily the actual iterations;
- it automatically detects if there's an allocated tty, and if there isn't (like in a shell pipeline), only the final receipt is printed (so you can safely include it in any code, and rest assure your log file won't get thousands of progress lines);
- you can pause it! I think that's an unprecedented feature for progress bars ANYWHERE โ in Python or in any other language โ no one has ever done it! It's incredible to be able to get to the Python prompt in the midst of any running processing! Then manually fix, prepare or cache some items, and finally get into that running progress bar again, like it had never stopped!! All the widgets are maintained, and the elapsed time disregard the paused time!;
- it is customizable, with a growing smorgasbord of different bar and spinner styles, as well as several factories to easily generate yours! Now (๐ new in 2.0) we even have super powerful and cool
.check()
tools in both bars and spinners, to help you design your animations! You can see all the frames and cycles exploded on screen, with several verbosity levels, even including an alive rendition! ๐
๐ NEW 2.0 series!
This is a major breakthrough in alive-progress
!
I took 1 year developing it, and I'm very proud of what I've accomplished \o/
- now there's complete support for Emojis ๐คฉ and exotic Unicode chars in general, which required MAJOR refactoring deep within the project, giving rise to what I called Cells Architecture => now all internal components use and generate streams of cells instead of chars, and correctly interprets grapheme clusters โ it has enabled to render complex multi-chars symbols as if they were one, thus making them work on any spinners, bars, texts, borders, backgrounds, everything!!! there's even support for wide chars, which are represented with any number of chars, including one, but take two spaces on screen!! pretty advanced stuff ๐ค
- new super cool spinner compiler and runner, which generates complete animations ahead-of-time, and play these ready-to-go animations seamlessly, with no overhead at all! ๐
- the spinner compiler also includes advanced extra commands to generate and modify animations, like reshape, replace, transpose, or randomize the animation cycles!
- new powerful and polished
.check()
tools, that compile and beautifully render all frames from all animation cycles of spinners and bars! they can even include complete frame data, internal codepoints and even their animations! ๐ - bars engine revamp, with invisible fills, advanced support for multi-char tips (which gradually enter and leave the bar), borders, tips and errors of any length, and underflow errors that can leap into the border if they can't fit!
- spinners engine revamp, with standardized factory signatures, improved performance, new types and new features: smoother bouncing spinners (with an additional frame at the edges), optimized scrolling of text messages (which go slower and pause for a moment at the edges), new alongside and sequential spinners, nicer effect in alongside spinners (which use weighted spreading over the available space), smoother animation in scrolling spinners (when the input is longer than the available space)
- new builtin spinners, bars and themes, which makes use of the new animation features
- new showtime that displays themes and is dynamic => it does not scroll the screen when it can't fit either vertically or horizontally, and can even filter for patterns!
- improved support for logging into files, which gets enriched as the print hook is!
- several new configuration options for customizing appearance, including support for disabling any
alive-progress
widgets! - includes a new iterator adapter
alive_it
, that accepts an iterable and callsbar()
for you! - requires python 3.6+ (and officially supports python 3.9 and 3.10)
Since this is a major version change, backward compatibility may be lacking. If something does not work at first, just check the new imports and functions' signatures, and you should be good to go. All previous features are still here! ๐
This README was completely rewritten, so please take a full look to find great new details!!
Get it
Just install with pip:
โฏ pip install alive-progress
Awake it
Want to see it gloriously running in your system before anything?
โฏ python -m alive_progress.tools.demo
Cool huh?? Now enter an ipython
REPL and try it yourself:
from alive_progress import alive_bar
import time
for x in 1000, 1500, 700, 0:
with alive_bar(x) as bar:
for i in range(1000):
time.sleep(.005)
bar()
You'll see something like this, with cool animations throughout the process ๐:
|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 1000/1000 [100%] in 5.8s (171.62/s)
|โโโโโโโโโโโโโโโโโโโโโโโโโโโโ ๏ธ | (!) 1000/1500 [67%] in 5.8s (172.62/s)
|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ๏ธ (!) 1000/700 [143%] in 5.8s (172.06/s)
|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 1000 in 5.8s (172.45/s)
Nice huh? Loved it? I knew you would, thank you ๐.
To actually use it, just wrap your normal loop in an alive_bar
context manager like this:
with alive_bar(total) as bar: # declare your expected total
for item in items: # <<-- your original loop
print(item) # process each item
bar() # call `bar()` at the end
And it's alive! ๐
So, in short: retrieve the items as usual, enter the alive_bar
context manager with the number of items, and then iterate/process those items, calling bar()
at the end! It's that simple! :)
Master it
items
can be any iterable, like for example a queryset;- the first argument of the
alive_bar
is the expected total, likeqs.count()
for querysets,len(items)
for iterables with length, or even a static number; - the call
bar()
is what makes the bar go forward โ you usually call it in every iteration, just after finishing an item; - if you call
bar()
too much (or too few at the end), the bar will graphically render that deviation from the expectedtotal
, making it very easy to notice overflows and underflows; - to retrieve the current bar count or percentage, call
bar.current()
.
You can get creative! Since the bar only go forward when you call
bar()
, it is independent of the loop! So you can use it to monitor anything you want, like pending transactions, broken items, etc, or even call it more than once in the same iteration! So, at the end, you'll get to know how many of those "special" events there were, including their percentage in relation to the total!
Displaying messages
While inside an alive_bar
context, you can effortlessly display messages with:
- the usual Python
print()
statement, wherealive_bar
nicely cleans up the line, prints your message alongside the current bar position at the time, and continues the bar right below it; - the standard Python
logging
framework, including file outputs, are also enriched exactly like the previous one; - the cool
bar.text('message')
, which sets a situational message right within the bar, where you can display something about the current item, or the phase the processing is in!
Auto-iterating (๐ new in 2.0)
You now have a quicker way to monitor anything! Here, the items are automatically tracked for you!
Behold the alive_it
=> the alive_bar
iterator adapter!
Simply wrap your items with it, and loop over them as usual!
The bar will just work, it's that simple!
from alive_progress import alive_it
for item in alive_it(items): # <<-- wrapped items
print(item) # process each item
HOW COOL IS THAT?! ๐
All alive_bar
parameters apply but total
, which is smarter (if not supplied it will be auto-inferred from your data using len
or length_hint
), and manual
that does not make sense here.
Note there isn't any bar
handle at all in there. But what if you do want it, for example to set text messages or retrieve the current progress?
You can interact with the internal alive_bar
by just assigning alive_it
to a variable, like this:
bar = alive_it(items): # <<-- bar with wrapped items
for item in bar: # <<-- iterate on bar
print(item) # process each item
bar.text(f'ok: {item}') # WOW, it works!
Note that this is a slightly special bar
, which does not support bar()
, since the iterator adapter tracks items automatically for you.
Please do mind their differences:
- the full use is
with alive_bar() as bar
, where you iterate and callbar()
whenever desired;- the basic adapter use is
for item in alive_it(items)
, where items are automatically tracked;- the named adapter use is
bar = alive_it(items)
, where, besides items being automatically tracked, you get a special iterablebar
to customize.
Modes of operation
Definite/unknown: Counter strategy
Actually, the total
argument is optional. If you do provide it, the bar enters in definite mode, the one used for well-bounded tasks. This mode has all the widgets alive-progress
has to offer: count, throughput and ETA.
If you don't, the bar enters in unknown mode, the one used for unbounded tasks. In this mode the whole progress bar is animated, as it's not possible to determine the percentage, and therefore the ETA. But you still get the count and throughput widgets as usual.
The cool spinner is still present here besides the progress bar, both running their own animations concurrently and independently of each other, rendering a unique show in your terminal! ๐
As a matter of fact, definite and unknown modes both use a core strategy with a counter to maintain progress. This is the source value from which all widgets are derived.
Manual: Percentage strategy
On the other hand, manual mode uses a core strategy with a percentage progress. This enables you to get complete control of the bar position! It's usually used to monitor processes that only feed you the percentage of completion, or to generate some kind of special effect.
To use it, just include a manual=True
argument into alive_bar
(or config_handler
), and you get to send your own percentage to the bar()
handler! For example to set it to 15%, you just call bar(0.15)
โ which is 15 / 100.
You can also use total
here! If you do provide it, the bar
will infer an internal counter, and thus you also get the count, throughput and ETA widgets!
If you don't, it's not possible to infer any counter, but you'll at least get rough versions of the throughput and ETA widgets! The throughput will use "%/s" (percent per second), and the ETA will be until 1 (100%). Both are very inaccurate, but are better than nothing.
You can call
bar
in manual mode as frequently as you want! The refresh rate will still be asynchronously computed as usual, according to the current progress and the elapsed time, so you won't ever spam the terminal with more updates than it can handle.
The bar()
handlers
The bar()
handlers support either relative or absolute semantics, depending on the mode:
- in counter modes, it is relative positioning, so you can just call
bar()
to increment count by one, or send any other positive increment likebar(5)
to increment those in one step; - in manual mode, it is absolute positioning, so you can just call
bar(0.35)
to instantly put the bar in 35% โ this argument is mandatory here!
The manual mode enables you to get super creative! Since you can set the bar instantly to whatever position you want, you could:
- make it go backwards โ perhaps to graphically display the timeout of something;
- create special effects โ perhaps to act like a real time gauge of some sort.
In any mode, to retrieve the current count/percentage, just call: bar.current()
:
- in counter modes, this provides an integer โ the actual internal count;
- in manual mode, this provides a float in the interval [0, 1] โ the last percentage set.
Summary
When total
is provided all is cool:
mode | counter | percentage | throughput | ETA | over/underflow |
---|---|---|---|---|---|
definite | โ (user tick) | โ (inferred) | โ | โ | โ |
manual | โ (inferred) | โ (user set) | โ | โ | โ |
When it isn't, some compromises have to be made:
mode | counter | percentage | throughput | ETA | over/underflow |
---|---|---|---|---|---|
unknown | โ (user tick) | โ | โ | โ | โ |
manual | โ | โ (user set) | โ ๏ธ (simpler) | โ ๏ธ (rough) | โ |
It's actually quite simple, you do not need to think about which mode you should use!
Just always send the
total
if you have it, and usemanual
if you need it!
It will just work the best it can! ๐ \o/
Customize it
Styles
Wondering what styles are builtin? It's showtime
! ;)
from alive_progress.styles import showtime
showtime()
Actually I've made these styles just to try the factories I've created, but I think some of them ended up very very cool! Use them at will, mix them to your heart's content!
The showtime
exhibit have an optional argument to choose which show to present, Show.SPINNERS
(default), Show.BARS
or Show.THEMES
, take a look at each of them! ;)
(๐ new in 2.0) And the themes one:
The showtime
exhibit also accepts some customization options:
- fps: the frames per second rate refresh rate, default is 15;
- length: the length of the bars, default is 40;
- pattern: a filter to choose which names to display.
For example to get a marine show, you can showtime(pattern='boat|fish|crab')
:
You can also access these shows with the shorthands
show_bars()
,show_spinners()
, andshow_themes()
!
There's also a small utility called
print_chars()
, to help finding that cool character to put in your customized spinners or bars, or to determine if your terminal do support unicode characters.
Configurations
There are several options to customize both appearance and behavior!
All of them can be set both directly in the alive_bar
or globally in the config_handler
!
These are the options - default values in brackets:
title
: an optional, always visible bar titlelength
: [40
] the number of characters to render the animated progress barspinner
: the spinner style to be rendered next to the bar
โณ accepts a predefined spinner name, a custom spinner factory, or Nonebar
: the bar style to be rendered in known modes
โณ accepts a predefined bar name, a custom bar factory, or Noneunknown
: the bar style to be rendered in the unknown mode
โณ accepts a predefined spinner name, or a custom spinner factory (cannot be None)theme
: ['smooth'
] a set of matching spinner, bar and unknown
โณ accepts a predefined theme nameforce_tty
: [None
] forces animations to be on, off, or according to the tty (more details here)manual
: [False
] set to manually control the bar positionenrich_print
: [True
] enriches print() and logging messages with the bar positionreceipt_text
: [False
] set to repeat the last text message in the final receiptmonitor
: [True
] set to display the monitor widget123/100 [123%]
stats
: [True
] set to display the stats widget(123.4/s eta: 12s)
elapsed
: [True
] set to display the elapsed time widgetin 12s
title_length
: [0
] fixes the title lengths, or 0 for unlimited
โณ title will be truncated if longer, and a cool ellipsis "โฆ" will appear at the endspinner_length
: [0
] forces the spinner length, or0
for its natural one
And there's also one that can only be set locally in an alive_bar
context:
calibrate
: maximum theoretical throughput to calibrate animation speed (more details here)
To set them locally, just send them as keyword arguments to alive_bar
:
with alive_bar(total, title='Processing', length=20, bar='halloween'):
...
To use them globally, send them to config_handler
, and any alive_bar
created after that will include those options! And you can mix and match them, local options always have precedence over global ones:
from alive_progress import config_handler
config_handler.set_global(length=20, spinner='wait')
with alive_bar(total, bar='blocks', spinner='twirls'):
# the length is 20, the bar is 'blocks' and the spinner is 'twirls'.
...
Create your own animations
Yes, you can assemble your own spinners! And it's easy!
I've created a plethora of special effects, so you can just mix and match them any way you want! There are frames, scrolling, bouncing, sequential, alongside and delayed spinners! Get creative! ๐
Intro: How do they work?
The spinners' animations are engineered by very advanced generator expressions, deep within several layers of meta factories, factories and generators ๐คฏ!
- the meta factory (public interface) receives the styling parameters from you, the user, and processes/stores them inside a closure to create the actual factory => this is the object you'll send to both
alive_bar
andconfig_handler
; - internally it still receives other operating parameters (like for instance the rendition length), to assemble the actual generator expression of the animation cycles of some effect, within yet another closure;
- this, for each cycle, assembles another generator expression for the animation frames of the same effect;
- these generators together finally produce the streams of cycles and frames of the cool animations we see on the screen! Wow ๐๐
These generators are capable of multiple different animation cycles according to the spinner behavior, e.g. a bouncing spinner with a simple pattern argument runs one cycle to smoothly bring a subject into the scene, then repeatedly reposition it until the other side, then make it smoothly disappear of the scene => this is all only one cycle! Then it is followed by another cycle to make it all backwards. But the same bouncing spinner accepts repeating patterns in both right and left directions, which generates the cartesian product of all combinations, thus capable of producing dozens of different cycles!! ๐คฏ
And there's more! They only yield the next animation frame until the current cycle is exhausted, then stops! The next cycle does not start just yet! It creates natural breaks, in exactly the correct spots, where the animations would not be disrupted, and I can smoothly restart whatever generator I want!!
That has all kinds of cool implications: the cycles can have different frame counts, different screen lengths, they do not need to be synchronized, they can create long different sequences by themselves, they can cooperate with each other to play cycles in sequence or alongside, and I can amaze you displaying several animations at the same time on the screen without any interferences!
It's almost like they were... alive! ==> Yes, that's where this project's name came from! ๐
(๐ new in 2.0) A Compiler, really?
Now these generators of cycles and frames are fully consumed ahead of time by the Spinner Compiler! This is a very cool new processor that I made inside the Cell Architecture effort, to make all these animations work even in the presence of wide chars or complex grapheme clusters! It was very hard to make these clusters smoothly and gradually enter and exit frames without breaking everything, because several chars can in fact represent only one visible symbol!! So they cannot ever be split, they have to enter and exit the scene always all at once or the grapheme won't show (an Emoji for instance)!! Enter the Spinner Compiler......
This has made possible some incredible things!! Since this Compiler generates the whole spinner frame data beforehand (the generators are actually infinite, but I've made them provide statistics about themselves), the animations do not need to be calculated anymore, those grapheme fixes can be applied only once, and I can just collect all that frame data unhindered, ready to play animations for this environment, so no runtime overhead at all!! ๐
Also, with the full frame data available, I could create several commands to refactor that data, like changing shapes and replacing chars, including visual pauses (frame repetitions), generating bouncing effects on demand over any content, and even transposing cycles with frames!!
But how can you see these effects? Does the effect you created look good? Or is not working as you thought? Now you can see all generated cycles and frames analytically, in a very beautiful rendition!!
I love what I've achieved here ๐, it's probably THE most beautiful tool I've ever created... Behold the check
tool!!
It's awesome, if I say so myself, isn't it? And a very complex piece of software I'm proud of, take a look at its code if you're curious.
Factories
The types of factories I've created are:
frames
: draws any sequence of characters at will, that will be played frame by frame in sequence;scrolling
: generates a smooth flow from one side to the other, hiding behind or wrapping upon invisible borders โ allows using subjects one at a time, generating several cycles of distinct characters;bouncing
: similar toscrolling
, but makes the animations bounce back to the start, hiding behind or immediately bouncing upon invisible borders;sequential
get a handful of factories and play them one after the other sequentially! allows to intermix them or not;alongside
get a handful of factories and play them alongside simultaneously, why choose when you can have them all?! allows to choose the pivot of the animation;delayed
: get any other factory and copy it multiple times, increasingly skipping some frames on each one! very cool effects are made here!
For more details please look at their docstrings, which are very complete.
Create your own bars
Customizing bars is nowhere near that involved. Let's say they are "immediate", passive objects. They do not support animations, i.e. it will always generate the exact same rendition given the same parameters. Remember spinners are infinite generators, capable of generating long and complex sequences.
Well, bars also have a meta factory, use closures to store the styling parameters, and receive additional operating parameters, but then the actual factory can't generate any content by itself. It still needs an additional floating point number between 0 and 1, the percentage to render itself, everytime it's needed.
The
alive_bar
calculates and provides this percentage automatically to it, but you can send it yourself with themanual
mode!
Bars also do not have a Bar Compiler, but they do provide the check tool!! ๐
You can even mix and match wide chars and normal chars! Just like spinners do!
Use and abuse the check tools!! They have more modes, there's even real time animations!
Create the widest and coolest animations you can, and send them to me!
I'm thinking about creating some kind ofcontrib
package, with user contributed spinners and bars!
Wow, if you read everything till here, you should now have a sound knowledge about using alive-progress
! ๐
And if you want to know even more, exciting stuff lies ahead!
If you've appreciated my work and would like me to continue improving it,
please back me up with a donation! I'll surely appreciate the encouragement!
Thank you! ๐
Advanced
So, you need to monitor a fixed operation, without any loop?
It'll work for sure! Here is an example, although a naive approach:
with alive_bar(4) as bar: corpus = read_file(file) bar() # file was read, tokenizing tokens = tokenize(corpus) bar() # tokens generated, processing data = process(tokens) bar() # process finished, sending response resp = send(data) bar() # we're done! four bar calls with `total=4`It's naive because it considers all steps are equal, but actually each one may take a very different time to complete. Think a
read_file
and atokenize
steps being extremely fast, making the percentage skyrocket to 50%, then stopping for a long time in theprocess
step. You get the point, it can ruin the user experience and create a very misleading ETA.What you need to do is distribute the steps accordingly! Since you told
alive_bar
there were four steps, when the first one completed it understood 1/4 or 25% of the whole processing was complete, which as we've seen may not be the case. Thus, you need to measure how long your steps do take, and use the manual mode to increase the bar percentage by different amounts at each step!You can use my other open source project about-time to easily measure these durations! Just try to simulate with some representative inputs, to get better results. Something like:
from about_time import about_time with about_time() as t_total: # this about_time will measure the whole time of the block. with about_time() as t1 # the other four will get the relative timings within the whole. corpus = read_file(file) # `about_time` supports several calling conventions, including one-liners. with about_time() as t2 # see its documentation for more details. tokens = tokenize(corpus) with about_time() as t3 data = process(tokens) with about_time() as t4 resp = send(data) print(f'percentage1 = {t1.duration / t_total.duration}') print(f'percentage2 = {t2.duration / t_total.duration}') print(f'percentage3 = {t3.duration / t_total.duration}') print(f'percentage4 = {t4.duration / t_total.duration}')There you go! Now you know the relative timings of all the steps, and can use them to improve your original code! Just get the cumulative timings and put within a manual mode
alive_bar
!For example, if the timings you found were 10%, 30%, 20% and 40%, you'd use 0.1, 0.4, 0.6 and 1. (the last one should always be 1.):
with alive_bar(4, manual=True) as bar: corpus = read_big_file() bar(0.1) # 10% tokens = tokenize(corpus) bar(0.4) # 30% + 10% from previous steps data = process(tokens) bar(0.6) # 20% + 40% from previous steps resp = send(data) bar(1.) # always 1. in the last stepThat's it! Your user experience and ETA should be greatly improved now.
You want to calibrate the engine?
FPS Calibration
The
alive-progress
bars have a cool visual feedback of the current throughput, so you can instantly see how fast your processing is, as the spinner runs faster or slower with it. For this to happen, I've put together and implemented a few fps curves to empirically find which one gave the best feel of speed:(interactive version [here](https://www.desmos.com/calculator/ema05elsux))
The graph shows the logarithmic (red), parabolic (blue) and linear (green) curves, these are the ones I started with. It was not an easy task, I've made hundreds of tests, and never found one that really inspired that feel of speed I was looking for. The best one was the logarithmic one, but it reacted poorly with small numbers. I know I could make it work with a few twists for those small numbers, so I experimented a lot and adjusted the logarithmic curve (dotted orange) until I finally found the behavior I expected. It is the one that seemed to provide the best all around perceived speed changes throughout the whole spectrum from units to billions. That is the curve I've settled with, and it's the one used in all modes and conditions. In the future and if someone would find it useful, that curve could be configurable.
Well, the default
alive-progress
calibration is 1,000,000 in bounded modes, i.e., it takes 1 million iterations per second for the bar to refresh itself at 60 frames per second. In the manual unbounded mode it is 1.0 (100%). Both enable a vast operating range and generally work really well.For example, take a look at the effect these very different calibrations have, running the very same code at the very same speed! Notice the feel the spinner passes to the user, is this processing going slow or going fast? And remember that isn't only the spinner refreshing but the whole line, complete with the bar rendition and all widgets, so everything gets smoother or sluggish:
So, if your processing hardly gets to 20 items per second and you think
alive-progress
is rendering sluggish, you could increase that sense of speed by calibrating it to let's say40
, and it will be running waaaay faster... Actually it is better to leave some headroom and calibrate it to something between 50% and 100% more, and then tweak it from there to find the one you like the most! :)
Oh you want to stop it altogether!
The Pause Mechanism
Why would you want to pause it, I hear? To get to manually act on some items at will, I say!
Suppose you need to reconcile payment transactions (been there, done that). You need to iterate over thousands of them, detect somehow the faulty ones, and fix them. This fix is not simple nor deterministic, you need to study each one to understand what to do. They could be missing a recipient, or have the wrong amount, or not be synced with the server, etc, it's hard to even imagine all possibilities. Typically you would have to let the detection process run until completion, appending to a list each inconsistency found, and waiting potentially a long time until you can actually start fixing them. You could of course mitigate that by processing in chunks or printing them and acting in another shell, but those have their own shortcomings.
Now there's a better way, pause the actual detection for a moment! Then you have to wait only until the next fault is found, and act in near real time!To use the pause mechanism you must be inside a function, to enable the code to
yield
the items you want to interact with. You should already be using one in your code, but in the ipython shell for example, just wrap thealive_bar
context inside one. Then you just need to enter thebar.pause()
context!! Something likewith bar.pause(): yield transaction
.def reconcile_transactions(): qs = Transaction.objects.filter() # django example, or in sqlalchemy: session.query(Transaction).filter() with alive_bar(qs.count()) as bar: for transaction in qs: if not validate(transaction): with bar.pause(): yield transaction bar()That's it! Then you can use it in any code or even ipython! Just call the reconcile function to instantiate the generator and assign it to
gen
for example, and whenever you want another transaction to fix, callnext(gen, None)
! The progress bar will pop in as usual, but as soon as an inconsistency is found, the bar pauses itself and you get the prompt back with a transaction! It's almost magic! ๐In [11]: gen = reconcile_transactions() In [12]: next(gen, None) |โโโโโโโโโโโโโโโโโโโโโ | 105/200 [52%] in 5s (18.8/s, eta: 4s) Out[12]: Transaction<#123>You can then use
_12
ipython's shortcut to get the transaction, if you don't like that just assign it withtrn = next(gen, None)
, and you're set up as well to fix thattrn
at once!
When you're done, revive the detection process with the samenext
as before... The bar reappears exactly like it had stopped and continues on the next item like nothing happened!! Nice huh :)In [21]: next(gen, None) |โโโโโโโโโโโโโโโโโโโโโ | โโโ 106/200 [52%] in 5s (18.8/s, eta: 4s)
Those astonishing animations refuse to display?
Forcing animations on non-interactive consoles
There are ttys that do not report themselves as "interactive", which are valid for example in shell pipelines "|" or headless consoles. But there are some that do that for no good reason, like Pycharm's python console for instance. The important thing is, if a console is not interactive,
alive_bar
disables all the animations and refreshes, as that could break some output, and prints only the final receipt. So if you are in a safe environment like Pycharm's and would like to seealive_bar
in all its glory, I've included aforce_tty
argument!with alive_bar(1000, force_tty=True) as bar: for i in range(1000): time.sleep(.01) bar()You can also set it system-wide in
config_handler
, then you won't need to pass it anymore.Do note that Pycharm's console is heavily instrumented and thus has more overhead, so the outcome may not be as fluid as you would expect. To see
alive_bar
animations perfectly, always prefer a full-fledged terminal.(๐ new) Now
force_tty
also supportsFalse
, which will disable animations even on interactive displays.
Interesting facts
- This whole project was implemented in functional style;
- It uses extensively (and very creatively) Python Closures and Generators, for example all spinners are made with cool Generator Expressions! Besides the spinners module, the exhibit module and the spinner_player function are cool examples ๐;
- Until 2.0,
alive-progress
hadn't had any dependency. Now it has two: one is about-time (another very cool project of mine, if I say so myself), to track the spinner compilation times and generate its human friendly renditions. The other is grapheme, to detect grapheme cluster breaks (I've opened an issue there asking about the future and correctness of it, and the author guarantees he intends to update the project on every new Unicode version); - Also, until 2.0
alive-progress
hadn't had a single Python class! Now it has two tiny ones, for very specific reasons (change callables and iterator adapter). I've used Closures extensively here, to create factories and persist parameters, and evenalive_bar
itself is a function, where I dynamically plug other ones (Python functions have a__dict__
just like classes do).
To do
- enable multiple simultaneous bars, for nested or multiple activities (this is always requested!);
- reset a running bar context, a quantifying mode is expected;
- dynamic bar width rendition, listening to changes in terminal size (the whole progress-bar line already truncates when needed, according to terminal size);
- improve test coverage, currently at 77% branch coverage, working to achieve 100% (but it's hard, since it's multi-threaded and includes system hooks);
- create a contrib system, to allow a simple way to share the coolest users' spinners and bars;
- jupyter notebook support (it's actually another whole implementation using graphical widgets, so not very likely to be done);
- support colors in spinners and bars (it's very hard, since color codes alter string sizes, and correctly cut, reverse and iterate is very complex);
- any other ideas welcome!
Already done ๐
- create an unknown mode for bars (without a known total and eta)
- implement a pausing mechanism
- change spinner styles
- change bar styles
- include a global configuration system
- create customizable generators for scrolling, bouncing, delayed and compound spinners
- create an exhibition for spinners and bars, to see them all in motion
- include theme support in configuration
- soft wrapping support
- hiding cursor support
- python logging support
- exponential smoothing of ETA time series
- create an exhibition for themes
Python versions End of Life notice
The alive_progress
framework starting from version 2.0 does not support Python 2.7 and 3.5 anymore.
If you still need support for them, you can always use the versions 1.x, which are also full-featured and do work very well, just:
โฏ pip install -U "alive_progress<2"
If you put this version as a dependency in a requirements.txt file, I strongly recommend to put
alive_progress<2
, as this will always fetch the latest release of the v1.x series. That way, if I ever release a bugfix for it, you will get it the next time you install it.
Changelog highlights (complete here):
- 2.0.0: new system-wide Cells Architecture with grapheme clusters support; super cool spinner compiler and runner;
.check()
tools in both spinners and bars; bars and spinners engines revamp; new animation modes in alongside and sequential spinners; new builtin spinners, bars and themes; dynamic showtime with themes, scroll protection and filter patterns; improved logging for files; several new configuration options for customizing appearance; new iterator adapteralive_it
; usestime.perf_counter()
high resolution clock; requires python 3.6+ (and officially supports python 3.9 and 3.10) - 1.6.2: new
bar.current()
method; newlines get printed on vanilla Python REPL; bar is truncated to 80 chars on Windows. - 1.6.1: fix logging support for python 3.6 and lower; support logging for file; support for wide unicode chars, which use 2 columns but have length 1
- 1.6.0: soft wrapping support; hiding cursor support; python logging support; exponential smoothing of ETA time series; proper bar title, always visible; enhanced times representation; new
bar.text()
method, to set situational messages at any time, without incrementing position (deprecates 'text' parameter inbar()
); performance optimizations - 1.5.1: fix compatibility with python 2.7 (should be the last one, version 2 is in the works, with python 3 support only)
- 1.5.0: standard_bar accepts a
background
parameter instead ofblank
, which accepts arbitrarily sized strings and remains fixed in the background, simulating a bar going "over it" - 1.4.4: restructure internal packages; 100% branch coverage of all animations systems, i.e., bars and spinners
- 1.4.3: protect configuration system against other errors (length='a' for example); first automated tests, 100% branch coverage of configuration system
- 1.4.2: sanitize text input, keeping \n from entering and replicating bar on screen
- 1.4.1: include license file in source distribution
- 1.4.0: print() enrichment can now be disabled (locally and globally), exhibits now have a real time fps indicator, new exhibit functions
show_spinners
andshow_bars
, new utilityprint_chars
,show_bars
gains some advanced demonstrations (try it again!) - 1.3.3: further improve stream compatibility with isatty
- 1.3.2: beautifully finalize bar in case of unexpected errors
- 1.3.1: fix a subtle race condition that could leave artifacts if ended very fast, flush print buffer when position changes or bar terminates, keep total argument from unexpected types
- 1.3.0: new fps calibration system, support force_tty and manual options in global configuration, multiple increment support in bar handler
- 1.2.0: filled blanks bar styles, clean underflow representation of filled blanks
- 1.1.1: optional percentage in manual mode
- 1.1.0: new manual mode
- 1.0.1: pycharm console support with force_tty, improve compatibility with python stdio streams
- 1.0.0: first public release, already very complete and mature
License
This software is licensed under the MIT License. See the LICENSE file in the top distribution directory for the full license text.
Did you like it?
I've put much โค๏ธ and effort into this.
If you've appreciated my work and would like me to continue improving it,
please back me up with a donation! I'll surely appreciate the encouragement!
Thank you! ๐
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file alive-progress-2.0.0.tar.gz
.
File metadata
- Download URL: alive-progress-2.0.0.tar.gz
- Upload date:
- Size: 93.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc043d687df96767d7573d31b8a86a229c4184cefb730bd7670826a6be93b0e9 |
|
MD5 | 98af1cacfda43cf928053334ce8d4f54 |
|
BLAKE2b-256 | 1e47a6350092558cfb529b060bfcc008c1524814fc389c39b8ed439bb8234c4d |
File details
Details for the file alive_progress-2.0.0-py3-none-any.whl
.
File metadata
- Download URL: alive_progress-2.0.0-py3-none-any.whl
- Upload date:
- Size: 72.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d6b847f6522e95a93ad41dd3cee80a41a8af9a572e5e4d624def543747670f0f |
|
MD5 | 6fa7f72ae56cc4ca29e83cc039a54749 |
|
BLAKE2b-256 | 08cae24943c9c1ae7dcd060a0b08704aff930d5c1687a99d0e4a8cec62197378 |