Skip to main content

Lightweight conveyor data processing python framework

Project description

FINQ

Lightweight conveyor data processing python framework, which allows to quickly write long queries without a fear that it'll become unreadable, because FINQ as opposed to standard library allows you to write each logical part of query at next line without tearing it and expanding logical block over whole function

Start

To start conveyor processing of your iterable you need to wrap it with FINQ() object which then allows you to call Basic methods

Basic methods

Method IsTerminal Description
concat(b:Iterable[T]) - Concatenates two sequences, creating sequence that contains items of the first iterable then of second iterable.
map(*f:T -> T2) - Applies given function to every element of sequence.
zip(b:Iterable[T]) - Pairs corresponding elements of two sequences in pairs.
flat_map(f:T -> Collection[T2] = Identity) - Applies given function to every element to get collection, then glues these collections.
flatten(f:T -> Collection[T] = Identity) - Applies given function to every element to get collection, then glues these collections. Repeats until all elements are non iterable.
filter(f:T -> bool) - Removes elements that doesn't satisfy predicate from sequence.
distinct(f:T -> T2) - Skips elements which f(element) repeated.
sort(f:T -> int) - Sorts sequence elements by key given by f.
skip(count:int) - Skips count elements from sequence.
take(count:int) - Limits sequence by count elements, dropping others.
cartesian_product(b:Iterable[T1], mapping:TxT1 -> T2) - Returns Cartesian product of two sequences after application of mapping if specified.
cartesian_power(pow:int, mapping:T^pow -> T2) - Returns Cartesian power of sequence after application of mapping if specified.
pairs() - Returns Cartesian square of sequence. Equivalent to Cartesian square with Identity mapping.
enumerate(start=0) - Maps sequence elements to pair which first value is index in sequence starting by start.
peek(f:T -> ()) - Applies function to each element in sequence leaving sequence unchanged.
group_by(mapping:T -> T2 = Identity) - Splits sequence into sequence of lists of elements which f(x) is the same.
random(precentage:float) - Takes roughly percentage*100% of random elements of sequence.
sort_randomly() - Shuffles sequence.
join_str(delimiter:str) + Joins sequence by delimiter.
join(seq:Iterable[T2], cond: :TxT2 -> bool, aggr:TxT2 -> T3) + Joins two sequences. Two values are aggregated if condition is true.
for_each(f:T -> () = Consumer) + Calls f for every element of a sequence. Equivalent to:
for e in collection:
f(e).
all(f:T -> bool = IdentityTrue) + Checks if all elements in sequence satisfy predicate.
any(f:T -> bool = IdentityTrue) + Checks if there exist element in sequence that satisfies predicate.
none(f:T -> bool = IdentityTrue) + Checks if there no element in sequence that satisfies predicate.
first() + Takes first element of sequence.
to_list() + Creates default python-list containing all sequence elements.
to_set() + Creates default python-set containing all distinct sequence elements.
to_counter() + Creates Counter containing all sequence elements.
to_dict(key:T -> TKey = First, value:T -> TValue = Second) + Creates default python-dict containing mapping (key(x), value(x)) for every x in sequence.
count() + Returns count of elements in sequence.
min() + Finds minimal element in sequence.
max() + Finds maximal element in sequence.
sum() + Sums all elements of sequence. Works only for summable types.
max_diff() + Counts maximal difference between elements. Equal to difference between max and min for sequence.
reduce(f:TxT -> T, /, first:T) + Applies function to first two elements, then to result and next element until elements end. Allows to specify first element.
fold(m:T -> T2, g:T2xT2 -> T2) + Applies mapper to each element, then aggregates pairs of T2 into single T2 until elements end. Equivalent to finq.map(mapper).reduce(aggregator)

Constant functions

These functions aren't intended to be called manually. Instead you have to pass them as an arguments to FINQ methods as mappings, reducers, predicates. Ordered Collection here is any collection which provides __get_item__ based on index (Tuple, List)

Method Returns
Identity T -> T Given argument
Consumer T -> None None
IdentityTrue T -> bool True for any argument
IdentityFalse T -> bool False for any value
Sum TxT -> T Sum of two given values
PairSum T^2 -> T Sum of first two values of Ordered Collection
First T^n -> T First value of Ordered Collection
Second T^n -> T Second value of Ordered Collection
Multiply TxT -> T Product of two given value
Square T -> T Square of given value
OneArgRandom T -> float Random value independent of given value
TupleSum T^n -> T Sum of given Ordered Collection
PairWith F^n -> (T -> T^2) Function that, when applied to value e returns e, f1(f2(...fn(e)...))
RPairWith F^n -> (T -> T^2) Function that, when applied to value e returns f1(f2(...fn(e)...)), e
Compose F^n -> F Function that, when applied to value e returns f1(f2(...fn(e)...))

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

FINQ-1.1.4.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

FINQ-1.1.4-py3-none-any.whl (20.7 kB view details)

Uploaded Python 3

File details

Details for the file FINQ-1.1.4.tar.gz.

File metadata

  • Download URL: FINQ-1.1.4.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.9.1

File hashes

Hashes for FINQ-1.1.4.tar.gz
Algorithm Hash digest
SHA256 d46d1457c33d93a6b4f5a52cdf6d8f3200afeb68f893975dce837323ed0875c9
MD5 8b879b8affaa35636ab52cf1e3b7f772
BLAKE2b-256 8a2b4a12fd9db5dea836c9d7c3318e647992d1f6e5e641306fe78171a163b6d7

See more details on using hashes here.

File details

Details for the file FINQ-1.1.4-py3-none-any.whl.

File metadata

  • Download URL: FINQ-1.1.4-py3-none-any.whl
  • Upload date:
  • Size: 20.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.56.0 CPython/3.9.1

File hashes

Hashes for FINQ-1.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 8278a6f928d9b6539e5ac9ace8286c4de4096c42b190fffb585798b635d780e5
MD5 19354c9bd2fc6b76bd211a58498f7cdd
BLAKE2b-256 1f811dce4e4263e9e3102d3a5a61ab72e9c42606786d4fe8b848603a3689100c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page