Functions for self-adaptive local data processing pipelines.
| dsbdp.byte-array-conversion | Helper functions for converting byte arrays into other data types/representations |
| dsbdp.data-processing-dsl | DSL for processing data |
| dsbdp.experiment-helper | Helper that are primarily used during experiments |
| dsbdp.local-data-processing-pipeline | Pipeline for processing data |
| dsbdp.main | Main class for launching experiments |
| dsbdp.processing-fn-utils | |
| Index Page | |
| Alphabetic Var Index |
Functions for self-adaptive local data processing pipelines.
Arglists: ========= (create-drop-detector n-repetitions n-detectors threshold) Docstring: ========== Create a detector for detecting drops based on pipeline stats delta data. n-repetitions define the number of subsequent repetitions of drops that have to occur in order to trigger a detection. n-detectors defines the number of detectors that are to be used. threshold defines the threshold of from which value on a drop is considered. Returns a single argument function that serves as the actual detector. The returned function takes the pipeline stats delta as argument and returns a vector of boolean values that indicate if drops were detected for a given pipeline stage.
Arglists: ========= (create-mapping-updater) Docstring: ========== Create an updater for updating function mappings based on detected drops. Returns a function that takes a function mapping and a vector of boolean values as returned from a drop detector as input and which calculates a new function mapping with the aim of avoiding drops.
Arglists: ========= (create-moving-average-calculator cnt) Docstring: ========== Create a calculator for calculating a moving average of cnt instances. Returns a single argument function that takes a numerical value as argument. The returned function evaluates to the moving average of the last cnt instances of numerical values that were passed.
Arglists: ========= (create-repetition-detector repetitions) Docstring: ========== Create a detector for detecting repetitions of pred-fn evaluating to true. Returns a function with one argument that takes a predicate function, pred-fn, as argument. The returned function only evaluates to true if pred-fn was true for the number of invocations defined by repetitions.
Arglists: ========= (create-self-adaptivity-controller cfg pipeline orig-fns mapping) Docstring: ========== Create a controller for a self-adaptive data processing pipeline.
Arglists: ========= (create-stat-delta-counter n) Docstring: ========== Create a delta counter for calculating the differences between subsequent measurements of pipeline statistics. Returns a function with one argument that takes the stats map as emitted from the pipeline. The returned function calculates the difference between the values of the passed stats map between subsequent invocations.
Arglists: ========= (get-drop-indices drop-det-vec) Docstring: ========== Get a vector of the indices for which drops were detected in the input vector drop-det-vec. More generically, returns a vector of the indices of the elements that were true in in the input vector.
Arglists: ========= (get-non-drop-indices drop-det-vec) Docstring: ========== Get a vector of the indices for which no drops were detected in the input vector drop-det-vec. More generically, returns a vector of the indices of the elements that were not true in the input vector.
Arglists: ========= (update v idx f) Docstring: ========== Update the element at the given index of the vector v by applying the function f to it.
Arglists: ========= (update-stats obj stats) Docstring: ========== No docs attached.