Namespace dsbdp.local-data-processing-pipeline

Pipeline for processing data

Other Namespaces

Show/Hide
dsbdp.byte-array-conversion
Helper functions for converting byte arrays into other data types/representations
dsbdp.data-processing-dsl
DSL for processing data
dsbdp.experiment-helper
Helper that are primarily used during experiments
dsbdp.local-dpp-self-adaptivity
Functions for self-adaptive local data processing pipelines.
dsbdp.main
Main class for launching experiments
dsbdp.processing-fn-utils
Index Page
Alphabetic Var Index

Public Vars

Usage Documentation

Show/Hide
Pipeline for processing data
Back to top

Details of Public Vars

Function: create-local-processing-element

Arglists:
=========

  (create-local-processing-element in-queue initial-proc-fn)
  (create-local-processing-element in-queue initial-proc-fn id)

Docstring:
==========

  Create a local processing element that is intended to be used in a local data processing pipeline.
   Input data will be read from the input queue in-queue and processed with the given initial processing function initial-proc-fn.
   Optionally, the name of the worker thread for the newly created processing element can be set to ProcessingElement_id for which id is replaced with the given id.
Back to top View Source

Function: create-local-processing-pipeline

Arglists:
=========

  (create-local-processing-pipeline fns out-fn)

Docstring:
==========

  Create a local data processing pipeline.
   fns is expected to be a vector of functions with two arguments.
   For each function in fns, one processing element will be created in which the respective function is executed.
   The output function out-fn is called with the result as emitted by the last processing element.
Back to top View Source

Macro: create-queue

Arglists:
=========

  (create-queue)

Docstring:
==========

  No docs attached.
Back to top View Source

Macro: enqueue

Arglists:
=========

  (enqueue queue data enqueued-counter dropped-counter)

Docstring:
==========

  No docs attached.
Back to top View Source

Function: get-counts

Arglists:
=========

  (get-counts obj)

Docstring:
==========

  Get the statistic counts of the given processing element or pipeline.
Back to top View Source

Function: get-id

Arglists:
=========

  (get-id obj)

Docstring:
==========

  Get the id of the given processing element.
Back to top View Source

Function: get-in-fn

Arglists:
=========

  (get-in-fn obj)

Docstring:
==========

  Get the input function of the given processing pipeline.
Back to top View Source

Function: get-out-queue

Arglists:
=========

  (get-out-queue obj)

Docstring:
==========

  Get the output queue of the given processing element or pipeline.
Back to top View Source

Function: get-thread-name

Arglists:
=========

  (get-thread-name obj)

Docstring:
==========

  Get the thread name of the given processing element.
Back to top View Source

Function: interrupt

Arglists:
=========

  (interrupt obj)

Docstring:
==========

  Interrupt the given processing element or pipeline.
Back to top View Source

Var: queue-setup

  No docs attached.
Back to top View Source

Var: queue-size

  No docs attached.
Back to top View Source

Function: set-proc-fn

Arglists:
=========

  (set-proc-fn obj proc-fn)

Docstring:
==========

  Set the processing function for the given processing element obj to proc-fn.
Back to top View Source

Function: set-proc-fns-vec

Arglists:
=========

  (set-proc-fns-vec obj fns)

Docstring:
==========

  Set the processing function vector of the given pipeline obj to fns.
Back to top View Source

Macro: take-from-queue

Arglists:
=========

  (take-from-queue queue)

Docstring:
==========

  No docs attached.
Back to top View Source