spiff-element-units

spiff-element-units decomposes workflows into element units that can be executed in isolation. This allows for incrementally executing large workflows.

The library requires callers to provide:

1. a serialized workflow spec in the form of {"spec":..., "subprocess_specs"...} dumped to a json string
2. a cache key that is used when refering to the above serialized workflow spec
3. a directory used to store the element unit cache
4. process and element ids

The library currently assumes that:

1. A full workflow is loaded into SpiffWorkflow once to find all the specs. This requirement may change in the future.

The Python API:

Currently extremely simple to get started. Expect the public api to change as it matures.

import spiff_element_units

Caching element units

def cache_element_units_for_workflow(
    cache_dir: str,
    cache_key: str,
    workflow_spec_json: str,
) -> None:
    

Forms element units for the workflow specs provided in json format and associates them with cache_key.

TODO: exceptions raised.

Getting cached element units

def workflow_from_cached_element_unit(
    cache_dir: str,
    cache_key: str,
    element_id: str,
) -> str:

Returns the json representation of a workflow capable of executing the first element unit available for the element_id associated with cache_key. This can be used to start or resume a process from previously cached element units.

TODO: exceptions raised.

Development

make dev-env to set up the development environment.

make compile compiles the code.

make tests tests the code.

make fmt formats the code.

make bindings creates the shared library that can be loaded as a Python module.

make run-integration-tests runs the integration tests with the latest result of make bindings.

make integration-tests does the two steps above.

make wheel makes a wheel for local testing in external applications.