SpiffWorkflow is a software development platform for building, running, and monitoring executable diagrams https://www.spiffworkflow.org/
Go to file
jasquat a71af6e40f
Tcoz openai assist (#1138)
* Update README.md

Some notes for people that might want to run full-on native, with detail about how Mac hijacks port 7000 and how to get around it.

* Revert "Update README.md"

This reverts commit 096887c26d.

* README update and native code patch

Some details for user that might be running Python3, Mac, and want to run everything locally/natively.

* Implement basic tooltips

Uses MUI tooltip, as it behaves more predictably with existing styling, and enables top-level theme config.

Top-level configuration for all MUI components can be controlled via overriding the existing theme. See index.tsx. This could be done per user for customization, etc.

Enabling JSON module imports in tsconfig.json seemed to fix the error in ReactDiagramEditor

* Naive AI code editor implementation

A working starting point.

* Implement API to return if script assist should be enabled

Along with route and function, api config, etc.

* UI calls backend to see if script assist is enabled.

If it is, loads the related UI, otherwise it doesn't appear.

* Moving forward with service for message processing.

* Services scaffolded

* Open API called, prompt-engineered to get script only.

* Little cleanup work

* Enabled + process message working.

Had to find all the places permissions are enabled, etc.

* Cleanup, comments, etc.

* Env vars, styling, error cases, conditional display of script assist

Finishing touches for the most part.

REQUIRES TWO ENV VARS BE SET.

SPIFFWORKFLOW_SCRIPT_ASSIST_ENABLED=["True" | "true" | 1]  (anything else is false)
SECRET_KEY_OPENAI_API=[thekey]

The are retrieved in default.py. I run the app locally, so I just set them in the terminal.

NEW INSTALL: @carbon/colors (so we consistently use carbon palette etc.)

* Fix tooltips, clean up some styling.

Finishing it off.

* Add loader and error message

Complete UX stuff

* Update useScriptAssistEnabled.tsx

Remove log

* Update script_assist_controller.py

Add this tweak to avoid TMI.

* Some reasonable changes suggested by the build process

* Comments from PR.

* Update ProcessModelEditDiagram.tsx

Should (but I don't know how to tell yet) call the change handler that wasn't firing before.

* updated the permissions setting in authorization service w/ burnettk

* precommit now passes. tests are failing w/ burnettk

* pinned SpiffWorkflow to known working version and fixed tests. we will update spiff in a later pr w/ burnettk

* made changes based on coderabbi suggestions

* updated the error handling to be more inline with how we have handled other errors and some ui tweaks

* removed pymysql package w/ burnettk

* forgot to remove pymysql from lock file w/ burnettk

---------

Co-authored-by: Tim Consolazio <tcoz@tcoz.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-03-04 10:42:27 -05:00
.github Bump actions/download-artifact from 4.1.3 to 4.1.4 (#1157) 2024-03-04 14:55:07 +00:00
bin Feature/typeahead allow guest user (#897) 2024-01-16 14:47:25 -05:00
connector-proxy-demo updated connector-http for new commands w/ burnettk 2024-02-14 11:52:31 -05:00
docs Bump attrs from 23.1.0 to 23.2.0 (#1132) 2024-02-29 14:34:07 +00:00
spiffworkflow-backend Tcoz openai assist (#1138) 2024-03-04 10:42:27 -05:00
spiffworkflow-frontend Tcoz openai assist (#1138) 2024-03-04 10:42:27 -05:00
.coderabbit.yaml document language server for coderabbit 2023-12-20 12:59:27 -05:00
.darglint added some base stuff to get pyl working 2022-10-27 09:15:56 -04:00
.flake8 pyl and turn back on autoreload for homepage w/ burnettk 2023-04-13 16:56:49 -04:00
.gitignore Dev containers now work with "run as me" (#1129) 2024-02-29 05:27:06 -05:00
.pre-commit-config.yaml Feature/background proc with celery (#788) 2023-12-05 11:41:59 -05:00
.readthedocs.yaml use requirements.txt for readthedocs build. 2023-05-18 11:26:47 -04:00
.tool-versions Bump pyyaml to enabled Python 3.12 support for arena (#873) 2024-01-10 11:42:49 -05:00
CONTRIBUTING.rst fix some links 2024-02-11 12:28:57 -05:00
Jenkinsfile ci: sent Discord notifications for all builds 2023-06-01 20:16:17 +02:00
LICENSE Initial commit 2022-10-12 10:17:40 -04:00
Makefile Update secrets programmatically (#1122) 2024-02-29 09:55:09 -05:00
README.md Dev Container Tweaks (#1117) 2024-02-28 09:49:45 -05:00
dev.Dockerfile Dev containers now work with "run as me" (#1129) 2024-02-29 05:27:06 -05:00
dev.docker-compose.yml Fix for first time use of dev containers in clean environment (#1136) 2024-03-01 15:28:06 -05:00
docker-compose.yml Dev Container Tweaks (#1117) 2024-02-28 09:49:45 -05:00
editor.docker-compose.yml feature/fix-run-scheduler-config (#456) 2023-08-31 16:09:26 -04:00
poetry.lock Bump reorder-python-imports from 3.9.0 to 3.12.0 (#1118) 2024-02-28 15:03:38 +00:00
pyproject.toml Bump reorder-python-imports from 3.9.0 to 3.12.0 (#1118) 2024-02-28 15:03:38 +00:00

README.md

spiff-arena

SpiffArena is a low(ish)-code software development platform for building, running, and monitoring executable diagrams. It is intended to support Citizen Developers and to enhance their ability to contribute to the software development process. Using tools that look a lot like flow-charts and spreadsheets, it is possible to capture complex rules in a way that everyone in your organization can see, understand, and directly execute.

Please visit the SpiffWorkflow website for a Getting Started Guide to see how to use SpiffArena and try it out. There are also additional articles, videos, and tutorials about SpiffArena and its components, including SpiffWorkflow, Service Connectors, and BPMN.js extensions.

Backend Setup, local

Remember, if you don't need a full-on native dev experience, you can run with docker (see below), which saves you from all the native setup. If you have issues with the local dev setup, please consult the troubleshooting guide.

There are three prerequisites for non-docker local development:

  1. python - asdf-vm works well for installing this.
  2. poetry - pip install poetry works
  3. mysql - the app also supports postgres. and sqlite, if you are talking local dev).

When these are installed, you are ready for:

cd spiffworkflow-backend
poetry install
./bin/recreate_db clean
./bin/run_server_locally

On a Mac, port 7000 (used by the backend) might be hijacked by Airplay. For those who upgraded to MacOS 12.1 and are running everything locally, your AirPlay receiver may have started on Port 7000 and your server (which uses port 7000 by default) may fail due to this port already being used. You can disable this port in System Preferences > Sharing > AirPlay receiver.

Keycloak Setup

You will want an openid server of some sort for authentication. There is one built in to the app that is used in the docker compose setup for simplicity, but this is not to be used in production, and non-compose defaults use a separate keycloak container by default. You can start it like this:

./keycloak/bin/start_keycloak

It'll be running on port 7002 If you want to log in to the keycloak admin console, it can be found at http://localhost:7002, and the creds are admin/admin (also logs you in to the app if running the frontend)

Frontend Setup, local

First install nodejs (also installable via asdf-vm), ideally the version in .tool-versions (but likely other versions will work). Then:

cd spiffworkflow-frontend
npm install
npm start

Assuming you're running Keycloak as indicated above, you can log in with admin/admin.

Run tests

./bin/run_pyl

Run cypress automated browser tests

Get the app running so you can access the frontend at http://localhost:7001 in your browser by following the frontend and backend setup steps above, and then:

./bin/run_cypress_tests_locally

Docker

For full instructions, see Running SpiffWorkflow Locally with Docker.

The docker-compose.yml file is for running a full-fledged instance of spiff-arena while editor.docker-compose.yml provides BPMN graphical editor capability to libraries and projects that depend on SpiffWorkflow but have no built-in BPMN edit capabilities.

Using Docker for Local Development

If you have docker and docker compose, as an alternative to locally installing the required dependencies, you can leverage the development docker containers and Makefile while working locally. To use, clone the repo and run make. This will build the required images, install all dependencies, start the servers and run the linting and tests. Once complete you can open the app and code changes will be reflected while running.

After the containers are set up, you can run make start-dev and make stop-dev to start and stop the servers. If the frontend or backend lock file changes, make dev-env will recreate the containers with the new dependencies.

Please refer to the Makefile as the source of truth, but for a summary of the available make targets:

Target Action
dev-env Builds the images, sets up the backend db and installs npm and poetry dependencies
start-dev Starts the frontend and backend servers, also stops them first if they were already running
stop-dev Stops the frontend and backend servers
be-tests-par Runs the backend unit tests in parallel
fe-lint-fix Runs npm lint:fix in the frontend container
run-pyl Runs all frontend and backend lints, backend unit tests

Contributing

To start understanding the system, you might:

  1. Explore the demo site via the Getting Started Guide
  2. Clone this repo, cd docs, run ./bin/build, and open your browser to http://127.0.0.1:8000 to view (and ideally edit!) the docs
  3. Check out our GitHub issues, find something you like, and ask for help on discord

Monorepo

This is a monorepo based on git subtrees that pulls together various spiffworkflow-related projects. FYI, some scripts:

ls bin | grep subtree

License

SpiffArena's main components are published under the terms of the GNU Lesser General Public License (LGPL) Version 3.

Support

You can find us on our Discord Channel. Commercial support for SpiffWorkflow is available from Sartography. Please contact us via the schedule a demo link on the SpiffWorkflow website to discuss your needs.